2022-08-10T17:24:46.643 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f 2022-08-10T17:24:46.645 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_dgalloway@teuthology --verbose --name dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} --archive /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900 -- /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/orig.config.yaml 2022-08-10T17:24:46.720 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-08-10T17:24:46.805 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900 branch: main description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '6965900' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 5662b52dca13a9032ec3c7fc11184d542141fc45 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 5662b52dca13a9032ec3c7fc11184d542141fc45 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: jammy sha1: e654560905d543d628247824fe5cbecad893480f owner: scheduled_dgalloway@teuthology priority: 10 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 sha1: 5662b52dca13a9032ec3c7fc11184d542141fc45 sleep_before_teardown: 0 suite: fs suite_branch: jammy suite_path: /home/teuthworker/src/github.com_ceph_ceph_e654560905d543d628247824fe5cbecad893480f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: e654560905d543d628247824fe5cbecad893480f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAZJpfUMaNiuBudAvL80S6Gm2DB/XlF4LwyI0myVHSJA39kPE9vR80TrdHhChBk9jxfLxauEaOsze+CmyyRAsobG/EfnyJHLbEVKDdA4LjYPckSp0Co24unwIn1axqVr/RguadeDJOID9v1MWQNuJSDjBOc2MhxmB8NkfE/ZmQkqTPoBNhiW6r0JzeZMr7y3USG0n3pO9/byiuephpLO9hqfHyi3NVey8ifVh/20gBZSBkaZY9/Go9jpcuRm116IWfmUmDdwBjpIcCZSwg5RnbXMh9+o2cdy9tEXTvh+Ue9FXgRi+Z6AGB1UXaWOIU+Y0c9x62M1QVaXpZ23DwK2DFmqXnMn6c8QzloIaVlt4UbJDMn7JdcznBBD1P6V+AHPZpvm/WOdg5NE/2XkSLjz6I++TkN2JXNPbU7oF9stFo3T9rRWHGYgQx4ZoJSPspO53UAcLHgZe3Jr/FnykYhc2piYvry/Qr42ZfWPrVfANEHIfuRe4tr+49dUWq9pWkxZc= smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVSU0PdFKJIkDUGkNG1wfjdiEJa56jK+a+iv4+f3zDu17DK7NUvEbdtbcOsDOLChg/SQJwq0CpgMo1dNEteLKzEQImtaE/dt1FUK+kyqgodJbR2TJy2zEaAqSn6RYBlz4AjJlEa5PN9KkYM9eMPH8NDGVACfnBcHbCW/EQ0A6qlrcyNypObGcN94vHzbCnpytph36WI4wa9bDcYyO9hzwLXYsDT17MJltYn8KQstqbbMAcOIAte1ph03lN0J0g4a/xi4riZthoYtn5I01oDvzBqj9QZkWrIOzmkm5pigP+F70dPAk4CJOe3SIkckTCe8gwfnm/8iL6futrpNUVqhK1jaTsk9k/Qf86vQ2t+7p4mni0Fw2XvDbM7IIEeiiQ9x7zciypOC5uzCRQFcJq7GRZJcsMH2GKpRyVG28O9QZyILNUnkxTMjRtSPaZCI/c18Rs67zZWpR2mN7Nu22ZjjL9gomwOq6N6Pjz6rZp2QkBSQHkF3xCKNGxH4J3HHqOcaM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53 timestamp: 2022-08-10_16:43:02 tube: smithi user: dgalloway verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-08-10T17:24:46.806 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_e654560905d543d628247824fe5cbecad893480f/qa; will attempt to use it 2022-08-10T17:24:46.806 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_e654560905d543d628247824fe5cbecad893480f/qa/tasks 2022-08-10T17:24:46.807 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-08-10T17:24:46.809 INFO:teuthology.task.internal:Checking packages... 2022-08-10T17:24:46.838 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '5662b52dca13a9032ec3c7fc11184d542141fc45' 2022-08-10T17:24:46.839 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-08-10T17:24:46.839 INFO:teuthology.packaging:ref: None 2022-08-10T17:24:46.840 INFO:teuthology.packaging:tag: None 2022-08-10T17:24:46.840 INFO:teuthology.packaging:branch: main 2022-08-10T17:24:46.840 INFO:teuthology.packaging:sha1: 5662b52dca13a9032ec3c7fc11184d542141fc45 2022-08-10T17:24:46.841 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2022-08-10T17:24:47.071 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-14164.gd7507189 2022-08-10T17:24:47.072 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-08-10T17:24:47.079 INFO:teuthology.task.internal:no buildpackages task found 2022-08-10T17:24:47.080 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-08-10T17:24:47.096 INFO:teuthology.task.internal:Saving configuration 2022-08-10T17:24:47.129 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-08-10T17:24:47.137 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-10T17:24:47.164 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-10 17:19:37.531006', 'locked_by': 'scheduled_dgalloway@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJWQXZLnNvDOS1nMwDz2Uv0Pc7kP/RJmD++aY9s/K0cMG55/gzOLil0JDegvQD5RuBjk4iEKVPCY1+S0wbUvtNM='} 2022-08-10T17:24:47.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi197.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-10 17:19:37.529561', 'locked_by': 'scheduled_dgalloway@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHon4lTCSl6AXlTT10DfECtUvnRWN9oIJjeCphncZICOgc8nmcAee/0pqobVRezZ0RUf+HrPsdMlRgs+72Gvq4='} 2022-08-10T17:24:47.193 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-08-10T17:24:47.201 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-08-10T17:24:47.201 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-08-10T17:24:47.201 INFO:teuthology.run_tasks:Running task console_log... 2022-08-10T17:24:47.284 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6aeea7fd90>, signals=[15]) 2022-08-10T17:24:47.285 INFO:teuthology.run_tasks:Running task internal.connect... 2022-08-10T17:24:47.293 INFO:teuthology.task.internal:Opening connections... 2022-08-10T17:24:47.294 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:24:47.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-10T17:24:47.398 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:24:47.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-10T17:24:47.502 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-08-10T17:24:47.510 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2022-08-10T17:24:47.534 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2022-08-10T17:24:47.534 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2022-08-10T17:24:47.594 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2022-08-10T17:24:47.594 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2022-08-10T17:24:47.594 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2022-08-10T17:24:47.595 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2022-08-10T17:24:47.595 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2022-08-10T17:24:47.595 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2022-08-10T17:24:47.595 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-08-10T17:24:47.596 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2022-08-10T17:24:47.596 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-08-10T17:24:47.596 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2022-08-10T17:24:47.596 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-10T17:24:47.597 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-10T17:24:47.597 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:47.597 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-10T17:24:47.597 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-08-10T17:24:47.597 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-10T17:24:47.598 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-08-10T17:24:47.599 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2022-08-10T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi197:> uname -m 2022-08-10T17:24:47.644 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2022-08-10T17:24:47.645 DEBUG:teuthology.orchestra.run.smithi197:> cat /etc/os-release 2022-08-10T17:24:47.704 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Red Hat Enterprise Linux" 2022-08-10T17:24:47.704 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8.6 (Ootpa)" 2022-08-10T17:24:47.705 INFO:teuthology.orchestra.run.smithi197.stdout:ID="rhel" 2022-08-10T17:24:47.705 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="fedora" 2022-08-10T17:24:47.705 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8.6" 2022-08-10T17:24:47.705 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2022-08-10T17:24:47.706 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-08-10T17:24:47.706 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2022-08-10T17:24:47.706 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-08-10T17:24:47.706 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.redhat.com/" 2022-08-10T17:24:47.707 INFO:teuthology.orchestra.run.smithi197.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-10T17:24:47.707 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-10T17:24:47.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:24:47.707 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-10T17:24:47.708 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-08-10T17:24:47.708 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-10T17:24:47.708 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-08-10T17:24:47.709 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2022-08-10T17:24:47.727 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-08-10T17:24:47.738 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-08-10T17:24:47.744 INFO:teuthology.task.internal:Checking for old test directory... 2022-08-10T17:24:47.745 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2022-08-10T17:24:47.748 DEBUG:teuthology.orchestra.run.smithi197:> test '!' -e /home/ubuntu/cephtest 2022-08-10T17:24:47.767 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-08-10T17:24:47.773 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-08-10T17:24:47.773 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2022-08-10T17:24:47.809 DEBUG:teuthology.orchestra.run.smithi197:> test -z $(ls -A /var/lib/ceph) 2022-08-10T17:24:47.835 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-08-10T17:24:47.928 INFO:teuthology.run_tasks:Running task kernel... 2022-08-10T17:24:47.943 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-08-10T17:24:47.944 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2022-08-10T17:24:47.944 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2022-08-10T17:24:47.945 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2022-08-10T17:24:47.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-10T17:24:47.965 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2022-08-10T17:24:48.027 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-372.9.1.el8.x86_64 2022-08-10T17:24:48.027 INFO:teuthology.task.kernel:Running kernel on smithi150: 4.18.0-372.9.1.el8.x86_64 2022-08-10T17:24:48.028 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2022-08-10T17:24:48.968 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2022-08-10T17:24:48.968 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2022-08-10T17:24:49.095 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:49.095 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-08-10T17:24:49.096 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:51.775 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 2.3 kB/s | 3.5 kB 00:01 2022-08-10T17:24:52.867 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2022-08-10T17:24:55.591 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 579 kB/s | 24 kB 00:00 2022-08-10T17:24:56.194 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-08-10T17:24:56.236 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2022-08-10T17:24:56.237 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2022-08-10T17:24:56.237 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2022-08-10T17:24:56.355 DEBUG:teuthology.orchestra.run.smithi150:> echo no | sudo yum reinstall kernel || true 2022-08-10T17:24:56.688 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2022-08-10T17:24:56.689 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2022-08-10T17:24:56.740 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:56.741 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-08-10T17:24:56.741 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:56.967 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:01 ago on Wed 10 Aug 2022 05:24:55 PM UTC. 2022-08-10T17:24:57.018 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-08-10T17:24:57.088 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2022-08-10T17:24:57.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum reinstall -y kernel || true 2022-08-10T17:24:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2022-08-10T17:24:57.466 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2022-08-10T17:24:57.516 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:57.517 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-08-10T17:24:57.517 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:24:57.738 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Wed 10 Aug 2022 05:24:55 PM UTC. 2022-08-10T17:24:57.776 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-08-10T17:24:57.810 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2022-08-10T17:24:57.856 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel --last | head -n 1 2022-08-10T17:24:57.936 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-08-10T17:24:57.937 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-08-10T17:24:57.938 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-08-10T17:24:57.938 DEBUG:teuthology.parallel:result is None 2022-08-10T17:24:57.938 INFO:teuthology.run_tasks:Running task internal.base... 2022-08-10T17:24:57.947 INFO:teuthology.task.internal:Creating test directory... 2022-08-10T17:24:57.948 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-08-10T17:24:57.950 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-08-10T17:24:57.971 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-08-10T17:24:57.981 INFO:teuthology.run_tasks:Running task internal.archive... 2022-08-10T17:24:57.991 INFO:teuthology.task.internal:Creating archive directory... 2022-08-10T17:24:57.992 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-08-10T17:24:58.007 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-08-10T17:24:58.052 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-08-10T17:24:58.067 INFO:teuthology.task.internal:Enabling coredump saving... 2022-08-10T17:24:58.068 DEBUG:teuthology.orchestra.run.smithi197:> test -f /run/.containerenv -o -f /.dockerenv 2022-08-10T17:24:58.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-10T17:24:58.095 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-08-10T17:24:58.098 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-08-10T17:24:58.128 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-10T17:24:58.149 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-10T17:24:58.180 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-10T17:24:58.200 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-10T17:24:58.202 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-08-10T17:24:58.210 INFO:teuthology.task.internal:Configuring sudo... 2022-08-10T17:24:58.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-08-10T17:24:58.213 DEBUG:teuthology.orchestra.run.smithi197:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-08-10T17:24:58.242 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-08-10T17:24:58.260 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-08-10T17:24:58.260 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-08-10T17:24:58.281 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-08-10T17:24:58.299 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-10T17:24:58.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-10T17:24:58.424 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-10T17:24:58.509 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-10T17:24:58.551 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:24:58.551 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-08-10T17:24:58.617 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-10T17:24:58.668 DEBUG:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-10T17:24:58.718 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-10T17:24:58.801 DEBUG:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-10T17:24:58.846 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:24:58.847 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-08-10T17:24:58.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2022-08-10T17:24:58.917 DEBUG:teuthology.orchestra.run.smithi197:> sudo service rsyslog restart 2022-08-10T17:24:58.963 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-10T17:24:59.009 INFO:teuthology.orchestra.run.smithi197.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-10T17:24:59.392 INFO:teuthology.run_tasks:Running task internal.timer... 2022-08-10T17:24:59.401 INFO:teuthology.task.internal:Starting timer... 2022-08-10T17:24:59.402 INFO:teuthology.run_tasks:Running task pcp... 2022-08-10T17:24:59.415 INFO:teuthology.run_tasks:Running task selinux... 2022-08-10T17:24:59.432 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-08-10T17:24:59.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2022-08-10T17:24:59.481 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2022-08-10T17:24:59.483 DEBUG:teuthology.orchestra.run.smithi197:> sudo service auditd rotate 2022-08-10T17:24:59.537 INFO:teuthology.orchestra.run.smithi197.stdout:Rotating logs: 2022-08-10T17:24:59.539 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-08-10T17:24:59.539 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2022-08-10T17:24:59.564 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2022-08-10T17:24:59.565 DEBUG:teuthology.orchestra.run.smithi197:> /usr/sbin/getenforce 2022-08-10T17:24:59.589 INFO:teuthology.orchestra.run.smithi197.stdout:Permissive 2022-08-10T17:24:59.589 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi197.front.sepia.ceph.com': 'permissive'} 2022-08-10T17:24:59.590 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-10T17:24:59.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-10T17:24:59.632 DEBUG:teuthology.orchestra.run.smithi197:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-10T17:24:59.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-10T17:24:59.661 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-08-10T17:24:59.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2022-08-10T17:24:59.700 DEBUG:teuthology.orchestra.run.smithi197:> sudo /usr/sbin/setenforce permissive 2022-08-10T17:24:59.728 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-08-10T17:24:59.748 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2022-08-10T17:24:59.749 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-08-10T17:24:59.790 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-08-10T17:24:59.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi150.front.sepia.ceph.com,smithi197.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-08-10T17:32:30.225 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi197.front.sepia.ceph.com')] 2022-08-10T17:32:30.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2022-08-10T17:32:30.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-10T17:32:30.335 DEBUG:teuthology.orchestra.run.smithi150:> true 2022-08-10T17:32:30.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2022-08-10T17:32:30.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-10T17:32:30.481 DEBUG:teuthology.orchestra.run.smithi197:> true 2022-08-10T17:32:30.552 INFO:teuthology.run_tasks:Running task clock... 2022-08-10T17:32:30.565 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-08-10T17:32:30.565 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-08-10T17:32:30.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-10T17:32:30.572 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-08-10T17:32:30.573 DEBUG:teuthology.orchestra.run.smithi197:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-10T17:32:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-08-10T17:32:30.618 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-08-10T17:32:30.624 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-08-10T17:32:30.639 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-08-10T17:32:30.698 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2022-08-10T17:32:30.710 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2022-08-10T17:32:30.716 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: ntpd: command not found 2022-08-10T17:32:30.724 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-08-10T17:32:30.729 INFO:teuthology.orchestra.run.smithi197.stdout:506 Cannot talk to daemon 2022-08-10T17:32:30.738 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-08-10T17:32:30.743 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-08-10T17:32:30.757 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-08-10T17:32:30.823 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2022-08-10T17:32:30.827 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-10T17:32:30.828 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2022-08-10T17:32:30.828 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.829 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.829 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.830 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.834 INFO:teuthology.orchestra.run.smithi197.stderr:bash: ntpq: command not found 2022-08-10T17:32:30.838 INFO:teuthology.orchestra.run.smithi197.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-10T17:32:30.839 INFO:teuthology.orchestra.run.smithi197.stdout:=============================================================================== 2022-08-10T17:32:30.839 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.839 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.839 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.840 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-10T17:32:30.840 INFO:teuthology.run_tasks:Running task install... 2022-08-10T17:32:30.853 DEBUG:teuthology.task.install:project ceph 2022-08-10T17:32:30.854 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45'}} 2022-08-10T17:32:30.855 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45'} 2022-08-10T17:32:30.855 INFO:teuthology.task.install:Using flavor: default 2022-08-10T17:32:30.866 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-08-10T17:32:30.867 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-08-10T17:32:30.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2022-08-10T17:32:30.909 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2022-08-10T17:32:30.911 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:32:30.911 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2022-08-10T17:32:30.912 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45', 'tag': None, 'wait_for_package': False} 2022-08-10T17:32:30.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2022-08-10T17:32:30.955 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2022-08-10T17:32:30.957 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:32:30.958 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45', 'tag': None, 'wait_for_package': False} 2022-08-10T17:32:30.958 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2022-08-10T17:32:30.992 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2022-08-10T17:32:30.993 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:32:30.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5662b52dca13a9032ec3c7fc11184d542141fc45 2022-08-10T17:32:31.039 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2022-08-10T17:32:31.040 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:32:31.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5662b52dca13a9032ec3c7fc11184d542141fc45 2022-08-10T17:32:31.155 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/ 2022-08-10T17:32:31.156 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14135.g5662b52d 2022-08-10T17:32:31.192 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/ 2022-08-10T17:32:31.193 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14135.g5662b52d 2022-08-10T17:32:31.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-08-10T17:32:31.296 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:32:31.296 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-08-10T17:32:31.309 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/5662b52dca13a9032ec3c7fc11184d542141fc45/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-08-10T17:32:31.310 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:32:31.310 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-08-10T17:32:31.323 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-08-10T17:32:31.324 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5662b52dca13a9032ec3c7fc11184d542141fc45/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-08-10T17:32:31.337 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-08-10T17:32:31.337 DEBUG:teuthology.orchestra.run.smithi197:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5662b52dca13a9032ec3c7fc11184d542141fc45/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-08-10T17:32:31.390 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-08-10T17:32:31.405 DEBUG:teuthology.orchestra.run.smithi197:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-08-10T17:32:31.467 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-08-10T17:32:31.481 DEBUG:teuthology.orchestra.run.smithi197:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-08-10T17:32:31.533 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2022-08-10T17:32:31.534 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2022-08-10T17:32:31.548 INFO:teuthology.orchestra.run.smithi197.stdout:check_obsoletes = 1 2022-08-10T17:32:31.550 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum clean all 2022-08-10T17:32:31.906 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2022-08-10T17:32:31.922 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2022-08-10T17:32:32.116 INFO:teuthology.orchestra.run.smithi150.stdout:52 files removed 2022-08-10T17:32:32.118 INFO:teuthology.orchestra.run.smithi197.stdout:52 files removed 2022-08-10T17:32:32.163 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-08-10T17:32:32.165 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-08-10T17:32:32.493 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2022-08-10T17:32:32.496 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2022-08-10T17:32:33.065 INFO:teuthology.orchestra.run.smithi197.stdout:ceph packages for x86_64 308 kB/s | 81 kB 00:00 2022-08-10T17:32:33.066 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 303 kB/s | 81 kB 00:00 2022-08-10T17:32:33.324 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 41 kB/s | 9.3 kB 00:00 2022-08-10T17:32:33.340 INFO:teuthology.orchestra.run.smithi197.stdout:ceph noarch packages 38 kB/s | 9.3 kB 00:00 2022-08-10T17:32:33.575 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 6.6 kB/s | 1.5 kB 00:00 2022-08-10T17:32:33.624 INFO:teuthology.orchestra.run.smithi197.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2022-08-10T17:32:34.967 INFO:teuthology.orchestra.run.smithi197.stdout:Copr repo for python3-asyncssh owned by ceph 2.6 kB/s | 3.5 kB 00:01 2022-08-10T17:32:34.976 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 2.5 kB/s | 3.5 kB 00:01 2022-08-10T17:32:36.002 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:01 2022-08-10T17:32:36.050 INFO:teuthology.orchestra.run.smithi197.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2022-08-10T17:32:38.768 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 425 kB/s | 24 kB 00:00 2022-08-10T17:32:38.875 INFO:teuthology.orchestra.run.smithi197.stdout:lab-extras 442 kB/s | 24 kB 00:00 2022-08-10T17:32:39.537 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 65 MB/s | 46 MB 00:00 2022-08-10T17:32:39.619 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 75 MB/s | 51 MB 00:00 2022-08-10T17:32:47.336 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 66 MB/s | 46 MB 00:00 2022-08-10T17:32:47.379 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 72 MB/s | 51 MB 00:00 2022-08-10T17:32:58.147 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-08-10T17:32:58.148 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-08-10T17:32:58.162 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.163 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.164 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-08-10T17:32:58.165 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-08-10T17:32:58.168 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-08-10T17:32:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.172 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-08-10T17:32:58.298 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2022-08-10T17:32:58.309 INFO:teuthology.orchestra.run.smithi150.stdout:=========================================================================================================================== 2022-08-10T17:32:58.310 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2022-08-10T17:32:58.311 INFO:teuthology.orchestra.run.smithi150.stdout:=========================================================================================================================== 2022-08-10T17:32:58.311 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2022-08-10T17:32:58.312 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-08-10T17:32:58.312 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-08-10T17:32:58.312 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 6.4 k 2022-08-10T17:32:58.313 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 5.2 M 2022-08-10T17:32:58.313 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 843 k 2022-08-10T17:32:58.313 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 165 k 2022-08-10T17:32:58.314 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 1.5 M 2022-08-10T17:32:58.314 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 113 k 2022-08-10T17:32:58.315 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 1.6 M 2022-08-10T17:32:58.315 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 7.4 M 2022-08-10T17:32:58.316 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 47 k 2022-08-10T17:32:58.316 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 17 M 2022-08-10T17:32:58.316 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 53 M 2022-08-10T17:32:58.317 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 262 k 2022-08-10T17:32:58.317 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 81 k 2022-08-10T17:32:58.318 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 257 k 2022-08-10T17:32:58.318 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 14 k 2022-08-10T17:32:58.318 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-08-10T17:32:58.319 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-08-10T17:32:58.319 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-08-10T17:32:58.320 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 30 k 2022-08-10T17:32:58.320 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 766 k 2022-08-10T17:32:58.320 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 139 k 2022-08-10T17:32:58.321 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-08-10T17:32:58.321 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-08-10T17:32:58.322 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-08-10T17:32:58.322 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 190 k 2022-08-10T17:32:58.323 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 371 k 2022-08-10T17:32:58.324 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 358 k 2022-08-10T17:32:58.324 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 107 k 2022-08-10T17:32:58.325 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 94 k 2022-08-10T17:32:58.325 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.5 M 2022-08-10T17:32:58.325 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 175 k 2022-08-10T17:32:58.326 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-08-10T17:32:58.327 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2022-08-10T17:32:58.327 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.6 M 2022-08-10T17:32:58.328 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.6 M 2022-08-10T17:32:58.329 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-08-10T17:32:58.329 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-08-10T17:32:58.330 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2022-08-10T17:32:58.331 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-08-10T17:32:58.332 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 24 M 2022-08-10T17:32:58.332 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 23 k 2022-08-10T17:32:58.333 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 2.3 M 2022-08-10T17:32:58.333 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 231 k 2022-08-10T17:32:58.334 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.9 M 2022-08-10T17:32:58.334 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 17 M 2022-08-10T17:32:58.335 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 15 k 2022-08-10T17:32:58.335 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 24 k 2022-08-10T17:32:58.336 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-08-10T17:32:58.336 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-08-10T17:32:58.337 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-08-10T17:32:58.337 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-08-10T17:32:58.338 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-08-10T17:32:58.339 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 137 k 2022-08-10T17:32:58.339 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-08-10T17:32:58.340 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-08-10T17:32:58.340 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-08-10T17:32:58.340 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-08-10T17:32:58.341 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-08-10T17:32:58.341 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 473 k 2022-08-10T17:32:58.341 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-08-10T17:32:58.341 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 5.8 M 2022-08-10T17:32:58.342 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-08-10T17:32:58.342 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-08-10T17:32:58.342 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-08-10T17:32:58.342 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-08-10T17:32:58.343 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-08-10T17:32:58.343 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-08-10T17:32:58.343 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-08-10T17:32:58.344 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-08-10T17:32:58.344 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-08-10T17:32:58.344 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-08-10T17:32:58.344 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-08-10T17:32:58.344 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-08-10T17:32:58.345 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-08-10T17:32:58.345 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-08-10T17:32:58.345 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-08-10T17:32:58.345 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-08-10T17:32:58.346 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 45 k 2022-08-10T17:32:58.346 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 108 k 2022-08-10T17:32:58.346 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-08-10T17:32:58.346 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-08-10T17:32:58.347 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-08-10T17:32:58.347 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-08-10T17:32:58.347 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-08-10T17:32:58.348 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-08-10T17:32:58.348 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-08-10T17:32:58.348 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-08-10T17:32:58.348 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-08-10T17:32:58.349 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-08-10T17:32:58.349 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-08-10T17:32:58.349 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-08-10T17:32:58.349 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-08-10T17:32:58.350 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-08-10T17:32:58.350 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-08-10T17:32:58.350 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-08-10T17:32:58.350 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-08-10T17:32:58.351 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-08-10T17:32:58.351 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-08-10T17:32:58.351 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-08-10T17:32:58.351 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-08-10T17:32:58.351 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-08-10T17:32:58.352 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-08-10T17:32:58.352 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-08-10T17:32:58.352 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-08-10T17:32:58.352 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-08-10T17:32:58.353 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-08-10T17:32:58.353 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-08-10T17:32:58.353 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-08-10T17:32:58.353 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-08-10T17:32:58.354 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-08-10T17:32:58.354 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-08-10T17:32:58.354 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-08-10T17:32:58.354 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-08-10T17:32:58.355 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-08-10T17:32:58.355 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-08-10T17:32:58.355 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-08-10T17:32:58.355 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-08-10T17:32:58.356 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-08-10T17:32:58.356 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-08-10T17:32:58.356 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-08-10T17:32:58.356 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-08-10T17:32:58.356 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-08-10T17:32:58.357 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-08-10T17:32:58.357 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-08-10T17:32:58.357 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-08-10T17:32:58.357 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-08-10T17:32:58.358 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-08-10T17:32:58.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:32:58.358 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2022-08-10T17:32:58.358 INFO:teuthology.orchestra.run.smithi150.stdout:=========================================================================================================================== 2022-08-10T17:32:58.359 INFO:teuthology.orchestra.run.smithi150.stdout:Install 123 Packages 2022-08-10T17:32:58.359 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 4 Packages 2022-08-10T17:32:58.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:32:58.361 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 207 M 2022-08-10T17:32:58.361 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2022-08-10T17:32:58.362 INFO:teuthology.orchestra.run.smithi197.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-08-10T17:32:58.362 INFO:teuthology.orchestra.run.smithi197.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-08-10T17:32:58.363 INFO:teuthology.orchestra.run.smithi197.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.363 INFO:teuthology.orchestra.run.smithi197.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.363 INFO:teuthology.orchestra.run.smithi197.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-08-10T17:32:58.364 INFO:teuthology.orchestra.run.smithi197.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-08-10T17:32:58.365 INFO:teuthology.orchestra.run.smithi197.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-08-10T17:32:58.368 INFO:teuthology.orchestra.run.smithi197.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-08-10T17:32:58.369 INFO:teuthology.orchestra.run.smithi197.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-08-10T17:32:58.492 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2022-08-10T17:32:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:(1/127): ceph-17.0.0-14135.g5662b52d.el8.x86_64 38 kB/s | 6.4 kB 00:00 2022-08-10T17:32:58.504 INFO:teuthology.orchestra.run.smithi197.stdout:=========================================================================================================================== 2022-08-10T17:32:58.505 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2022-08-10T17:32:58.505 INFO:teuthology.orchestra.run.smithi197.stdout:=========================================================================================================================== 2022-08-10T17:32:58.505 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2022-08-10T17:32:58.505 INFO:teuthology.orchestra.run.smithi197.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-08-10T17:32:58.506 INFO:teuthology.orchestra.run.smithi197.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-08-10T17:32:58.506 INFO:teuthology.orchestra.run.smithi197.stdout: ceph x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 6.4 k 2022-08-10T17:32:58.506 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 5.2 M 2022-08-10T17:32:58.507 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 843 k 2022-08-10T17:32:58.507 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 165 k 2022-08-10T17:32:58.507 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 1.5 M 2022-08-10T17:32:58.507 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 113 k 2022-08-10T17:32:58.508 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 1.6 M 2022-08-10T17:32:58.508 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 7.4 M 2022-08-10T17:32:58.508 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 47 k 2022-08-10T17:32:58.509 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 17 M 2022-08-10T17:32:58.509 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 53 M 2022-08-10T17:32:58.509 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-volume noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 262 k 2022-08-10T17:32:58.509 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 81 k 2022-08-10T17:32:58.510 INFO:teuthology.orchestra.run.smithi197.stdout: cephfs-mirror x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 257 k 2022-08-10T17:32:58.510 INFO:teuthology.orchestra.run.smithi197.stdout: cephfs-top noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 14 k 2022-08-10T17:32:58.510 INFO:teuthology.orchestra.run.smithi197.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-08-10T17:32:58.510 INFO:teuthology.orchestra.run.smithi197.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-08-10T17:32:58.511 INFO:teuthology.orchestra.run.smithi197.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-08-10T17:32:58.511 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 30 k 2022-08-10T17:32:58.511 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 766 k 2022-08-10T17:32:58.511 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 139 k 2022-08-10T17:32:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-08-10T17:32:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-08-10T17:32:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-08-10T17:32:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 190 k 2022-08-10T17:32:58.513 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 371 k 2022-08-10T17:32:58.513 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 358 k 2022-08-10T17:32:58.513 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 107 k 2022-08-10T17:32:58.513 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 94 k 2022-08-10T17:32:58.514 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.5 M 2022-08-10T17:32:58.514 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 175 k 2022-08-10T17:32:58.514 INFO:teuthology.orchestra.run.smithi197.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-08-10T17:32:58.515 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrading: 2022-08-10T17:32:58.515 INFO:teuthology.orchestra.run.smithi197.stdout: librados2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.6 M 2022-08-10T17:32:58.515 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.6 M 2022-08-10T17:32:58.515 INFO:teuthology.orchestra.run.smithi197.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-08-10T17:32:58.516 INFO:teuthology.orchestra.run.smithi197.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-08-10T17:32:58.516 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2022-08-10T17:32:58.516 INFO:teuthology.orchestra.run.smithi197.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-08-10T17:32:58.516 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 24 M 2022-08-10T17:32:58.517 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 23 k 2022-08-10T17:32:58.517 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 2.3 M 2022-08-10T17:32:58.517 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 231 k 2022-08-10T17:32:58.517 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 3.9 M 2022-08-10T17:32:58.518 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 17 M 2022-08-10T17:32:58.518 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14135.g5662b52d.el8 ceph-noarch 15 k 2022-08-10T17:32:58.518 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 24 k 2022-08-10T17:32:58.519 INFO:teuthology.orchestra.run.smithi197.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-08-10T17:32:58.519 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-08-10T17:32:58.519 INFO:teuthology.orchestra.run.smithi197.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-08-10T17:32:58.520 INFO:teuthology.orchestra.run.smithi197.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-08-10T17:32:58.520 INFO:teuthology.orchestra.run.smithi197.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-08-10T17:32:58.520 INFO:teuthology.orchestra.run.smithi197.stdout: libcephsqlite x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 137 k 2022-08-10T17:32:58.520 INFO:teuthology.orchestra.run.smithi197.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-08-10T17:32:58.521 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-08-10T17:32:58.521 INFO:teuthology.orchestra.run.smithi197.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-08-10T17:32:58.521 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-08-10T17:32:58.521 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-08-10T17:32:58.522 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 473 k 2022-08-10T17:32:58.522 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-08-10T17:32:58.522 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2 x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 5.8 M 2022-08-10T17:32:58.522 INFO:teuthology.orchestra.run.smithi197.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-08-10T17:32:58.523 INFO:teuthology.orchestra.run.smithi197.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-08-10T17:32:58.523 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-08-10T17:32:58.523 INFO:teuthology.orchestra.run.smithi197.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-08-10T17:32:58.523 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-08-10T17:32:58.524 INFO:teuthology.orchestra.run.smithi197.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-08-10T17:32:58.524 INFO:teuthology.orchestra.run.smithi197.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-08-10T17:32:58.525 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-08-10T17:32:58.525 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-08-10T17:32:58.526 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-08-10T17:32:58.526 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-08-10T17:32:58.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-08-10T17:32:58.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-08-10T17:32:58.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-08-10T17:32:58.528 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-08-10T17:32:58.528 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-08-10T17:32:58.529 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 45 k 2022-08-10T17:32:58.529 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common x86_64 2:17.0.0-14135.g5662b52d.el8 ceph 108 k 2022-08-10T17:32:58.530 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-08-10T17:32:58.530 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-08-10T17:32:58.530 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-08-10T17:32:58.531 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-08-10T17:32:58.531 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-08-10T17:32:58.532 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-08-10T17:32:58.532 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-08-10T17:32:58.532 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-08-10T17:32:58.532 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-08-10T17:32:58.533 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-08-10T17:32:58.533 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-08-10T17:32:58.533 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-08-10T17:32:58.533 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-08-10T17:32:58.534 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-08-10T17:32:58.534 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-08-10T17:32:58.534 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-08-10T17:32:58.534 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-08-10T17:32:58.535 INFO:teuthology.orchestra.run.smithi197.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-08-10T17:32:58.535 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-08-10T17:32:58.535 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-08-10T17:32:58.535 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-08-10T17:32:58.536 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-08-10T17:32:58.536 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-08-10T17:32:58.536 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-08-10T17:32:58.536 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-08-10T17:32:58.537 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-08-10T17:32:58.537 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-08-10T17:32:58.537 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-08-10T17:32:58.537 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-08-10T17:32:58.537 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-08-10T17:32:58.538 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-08-10T17:32:58.538 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-08-10T17:32:58.538 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-08-10T17:32:58.539 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-08-10T17:32:58.539 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-08-10T17:32:58.539 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-08-10T17:32:58.539 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-08-10T17:32:58.540 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-08-10T17:32:58.540 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-08-10T17:32:58.540 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-08-10T17:32:58.540 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-08-10T17:32:58.541 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-08-10T17:32:58.541 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-08-10T17:32:58.541 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-08-10T17:32:58.541 INFO:teuthology.orchestra.run.smithi197.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-08-10T17:32:58.541 INFO:teuthology.orchestra.run.smithi197.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-08-10T17:32:58.542 INFO:teuthology.orchestra.run.smithi197.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-08-10T17:32:58.542 INFO:teuthology.orchestra.run.smithi197.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-08-10T17:32:58.542 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:32:58.542 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2022-08-10T17:32:58.543 INFO:teuthology.orchestra.run.smithi197.stdout:=========================================================================================================================== 2022-08-10T17:32:58.543 INFO:teuthology.orchestra.run.smithi197.stdout:Install 123 Packages 2022-08-10T17:32:58.543 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrade 4 Packages 2022-08-10T17:32:58.543 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:32:58.544 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 207 M 2022-08-10T17:32:58.545 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2022-08-10T17:32:58.653 INFO:teuthology.orchestra.run.smithi197.stdout:(1/127): ceph-17.0.0-14135.g5662b52d.el8.x86_64 48 kB/s | 6.4 kB 00:00 2022-08-10T17:32:58.721 INFO:teuthology.orchestra.run.smithi150.stdout:(2/127): ceph-fuse-17.0.0-14135.g5662b52d.el8.x 3.7 MB/s | 843 kB 00:00 2022-08-10T17:32:58.805 INFO:teuthology.orchestra.run.smithi150.stdout:(3/127): ceph-immutable-object-cache-17.0.0-141 1.9 MB/s | 165 kB 00:00 2022-08-10T17:32:59.178 INFO:teuthology.orchestra.run.smithi197.stdout:(2/127): ceph-fuse-17.0.0-14135.g5662b52d.el8.x 1.6 MB/s | 843 kB 00:00 2022-08-10T17:32:59.222 INFO:teuthology.orchestra.run.smithi150.stdout:(4/127): ceph-base-17.0.0-14135.g5662b52d.el8.x 5.8 MB/s | 5.2 MB 00:00 2022-08-10T17:32:59.304 INFO:teuthology.orchestra.run.smithi197.stdout:(3/127): ceph-immutable-object-cache-17.0.0-141 1.3 MB/s | 165 kB 00:00 2022-08-10T17:32:59.305 INFO:teuthology.orchestra.run.smithi150.stdout:(5/127): ceph-mds-17.0.0-14135.g5662b52d.el8.x8 4.5 MB/s | 2.3 MB 00:00 2022-08-10T17:32:59.481 INFO:teuthology.orchestra.run.smithi150.stdout:(6/127): ceph-mgr-17.0.0-14135.g5662b52d.el8.x8 5.9 MB/s | 1.5 MB 00:00 2022-08-10T17:33:00.081 INFO:teuthology.orchestra.run.smithi150.stdout:(7/127): ceph-mon-17.0.0-14135.g5662b52d.el8.x8 5.0 MB/s | 3.9 MB 00:00 2022-08-10T17:33:00.687 INFO:teuthology.orchestra.run.smithi197.stdout:(4/127): ceph-base-17.0.0-14135.g5662b52d.el8.x 2.4 MB/s | 5.2 MB 00:02 2022-08-10T17:33:00.845 INFO:teuthology.orchestra.run.smithi197.stdout:(5/127): ceph-mds-17.0.0-14135.g5662b52d.el8.x8 1.5 MB/s | 2.3 MB 00:01 2022-08-10T17:33:01.554 INFO:teuthology.orchestra.run.smithi197.stdout:(6/127): ceph-mgr-17.0.0-14135.g5662b52d.el8.x8 1.8 MB/s | 1.5 MB 00:00 2022-08-10T17:33:01.665 INFO:teuthology.orchestra.run.smithi150.stdout:(8/127): ceph-osd-17.0.0-14135.g5662b52d.el8.x8 7.7 MB/s | 17 MB 00:02 2022-08-10T17:33:01.773 INFO:teuthology.orchestra.run.smithi150.stdout:(9/127): ceph-selinux-17.0.0-14135.g5662b52d.el 224 kB/s | 24 kB 00:00 2022-08-10T17:33:02.199 INFO:teuthology.orchestra.run.smithi150.stdout:(10/127): ceph-common-17.0.0-14135.g5662b52d.el 6.1 MB/s | 24 MB 00:03 2022-08-10T17:33:02.449 INFO:teuthology.orchestra.run.smithi150.stdout:(11/127): ceph-radosgw-17.0.0-14135.g5662b52d.e 7.3 MB/s | 17 MB 00:02 2022-08-10T17:33:02.560 INFO:teuthology.orchestra.run.smithi150.stdout:(12/127): libcephfs-devel-17.0.0-14135.g5662b52 272 kB/s | 30 kB 00:00 2022-08-10T17:33:02.674 INFO:teuthology.orchestra.run.smithi150.stdout:(13/127): libcephfs2-17.0.0-14135.g5662b52d.el8 6.6 MB/s | 766 kB 00:00 2022-08-10T17:33:02.758 INFO:teuthology.orchestra.run.smithi150.stdout:(14/127): libcephsqlite-17.0.0-14135.g5662b52d. 1.6 MB/s | 137 kB 00:00 2022-08-10T17:33:02.808 INFO:teuthology.orchestra.run.smithi150.stdout:(15/127): cephfs-mirror-17.0.0-14135.g5662b52d. 423 kB/s | 257 kB 00:00 2022-08-10T17:33:02.829 INFO:teuthology.orchestra.run.smithi197.stdout:(7/127): ceph-mon-17.0.0-14135.g5662b52d.el8.x8 1.9 MB/s | 3.9 MB 00:01 2022-08-10T17:33:02.841 INFO:teuthology.orchestra.run.smithi150.stdout:(16/127): librados-devel-17.0.0-14135.g5662b52d 1.6 MB/s | 139 kB 00:00 2022-08-10T17:33:02.984 INFO:teuthology.orchestra.run.smithi150.stdout:(17/127): libradosstriper1-17.0.0-14135.g5662b5 2.6 MB/s | 473 kB 00:00 2022-08-10T17:33:03.101 INFO:teuthology.orchestra.run.smithi150.stdout:(18/127): python3-ceph-argparse-17.0.0-14135.g5 381 kB/s | 45 kB 00:00 2022-08-10T17:33:03.184 INFO:teuthology.orchestra.run.smithi150.stdout:(19/127): python3-ceph-common-17.0.0-14135.g566 1.3 MB/s | 108 kB 00:00 2022-08-10T17:33:03.268 INFO:teuthology.orchestra.run.smithi150.stdout:(20/127): python3-cephfs-17.0.0-14135.g5662b52d 2.2 MB/s | 190 kB 00:00 2022-08-10T17:33:03.329 INFO:teuthology.orchestra.run.smithi197.stdout:(8/127): ceph-common-17.0.0-14135.g5662b52d.el8 4.9 MB/s | 24 MB 00:04 2022-08-10T17:33:03.402 INFO:teuthology.orchestra.run.smithi150.stdout:(21/127): python3-rados-17.0.0-14135.g5662b52d. 2.7 MB/s | 371 kB 00:00 2022-08-10T17:33:03.421 INFO:teuthology.orchestra.run.smithi197.stdout:(9/127): ceph-selinux-17.0.0-14135.g5662b52d.el 265 kB/s | 24 kB 00:00 2022-08-10T17:33:03.485 INFO:teuthology.orchestra.run.smithi150.stdout:(22/127): librgw2-17.0.0-14135.g5662b52d.el8.x8 8.9 MB/s | 5.8 MB 00:00 2022-08-10T17:33:03.544 INFO:teuthology.orchestra.run.smithi150.stdout:(23/127): python3-rbd-17.0.0-14135.g5662b52d.el 2.5 MB/s | 358 kB 00:00 2022-08-10T17:33:03.569 INFO:teuthology.orchestra.run.smithi150.stdout:(24/127): python3-rgw-17.0.0-14135.g5662b52d.el 1.2 MB/s | 107 kB 00:00 2022-08-10T17:33:03.636 INFO:teuthology.orchestra.run.smithi150.stdout:(25/127): rbd-fuse-17.0.0-14135.g5662b52d.el8.x 1.0 MB/s | 94 kB 00:00 2022-08-10T17:33:03.736 INFO:teuthology.orchestra.run.smithi150.stdout:(26/127): rbd-nbd-17.0.0-14135.g5662b52d.el8.x8 1.7 MB/s | 175 kB 00:00 2022-08-10T17:33:03.836 INFO:teuthology.orchestra.run.smithi150.stdout:(27/127): ceph-grafana-dashboards-17.0.0-14135. 229 kB/s | 23 kB 00:00 2022-08-10T17:33:03.937 INFO:teuthology.orchestra.run.smithi150.stdout:(28/127): ceph-mgr-cephadm-17.0.0-14135.g5662b5 1.1 MB/s | 113 kB 00:00 2022-08-10T17:33:04.104 INFO:teuthology.orchestra.run.smithi150.stdout:(29/127): rbd-mirror-17.0.0-14135.g5662b52d.el8 6.5 MB/s | 3.5 MB 00:00 2022-08-10T17:33:04.546 INFO:teuthology.orchestra.run.smithi150.stdout:(30/127): ceph-mgr-dashboard-17.0.0-14135.g5662 2.7 MB/s | 1.6 MB 00:00 2022-08-10T17:33:04.663 INFO:teuthology.orchestra.run.smithi150.stdout:(31/127): ceph-mgr-modules-core-17.0.0-14135.g5 1.9 MB/s | 231 kB 00:00 2022-08-10T17:33:04.771 INFO:teuthology.orchestra.run.smithi150.stdout:(32/127): ceph-mgr-rook-17.0.0-14135.g5662b52d. 432 kB/s | 47 kB 00:00 2022-08-10T17:33:04.888 INFO:teuthology.orchestra.run.smithi150.stdout:(33/127): ceph-prometheus-alerts-17.0.0-14135.g 126 kB/s | 15 kB 00:00 2022-08-10T17:33:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:(34/127): ceph-volume-17.0.0-14135.g5662b52d.el 2.2 MB/s | 262 kB 00:00 2022-08-10T17:33:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:(35/127): cephadm-17.0.0-14135.g5662b52d.el8.no 810 kB/s | 81 kB 00:00 2022-08-10T17:33:05.222 INFO:teuthology.orchestra.run.smithi150.stdout:(36/127): ceph-mgr-diskprediction-local-17.0.0- 6.6 MB/s | 7.4 MB 00:01 2022-08-10T17:33:05.248 INFO:teuthology.orchestra.run.smithi150.stdout:(37/127): cephfs-top-17.0.0-14135.g5662b52d.el8 101 kB/s | 14 kB 00:00 2022-08-10T17:33:05.515 INFO:teuthology.orchestra.run.smithi150.stdout:(38/127): liboath-2.6.2-3.el8.x86_64.rpm 220 kB/s | 59 kB 00:00 2022-08-10T17:33:05.640 INFO:teuthology.orchestra.run.smithi150.stdout:(39/127): gperftools-libs-2.7-9.el8.x86_64.rpm 734 kB/s | 306 kB 00:00 2022-08-10T17:33:05.657 INFO:teuthology.orchestra.run.smithi150.stdout:(40/127): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2022-08-10T17:33:05.741 INFO:teuthology.orchestra.run.smithi150.stdout:(41/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2022-08-10T17:33:05.791 INFO:teuthology.orchestra.run.smithi150.stdout:(42/127): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2022-08-10T17:33:05.874 INFO:teuthology.orchestra.run.smithi150.stdout:(43/127): python3-cachetools-3.1.1-4.el8.noarch 397 kB/s | 33 kB 00:00 2022-08-10T17:33:05.900 INFO:teuthology.orchestra.run.smithi150.stdout:(44/127): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2022-08-10T17:33:05.967 INFO:teuthology.orchestra.run.smithi150.stdout:(45/127): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2022-08-10T17:33:06.022 INFO:teuthology.orchestra.run.smithi150.stdout:(46/127): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2022-08-10T17:33:06.093 INFO:teuthology.orchestra.run.smithi150.stdout:(47/127): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2022-08-10T17:33:06.109 INFO:teuthology.orchestra.run.smithi150.stdout:(48/127): python3-google-auth-1.1.1-10.el8.noar 933 kB/s | 81 kB 00:00 2022-08-10T17:33:06.160 INFO:teuthology.orchestra.run.smithi150.stdout:(49/127): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2022-08-10T17:33:06.177 INFO:teuthology.orchestra.run.smithi150.stdout:(50/127): python3-jaraco-functools-2.0-4.el8.no 262 kB/s | 18 kB 00:00 2022-08-10T17:33:06.244 INFO:teuthology.orchestra.run.smithi150.stdout:(51/127): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2022-08-10T17:33:06.310 INFO:teuthology.orchestra.run.smithi150.stdout:(52/127): python3-more-itertools-7.2.0-3.el8.no 882 kB/s | 59 kB 00:00 2022-08-10T17:33:06.386 INFO:teuthology.orchestra.run.smithi150.stdout:(53/127): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2022-08-10T17:33:06.411 INFO:teuthology.orchestra.run.smithi150.stdout:(54/127): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2022-08-10T17:33:06.453 INFO:teuthology.orchestra.run.smithi150.stdout:(55/127): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2022-08-10T17:33:06.470 INFO:teuthology.orchestra.run.smithi150.stdout:(56/127): python3-portend-2.6-1.el8.noarch.rpm 265 kB/s | 16 kB 00:00 2022-08-10T17:33:06.495 INFO:teuthology.orchestra.run.smithi150.stdout:(57/127): python3-repoze-lru-0.7-6.el8.noarch.r 804 kB/s | 34 kB 00:00 2022-08-10T17:33:06.521 INFO:teuthology.orchestra.run.smithi150.stdout:(58/127): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2022-08-10T17:33:06.546 INFO:teuthology.orchestra.run.smithi150.stdout:(59/127): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2022-08-10T17:33:06.563 INFO:teuthology.orchestra.run.smithi150.stdout:(60/127): python3-simplegeneric-0.8.1-17.el8.no 444 kB/s | 19 kB 00:00 2022-08-10T17:33:06.613 INFO:teuthology.orchestra.run.smithi150.stdout:(61/127): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2022-08-10T17:33:06.631 INFO:teuthology.orchestra.run.smithi150.stdout:(62/127): python3-tempora-1.14.1-5.el8.noarch.r 438 kB/s | 29 kB 00:00 2022-08-10T17:33:06.656 INFO:teuthology.orchestra.run.smithi150.stdout:(63/127): python3-trustme-0.6.0-4.el8.noarch.rp 658 kB/s | 27 kB 00:00 2022-08-10T17:33:06.681 INFO:teuthology.orchestra.run.smithi150.stdout:(64/127): python3-waitress-1.2.1-2.el8.1.noarch 4.7 MB/s | 241 kB 00:00 2022-08-10T17:33:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:(65/127): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2022-08-10T17:33:06.731 INFO:teuthology.orchestra.run.smithi150.stdout:(66/127): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2022-08-10T17:33:06.748 INFO:teuthology.orchestra.run.smithi150.stdout:(67/127): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2022-08-10T17:33:06.782 INFO:teuthology.orchestra.run.smithi150.stdout:(68/127): python3-zc-lockfile-2.0-2.el8.noarch. 456 kB/s | 23 kB 00:00 2022-08-10T17:33:06.832 INFO:teuthology.orchestra.run.smithi150.stdout:(69/127): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2022-08-10T17:33:06.883 INFO:teuthology.orchestra.run.smithi150.stdout:(70/127): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2022-08-10T17:33:06.946 INFO:teuthology.orchestra.run.smithi197.stdout:(10/127): ceph-osd-17.0.0-14135.g5662b52d.el8.x 3.1 MB/s | 17 MB 00:05 2022-08-10T17:33:07.008 INFO:teuthology.orchestra.run.smithi150.stdout:(71/127): python3-numpy-1.14.3-10.el8.x86_64.rp 30 MB/s | 3.7 MB 00:00 2022-08-10T17:33:07.074 INFO:teuthology.orchestra.run.smithi197.stdout:(11/127): cephfs-mirror-17.0.0-14135.g5662b52d. 2.0 MB/s | 257 kB 00:00 2022-08-10T17:33:07.075 INFO:teuthology.orchestra.run.smithi150.stdout:(72/127): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2022-08-10T17:33:07.117 INFO:teuthology.orchestra.run.smithi150.stdout:(73/127): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2022-08-10T17:33:07.138 INFO:teuthology.orchestra.run.smithi197.stdout:(12/127): libcephfs-devel-17.0.0-14135.g5662b52 457 kB/s | 30 kB 00:00 2022-08-10T17:33:07.176 INFO:teuthology.orchestra.run.smithi150.stdout:(74/127): python3-markupsafe-0.23-19.el8.x86_64 386 kB/s | 39 kB 00:00 2022-08-10T17:33:07.210 INFO:teuthology.orchestra.run.smithi150.stdout:(75/127): python3-prettytable-0.7.2-14.el8.noar 476 kB/s | 44 kB 00:00 2022-08-10T17:33:07.235 INFO:teuthology.orchestra.run.smithi150.stdout:(76/127): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2022-08-10T17:33:07.277 INFO:teuthology.orchestra.run.smithi150.stdout:(77/127): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2022-08-10T17:33:07.310 INFO:teuthology.orchestra.run.smithi150.stdout:(78/127): libtool-2.4.6-25.el8.x86_64.rpm 9.3 MB/s | 709 kB 00:00 2022-08-10T17:33:07.344 INFO:teuthology.orchestra.run.smithi150.stdout:(79/127): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2022-08-10T17:33:07.386 INFO:teuthology.orchestra.run.smithi150.stdout:(80/127): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2022-08-10T17:33:07.405 INFO:teuthology.orchestra.run.smithi197.stdout:(13/127): libcephfs2-17.0.0-14135.g5662b52d.el8 2.8 MB/s | 766 kB 00:00 2022-08-10T17:33:07.469 INFO:teuthology.orchestra.run.smithi150.stdout:(81/127): openblas-threads-0.3.15-3.el8.x86_64. 31 MB/s | 4.9 MB 00:00 2022-08-10T17:33:07.489 INFO:teuthology.orchestra.run.smithi197.stdout:(14/127): libcephsqlite-17.0.0-14135.g5662b52d. 1.6 MB/s | 137 kB 00:00 2022-08-10T17:33:07.512 INFO:teuthology.orchestra.run.smithi150.stdout:(82/127): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-08-10T17:33:07.572 INFO:teuthology.orchestra.run.smithi197.stdout:(15/127): librados-devel-17.0.0-14135.g5662b52d 1.6 MB/s | 139 kB 00:00 2022-08-10T17:33:07.603 INFO:teuthology.orchestra.run.smithi150.stdout:(83/127): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2022-08-10T17:33:07.629 INFO:teuthology.orchestra.run.smithi150.stdout:(84/127): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2022-08-10T17:33:07.671 INFO:teuthology.orchestra.run.smithi150.stdout:(85/127): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2022-08-10T17:33:07.712 INFO:teuthology.orchestra.run.smithi150.stdout:(86/127): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2022-08-10T17:33:07.731 INFO:teuthology.orchestra.run.smithi197.stdout:(16/127): libradosstriper1-17.0.0-14135.g5662b5 2.9 MB/s | 473 kB 00:00 2022-08-10T17:33:07.797 INFO:teuthology.orchestra.run.smithi150.stdout:(87/127): openblas-0.3.15-3.el8.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2022-08-10T17:33:07.839 INFO:teuthology.orchestra.run.smithi150.stdout:(88/127): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-08-10T17:33:07.864 INFO:teuthology.orchestra.run.smithi150.stdout:(89/127): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-08-10T17:33:07.897 INFO:teuthology.orchestra.run.smithi150.stdout:(90/127): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2022-08-10T17:33:07.922 INFO:teuthology.orchestra.run.smithi150.stdout:(91/127): python3-jsonpointer-1.10-11.el8.noarc 803 kB/s | 20 kB 00:00 2022-08-10T17:33:07.964 INFO:teuthology.orchestra.run.smithi150.stdout:(92/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2022-08-10T17:33:08.106 INFO:teuthology.orchestra.run.smithi150.stdout:(93/127): python3-scipy-1.0.0-21.module+el8.5.0 35 MB/s | 14 MB 00:00 2022-08-10T17:33:08.131 INFO:teuthology.orchestra.run.smithi150.stdout:(94/127): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2022-08-10T17:33:08.157 INFO:teuthology.orchestra.run.smithi150.stdout:(95/127): python3-jsonpatch-1.21-2.el8.noarch.r 529 kB/s | 27 kB 00:00 2022-08-10T17:33:08.182 INFO:teuthology.orchestra.run.smithi150.stdout:(96/127): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2022-08-10T17:33:08.224 INFO:teuthology.orchestra.run.smithi150.stdout:(97/127): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2022-08-10T17:33:08.249 INFO:teuthology.orchestra.run.smithi150.stdout:(98/127): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2022-08-10T17:33:08.257 INFO:teuthology.orchestra.run.smithi197.stdout:(17/127): ceph-test-17.0.0-14135.g5662b52d.el8. 11 MB/s | 53 MB 00:04 2022-08-10T17:33:08.307 INFO:teuthology.orchestra.run.smithi197.stdout:(18/127): python3-ceph-argparse-17.0.0-14135.g5 899 kB/s | 45 kB 00:00 2022-08-10T17:33:08.365 INFO:teuthology.orchestra.run.smithi197.stdout:(19/127): python3-ceph-common-17.0.0-14135.g566 1.8 MB/s | 108 kB 00:00 2022-08-10T17:33:08.424 INFO:teuthology.orchestra.run.smithi197.stdout:(20/127): python3-cephfs-17.0.0-14135.g5662b52d 3.2 MB/s | 190 kB 00:00 2022-08-10T17:33:08.491 INFO:teuthology.orchestra.run.smithi197.stdout:(21/127): python3-rados-17.0.0-14135.g5662b52d. 5.5 MB/s | 371 kB 00:00 2022-08-10T17:33:08.558 INFO:teuthology.orchestra.run.smithi197.stdout:(22/127): python3-rbd-17.0.0-14135.g5662b52d.el 5.2 MB/s | 358 kB 00:00 2022-08-10T17:33:08.616 INFO:teuthology.orchestra.run.smithi197.stdout:(23/127): python3-rgw-17.0.0-14135.g5662b52d.el 1.8 MB/s | 107 kB 00:00 2022-08-10T17:33:08.708 INFO:teuthology.orchestra.run.smithi150.stdout:(99/127): ceph-test-17.0.0-14135.g5662b52d.el8. 7.7 MB/s | 53 MB 00:06 2022-08-10T17:33:08.733 INFO:teuthology.orchestra.run.smithi150.stdout:(100/127): libsepol-devel-2.9-3.el8.x86_64.rpm 171 kB/s | 87 kB 00:00 2022-08-10T17:33:08.759 INFO:teuthology.orchestra.run.smithi150.stdout:(101/127): pcre2-utf32-10.32-2.el8.x86_64.rpm 434 kB/s | 220 kB 00:00 2022-08-10T17:33:08.792 INFO:teuthology.orchestra.run.smithi150.stdout:(102/127): libverto-devel-0.3.0-5.el8.x86_64.rp 312 kB/s | 18 kB 00:00 2022-08-10T17:33:08.809 INFO:teuthology.orchestra.run.smithi197.stdout:(24/127): ceph-radosgw-17.0.0-14135.g5662b52d.e 2.9 MB/s | 17 MB 00:05 2022-08-10T17:33:08.818 INFO:teuthology.orchestra.run.smithi150.stdout:(103/127): librabbitmq-0.9.0-3.el8.x86_64.rpm 813 kB/s | 47 kB 00:00 2022-08-10T17:33:08.825 INFO:teuthology.orchestra.run.smithi197.stdout:(25/127): rbd-fuse-17.0.0-14135.g5662b52d.el8.x 451 kB/s | 94 kB 00:00 2022-08-10T17:33:08.843 INFO:teuthology.orchestra.run.smithi150.stdout:(104/127): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2022-08-10T17:33:08.902 INFO:teuthology.orchestra.run.smithi150.stdout:(105/127): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2022-08-10T17:33:08.917 INFO:teuthology.orchestra.run.smithi197.stdout:(26/127): librgw2-17.0.0-14135.g5662b52d.el8.x8 4.9 MB/s | 5.8 MB 00:01 2022-08-10T17:33:08.927 INFO:teuthology.orchestra.run.smithi150.stdout:(106/127): python3-pycparser-2.14-14.el8.noarch 1.3 MB/s | 109 kB 00:00 2022-08-10T17:33:08.934 INFO:teuthology.orchestra.run.smithi197.stdout:(27/127): rbd-nbd-17.0.0-14135.g5662b52d.el8.x8 1.6 MB/s | 175 kB 00:00 2022-08-10T17:33:08.951 INFO:teuthology.orchestra.run.smithi197.stdout:(28/127): ceph-grafana-dashboards-17.0.0-14135. 547 kB/s | 23 kB 00:00 2022-08-10T17:33:08.952 INFO:teuthology.orchestra.run.smithi150.stdout:(107/127): python3-cryptography-3.2.1-5.el8.x86 3.4 MB/s | 559 kB 00:00 2022-08-10T17:33:08.993 INFO:teuthology.orchestra.run.smithi197.stdout:(29/127): ceph-mgr-cephadm-17.0.0-14135.g5662b5 1.9 MB/s | 113 kB 00:00 2022-08-10T17:33:08.995 INFO:teuthology.orchestra.run.smithi150.stdout:(108/127): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2022-08-10T17:33:09.019 INFO:teuthology.orchestra.run.smithi150.stdout:(109/127): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2022-08-10T17:33:09.045 INFO:teuthology.orchestra.run.smithi150.stdout:(110/127): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.4 MB/s | 171 kB 00:00 2022-08-10T17:33:09.078 INFO:teuthology.orchestra.run.smithi150.stdout:(111/127): zlib-devel-1.2.11-18.el8_5.x86_64.rp 688 kB/s | 58 kB 00:00 2022-08-10T17:33:09.104 INFO:teuthology.orchestra.run.smithi150.stdout:(112/127): elfutils-libelf-devel-0.186-1.el8.x8 714 kB/s | 60 kB 00:00 2022-08-10T17:33:09.129 INFO:teuthology.orchestra.run.smithi150.stdout:(113/127): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2022-08-10T17:33:09.163 INFO:teuthology.orchestra.run.smithi150.stdout:(114/127): libaio-devel-0.3.112-1.el8.x86_64.rp 223 kB/s | 19 kB 00:00 2022-08-10T17:33:09.187 INFO:teuthology.orchestra.run.smithi150.stdout:(115/127): libuuid-devel-2.32.1-35.el8.x86_64.r 1.1 MB/s | 98 kB 00:00 2022-08-10T17:33:09.213 INFO:teuthology.orchestra.run.smithi150.stdout:(116/127): NetworkManager-initscripts-updown-1. 1.6 MB/s | 137 kB 00:00 2022-08-10T17:33:09.246 INFO:teuthology.orchestra.run.smithi150.stdout:(117/127): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2022-08-10T17:33:09.272 INFO:teuthology.orchestra.run.smithi150.stdout:(118/127): python3-requests-oauthlib-1.0.0-1.el 516 kB/s | 43 kB 00:00 2022-08-10T17:33:09.297 INFO:teuthology.orchestra.run.smithi150.stdout:(119/127): xfsprogs-devel-5.0.0-10.el8.x86_64.r 864 kB/s | 72 kB 00:00 2022-08-10T17:33:09.331 INFO:teuthology.orchestra.run.smithi150.stdout:(120/127): libcom_err-devel-1.45.6-4.el8.x86_64 460 kB/s | 39 kB 00:00 2022-08-10T17:33:09.357 INFO:teuthology.orchestra.run.smithi150.stdout:(121/127): keyutils-libs-devel-1.5.10-9.el8.x86 838 kB/s | 48 kB 00:00 2022-08-10T17:33:09.385 INFO:teuthology.orchestra.run.smithi197.stdout:(30/127): ceph-mgr-dashboard-17.0.0-14135.g5662 3.8 MB/s | 1.6 MB 00:00 2022-08-10T17:33:09.398 INFO:teuthology.orchestra.run.smithi150.stdout:(122/127): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2022-08-10T17:33:09.448 INFO:teuthology.orchestra.run.smithi150.stdout:(123/127): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2022-08-10T17:33:09.486 INFO:teuthology.orchestra.run.smithi197.stdout:(31/127): ceph-mgr-modules-core-17.0.0-14135.g5 2.3 MB/s | 231 kB 00:00 2022-08-10T17:33:09.498 INFO:teuthology.orchestra.run.smithi150.stdout:(124/127): openssl-1.1.1k-7.el8_6.x86_64.rpm 14 MB/s | 709 kB 00:00 2022-08-10T17:33:09.557 INFO:teuthology.orchestra.run.smithi150.stdout:(125/127): openssl-libs-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 1.5 MB 00:00 2022-08-10T17:33:09.627 INFO:teuthology.orchestra.run.smithi197.stdout:(32/127): ceph-mgr-diskprediction-local-17.0.0- 12 MB/s | 7.4 MB 00:00 2022-08-10T17:33:09.653 INFO:teuthology.orchestra.run.smithi197.stdout:(33/127): ceph-mgr-rook-17.0.0-14135.g5662b52d. 281 kB/s | 47 kB 00:00 2022-08-10T17:33:09.703 INFO:teuthology.orchestra.run.smithi197.stdout:(34/127): rbd-mirror-17.0.0-14135.g5662b52d.el8 3.9 MB/s | 3.5 MB 00:00 2022-08-10T17:33:09.728 INFO:teuthology.orchestra.run.smithi197.stdout:(35/127): ceph-prometheus-alerts-17.0.0-14135.g 147 kB/s | 15 kB 00:00 2022-08-10T17:33:09.762 INFO:teuthology.orchestra.run.smithi197.stdout:(36/127): ceph-volume-17.0.0-14135.g5662b52d.el 2.4 MB/s | 262 kB 00:00 2022-08-10T17:33:09.787 INFO:teuthology.orchestra.run.smithi197.stdout:(37/127): cephadm-17.0.0-14135.g5662b52d.el8.no 965 kB/s | 81 kB 00:00 2022-08-10T17:33:09.812 INFO:teuthology.orchestra.run.smithi197.stdout:(38/127): cephfs-top-17.0.0-14135.g5662b52d.el8 171 kB/s | 14 kB 00:00 2022-08-10T17:33:09.949 INFO:teuthology.orchestra.run.smithi150.stdout:(126/127): librados2-17.0.0-14135.g5662b52d.el8 6.1 MB/s | 3.6 MB 00:00 2022-08-10T17:33:10.004 INFO:teuthology.orchestra.run.smithi197.stdout:(39/127): liboath-2.6.2-3.el8.x86_64.rpm 271 kB/s | 59 kB 00:00 2022-08-10T17:33:10.030 INFO:teuthology.orchestra.run.smithi197.stdout:(40/127): libunwind-1.3.1-3.el8.x86_64.rpm 346 kB/s | 75 kB 00:00 2022-08-10T17:33:10.074 INFO:teuthology.orchestra.run.smithi150.stdout:(127/127): librbd1-17.0.0-14135.g5662b52d.el8.x 5.3 MB/s | 3.6 MB 00:00 2022-08-10T17:33:10.077 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2022-08-10T17:33:10.077 INFO:teuthology.orchestra.run.smithi150.stdout:Total 18 MB/s | 207 MB 00:11 2022-08-10T17:33:10.105 INFO:teuthology.orchestra.run.smithi197.stdout:(41/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 583 kB/s | 44 kB 00:00 2022-08-10T17:33:10.147 INFO:teuthology.orchestra.run.smithi197.stdout:(42/127): gperftools-libs-2.7-9.el8.x86_64.rpm 796 kB/s | 306 kB 00:00 2022-08-10T17:33:10.222 INFO:teuthology.orchestra.run.smithi197.stdout:(43/127): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2022-08-10T17:33:10.264 INFO:teuthology.orchestra.run.smithi197.stdout:(44/127): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2022-08-10T17:33:10.289 INFO:teuthology.orchestra.run.smithi197.stdout:(45/127): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2022-08-10T17:33:10.314 INFO:teuthology.orchestra.run.smithi197.stdout:(46/127): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2022-08-10T17:33:10.340 INFO:teuthology.orchestra.run.smithi197.stdout:(47/127): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2022-08-10T17:33:10.382 INFO:teuthology.orchestra.run.smithi197.stdout:(48/127): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2022-08-10T17:33:10.407 INFO:teuthology.orchestra.run.smithi197.stdout:(49/127): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2022-08-10T17:33:10.432 INFO:teuthology.orchestra.run.smithi197.stdout:(50/127): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2022-08-10T17:33:10.458 INFO:teuthology.orchestra.run.smithi197.stdout:(51/127): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2022-08-10T17:33:10.491 INFO:teuthology.orchestra.run.smithi197.stdout:(52/127): python3-logutils-0.3.5-11.el8.noarch. 834 kB/s | 49 kB 00:00 2022-08-10T17:33:10.516 INFO:teuthology.orchestra.run.smithi197.stdout:(53/127): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2022-08-10T17:33:10.558 INFO:teuthology.orchestra.run.smithi197.stdout:(54/127): python3-natsort-7.1.1-2.el8.noarch.rp 903 kB/s | 60 kB 00:00 2022-08-10T17:33:10.600 INFO:teuthology.orchestra.run.smithi197.stdout:(55/127): python3-kubernetes-11.0.0-6.el8.noarc 6.0 MB/s | 1.2 MB 00:00 2022-08-10T17:33:10.626 INFO:teuthology.orchestra.run.smithi197.stdout:(56/127): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2022-08-10T17:33:10.667 INFO:teuthology.orchestra.run.smithi197.stdout:(57/127): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2022-08-10T17:33:10.701 INFO:teuthology.orchestra.run.smithi197.stdout:(58/127): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2022-08-10T17:33:10.726 INFO:teuthology.orchestra.run.smithi197.stdout:(59/127): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2022-08-10T17:33:10.743 INFO:teuthology.orchestra.run.smithi197.stdout:(60/127): python3-rsa-4.8-1.el8.noarch.rpm 811 kB/s | 61 kB 00:00 2022-08-10T17:33:10.785 INFO:teuthology.orchestra.run.smithi197.stdout:(61/127): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2022-08-10T17:33:10.811 INFO:teuthology.orchestra.run.smithi197.stdout:(62/127): python3-singledispatch-3.4.0.3-18.el8 285 kB/s | 24 kB 00:00 2022-08-10T17:33:10.827 INFO:teuthology.orchestra.run.smithi197.stdout:(63/127): python3-tempora-1.14.1-5.el8.noarch.r 348 kB/s | 29 kB 00:00 2022-08-10T17:33:10.846 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2022-08-10T17:33:10.870 INFO:teuthology.orchestra.run.smithi197.stdout:(64/127): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2022-08-10T17:33:10.962 INFO:teuthology.orchestra.run.smithi197.stdout:(65/127): python3-websocket-client-0.56.0-5.el8 667 kB/s | 61 kB 00:00 2022-08-10T17:33:11.000 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2022-08-10T17:33:11.000 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2022-08-10T17:33:11.028 INFO:teuthology.orchestra.run.smithi197.stdout:(66/127): python3-webtest-2.0.33-1.el8.noarch.r 1.3 MB/s | 85 kB 00:00 2022-08-10T17:33:11.078 INFO:teuthology.orchestra.run.smithi197.stdout:(67/127): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2022-08-10T17:33:11.546 INFO:teuthology.orchestra.run.smithi197.stdout:(68/127): python3-waitress-1.2.1-2.el8.1.noarch 328 kB/s | 241 kB 00:00 2022-08-10T17:33:11.646 INFO:teuthology.orchestra.run.smithi197.stdout:(69/127): xmlstarlet-1.6.1-11.el8.x86_64.rpm 691 kB/s | 69 kB 00:00 2022-08-10T17:33:11.704 INFO:teuthology.orchestra.run.smithi197.stdout:(70/127): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2022-08-10T17:33:11.746 INFO:teuthology.orchestra.run.smithi197.stdout:(71/127): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2022-08-10T17:33:11.780 INFO:teuthology.orchestra.run.smithi197.stdout:(72/127): libsepol-devel-2.9-3.el8.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2022-08-10T17:33:11.822 INFO:teuthology.orchestra.run.smithi197.stdout:(73/127): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2022-08-10T17:33:11.864 INFO:teuthology.orchestra.run.smithi197.stdout:(74/127): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2022-08-10T17:33:11.914 INFO:teuthology.orchestra.run.smithi197.stdout:(75/127): thrift-0.13.0-2.el8.x86_64.rpm 2.1 MB/s | 1.7 MB 00:00 2022-08-10T17:33:11.939 INFO:teuthology.orchestra.run.smithi197.stdout:(76/127): libverto-devel-0.3.0-5.el8.x86_64.rpm 237 kB/s | 18 kB 00:00 2022-08-10T17:33:11.981 INFO:teuthology.orchestra.run.smithi197.stdout:(77/127): librabbitmq-0.9.0-3.el8.x86_64.rpm 699 kB/s | 47 kB 00:00 2022-08-10T17:33:12.006 INFO:teuthology.orchestra.run.smithi197.stdout:(78/127): python3-cryptography-3.2.1-5.el8.x86_ 8.4 MB/s | 559 kB 00:00 2022-08-10T17:33:12.040 INFO:teuthology.orchestra.run.smithi197.stdout:(79/127): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2022-08-10T17:33:12.066 INFO:teuthology.orchestra.run.smithi197.stdout:(80/127): python3-pycparser-2.14-14.el8.noarch. 1.9 MB/s | 109 kB 00:00 2022-08-10T17:33:12.083 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2022-08-10T17:33:12.101 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2022-08-10T17:33:12.107 INFO:teuthology.orchestra.run.smithi197.stdout:(81/127): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2022-08-10T17:33:12.132 INFO:teuthology.orchestra.run.smithi197.stdout:(82/127): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.9 MB/s | 560 kB 00:00 2022-08-10T17:33:12.166 INFO:teuthology.orchestra.run.smithi197.stdout:(83/127): python3-jwt-1.6.1-2.el8.noarch.rpm 730 kB/s | 43 kB 00:00 2022-08-10T17:33:12.191 INFO:teuthology.orchestra.run.smithi197.stdout:(84/127): python3-webob-1.8.5-1.el8.1.noarch.rp 184 kB/s | 251 kB 00:01 2022-08-10T17:33:12.247 INFO:teuthology.orchestra.run.smithi197.stdout:(85/127): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 509 kB/s | 58 kB 00:00 2022-08-10T17:33:12.292 INFO:teuthology.orchestra.run.smithi197.stdout:(86/127): elfutils-libelf-devel-0.186-1.el8.x86 477 kB/s | 60 kB 00:00 2022-08-10T17:33:12.317 INFO:teuthology.orchestra.run.smithi197.stdout:(87/127): libaio-devel-0.3.112-1.el8.x86_64.rpm 278 kB/s | 19 kB 00:00 2022-08-10T17:33:12.342 INFO:teuthology.orchestra.run.smithi197.stdout:(88/127): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2022-08-10T17:33:12.377 INFO:teuthology.orchestra.run.smithi197.stdout:(89/127): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.1 MB/s | 98 kB 00:00 2022-08-10T17:33:12.402 INFO:teuthology.orchestra.run.smithi197.stdout:(90/127): NetworkManager-initscripts-updown-1.3 1.6 MB/s | 137 kB 00:00 2022-08-10T17:33:12.427 INFO:teuthology.orchestra.run.smithi197.stdout:(91/127): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2022-08-10T17:33:12.469 INFO:teuthology.orchestra.run.smithi197.stdout:(92/127): python3-requests-oauthlib-1.0.0-1.el8 464 kB/s | 43 kB 00:00 2022-08-10T17:33:12.494 INFO:teuthology.orchestra.run.smithi197.stdout:(93/127): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 786 kB/s | 72 kB 00:00 2022-08-10T17:33:12.520 INFO:teuthology.orchestra.run.smithi197.stdout:(94/127): libcom_err-devel-1.45.6-4.el8.x86_64. 428 kB/s | 39 kB 00:00 2022-08-10T17:33:12.561 INFO:teuthology.orchestra.run.smithi197.stdout:(95/127): keyutils-libs-devel-1.5.10-9.el8.x86_ 719 kB/s | 48 kB 00:00 2022-08-10T17:33:12.595 INFO:teuthology.orchestra.run.smithi197.stdout:(96/127): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.5 MB/s | 644 kB 00:00 2022-08-10T17:33:12.653 INFO:teuthology.orchestra.run.smithi197.stdout:(97/127): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2022-08-10T17:33:12.695 INFO:teuthology.orchestra.run.smithi197.stdout:(98/127): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2022-08-10T17:33:12.729 INFO:teuthology.orchestra.run.smithi197.stdout:(99/127): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2022-08-10T17:33:12.762 INFO:teuthology.orchestra.run.smithi197.stdout:(100/127): python3-markupsafe-0.23-19.el8.x86_6 582 kB/s | 39 kB 00:00 2022-08-10T17:33:12.788 INFO:teuthology.orchestra.run.smithi197.stdout:(101/127): python3-prettytable-0.7.2-14.el8.noa 764 kB/s | 44 kB 00:00 2022-08-10T17:33:12.855 INFO:teuthology.orchestra.run.smithi197.stdout:(102/127): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2022-08-10T17:33:12.880 INFO:teuthology.orchestra.run.smithi197.stdout:(103/127): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2022-08-10T17:33:12.905 INFO:teuthology.orchestra.run.smithi197.stdout:(104/127): python3-jinja2-2.10.1-3.el8.noarch.r 4.5 MB/s | 538 kB 00:00 2022-08-10T17:33:12.947 INFO:teuthology.orchestra.run.smithi197.stdout:(105/127): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2022-08-10T17:33:12.972 INFO:teuthology.orchestra.run.smithi197.stdout:(106/127): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2022-08-10T17:33:13.016 INFO:teuthology.orchestra.run.smithi197.stdout:(107/127): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-08-10T17:33:13.048 INFO:teuthology.orchestra.run.smithi197.stdout:(108/127): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.0 MB/s | 103 kB 00:00 2022-08-10T17:33:13.123 INFO:teuthology.orchestra.run.smithi197.stdout:(109/127): openblas-threads-0.3.15-3.el8.x86_64 23 MB/s | 4.9 MB 00:00 2022-08-10T17:33:13.149 INFO:teuthology.orchestra.run.smithi197.stdout:(110/127): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2022-08-10T17:33:13.224 INFO:teuthology.orchestra.run.smithi197.stdout:(111/127): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2022-08-10T17:33:13.274 INFO:teuthology.orchestra.run.smithi197.stdout:(112/127): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2022-08-10T17:33:13.316 INFO:teuthology.orchestra.run.smithi197.stdout:(113/127): jq-1.6-3.el8.x86_64.rpm 2.2 MB/s | 202 kB 00:00 2022-08-10T17:33:13.358 INFO:teuthology.orchestra.run.smithi197.stdout:(114/127): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-08-10T17:33:13.425 INFO:teuthology.orchestra.run.smithi197.stdout:(115/127): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2022-08-10T17:33:13.450 INFO:teuthology.orchestra.run.smithi197.stdout:(116/127): python3-pytz-2017.2-9.el8.noarch.rpm 591 kB/s | 54 kB 00:00 2022-08-10T17:33:13.484 INFO:teuthology.orchestra.run.smithi197.stdout:(117/127): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.1 MB/s | 126 kB 00:00 2022-08-10T17:33:13.509 INFO:teuthology.orchestra.run.smithi197.stdout:(118/127): python3-jsonpointer-1.10-11.el8.noar 342 kB/s | 20 kB 00:00 2022-08-10T17:33:13.551 INFO:teuthology.orchestra.run.smithi197.stdout:(119/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-08-10T17:33:13.577 INFO:teuthology.orchestra.run.smithi197.stdout:(120/127): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2022-08-10T17:33:13.618 INFO:teuthology.orchestra.run.smithi197.stdout:(121/127): python3-jsonpatch-1.21-2.el8.noarch. 396 kB/s | 27 kB 00:00 2022-08-10T17:33:13.644 INFO:teuthology.orchestra.run.smithi197.stdout:(122/127): python3-pyasn1-modules-0.3.7-6.el8.n 1.6 MB/s | 110 kB 00:00 2022-08-10T17:33:13.811 INFO:teuthology.orchestra.run.smithi197.stdout:(123/127): python3-scipy-1.0.0-21.module+el8.5. 26 MB/s | 14 MB 00:00 2022-08-10T17:33:13.853 INFO:teuthology.orchestra.run.smithi197.stdout:(124/127): openssl-1.1.1k-7.el8_6.x86_64.rpm 17 MB/s | 709 kB 00:00 2022-08-10T17:33:13.903 INFO:teuthology.orchestra.run.smithi197.stdout:(125/127): openssl-libs-1.1.1k-7.el8_6.x86_64.r 29 MB/s | 1.5 MB 00:00 2022-08-10T17:33:14.236 INFO:teuthology.orchestra.run.smithi197.stdout:(126/127): librbd1-17.0.0-14135.g5662b52d.el8.x 6.0 MB/s | 3.6 MB 00:00 2022-08-10T17:33:14.345 INFO:teuthology.orchestra.run.smithi197.stdout:(127/127): librados2-17.0.0-14135.g5662b52d.el8 5.0 MB/s | 3.6 MB 00:00 2022-08-10T17:33:14.348 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2022-08-10T17:33:14.348 INFO:teuthology.orchestra.run.smithi197.stdout:Total 13 MB/s | 207 MB 00:15 2022-08-10T17:33:15.113 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2022-08-10T17:33:15.257 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2022-08-10T17:33:15.257 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2022-08-10T17:33:16.330 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2022-08-10T17:33:16.334 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2022-08-10T17:33:17.088 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2022-08-10T17:33:17.323 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/131 2022-08-10T17:33:17.537 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/131 2022-08-10T17:33:17.885 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/131 2022-08-10T17:33:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/131 2022-08-10T17:33:18.558 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/131 2022-08-10T17:33:18.627 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/131 2022-08-10T17:33:18.869 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/131 2022-08-10T17:33:19.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/131 2022-08-10T17:33:19.424 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/131 2022-08-10T17:33:19.624 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:33:19.996 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:33:20.183 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:33:20.307 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:33:20.516 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:33:20.613 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:33:21.244 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2022-08-10T17:33:21.284 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_6 10/131 2022-08-10T17:33:21.466 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:33:21.479 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/131 2022-08-10T17:33:21.558 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:33:21.692 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/131 2022-08-10T17:33:21.769 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/131 2022-08-10T17:33:21.860 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/131 2022-08-10T17:33:21.903 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/131 2022-08-10T17:33:22.034 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/131 2022-08-10T17:33:22.074 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 14/131 2022-08-10T17:33:22.174 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 14/131 2022-08-10T17:33:22.219 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/131 2022-08-10T17:33:22.371 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/131 2022-08-10T17:33:22.382 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 15/131 2022-08-10T17:33:22.447 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 15/131 2022-08-10T17:33:22.450 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/131 2022-08-10T17:33:22.612 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 16/131 2022-08-10T17:33:22.613 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/131 2022-08-10T17:33:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/131 2022-08-10T17:33:22.906 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/131 2022-08-10T17:33:22.999 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/131 2022-08-10T17:33:23.041 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/131 2022-08-10T17:33:23.238 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:33:23.624 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:33:23.655 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/131 2022-08-10T17:33:23.807 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/131 2022-08-10T17:33:23.821 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:33:23.929 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:33:24.154 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:33:24.250 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:33:24.404 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/131 2022-08-10T17:33:24.599 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/131 2022-08-10T17:33:24.924 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_6 10/131 2022-08-10T17:33:25.270 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/131 2022-08-10T17:33:25.529 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/131 2022-08-10T17:33:25.596 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:33:25.702 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/131 2022-08-10T17:33:25.708 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:33:25.908 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/131 2022-08-10T17:33:25.956 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/131 2022-08-10T17:33:26.058 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/131 2022-08-10T17:33:26.228 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/131 2022-08-10T17:33:26.229 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 14/131 2022-08-10T17:33:26.329 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 14/131 2022-08-10T17:33:26.472 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/131 2022-08-10T17:33:26.496 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 15/131 2022-08-10T17:33:26.560 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 15/131 2022-08-10T17:33:26.655 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:17.0.0-14135.g5662b52d.el8 26/131 2022-08-10T17:33:26.733 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/131 2022-08-10T17:33:26.809 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:17.0.0-14135.g5662b52d.e 27/131 2022-08-10T17:33:26.991 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/131 2022-08-10T17:33:27.063 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_ 28/131 2022-08-10T17:33:27.168 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/131 2022-08-10T17:33:27.326 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/131 2022-08-10T17:33:27.445 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 20/131 2022-08-10T17:33:27.585 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 20/131 2022-08-10T17:33:27.704 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 21/131 2022-08-10T17:33:27.973 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/131 2022-08-10T17:33:28.319 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 21/131 2022-08-10T17:33:28.326 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/131 2022-08-10T17:33:28.503 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 22/131 2022-08-10T17:33:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/131 2022-08-10T17:33:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-08-10T17:33:29.103 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 22/131 2022-08-10T17:33:29.304 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-0.3.15-3.el8.x86_64 23/131 2022-08-10T17:33:29.986 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 23/131 2022-08-10T17:33:30.292 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/131 2022-08-10T17:33:30.536 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/131 2022-08-10T17:33:30.710 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-common-2:17.0.0-14135.g5662b52d.el8 26/131 2022-08-10T17:33:30.787 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-08-10T17:33:30.880 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-argparse-2:17.0.0-14135.g5662b52d.e 27/131 2022-08-10T17:33:31.124 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/131 2022-08-10T17:33:31.137 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_ 28/131 2022-08-10T17:33:31.320 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/131 2022-08-10T17:33:31.342 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/131 2022-08-10T17:33:31.542 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/131 2022-08-10T17:33:31.791 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 36/131 2022-08-10T17:33:32.045 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 37/131 2022-08-10T17:33:32.261 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_ 38/131 2022-08-10T17:33:32.461 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/131 2022-08-10T17:33:32.627 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 40/131 2022-08-10T17:33:32.801 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 41/131 2022-08-10T17:33:33.005 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/131 2022-08-10T17:33:33.049 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/131 2022-08-10T17:33:33.203 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 43/131 2022-08-10T17:33:33.403 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/131 2022-08-10T17:33:33.410 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 44/131 2022-08-10T17:33:33.833 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 45/131 2022-08-10T17:33:34.183 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 46/131 2022-08-10T17:33:34.369 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/131 2022-08-10T17:33:34.423 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 47/131 2022-08-10T17:33:34.674 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 48/131 2022-08-10T17:33:34.681 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/131 2022-08-10T17:33:34.929 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/131 2022-08-10T17:33:34.976 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 49/131 2022-08-10T17:33:35.163 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/131 2022-08-10T17:33:35.294 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 50/131 2022-08-10T17:33:35.322 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/131 2022-08-10T17:33:35.505 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 51/131 2022-08-10T17:33:35.595 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 36/131 2022-08-10T17:33:35.665 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 52/131 2022-08-10T17:33:35.774 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 37/131 2022-08-10T17:33:35.908 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 53/131 2022-08-10T17:33:35.980 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_ 38/131 2022-08-10T17:33:36.100 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 54/131 2022-08-10T17:33:36.197 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/131 2022-08-10T17:33:36.376 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/131 2022-08-10T17:33:36.448 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/131 2022-08-10T17:33:36.453 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/131 2022-08-10T17:33:36.676 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/131 2022-08-10T17:33:36.683 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : jq-1.6-3.el8.x86_64 41/131 2022-08-10T17:33:36.834 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/131 2022-08-10T17:33:36.944 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/131 2022-08-10T17:33:37.072 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/131 2022-08-10T17:33:37.168 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/131 2022-08-10T17:33:37.310 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : automake-1.16.1-7.el8.noarch 44/131 2022-08-10T17:33:37.390 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 59/131 2022-08-10T17:33:37.456 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/131 2022-08-10T17:33:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-15.el8.x86_64 60/131 2022-08-10T17:33:37.623 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 46/131 2022-08-10T17:33:37.780 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 47/131 2022-08-10T17:33:37.814 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/131 2022-08-10T17:33:37.881 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/131 2022-08-10T17:33:37.993 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 48/131 2022-08-10T17:33:38.086 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.6-3.el8.x86_64 62/131 2022-08-10T17:33:38.183 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 49/131 2022-08-10T17:33:38.280 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 63/131 2022-08-10T17:33:38.423 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 50/131 2022-08-10T17:33:38.588 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 64/131 2022-08-10T17:33:38.805 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-7.el8.noarch 65/131 2022-08-10T17:33:38.835 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 51/131 2022-08-10T17:33:38.999 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 66/131 2022-08-10T17:33:39.128 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 52/131 2022-08-10T17:33:39.164 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/131 2022-08-10T17:33:39.296 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 53/131 2022-08-10T17:33:39.360 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/131 2022-08-10T17:33:39.567 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 54/131 2022-08-10T17:33:39.647 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/131 2022-08-10T17:33:39.830 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 55/131 2022-08-10T17:33:39.887 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/131 2022-08-10T17:33:40.085 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/131 2022-08-10T17:33:40.149 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 56/131 2022-08-10T17:33:40.249 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/131 2022-08-10T17:33:40.385 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 57/131 2022-08-10T17:33:40.455 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/131 2022-08-10T17:33:40.586 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 58/131 2022-08-10T17:33:40.692 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/131 2022-08-10T17:33:40.804 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 59/131 2022-08-10T17:33:40.866 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/131 2022-08-10T17:33:40.947 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 60/131 2022-08-10T17:33:41.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/131 2022-08-10T17:33:41.169 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/131 2022-08-10T17:33:41.305 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/131 2022-08-10T17:33:41.407 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/131 2022-08-10T17:33:41.498 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/131 2022-08-10T17:33:41.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/131 2022-08-10T17:33:41.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/131 2022-08-10T17:33:41.774 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 63/131 2022-08-10T17:33:42.014 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/131 2022-08-10T17:33:42.031 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/131 2022-08-10T17:33:42.245 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/131 2022-08-10T17:33:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 65/131 2022-08-10T17:33:42.445 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/131 2022-08-10T17:33:42.494 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : fuse-2.9.7-15.el8.x86_64 66/131 2022-08-10T17:33:42.661 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/131 2022-08-10T17:33:42.693 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/131 2022-08-10T17:33:42.871 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/131 2022-08-10T17:33:43.132 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/131 2022-08-10T17:33:43.341 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/131 2022-08-10T17:33:43.514 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/131 2022-08-10T17:33:43.686 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/131 2022-08-10T17:33:43.703 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/131 2022-08-10T17:33:43.882 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/131 2022-08-10T17:33:43.974 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/131 2022-08-10T17:33:44.095 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/131 2022-08-10T17:33:44.228 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/131 2022-08-10T17:33:44.301 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/131 2022-08-10T17:33:44.470 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/131 2022-08-10T17:33:44.578 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/131 2022-08-10T17:33:44.656 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/131 2022-08-10T17:33:44.877 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/131 2022-08-10T17:33:44.896 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/131 2022-08-10T17:33:45.096 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/131 2022-08-10T17:33:45.112 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/131 2022-08-10T17:33:45.257 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/131 2022-08-10T17:33:45.355 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/131 2022-08-10T17:33:45.486 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/131 2022-08-10T17:33:45.708 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/131 2022-08-10T17:33:45.891 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/131 2022-08-10T17:33:46.141 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/131 2022-08-10T17:33:47.195 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/131 2022-08-10T17:33:47.487 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/131 2022-08-10T17:33:47.724 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/131 2022-08-10T17:33:48.018 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/131 2022-08-10T17:33:48.284 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/131 2022-08-10T17:33:48.517 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/131 2022-08-10T17:33:48.709 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/131 2022-08-10T17:33:49.118 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:49.346 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:49.903 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:50.278 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 93/131 2022-08-10T17:33:50.361 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 93/131 2022-08-10T17:33:50.504 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 94/131 2022-08-10T17:33:52.448 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:52.642 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:53.195 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 92/131 2022-08-10T17:33:53.483 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 93/131 2022-08-10T17:33:53.570 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 93/131 2022-08-10T17:33:53.700 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 94/131 2022-08-10T17:34:09.287 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 94/131 2022-08-10T17:34:09.288 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2022-08-10T17:34:09.288 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2022-08-10T17:34:09.288 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2022-08-10T17:34:09.289 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2022-08-10T17:34:09.289 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2022-08-10T17:34:09.289 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2022-08-10T17:34:09.290 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2022-08-10T17:34:09.290 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2022-08-10T17:34:09.290 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2022-08-10T17:34:09.291 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:09.635 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 95/131 2022-08-10T17:34:11.106 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 95/131 2022-08-10T17:34:11.308 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 96/131 2022-08-10T17:34:11.524 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 96/131 2022-08-10T17:34:11.759 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 97/131 2022-08-10T17:34:11.946 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 94/131 2022-08-10T17:34:11.946 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /sys 2022-08-10T17:34:11.946 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /proc 2022-08-10T17:34:11.947 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2022-08-10T17:34:11.947 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /run 2022-08-10T17:34:11.947 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /mnt 2022-08-10T17:34:11.948 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /var/tmp 2022-08-10T17:34:11.948 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /home 2022-08-10T17:34:11.948 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /tmp 2022-08-10T17:34:11.949 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2022-08-10T17:34:11.949 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:12.139 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 97/131 2022-08-10T17:34:12.297 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 95/131 2022-08-10T17:34:12.343 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 98/131 2022-08-10T17:34:12.360 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 98/131 2022-08-10T17:34:13.772 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 95/131 2022-08-10T17:34:13.932 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 99/131 2022-08-10T17:34:13.987 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 96/131 2022-08-10T17:34:14.127 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 99/131 2022-08-10T17:34:14.204 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 96/131 2022-08-10T17:34:14.265 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d. 100/131 2022-08-10T17:34:14.371 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 97/131 2022-08-10T17:34:14.444 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d 101/131 2022-08-10T17:34:14.642 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 102/131 2022-08-10T17:34:14.752 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 97/131 2022-08-10T17:34:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 102/131 2022-08-10T17:34:14.922 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 98/131 2022-08-10T17:34:14.939 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 98/131 2022-08-10T17:34:15.158 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 103/131 2022-08-10T17:34:16.127 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 103/131 2022-08-10T17:34:16.334 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 104/131 2022-08-10T17:34:16.423 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 104/131 2022-08-10T17:34:16.466 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 99/131 2022-08-10T17:34:16.623 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 99/131 2022-08-10T17:34:16.743 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d. 100/131 2022-08-10T17:34:16.767 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.e 105/131 2022-08-10T17:34:16.947 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d 101/131 2022-08-10T17:34:16.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 106/131 2022-08-10T17:34:17.023 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 106/131 2022-08-10T17:34:17.104 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 102/131 2022-08-10T17:34:17.184 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 107/131 2022-08-10T17:34:17.195 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 107/131 2022-08-10T17:34:17.313 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 102/131 2022-08-10T17:34:17.578 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 103/131 2022-08-10T17:34:18.538 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 103/131 2022-08-10T17:34:18.696 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 104/131 2022-08-10T17:34:18.785 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 104/131 2022-08-10T17:34:18.820 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 108/131 2022-08-10T17:34:19.032 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 109/131 2022-08-10T17:34:19.110 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 109/131 2022-08-10T17:34:19.145 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.e 105/131 2022-08-10T17:34:19.300 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14135.g5662 110/131 2022-08-10T17:34:19.338 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 106/131 2022-08-10T17:34:19.342 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14135.g5662 110/131 2022-08-10T17:34:19.373 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 106/131 2022-08-10T17:34:19.508 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 111/131 2022-08-10T17:34:19.520 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 107/131 2022-08-10T17:34:19.532 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 107/131 2022-08-10T17:34:19.854 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 111/131 2022-08-10T17:34:20.009 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 112/131 2022-08-10T17:34:21.152 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 108/131 2022-08-10T17:34:21.372 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 109/131 2022-08-10T17:34:21.469 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 109/131 2022-08-10T17:34:21.604 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14135.g5662 110/131 2022-08-10T17:34:21.646 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14135.g5662 110/131 2022-08-10T17:34:21.804 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 111/131 2022-08-10T17:34:22.149 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 111/131 2022-08-10T17:34:22.304 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 112/131 2022-08-10T17:34:24.970 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 112/131 2022-08-10T17:34:25.251 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 113/131 2022-08-10T17:34:25.391 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/131 2022-08-10T17:34:25.471 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/131 2022-08-10T17:34:26.302 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 115/131 2022-08-10T17:34:26.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/131 2022-08-10T17:34:26.736 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 117/131 2022-08-10T17:34:26.911 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86 118/131 2022-08-10T17:34:27.044 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 119/131 2022-08-10T17:34:27.207 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 120/131 2022-08-10T17:34:27.271 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 112/131 2022-08-10T17:34:27.407 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 121/131 2022-08-10T17:34:27.559 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 113/131 2022-08-10T17:34:27.642 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 122/131 2022-08-10T17:34:27.867 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 123/131 2022-08-10T17:34:28.007 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 124/131 2022-08-10T17:34:28.016 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 124/131 2022-08-10T17:34:28.169 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 125/131 2022-08-10T17:34:28.360 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 114/131 2022-08-10T17:34:28.398 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/131 2022-08-10T17:34:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/131 2022-08-10T17:34:28.647 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 115/131 2022-08-10T17:34:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/131 2022-08-10T17:34:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/131 2022-08-10T17:34:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 128/131 2022-08-10T17:34:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 129/131 2022-08-10T17:34:28.879 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 116/131 2022-08-10T17:34:29.027 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/131 2022-08-10T17:34:29.039 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/131 2022-08-10T17:34:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 129/131 2022-08-10T17:34:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 130/131 2022-08-10T17:34:29.215 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86 118/131 2022-08-10T17:34:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 130/131 2022-08-10T17:34:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:29.356 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 119/131 2022-08-10T17:34:29.556 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 120/131 2022-08-10T17:34:29.719 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 121/131 2022-08-10T17:34:29.962 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 122/131 2022-08-10T17:34:30.072 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:30.072 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 1/131 2022-08-10T17:34:30.072 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 2/131 2022-08-10T17:34:30.073 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 3/131 2022-08-10T17:34:30.073 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 4/131 2022-08-10T17:34:30.073 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14135.g5662 5/131 2022-08-10T17:34:30.073 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 6/131 2022-08-10T17:34:30.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:34:30.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:34:30.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:34:30.074 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 10/131 2022-08-10T17:34:30.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:34:30.075 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 12/131 2022-08-10T17:34:30.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 13/131 2022-08-10T17:34:30.076 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86 14/131 2022-08-10T17:34:30.077 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 15/131 2022-08-10T17:34:30.077 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 16/131 2022-08-10T17:34:30.077 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_ 17/131 2022-08-10T17:34:30.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 18/131 2022-08-10T17:34:30.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 19/131 2022-08-10T17:34:30.078 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14135.g5662b52d.e 20/131 2022-08-10T17:34:30.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:17.0.0-14135.g5662b52d.el8 21/131 2022-08-10T17:34:30.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_ 22/131 2022-08-10T17:34:30.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_6 23/131 2022-08-10T17:34:30.079 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 24/131 2022-08-10T17:34:30.080 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 25/131 2022-08-10T17:34:30.080 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 26/131 2022-08-10T17:34:30.080 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 27/131 2022-08-10T17:34:30.080 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 28/131 2022-08-10T17:34:30.080 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d 29/131 2022-08-10T17:34:30.081 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 30/131 2022-08-10T17:34:30.081 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 31/131 2022-08-10T17:34:30.081 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 32/131 2022-08-10T17:34:30.081 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.e 33/131 2022-08-10T17:34:30.082 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 34/131 2022-08-10T17:34:30.082 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d. 35/131 2022-08-10T17:34:30.082 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 36/131 2022-08-10T17:34:30.082 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 37/131 2022-08-10T17:34:30.083 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 38/131 2022-08-10T17:34:30.083 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/131 2022-08-10T17:34:30.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/131 2022-08-10T17:34:30.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/131 2022-08-10T17:34:30.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/131 2022-08-10T17:34:30.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/131 2022-08-10T17:34:30.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/131 2022-08-10T17:34:30.086 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/131 2022-08-10T17:34:30.086 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/131 2022-08-10T17:34:30.086 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/131 2022-08-10T17:34:30.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/131 2022-08-10T17:34:30.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/131 2022-08-10T17:34:30.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/131 2022-08-10T17:34:30.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/131 2022-08-10T17:34:30.087 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/131 2022-08-10T17:34:30.088 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/131 2022-08-10T17:34:30.088 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/131 2022-08-10T17:34:30.088 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/131 2022-08-10T17:34:30.088 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/131 2022-08-10T17:34:30.089 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/131 2022-08-10T17:34:30.089 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/131 2022-08-10T17:34:30.089 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/131 2022-08-10T17:34:30.090 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/131 2022-08-10T17:34:30.090 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/131 2022-08-10T17:34:30.090 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/131 2022-08-10T17:34:30.091 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/131 2022-08-10T17:34:30.091 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/131 2022-08-10T17:34:30.091 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/131 2022-08-10T17:34:30.091 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/131 2022-08-10T17:34:30.091 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/131 2022-08-10T17:34:30.092 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/131 2022-08-10T17:34:30.092 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/131 2022-08-10T17:34:30.092 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/131 2022-08-10T17:34:30.092 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/131 2022-08-10T17:34:30.093 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 72/131 2022-08-10T17:34:30.093 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 73/131 2022-08-10T17:34:30.093 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 74/131 2022-08-10T17:34:30.093 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/131 2022-08-10T17:34:30.094 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 76/131 2022-08-10T17:34:30.094 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 77/131 2022-08-10T17:34:30.094 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 78/131 2022-08-10T17:34:30.094 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 79/131 2022-08-10T17:34:30.095 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 80/131 2022-08-10T17:34:30.095 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 81/131 2022-08-10T17:34:30.095 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 82/131 2022-08-10T17:34:30.095 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/131 2022-08-10T17:34:30.095 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/131 2022-08-10T17:34:30.096 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 85/131 2022-08-10T17:34:30.096 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/131 2022-08-10T17:34:30.096 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 87/131 2022-08-10T17:34:30.096 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.6-3.el8.x86_64 88/131 2022-08-10T17:34:30.096 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 89/131 2022-08-10T17:34:30.097 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-7.el8.noarch 90/131 2022-08-10T17:34:30.097 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 91/131 2022-08-10T17:34:30.097 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 92/131 2022-08-10T17:34:30.098 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 93/131 2022-08-10T17:34:30.098 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/131 2022-08-10T17:34:30.098 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 95/131 2022-08-10T17:34:30.098 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/131 2022-08-10T17:34:30.099 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 97/131 2022-08-10T17:34:30.099 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 98/131 2022-08-10T17:34:30.099 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 99/131 2022-08-10T17:34:30.099 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 100/131 2022-08-10T17:34:30.100 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 101/131 2022-08-10T17:34:30.100 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 102/131 2022-08-10T17:34:30.100 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/131 2022-08-10T17:34:30.100 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 104/131 2022-08-10T17:34:30.101 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 105/131 2022-08-10T17:34:30.101 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/131 2022-08-10T17:34:30.101 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/131 2022-08-10T17:34:30.101 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 108/131 2022-08-10T17:34:30.102 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 109/131 2022-08-10T17:34:30.102 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 110/131 2022-08-10T17:34:30.102 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 111/131 2022-08-10T17:34:30.103 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 112/131 2022-08-10T17:34:30.103 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 113/131 2022-08-10T17:34:30.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 114/131 2022-08-10T17:34:30.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 115/131 2022-08-10T17:34:30.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 116/131 2022-08-10T17:34:30.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 117/131 2022-08-10T17:34:30.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 118/131 2022-08-10T17:34:30.105 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 119/131 2022-08-10T17:34:30.105 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 120/131 2022-08-10T17:34:30.105 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 121/131 2022-08-10T17:34:30.105 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 122/131 2022-08-10T17:34:30.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 123/131 2022-08-10T17:34:30.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 124/131 2022-08-10T17:34:30.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/131 2022-08-10T17:34:30.107 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 126/131 2022-08-10T17:34:30.107 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/131 2022-08-10T17:34:30.107 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 128/131 2022-08-10T17:34:30.107 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 129/131 2022-08-10T17:34:30.108 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 130/131 2022-08-10T17:34:30.255 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 123/131 2022-08-10T17:34:30.452 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/131 2022-08-10T17:34:30.527 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/131 2022-08-10T17:34:30.769 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/131 2022-08-10T17:34:30.781 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/131 2022-08-10T17:34:30.935 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 126/131 2022-08-10T17:34:30.944 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 126/131 2022-08-10T17:34:31.106 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 127/131 2022-08-10T17:34:31.296 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 128/131 2022-08-10T17:34:31.296 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 129/131 2022-08-10T17:34:31.489 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 129/131 2022-08-10T17:34:31.489 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 130/131 2022-08-10T17:34:31.705 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 130/131 2022-08-10T17:34:31.705 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:31.852 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:31.853 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2022-08-10T17:34:32.075 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:32.075 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2022-08-10T17:34:32.075 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.076 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.076 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:32.076 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:32.076 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2022-08-10T17:34:32.077 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-08-10T17:34:32.077 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-7.el8.noarch 2022-08-10T17:34:32.077 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2022-08-10T17:34:32.077 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.077 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.078 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.078 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.078 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.078 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.079 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.079 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.079 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.079 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.080 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.080 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.080 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.080 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.081 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.081 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.081 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.081 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.081 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.082 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.082 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.082 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.082 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:32.083 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-08-10T17:34:32.083 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2022-08-10T17:34:32.083 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-15.el8.x86_64 2022-08-10T17:34:32.083 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-08-10T17:34:32.084 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.6-3.el8.x86_64 2022-08-10T17:34:32.084 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-08-10T17:34:32.084 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-08-10T17:34:32.084 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-08-10T17:34:32.084 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.085 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.085 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.085 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-08-10T17:34:32.085 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-08-10T17:34:32.086 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2022-08-10T17:34:32.086 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-08-10T17:34:32.086 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-08-10T17:34:32.086 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.087 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.087 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-08-10T17:34:32.087 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.087 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-08-10T17:34:32.088 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-08-10T17:34:32.088 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2022-08-10T17:34:32.088 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2022-08-10T17:34:32.088 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-08-10T17:34:32.088 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-08-10T17:34:32.089 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-08-10T17:34:32.089 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-08-10T17:34:32.089 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.15-3.el8.x86_64 2022-08-10T17:34:32.089 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-08-10T17:34:32.090 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:32.090 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-08-10T17:34:32.090 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-08-10T17:34:32.090 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-08-10T17:34:32.091 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-08-10T17:34:32.091 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-7.el8.noarch 2022-08-10T17:34:32.091 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-08-10T17:34:32.091 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-08-10T17:34:32.091 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-08-10T17:34:32.092 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.092 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.092 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.092 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-08-10T17:34:32.093 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-08-10T17:34:32.093 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-08-10T17:34:32.093 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-08-10T17:34:32.093 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-08-10T17:34:32.093 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-08-10T17:34:32.094 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2022-08-10T17:34:32.094 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-08-10T17:34:32.094 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-08-10T17:34:32.094 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-08-10T17:34:32.095 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-08-10T17:34:32.095 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-08-10T17:34:32.095 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-08-10T17:34:32.095 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-08-10T17:34:32.095 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-13.el8.noarch 2022-08-10T17:34:32.096 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-08-10T17:34:32.096 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-08-10T17:34:32.096 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-08-10T17:34:32.096 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-08-10T17:34:32.097 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-08-10T17:34:32.097 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-08-10T17:34:32.097 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-08-10T17:34:32.097 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2022-08-10T17:34:32.098 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-08-10T17:34:32.098 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-08-10T17:34:32.098 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-08-10T17:34:32.098 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-08-10T17:34:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.14-14.el8.noarch 2022-08-10T17:34:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-9.el8.noarch 2022-08-10T17:34:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-08-10T17:34:32.100 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-08-10T17:34:32.100 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.100 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2022-08-10T17:34:32.100 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.8-1.el8.noarch 2022-08-10T17:34:32.101 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-08-10T17:34:32.101 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-08-10T17:34:32.101 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-08-10T17:34:32.101 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-08-10T17:34:32.101 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-08-10T17:34:32.102 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-08-10T17:34:32.102 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-08-10T17:34:32.102 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-08-10T17:34:32.102 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-08-10T17:34:32.103 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-08-10T17:34:32.103 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-08-10T17:34:32.103 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.103 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.104 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:32.104 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-1.el8.x86_64 2022-08-10T17:34:32.104 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.13.0-2.el8.x86_64 2022-08-10T17:34:32.104 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-08-10T17:34:32.104 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-08-10T17:34:32.105 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-08-10T17:34:32.105 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:32.106 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2022-08-10T17:34:32.276 DEBUG:teuthology.parallel:result is None 2022-08-10T17:34:32.493 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:32.494 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 1/131 2022-08-10T17:34:32.494 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 2/131 2022-08-10T17:34:32.494 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 3/131 2022-08-10T17:34:32.495 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 4/131 2022-08-10T17:34:32.495 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14135.g5662 5/131 2022-08-10T17:34:32.495 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 6/131 2022-08-10T17:34:32.495 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 7/131 2022-08-10T17:34:32.496 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 8/131 2022-08-10T17:34:32.496 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 9/131 2022-08-10T17:34:32.496 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 10/131 2022-08-10T17:34:32.496 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 11/131 2022-08-10T17:34:32.497 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 12/131 2022-08-10T17:34:32.497 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_6 13/131 2022-08-10T17:34:32.497 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86 14/131 2022-08-10T17:34:32.497 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 15/131 2022-08-10T17:34:32.498 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_6 16/131 2022-08-10T17:34:32.498 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_ 17/131 2022-08-10T17:34:32.498 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x8 18/131 2022-08-10T17:34:32.498 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 19/131 2022-08-10T17:34:32.499 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14135.g5662b52d.e 20/131 2022-08-10T17:34:32.499 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-common-2:17.0.0-14135.g5662b52d.el8 21/131 2022-08-10T17:34:32.499 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_ 22/131 2022-08-10T17:34:32.499 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_6 23/131 2022-08-10T17:34:32.500 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 24/131 2022-08-10T17:34:32.500 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 25/131 2022-08-10T17:34:32.500 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 26/131 2022-08-10T17:34:32.500 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 27/131 2022-08-10T17:34:32.501 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 28/131 2022-08-10T17:34:32.501 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d 29/131 2022-08-10T17:34:32.501 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.no 30/131 2022-08-10T17:34:32.501 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8. 31/131 2022-08-10T17:34:32.502 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14135.g56 32/131 2022-08-10T17:34:32.502 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.e 33/131 2022-08-10T17:34:32.502 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarc 34/131 2022-08-10T17:34:32.502 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d. 35/131 2022-08-10T17:34:32.503 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 36/131 2022-08-10T17:34:32.503 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 37/131 2022-08-10T17:34:32.503 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 38/131 2022-08-10T17:34:32.503 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/131 2022-08-10T17:34:32.503 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/131 2022-08-10T17:34:32.504 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/131 2022-08-10T17:34:32.504 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/131 2022-08-10T17:34:32.504 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/131 2022-08-10T17:34:32.504 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/131 2022-08-10T17:34:32.505 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/131 2022-08-10T17:34:32.505 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/131 2022-08-10T17:34:32.505 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/131 2022-08-10T17:34:32.505 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/131 2022-08-10T17:34:32.505 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/131 2022-08-10T17:34:32.506 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/131 2022-08-10T17:34:32.506 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/131 2022-08-10T17:34:32.506 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/131 2022-08-10T17:34:32.506 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/131 2022-08-10T17:34:32.507 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/131 2022-08-10T17:34:32.507 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/131 2022-08-10T17:34:32.507 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/131 2022-08-10T17:34:32.507 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/131 2022-08-10T17:34:32.508 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/131 2022-08-10T17:34:32.508 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/131 2022-08-10T17:34:32.508 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/131 2022-08-10T17:34:32.508 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/131 2022-08-10T17:34:32.508 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/131 2022-08-10T17:34:32.509 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/131 2022-08-10T17:34:32.509 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/131 2022-08-10T17:34:32.509 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/131 2022-08-10T17:34:32.509 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/131 2022-08-10T17:34:32.510 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/131 2022-08-10T17:34:32.510 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/131 2022-08-10T17:34:32.510 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/131 2022-08-10T17:34:32.510 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/131 2022-08-10T17:34:32.511 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/131 2022-08-10T17:34:32.511 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/131 2022-08-10T17:34:32.511 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/131 2022-08-10T17:34:32.511 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/131 2022-08-10T17:34:32.511 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/131 2022-08-10T17:34:32.512 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/131 2022-08-10T17:34:32.512 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/131 2022-08-10T17:34:32.512 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/131 2022-08-10T17:34:32.512 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/131 2022-08-10T17:34:32.513 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/131 2022-08-10T17:34:32.513 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/131 2022-08-10T17:34:32.513 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/131 2022-08-10T17:34:32.513 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/131 2022-08-10T17:34:32.514 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/131 2022-08-10T17:34:32.514 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/131 2022-08-10T17:34:32.514 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/131 2022-08-10T17:34:32.514 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/131 2022-08-10T17:34:32.515 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/131 2022-08-10T17:34:32.515 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/131 2022-08-10T17:34:32.515 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 90/131 2022-08-10T17:34:32.515 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 91/131 2022-08-10T17:34:32.515 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/131 2022-08-10T17:34:32.516 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/131 2022-08-10T17:34:32.516 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/131 2022-08-10T17:34:32.516 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 95/131 2022-08-10T17:34:32.516 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/131 2022-08-10T17:34:32.517 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 97/131 2022-08-10T17:34:32.517 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : bison-3.0.4-10.el8.x86_64 98/131 2022-08-10T17:34:32.517 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 99/131 2022-08-10T17:34:32.517 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 100/131 2022-08-10T17:34:32.517 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/131 2022-08-10T17:34:32.518 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 102/131 2022-08-10T17:34:32.518 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 103/131 2022-08-10T17:34:32.518 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 104/131 2022-08-10T17:34:32.519 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/131 2022-08-10T17:34:32.519 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 106/131 2022-08-10T17:34:32.519 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 107/131 2022-08-10T17:34:32.519 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 108/131 2022-08-10T17:34:32.519 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/131 2022-08-10T17:34:32.520 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 110/131 2022-08-10T17:34:32.520 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 111/131 2022-08-10T17:34:32.520 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : flex-2.6.1-9.el8.x86_64 112/131 2022-08-10T17:34:32.520 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 113/131 2022-08-10T17:34:32.521 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : jq-1.6-3.el8.x86_64 114/131 2022-08-10T17:34:32.521 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 115/131 2022-08-10T17:34:32.521 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : automake-1.16.1-7.el8.noarch 116/131 2022-08-10T17:34:32.521 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 117/131 2022-08-10T17:34:32.522 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 118/131 2022-08-10T17:34:32.522 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 119/131 2022-08-10T17:34:32.522 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 120/131 2022-08-10T17:34:32.522 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 121/131 2022-08-10T17:34:32.522 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 122/131 2022-08-10T17:34:32.523 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 123/131 2022-08-10T17:34:32.523 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 124/131 2022-08-10T17:34:32.523 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/131 2022-08-10T17:34:32.523 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 126/131 2022-08-10T17:34:32.524 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/131 2022-08-10T17:34:32.524 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 128/131 2022-08-10T17:34:32.524 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 129/131 2022-08-10T17:34:32.524 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 130/131 2022-08-10T17:34:34.235 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 131/131 2022-08-10T17:34:34.235 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2022-08-10T17:34:34.473 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:34.473 INFO:teuthology.orchestra.run.smithi197.stdout:Upgraded: 2022-08-10T17:34:34.474 INFO:teuthology.orchestra.run.smithi197.stdout: librados2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.474 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.474 INFO:teuthology.orchestra.run.smithi197.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:34.475 INFO:teuthology.orchestra.run.smithi197.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:34.475 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2022-08-10T17:34:34.475 INFO:teuthology.orchestra.run.smithi197.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-08-10T17:34:34.475 INFO:teuthology.orchestra.run.smithi197.stdout: automake-1.16.1-7.el8.noarch 2022-08-10T17:34:34.476 INFO:teuthology.orchestra.run.smithi197.stdout: bison-3.0.4-10.el8.x86_64 2022-08-10T17:34:34.476 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.476 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.476 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.476 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.477 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.477 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.477 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.477 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.478 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.478 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.478 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.478 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.479 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.479 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.479 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.479 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.480 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.480 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.480 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.480 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-volume-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.481 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.481 INFO:teuthology.orchestra.run.smithi197.stdout: cephfs-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.481 INFO:teuthology.orchestra.run.smithi197.stdout: cephfs-top-2:17.0.0-14135.g5662b52d.el8.noarch 2022-08-10T17:34:34.481 INFO:teuthology.orchestra.run.smithi197.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-08-10T17:34:34.482 INFO:teuthology.orchestra.run.smithi197.stdout: flex-2.6.1-9.el8.x86_64 2022-08-10T17:34:34.482 INFO:teuthology.orchestra.run.smithi197.stdout: fuse-2.9.7-15.el8.x86_64 2022-08-10T17:34:34.482 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-08-10T17:34:34.482 INFO:teuthology.orchestra.run.smithi197.stdout: jq-1.6-3.el8.x86_64 2022-08-10T17:34:34.483 INFO:teuthology.orchestra.run.smithi197.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-08-10T17:34:34.483 INFO:teuthology.orchestra.run.smithi197.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-08-10T17:34:34.483 INFO:teuthology.orchestra.run.smithi197.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-08-10T17:34:34.483 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.484 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.484 INFO:teuthology.orchestra.run.smithi197.stdout: libcephsqlite-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.484 INFO:teuthology.orchestra.run.smithi197.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-08-10T17:34:34.484 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-08-10T17:34:34.484 INFO:teuthology.orchestra.run.smithi197.stdout: liboath-2.6.2-3.el8.x86_64 2022-08-10T17:34:34.485 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-08-10T17:34:34.485 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-08-10T17:34:34.485 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.485 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.486 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-08-10T17:34:34.486 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.486 INFO:teuthology.orchestra.run.smithi197.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-08-10T17:34:34.486 INFO:teuthology.orchestra.run.smithi197.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-08-10T17:34:34.487 INFO:teuthology.orchestra.run.smithi197.stdout: libtool-2.4.6-25.el8.x86_64 2022-08-10T17:34:34.487 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind-1.3.1-3.el8.x86_64 2022-08-10T17:34:34.487 INFO:teuthology.orchestra.run.smithi197.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-08-10T17:34:34.487 INFO:teuthology.orchestra.run.smithi197.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-08-10T17:34:34.488 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-08-10T17:34:34.488 INFO:teuthology.orchestra.run.smithi197.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-08-10T17:34:34.488 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-0.3.15-3.el8.x86_64 2022-08-10T17:34:34.488 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-08-10T17:34:34.489 INFO:teuthology.orchestra.run.smithi197.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-08-10T17:34:34.489 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-08-10T17:34:34.489 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-08-10T17:34:34.489 INFO:teuthology.orchestra.run.smithi197.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-08-10T17:34:34.490 INFO:teuthology.orchestra.run.smithi197.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-08-10T17:34:34.490 INFO:teuthology.orchestra.run.smithi197.stdout: python3-babel-2.5.1-7.el8.noarch 2022-08-10T17:34:34.490 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-08-10T17:34:34.490 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-08-10T17:34:34.491 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-08-10T17:34:34.491 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.491 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.491 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.492 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-08-10T17:34:34.492 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-08-10T17:34:34.492 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-08-10T17:34:34.492 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-08-10T17:34:34.493 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-08-10T17:34:34.493 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-08-10T17:34:34.493 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-6.2-6.el8.noarch 2022-08-10T17:34:34.493 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-08-10T17:34:34.494 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-08-10T17:34:34.494 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-08-10T17:34:34.494 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-08-10T17:34:34.494 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-08-10T17:34:34.495 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-08-10T17:34:34.495 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-08-10T17:34:34.495 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako-1.0.6-13.el8.noarch 2022-08-10T17:34:34.495 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-08-10T17:34:34.496 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-08-10T17:34:34.496 INFO:teuthology.orchestra.run.smithi197.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-08-10T17:34:34.496 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-08-10T17:34:34.496 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-08-10T17:34:34.497 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-08-10T17:34:34.497 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-08-10T17:34:34.497 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend-2.6-1.el8.noarch 2022-08-10T17:34:34.497 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-08-10T17:34:34.498 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-08-10T17:34:34.498 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-08-10T17:34:34.498 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-08-10T17:34:34.499 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pycparser-2.14-14.el8.noarch 2022-08-10T17:34:34.499 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz-2017.2-9.el8.noarch 2022-08-10T17:34:34.499 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.499 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.500 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-08-10T17:34:34.500 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-08-10T17:34:34.500 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.500 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes-2.4.1-12.el8.noarch 2022-08-10T17:34:34.501 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa-4.8-1.el8.noarch 2022-08-10T17:34:34.501 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-08-10T17:34:34.501 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-08-10T17:34:34.501 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-08-10T17:34:34.502 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-08-10T17:34:34.502 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-08-10T17:34:34.502 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-08-10T17:34:34.503 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-08-10T17:34:34.503 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-08-10T17:34:34.503 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-08-10T17:34:34.503 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-08-10T17:34:34.504 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-08-10T17:34:34.504 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.504 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.504 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd-2:17.0.0-14135.g5662b52d.el8.x86_64 2022-08-10T17:34:34.504 INFO:teuthology.orchestra.run.smithi197.stdout: socat-1.7.4.1-1.el8.x86_64 2022-08-10T17:34:34.505 INFO:teuthology.orchestra.run.smithi197.stdout: thrift-0.13.0-2.el8.x86_64 2022-08-10T17:34:34.505 INFO:teuthology.orchestra.run.smithi197.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-08-10T17:34:34.505 INFO:teuthology.orchestra.run.smithi197.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-08-10T17:34:34.506 INFO:teuthology.orchestra.run.smithi197.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-08-10T17:34:34.506 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:34.507 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2022-08-10T17:34:34.681 DEBUG:teuthology.parallel:result is None 2022-08-10T17:34:34.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2022-08-10T17:34:34.747 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2022-08-10T17:34:34.748 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:34:34.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5662b52dca13a9032ec3c7fc11184d542141fc45 2022-08-10T17:34:34.980 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-08-10T17:34:35.007 INFO:teuthology.orchestra.run.smithi150.stdout:17.0.0-14135.g5662b52d.el8 2022-08-10T17:34:35.008 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14135.g5662b52d.el8 2022-08-10T17:34:35.009 INFO:teuthology.task.install:The correct ceph version 17.0.0-14135.g5662b52d is installed. 2022-08-10T17:34:35.009 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2022-08-10T17:34:35.066 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2022-08-10T17:34:35.067 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-08-10T17:34:35.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5662b52dca13a9032ec3c7fc11184d542141fc45 2022-08-10T17:34:35.301 DEBUG:teuthology.orchestra.run.smithi197:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-08-10T17:34:35.322 INFO:teuthology.orchestra.run.smithi197.stdout:17.0.0-14135.g5662b52d.el8 2022-08-10T17:34:35.323 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14135.g5662b52d.el8 2022-08-10T17:34:35.323 INFO:teuthology.task.install:The correct ceph version 17.0.0-14135.g5662b52d is installed. 2022-08-10T17:34:35.324 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-08-10T17:34:35.324 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:35.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-08-10T17:34:35.358 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:35.358 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-08-10T17:34:35.388 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-08-10T17:34:35.389 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:35.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2022-08-10T17:34:35.428 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-08-10T17:34:35.496 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:35.497 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/daemon-helper 2022-08-10T17:34:35.523 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-08-10T17:34:35.590 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-08-10T17:34:35.591 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:35.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2022-08-10T17:34:35.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-08-10T17:34:35.688 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:35.688 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/adjust-ulimits 2022-08-10T17:34:35.715 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-08-10T17:34:35.781 INFO:teuthology.run_tasks:Running task ceph... 2022-08-10T17:34:35.868 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-08-10T17:34:35.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2022-08-10T17:34:35.873 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 777 /var/log/ceph 2022-08-10T17:34:35.899 INFO:tasks.ceph:Disabling ceph logrotate... 2022-08-10T17:34:35.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2022-08-10T17:34:35.940 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -f -- /etc/logrotate.d/ceph 2022-08-10T17:34:35.968 INFO:tasks.ceph:Creating extra log directories... 2022-08-10T17:34:35.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-08-10T17:34:36.007 DEBUG:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-08-10T17:34:36.048 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-08-10T17:34:36.048 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-08-10T17:34:36.049 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-08-10T17:34:36.049 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:36.049 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-08-10T17:34:36.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-08-10T17:34:36.204 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-08-10T17:34:36.231 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:36.231 DEBUG:teuthology.orchestra.run.smithi197:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-08-10T17:34:36.248 DEBUG:teuthology.orchestra.run.smithi197:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-08-10T17:34:36.363 DEBUG:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-08-10T17:34:36.396 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-08-10T17:34:36.397 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-08-10T17:34:36.397 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900', 'branch': 'main', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': None, 'first_in_suite': False, 'job_id': '6965900', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'jammy', 'sha1': 'e654560905d543d628247824fe5cbecad893480f'}}, 'owner': 'scheduled_dgalloway@teuthology', 'priority': 10, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'jammy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_e654560905d543d628247824fe5cbecad893480f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'e654560905d543d628247824fe5cbecad893480f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi150.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAZJpfUMaNiuBudAvL80S6Gm2DB/XlF4LwyI0myVHSJA39kPE9vR80TrdHhChBk9jxfLxauEaOsze+CmyyRAsobG/EfnyJHLbEVKDdA4LjYPckSp0Co24unwIn1axqVr/RguadeDJOID9v1MWQNuJSDjBOc2MhxmB8NkfE/ZmQkqTPoBNhiW6r0JzeZMr7y3USG0n3pO9/byiuephpLO9hqfHyi3NVey8ifVh/20gBZSBkaZY9/Go9jpcuRm116IWfmUmDdwBjpIcCZSwg5RnbXMh9+o2cdy9tEXTvh+Ue9FXgRi+Z6AGB1UXaWOIU+Y0c9x62M1QVaXpZ23DwK2DFmqXnMn6c8QzloIaVlt4UbJDMn7JdcznBBD1P6V+AHPZpvm/WOdg5NE/2XkSLjz6I++TkN2JXNPbU7oF9stFo3T9rRWHGYgQx4ZoJSPspO53UAcLHgZe3Jr/FnykYhc2piYvry/Qr42ZfWPrVfANEHIfuRe4tr+49dUWq9pWkxZc=', 'smithi197.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVSU0PdFKJIkDUGkNG1wfjdiEJa56jK+a+iv4+f3zDu17DK7NUvEbdtbcOsDOLChg/SQJwq0CpgMo1dNEteLKzEQImtaE/dt1FUK+kyqgodJbR2TJy2zEaAqSn6RYBlz4AjJlEa5PN9KkYM9eMPH8NDGVACfnBcHbCW/EQ0A6qlrcyNypObGcN94vHzbCnpytph36WI4wa9bDcYyO9hzwLXYsDT17MJltYn8KQstqbbMAcOIAte1ph03lN0J0g4a/xi4riZthoYtn5I01oDvzBqj9QZkWrIOzmkm5pigP+F70dPAk4CJOe3SIkckTCe8gwfnm/8iL6futrpNUVqhK1jaTsk9k/Qf86vQ2t+7p4mni0Fw2XvDbM7IIEeiiQ9x7zciypOC5uzCRQFcJq7GRZJcsMH2GKpRyVG28O9QZyILNUnkxTMjRtSPaZCI/c18Rs67zZWpR2mN7Nu22ZjjL9gomwOq6N6Pjz6rZp2QkBSQHkF3xCKNGxH4J3HHqOcaM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5662b52dca13a9032ec3c7fc11184d542141fc45'}}, {'ceph': None}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53', 'timestamp': '2022-08-10_16:43:02', 'tube': 'smithi', 'user': 'dgalloway', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1713'} 2022-08-10T17:34:36.399 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-08-10T17:34:36.401 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-08-10T17:34:36.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2022-08-10T17:34:36.459 DEBUG:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/run/ceph 2022-08-10T17:34:36.512 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:36.512 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2022-08-10T17:34:36.540 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-08-10T17:34:36.541 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-08-10T17:34:36.597 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-08-10T17:34:36.597 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 358513 Links: 1 2022-08-10T17:34:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2022-08-10 17:34:29.761682516 +0000 2022-08-10T17:34:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2022-08-10 17:31:50.537568268 +0000 2022-08-10T17:34:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2022-08-10 17:31:50.537568268 +0000 2022-08-10T17:34:36.599 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2022-08-10T17:34:36.606 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2022-08-10T17:34:36.607 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2022-08-10T17:34:36.607 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000241197 s, 2.1 MB/s 2022-08-10T17:34:36.610 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-08-10T17:34:36.666 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-08-10T17:34:36.666 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 358658 Links: 1 2022-08-10T17:34:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2022-08-10 17:34:29.761682516 +0000 2022-08-10T17:34:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2022-08-10 17:31:51.098557608 +0000 2022-08-10T17:34:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2022-08-10 17:31:51.098557608 +0000 2022-08-10T17:34:36.668 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2022-08-10T17:34:36.676 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2022-08-10T17:34:36.676 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2022-08-10T17:34:36.676 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000238668 s, 2.1 MB/s 2022-08-10T17:34:36.679 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-08-10T17:34:36.736 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-08-10T17:34:36.736 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.737 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 359625 Links: 1 2022-08-10T17:34:36.737 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.737 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.737 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2022-08-10 17:34:29.761682516 +0000 2022-08-10T17:34:36.738 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2022-08-10 17:31:51.646547195 +0000 2022-08-10T17:34:36.738 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2022-08-10 17:31:51.646547195 +0000 2022-08-10T17:34:36.738 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2022-08-10T17:34:36.746 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2022-08-10T17:34:36.746 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2022-08-10T17:34:36.747 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000167733 s, 3.1 MB/s 2022-08-10T17:34:36.749 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-08-10T17:34:36.806 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-08-10T17:34:36.806 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.807 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 361525 Links: 1 2022-08-10T17:34:36.807 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.807 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.807 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2022-08-10 17:34:29.761682516 +0000 2022-08-10T17:34:36.808 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2022-08-10 17:31:52.172537200 +0000 2022-08-10T17:34:36.808 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2022-08-10 17:31:52.172537200 +0000 2022-08-10T17:34:36.808 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2022-08-10T17:34:36.816 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2022-08-10T17:34:36.816 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2022-08-10T17:34:36.816 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000215323 s, 2.4 MB/s 2022-08-10T17:34:36.818 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:36.819 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:36.819 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/scratch_devs of=/dev/stdout 2022-08-10T17:34:36.837 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-08-10T17:34:36.837 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-08-10T17:34:36.894 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-08-10T17:34:36.895 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.895 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 348023 Links: 1 2022-08-10T17:34:36.895 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.896 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.896 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2022-08-10 17:34:32.165730390 +0000 2022-08-10T17:34:36.896 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2022-08-10 17:31:54.791686364 +0000 2022-08-10T17:34:36.897 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2022-08-10 17:31:54.791686364 +0000 2022-08-10T17:34:36.897 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2022-08-10T17:34:36.904 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2022-08-10T17:34:36.905 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2022-08-10T17:34:36.905 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000201383 s, 2.5 MB/s 2022-08-10T17:34:36.907 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-08-10T17:34:36.964 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-08-10T17:34:36.965 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:36.965 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 357533 Links: 1 2022-08-10T17:34:36.965 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:36.965 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:36.965 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2022-08-10 17:34:32.165730390 +0000 2022-08-10T17:34:36.966 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2022-08-10 17:31:55.327673048 +0000 2022-08-10T17:34:36.966 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2022-08-10 17:31:55.327673048 +0000 2022-08-10T17:34:36.966 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2022-08-10T17:34:36.974 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2022-08-10T17:34:36.974 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2022-08-10T17:34:36.975 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000229205 s, 2.2 MB/s 2022-08-10T17:34:36.977 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-08-10T17:34:37.034 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-08-10T17:34:37.034 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:37.035 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 357567 Links: 1 2022-08-10T17:34:37.035 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:37.035 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:37.035 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2022-08-10 17:34:32.165730390 +0000 2022-08-10T17:34:37.036 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2022-08-10 17:31:55.862659758 +0000 2022-08-10T17:34:37.036 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2022-08-10 17:31:55.862659758 +0000 2022-08-10T17:34:37.036 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2022-08-10T17:34:37.044 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2022-08-10T17:34:37.044 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2022-08-10T17:34:37.044 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000213983 s, 2.4 MB/s 2022-08-10T17:34:37.047 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-08-10T17:34:37.103 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-08-10T17:34:37.103 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-10T17:34:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 357613 Links: 1 2022-08-10T17:34:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:34:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2022-08-10T17:34:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2022-08-10 17:34:32.165730390 +0000 2022-08-10T17:34:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2022-08-10 17:31:56.408646194 +0000 2022-08-10T17:34:37.105 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2022-08-10 17:31:56.408646194 +0000 2022-08-10T17:34:37.105 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2022-08-10T17:34:37.112 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2022-08-10T17:34:37.113 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2022-08-10T17:34:37.113 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000193537 s, 2.6 MB/s 2022-08-10T17:34:37.115 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:37.115 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-08-10T17:34:37.116 INFO:tasks.ceph:Generating config... 2022-08-10T17:34:37.118 INFO:tasks.ceph:[client] client mount timeout = 600 2022-08-10T17:34:37.118 INFO:tasks.ceph:[client] debug client = 20 2022-08-10T17:34:37.118 INFO:tasks.ceph:[client] debug ms = 1 2022-08-10T17:34:37.119 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-08-10T17:34:37.119 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-08-10T17:34:37.119 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-08-10T17:34:37.120 INFO:tasks.ceph:[mds] debug mds = 20 2022-08-10T17:34:37.120 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-08-10T17:34:37.120 INFO:tasks.ceph:[mds] debug ms = 1 2022-08-10T17:34:37.120 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-08-10T17:34:37.121 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-08-10T17:34:37.121 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-08-10T17:34:37.121 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-08-10T17:34:37.122 INFO:tasks.ceph:[mds] mds debug frag = True 2022-08-10T17:34:37.122 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-08-10T17:34:37.123 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2022-08-10T17:34:37.123 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-08-10T17:34:37.123 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-08-10T17:34:37.123 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2022-08-10T17:34:37.124 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2022-08-10T17:34:37.124 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2022-08-10T17:34:37.125 INFO:tasks.ceph:[mds] ms inject delay max = 1 2022-08-10T17:34:37.125 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2022-08-10T17:34:37.125 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2022-08-10T17:34:37.126 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2022-08-10T17:34:37.126 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-08-10T17:34:37.126 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-08-10T17:34:37.127 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-08-10T17:34:37.127 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-08-10T17:34:37.127 INFO:tasks.ceph:[mgr] debug ms = 1 2022-08-10T17:34:37.128 INFO:tasks.ceph:[mon] debug mon = 20 2022-08-10T17:34:37.128 INFO:tasks.ceph:[mon] debug ms = 1 2022-08-10T17:34:37.128 INFO:tasks.ceph:[mon] debug paxos = 20 2022-08-10T17:34:37.129 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-08-10T17:34:37.129 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-08-10T17:34:37.129 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-08-10T17:34:37.130 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-08-10T17:34:37.130 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-08-10T17:34:37.130 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-08-10T17:34:37.131 INFO:tasks.ceph:[osd] debug ms = 1 2022-08-10T17:34:37.131 INFO:tasks.ceph:[osd] debug osd = 20 2022-08-10T17:34:37.131 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-08-10T17:34:37.131 INFO:tasks.ceph:[osd] filestore flush min = 0 2022-08-10T17:34:37.132 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2022-08-10T17:34:37.132 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-08-10T17:34:37.132 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-08-10T17:34:37.133 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-08-10T17:34:37.133 INFO:tasks.ceph:[osd] ms inject delay max = 1 2022-08-10T17:34:37.133 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2022-08-10T17:34:37.134 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2022-08-10T17:34:37.134 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2022-08-10T17:34:37.134 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2022-08-10T17:34:37.135 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-08-10T17:34:37.135 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2022-08-10T17:34:37.135 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-08-10T17:34:37.136 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-08-10T17:34:37.136 INFO:tasks.ceph:Setting up mon.a... 2022-08-10T17:34:37.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-08-10T17:34:37.188 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.keyring 2022-08-10T17:34:37.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-08-10T17:34:37.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-10T17:34:37.261 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.150'), ('mon.b', '172.21.15.197'), ('mon.c', '[v2:172.21.15.197:3301,v1:172.21.15.197:6790]')] 2022-08-10T17:34:37.262 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.150,172.21.15.197,[v2:172.21.15.197:3301,v1:172.21.15.197:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-08-10T17:34:37.263 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:37.264 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-08-10T17:34:37.318 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.150 --add b 172.21.15.197 --addv c '[v2:172.21.15.197:3301,v1:172.21.15.197:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:37.407 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:37.407 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: generated fsid 1038d638-5c3e-47f8-a696-c70f19144095 2022-08-10T17:34:37.408 INFO:teuthology.orchestra.run.smithi150.stdout:setting min_mon_release = octopus 2022-08-10T17:34:37.408 INFO:teuthology.orchestra.run.smithi150.stdout:epoch 0 2022-08-10T17:34:37.408 INFO:teuthology.orchestra.run.smithi150.stdout:fsid 1038d638-5c3e-47f8-a696-c70f19144095 2022-08-10T17:34:37.408 INFO:teuthology.orchestra.run.smithi150.stdout:last_changed 2022-08-10T17:34:37.404807+0000 2022-08-10T17:34:37.409 INFO:teuthology.orchestra.run.smithi150.stdout:created 2022-08-10T17:34:37.404807+0000 2022-08-10T17:34:37.409 INFO:teuthology.orchestra.run.smithi150.stdout:min_mon_release 15 (octopus) 2022-08-10T17:34:37.409 INFO:teuthology.orchestra.run.smithi150.stdout:election_strategy: 1 2022-08-10T17:34:37.409 INFO:teuthology.orchestra.run.smithi150.stdout:0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2022-08-10T17:34:37.410 INFO:teuthology.orchestra.run.smithi150.stdout:1: [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] mon.b 2022-08-10T17:34:37.410 INFO:teuthology.orchestra.run.smithi150.stdout:2: [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] mon.c 2022-08-10T17:34:37.410 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-08-10T17:34:37.412 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-08-10T17:34:37.428 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1038d638-5c3e-47f8-a696-c70f19144095... 2022-08-10T17:34:37.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-08-10T17:34:37.471 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-08-10T17:34:37.514 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2022-08-10T17:34:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2022-08-10T17:34:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-08-10T17:34:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2022-08-10T17:34:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2022-08-10T17:34:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2022-08-10T17:34:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2022-08-10T17:34:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2022-08-10T17:34:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2022-08-10T17:34:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2022-08-10T17:34:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2022-08-10T17:34:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2022-08-10T17:34:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2022-08-10T17:34:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2022-08-10T17:34:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2022-08-10T17:34:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2022-08-10T17:34:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2022-08-10T17:34:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2022-08-10T17:34:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2022-08-10T17:34:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2022-08-10T17:34:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2022-08-10T17:34:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2022-08-10T17:34:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-08-10T17:34:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2022-08-10T17:34:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2022-08-10T17:34:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-08-10T17:34:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2022-08-10T17:34:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2022-08-10T17:34:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2022-08-10T17:34:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2022-08-10T17:34:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2022-08-10T17:34:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.150,172.21.15.197,[v2:172.21.15.197:3301,v1:172.21.15.197:6790]" 2022-08-10T17:34:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2022-08-10T17:34:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 1038d638-5c3e-47f8-a696-c70f19144095 2022-08-10T17:34:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.525 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2022-08-10T17:34:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2022-08-10T17:34:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2022-08-10T17:34:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2022-08-10T17:34:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2022-08-10T17:34:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2022-08-10T17:34:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2022-08-10T17:34:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2022-08-10T17:34:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2022-08-10T17:34:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2022-08-10T17:34:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2022-08-10T17:34:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2022-08-10T17:34:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2022-08-10T17:34:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2022-08-10T17:34:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2022-08-10T17:34:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2022-08-10T17:34:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2022-08-10T17:34:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2022-08-10T17:34:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2022-08-10T17:34:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore compression mode = aggressive 2022-08-10T17:34:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2022-08-10T17:34:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2022-08-10T17:34:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2022-08-10T17:34:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2022-08-10T17:34:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2022-08-10T17:34:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2022-08-10T17:34:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: filestore flush min = 0 2022-08-10T17:34:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: mon client directed command retry = 5 2022-08-10T17:34:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2022-08-10T17:34:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2022-08-10T17:34:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2022-08-10T17:34:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay max = 1 2022-08-10T17:34:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay probability = 0.005 2022-08-10T17:34:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay type = client mds 2022-08-10T17:34:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject socket failures = 2500 2022-08-10T17:34:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: osd blocked scrub grace period = 3600 2022-08-10T17:34:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2022-08-10T17:34:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: osd max markdown count = 1000 2022-08-10T17:34:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2022-08-10T17:34:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2022-08-10T17:34:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.536 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2022-08-10T17:34:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2022-08-10T17:34:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2022-08-10T17:34:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2022-08-10T17:34:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2022-08-10T17:34:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2022-08-10T17:34:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2022-08-10T17:34:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2022-08-10T17:34:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.538 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2022-08-10T17:34:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2022-08-10T17:34:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2022-08-10T17:34:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2022-08-10T17:34:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2022-08-10T17:34:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2022-08-10T17:34:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2022-08-10T17:34:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2022-08-10T17:34:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2022-08-10T17:34:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2022-08-10T17:34:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2022-08-10T17:34:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-08-10T17:34:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2022-08-10T17:34:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2022-08-10T17:34:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2022-08-10T17:34:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-08-10T17:34:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-08-10T17:34:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2022-08-10T17:34:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2022-08-10T17:34:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2022-08-10T17:34:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2022-08-10T17:34:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:34:37.544 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2022-08-10T17:34:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2022-08-10T17:34:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2022-08-10T17:34:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2022-08-10T17:34:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-08-10T17:34:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-08-10T17:34:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2022-08-10T17:34:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2022-08-10T17:34:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2022-08-10T17:34:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2022-08-10T17:34:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2022-08-10T17:34:37.547 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2022-08-10T17:34:37.547 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2022-08-10T17:34:37.547 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2022-08-10T17:34:37.548 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2022-08-10T17:34:37.548 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2022-08-10T17:34:37.548 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.e] 2022-08-10T17:34:37.548 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2022-08-10T17:34:37.549 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2022-08-10T17:34:37.549 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.f] 2022-08-10T17:34:37.549 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2022-08-10T17:34:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2022-08-10T17:34:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2022-08-10T17:34:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2022-08-10T17:34:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal fragment size max = 10000 2022-08-10T17:34:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal merge size = 5 2022-08-10T17:34:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split bits = 3 2022-08-10T17:34:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split size = 100 2022-08-10T17:34:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2022-08-10T17:34:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2022-08-10T17:34:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: mds oft prefetch dirfrags = True 2022-08-10T17:34:37.552 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2022-08-10T17:34:37.552 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2022-08-10T17:34:37.552 INFO:teuthology.orchestra.run.smithi150.stdout: mds_dir_prefetch = True 2022-08-10T17:34:37.552 INFO:teuthology.orchestra.run.smithi150.stdout: mds_sleep_rank_change = 5000000.0 2022-08-10T17:34:37.552 INFO:teuthology.orchestra.run.smithi150.stdout: mon client directed command retry = 5 2022-08-10T17:34:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay max = 1 2022-08-10T17:34:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay probability = 0.005 2022-08-10T17:34:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject delay type = client mds osd 2022-08-10T17:34:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject socket failures = 2500 2022-08-10T17:34:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2022-08-10T17:34:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2022-08-10T17:34:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2022-08-10T17:34:37.556 INFO:teuthology.orchestra.run.smithi197.stdout:[global] 2022-08-10T17:34:37.556 INFO:teuthology.orchestra.run.smithi197.stdout: chdir = "" 2022-08-10T17:34:37.557 INFO:teuthology.orchestra.run.smithi197.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-08-10T17:34:37.557 INFO:teuthology.orchestra.run.smithi197.stdout: auth supported = cephx 2022-08-10T17:34:37.557 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.557 INFO:teuthology.orchestra.run.smithi197.stdout: filestore xattr use omap = true 2022-08-10T17:34:37.558 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.558 INFO:teuthology.orchestra.run.smithi197.stdout: mon clock drift allowed = 1.000 2022-08-10T17:34:37.558 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.558 INFO:teuthology.orchestra.run.smithi197.stdout: osd crush chooseleaf type = 0 2022-08-10T17:34:37.558 INFO:teuthology.orchestra.run.smithi197.stdout: auth debug = true 2022-08-10T17:34:37.559 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.559 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on old message = true 2022-08-10T17:34:37.559 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on bug = true 2022-08-10T17:34:37.559 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.560 INFO:teuthology.orchestra.run.smithi197.stdout: mon max pg per osd = 10000 # >= luminous 2022-08-10T17:34:37.560 INFO:teuthology.orchestra.run.smithi197.stdout: mon pg warn max object skew = 0 2022-08-10T17:34:37.560 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.560 INFO:teuthology.orchestra.run.smithi197.stdout: # disable pg_autoscaler by default for new pools 2022-08-10T17:34:37.560 INFO:teuthology.orchestra.run.smithi197.stdout: osd_pool_default_pg_autoscale_mode = off 2022-08-10T17:34:37.561 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.561 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default size = 2 2022-08-10T17:34:37.561 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.561 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow primary affinity = true 2022-08-10T17:34:37.562 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow pg remap = true 2022-08-10T17:34:37.562 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on legacy crush tunables = false 2022-08-10T17:34:37.562 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on crush straw calc version zero = false 2022-08-10T17:34:37.562 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on no sortbitwise = false 2022-08-10T17:34:37.562 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on osd down out interval zero = false 2022-08-10T17:34:37.563 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on too few osds = false 2022-08-10T17:34:37.563 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-08-10T17:34:37.563 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_no_redundancy = false 2022-08-10T17:34:37.563 INFO:teuthology.orchestra.run.smithi197.stdout: mon_allow_pool_size_one = true 2022-08-10T17:34:37.564 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.564 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-08-10T17:34:37.564 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.564 INFO:teuthology.orchestra.run.smithi197.stdout: osd default data pool replay window = 5 2022-08-10T17:34:37.565 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.565 INFO:teuthology.orchestra.run.smithi197.stdout: mon allow pool delete = true 2022-08-10T17:34:37.565 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.565 INFO:teuthology.orchestra.run.smithi197.stdout: mon cluster log file level = debug 2022-08-10T17:34:37.566 INFO:teuthology.orchestra.run.smithi197.stdout: debug asserts on shutdown = true 2022-08-10T17:34:37.566 INFO:teuthology.orchestra.run.smithi197.stdout: mon health detail to clog = false 2022-08-10T17:34:37.566 INFO:teuthology.orchestra.run.smithi197.stdout: mon host = "172.21.15.150,172.21.15.197,[v2:172.21.15.197:3301,v1:172.21.15.197:6790]" 2022-08-10T17:34:37.566 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on skipped message = False 2022-08-10T17:34:37.567 INFO:teuthology.orchestra.run.smithi197.stdout: fsid = 1038d638-5c3e-47f8-a696-c70f19144095 2022-08-10T17:34:37.567 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.567 INFO:teuthology.orchestra.run.smithi197.stdout:[osd] 2022-08-10T17:34:37.567 INFO:teuthology.orchestra.run.smithi197.stdout: osd journal size = 100 2022-08-10T17:34:37.567 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.568 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub load threshold = 5.0 2022-08-10T17:34:37.568 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub max interval = 600 2022-08-10T17:34:37.568 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.568 INFO:teuthology.orchestra.run.smithi197.stdout: osd recover clone overlap = true 2022-08-10T17:34:37.569 INFO:teuthology.orchestra.run.smithi197.stdout: osd recovery max chunk = 1048576 2022-08-10T17:34:37.569 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.569 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug shutdown = true 2022-08-10T17:34:37.569 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug op order = true 2022-08-10T17:34:37.569 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug verify stray on activate = true 2022-08-10T17:34:37.570 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.570 INFO:teuthology.orchestra.run.smithi197.stdout: osd open classes on start = true 2022-08-10T17:34:37.570 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug pg log writeout = true 2022-08-10T17:34:37.570 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.571 INFO:teuthology.orchestra.run.smithi197.stdout: osd deep scrub update digest min age = 30 2022-08-10T17:34:37.571 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.571 INFO:teuthology.orchestra.run.smithi197.stdout: osd map max advance = 10 2022-08-10T17:34:37.571 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.571 INFO:teuthology.orchestra.run.smithi197.stdout: journal zero on create = true 2022-08-10T17:34:37.572 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.572 INFO:teuthology.orchestra.run.smithi197.stdout: filestore ondisk finisher threads = 3 2022-08-10T17:34:37.572 INFO:teuthology.orchestra.run.smithi197.stdout: filestore apply finisher threads = 3 2022-08-10T17:34:37.572 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.573 INFO:teuthology.orchestra.run.smithi197.stdout: bdev debug aio = true 2022-08-10T17:34:37.573 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug misdirected ops = true 2022-08-10T17:34:37.573 INFO:teuthology.orchestra.run.smithi197.stdout: bluestore block size = 96636764160 2022-08-10T17:34:37.573 INFO:teuthology.orchestra.run.smithi197.stdout: bluestore compression mode = aggressive 2022-08-10T17:34:37.573 INFO:teuthology.orchestra.run.smithi197.stdout: bluestore fsck on mount = True 2022-08-10T17:34:37.574 INFO:teuthology.orchestra.run.smithi197.stdout: debug bluefs = 20 2022-08-10T17:34:37.574 INFO:teuthology.orchestra.run.smithi197.stdout: debug bluestore = 20 2022-08-10T17:34:37.574 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2022-08-10T17:34:37.574 INFO:teuthology.orchestra.run.smithi197.stdout: debug osd = 20 2022-08-10T17:34:37.575 INFO:teuthology.orchestra.run.smithi197.stdout: debug rocksdb = 10 2022-08-10T17:34:37.575 INFO:teuthology.orchestra.run.smithi197.stdout: filestore flush min = 0 2022-08-10T17:34:37.575 INFO:teuthology.orchestra.run.smithi197.stdout: mon client directed command retry = 5 2022-08-10T17:34:37.576 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd backfillfull_ratio = 0.85 2022-08-10T17:34:37.576 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd full ratio = 0.9 2022-08-10T17:34:37.576 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd nearfull ratio = 0.8 2022-08-10T17:34:37.576 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay max = 1 2022-08-10T17:34:37.577 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay probability = 0.005 2022-08-10T17:34:37.577 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay type = client mds 2022-08-10T17:34:37.577 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject socket failures = 2500 2022-08-10T17:34:37.577 INFO:teuthology.orchestra.run.smithi197.stdout: osd blocked scrub grace period = 3600 2022-08-10T17:34:37.577 INFO:teuthology.orchestra.run.smithi197.stdout: osd failsafe full ratio = 0.95 2022-08-10T17:34:37.578 INFO:teuthology.orchestra.run.smithi197.stdout: osd max markdown count = 1000 2022-08-10T17:34:37.578 INFO:teuthology.orchestra.run.smithi197.stdout: osd objectstore = bluestore 2022-08-10T17:34:37.578 INFO:teuthology.orchestra.run.smithi197.stdout: osd op complaint time = 180 2022-08-10T17:34:37.578 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.578 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr] 2022-08-10T17:34:37.579 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2022-08-10T17:34:37.579 INFO:teuthology.orchestra.run.smithi197.stdout: debug mgr = 20 2022-08-10T17:34:37.579 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2022-08-10T17:34:37.579 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2022-08-10T17:34:37.580 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2022-08-10T17:34:37.580 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2022-08-10T17:34:37.580 INFO:teuthology.orchestra.run.smithi197.stdout: mgr/telemetry/nag = false 2022-08-10T17:34:37.580 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.580 INFO:teuthology.orchestra.run.smithi197.stdout:[mon] 2022-08-10T17:34:37.581 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2022-08-10T17:34:37.581 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2022-08-10T17:34:37.581 INFO:teuthology.orchestra.run.smithi197.stdout: debug paxos = 20 2022-08-10T17:34:37.581 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2022-08-10T17:34:37.582 INFO:teuthology.orchestra.run.smithi197.stdout: mon data avail warn = 5 2022-08-10T17:34:37.582 INFO:teuthology.orchestra.run.smithi197.stdout: mon mgr mkfs grace = 240 2022-08-10T17:34:37.582 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2022-08-10T17:34:37.582 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd reporter subtree level = osd 2022-08-10T17:34:37.583 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd prime pg temp = true 2022-08-10T17:34:37.583 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2022-08-10T17:34:37.583 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.583 INFO:teuthology.orchestra.run.smithi197.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-08-10T17:34:37.583 INFO:teuthology.orchestra.run.smithi197.stdout: auth mon ticket ttl = 660 # 11m 2022-08-10T17:34:37.584 INFO:teuthology.orchestra.run.smithi197.stdout: auth service ticket ttl = 240 # 4m 2022-08-10T17:34:37.584 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.584 INFO:teuthology.orchestra.run.smithi197.stdout: # don't complain about insecure global_id in the test suite 2022-08-10T17:34:37.584 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-08-10T17:34:37.585 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-08-10T17:34:37.585 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.585 INFO:teuthology.orchestra.run.smithi197.stdout: # 1m isn't quite enough 2022-08-10T17:34:37.585 INFO:teuthology.orchestra.run.smithi197.stdout: mon_down_mkfs_grace = 2m 2022-08-10T17:34:37.586 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.586 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_filestore_osds = false 2022-08-10T17:34:37.586 INFO:teuthology.orchestra.run.smithi197.stdout: mon op complaint time = 120 2022-08-10T17:34:37.586 INFO:teuthology.orchestra.run.smithi197.stdout: 2022-08-10T17:34:37.587 INFO:teuthology.orchestra.run.smithi197.stdout:[client] 2022-08-10T17:34:37.587 INFO:teuthology.orchestra.run.smithi197.stdout: rgw cache enabled = true 2022-08-10T17:34:37.587 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable ops log = true 2022-08-10T17:34:37.587 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable usage log = true 2022-08-10T17:34:37.587 INFO:teuthology.orchestra.run.smithi197.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-08-10T17:34:37.588 INFO:teuthology.orchestra.run.smithi197.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-08-10T17:34:37.588 INFO:teuthology.orchestra.run.smithi197.stdout: client mount timeout = 600 2022-08-10T17:34:37.588 INFO:teuthology.orchestra.run.smithi197.stdout: debug client = 20 2022-08-10T17:34:37.588 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2022-08-10T17:34:37.589 INFO:teuthology.orchestra.run.smithi197.stdout: rados mon op timeout = 900 2022-08-10T17:34:37.589 INFO:teuthology.orchestra.run.smithi197.stdout: rados osd op timeout = 900 2022-08-10T17:34:37.589 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.a] 2022-08-10T17:34:37.589 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.b] 2022-08-10T17:34:37.589 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.c] 2022-08-10T17:34:37.590 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.a] 2022-08-10T17:34:37.590 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.c] 2022-08-10T17:34:37.590 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.e] 2022-08-10T17:34:37.590 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.b] 2022-08-10T17:34:37.591 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.d] 2022-08-10T17:34:37.591 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.f] 2022-08-10T17:34:37.591 INFO:teuthology.orchestra.run.smithi197.stdout:[mds] 2022-08-10T17:34:37.591 INFO:teuthology.orchestra.run.smithi197.stdout: debug mds = 20 2022-08-10T17:34:37.591 INFO:teuthology.orchestra.run.smithi197.stdout: debug mds balancer = 20 2022-08-10T17:34:37.592 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2022-08-10T17:34:37.592 INFO:teuthology.orchestra.run.smithi197.stdout: mds bal fragment size max = 10000 2022-08-10T17:34:37.592 INFO:teuthology.orchestra.run.smithi197.stdout: mds bal merge size = 5 2022-08-10T17:34:37.592 INFO:teuthology.orchestra.run.smithi197.stdout: mds bal split bits = 3 2022-08-10T17:34:37.592 INFO:teuthology.orchestra.run.smithi197.stdout: mds bal split size = 100 2022-08-10T17:34:37.593 INFO:teuthology.orchestra.run.smithi197.stdout: mds debug frag = True 2022-08-10T17:34:37.593 INFO:teuthology.orchestra.run.smithi197.stdout: mds debug scatterstat = True 2022-08-10T17:34:37.593 INFO:teuthology.orchestra.run.smithi197.stdout: mds oft prefetch dirfrags = True 2022-08-10T17:34:37.593 INFO:teuthology.orchestra.run.smithi197.stdout: mds op complaint time = 180 2022-08-10T17:34:37.594 INFO:teuthology.orchestra.run.smithi197.stdout: mds verify scatter = True 2022-08-10T17:34:37.594 INFO:teuthology.orchestra.run.smithi197.stdout: mds_dir_prefetch = True 2022-08-10T17:34:37.594 INFO:teuthology.orchestra.run.smithi197.stdout: mds_sleep_rank_change = 5000000.0 2022-08-10T17:34:37.594 INFO:teuthology.orchestra.run.smithi197.stdout: mon client directed command retry = 5 2022-08-10T17:34:37.594 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay max = 1 2022-08-10T17:34:37.595 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay probability = 0.005 2022-08-10T17:34:37.595 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject delay type = client mds osd 2022-08-10T17:34:37.595 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject socket failures = 2500 2022-08-10T17:34:37.595 INFO:teuthology.orchestra.run.smithi197.stdout: osd op complaint time = 180 2022-08-10T17:34:37.596 INFO:teuthology.orchestra.run.smithi197.stdout: rados mon op timeout = 900 2022-08-10T17:34:37.596 INFO:teuthology.orchestra.run.smithi197.stdout: rados osd op timeout = 900 2022-08-10T17:34:37.596 INFO:tasks.ceph:Creating admin key on mon.a... 2022-08-10T17:34:37.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-08-10T17:34:37.653 INFO:tasks.ceph:Copying monmap to all nodes... 2022-08-10T17:34:37.654 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:37.654 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-08-10T17:34:37.671 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:37.672 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-08-10T17:34:37.728 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:34:37.728 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:37.729 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2022-08-10T17:34:37.729 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-10T17:34:37.803 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:34:37.804 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:37.860 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:34:37.861 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:37.861 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/ceph/ceph.keyring 2022-08-10T17:34:37.861 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-10T17:34:37.898 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:34:37.899 DEBUG:teuthology.orchestra.run.smithi197:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:37.955 INFO:tasks.ceph:Setting up mon nodes... 2022-08-10T17:34:37.956 INFO:tasks.ceph:Setting up mgr nodes... 2022-08-10T17:34:37.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-08-10T17:34:38.009 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-08-10T17:34:38.012 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-08-10T17:34:38.076 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-08-10T17:34:38.079 INFO:tasks.ceph:Setting up mds nodes... 2022-08-10T17:34:38.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-08-10T17:34:38.133 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-08-10T17:34:38.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-08-10T17:34:38.162 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-08-10T17:34:38.255 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-08-10T17:34:38.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-08-10T17:34:38.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-08-10T17:34:38.377 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-08-10T17:34:38.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-08-10T17:34:38.407 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-08-10T17:34:38.462 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-08-10T17:34:38.465 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-08-10T17:34:38.491 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-08-10T17:34:38.584 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-08-10T17:34:38.587 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-08-10T17:34:38.613 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-08-10T17:34:38.707 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-08-10T17:34:38.709 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-08-10T17:34:38.736 INFO:tasks.ceph_client:Setting up client nodes... 2022-08-10T17:34:38.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-08-10T17:34:38.783 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-08-10T17:34:38.796 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-08-10T17:34:38.796 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-08-10T17:34:38.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-08-10T17:34:38.824 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:38.824 INFO:tasks.ceph:role: osd.0 2022-08-10T17:34:38.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:34:38.825 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-08-10T17:34:38.898 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:38.898 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:38.899 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:38.899 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:38.899 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:38.899 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:38.900 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:38.900 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:38.900 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:38.901 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:39.330 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2022-08-10T17:34:39.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2022-08-10T17:34:39.332 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-08-10T17:34:39.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-08-10T17:34:39.539 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-08-10T17:34:39.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:39.607 INFO:tasks.ceph:role: osd.1 2022-08-10T17:34:39.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:34:39.608 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-08-10T17:34:39.681 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:39.681 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:39.682 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:39.682 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:39.682 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:39.682 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:39.683 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:39.683 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:39.683 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:39.683 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:40.107 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2022-08-10T17:34:40.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2022-08-10T17:34:40.109 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-08-10T17:34:40.214 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-08-10T17:34:40.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-08-10T17:34:40.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:40.313 INFO:tasks.ceph:role: osd.2 2022-08-10T17:34:40.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:34:40.313 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-08-10T17:34:40.386 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:40.387 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:40.387 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:40.387 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:40.387 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:40.388 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:40.388 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:40.388 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:40.388 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:40.389 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:40.827 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2022-08-10T17:34:40.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2022-08-10T17:34:40.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-08-10T17:34:40.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-08-10T17:34:41.052 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-08-10T17:34:41.120 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:41.121 INFO:tasks.ceph:role: osd.3 2022-08-10T17:34:41.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:34:41.122 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-08-10T17:34:41.195 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:41.196 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:41.196 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:41.197 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:41.197 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:41.198 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:41.198 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:41.199 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:41.199 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:41.200 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:41.627 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2022-08-10T17:34:41.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2022-08-10T17:34:41.630 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-08-10T17:34:41.803 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-08-10T17:34:41.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.923+0000 7fddbe0e4440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-08-10T17:34:41.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.923+0000 7fddbe0e4440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-08-10T17:34:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.923+0000 7fddbe0e4440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-10T17:34:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.923+0000 7fddbe0e4440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-10T17:34:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.923+0000 7fddbe0e4440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-10T17:34:41.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:41.924+0000 7fddbe0e4440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-08-10T17:34:44.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-08-10T17:34:44.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:44.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.941+0000 7fe921310440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-08-10T17:34:44.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.942+0000 7fe921310440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-08-10T17:34:44.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.942+0000 7fe921310440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-10T17:34:44.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.942+0000 7fe921310440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-10T17:34:44.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.942+0000 7fe921310440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-10T17:34:44.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:44.942+0000 7fe921310440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-08-10T17:34:47.796 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-08-10T17:34:47.828 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:47.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.914+0000 7fdc09796440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-08-10T17:34:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.914+0000 7fdc09796440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-08-10T17:34:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.914+0000 7fdc09796440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-10T17:34:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.914+0000 7fdc09796440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-10T17:34:47.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.914+0000 7fdc09796440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-10T17:34:47.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:47.915+0000 7fdc09796440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-08-10T17:34:50.783 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-08-10T17:34:50.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:50.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.908+0000 7ff0184c6440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-08-10T17:34:50.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.909+0000 7ff0184c6440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-08-10T17:34:50.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.909+0000 7ff0184c6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-10T17:34:50.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.909+0000 7ff0184c6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-10T17:34:50.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.909+0000 7ff0184c6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-10T17:34:50.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:34:50.909+0000 7ff0184c6440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-08-10T17:34:53.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-08-10T17:34:53.805 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-08-10T17:34:53.838 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:53.838 INFO:tasks.ceph:role: osd.4 2022-08-10T17:34:53.839 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:34:53.839 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-08-10T17:34:53.916 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:53.917 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:53.917 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:53.917 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:53.917 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:53.918 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:53.918 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:53.918 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:53.918 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:53.918 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:54.358 INFO:teuthology.orchestra.run.smithi197.stdout:Discarding blocks...Done. 2022-08-10T17:34:54.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2022-08-10T17:34:54.360 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-08-10T17:34:54.553 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-08-10T17:34:54.592 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-08-10T17:34:54.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:54.663 INFO:tasks.ceph:role: osd.5 2022-08-10T17:34:54.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:34:54.664 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-08-10T17:34:54.739 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:54.739 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:54.740 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:54.741 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:54.741 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:54.741 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:54.741 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:54.742 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:54.742 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:54.742 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:55.148 INFO:teuthology.orchestra.run.smithi197.stdout:Discarding blocks...Done. 2022-08-10T17:34:55.150 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2022-08-10T17:34:55.151 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-08-10T17:34:55.267 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-08-10T17:34:55.301 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-08-10T17:34:55.370 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:55.370 INFO:tasks.ceph:role: osd.6 2022-08-10T17:34:55.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:34:55.371 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-08-10T17:34:55.446 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:55.446 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:55.446 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:55.447 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:55.447 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:55.447 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:55.447 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:55.448 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:55.448 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:55.448 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:55.888 INFO:teuthology.orchestra.run.smithi197.stdout:Discarding blocks...Done. 2022-08-10T17:34:55.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2022-08-10T17:34:55.890 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-08-10T17:34:56.034 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-08-10T17:34:56.067 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-08-10T17:34:56.136 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-10T17:34:56.136 INFO:tasks.ceph:role: osd.7 2022-08-10T17:34:56.137 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:34:56.137 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-08-10T17:34:56.212 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-08-10T17:34:56.213 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-10T17:34:56.213 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-10T17:34:56.214 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-10T17:34:56.214 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-10T17:34:56.214 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2022-08-10T17:34:56.215 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-10T17:34:56.215 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-10T17:34:56.216 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-10T17:34:56.216 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-10T17:34:56.658 INFO:teuthology.orchestra.run.smithi197.stdout:Discarding blocks...Done. 2022-08-10T17:34:56.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2022-08-10T17:34:56.660 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-08-10T17:34:56.840 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-08-10T17:34:56.877 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:56.967 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.963+0000 7fcdd7607440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-08-10T17:34:56.967 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.964+0000 7fcdd7607440 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-08-10T17:34:56.968 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.964+0000 7fcdd7607440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-10T17:34:56.968 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.964+0000 7fcdd7607440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-10T17:34:56.968 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.964+0000 7fcdd7607440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-10T17:34:56.968 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:56.964+0000 7fcdd7607440 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-08-10T17:34:59.829 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-08-10T17:34:59.860 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:34:59.950 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.947+0000 7f6fd6074440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-08-10T17:34:59.951 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.947+0000 7f6fd6074440 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-08-10T17:34:59.951 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.947+0000 7f6fd6074440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-10T17:34:59.951 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.947+0000 7f6fd6074440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-10T17:34:59.952 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.947+0000 7f6fd6074440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-10T17:34:59.952 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:34:59.948+0000 7f6fd6074440 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-08-10T17:35:02.809 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-08-10T17:35:02.841 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:35:02.934 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.930+0000 7fd6e0d76440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-08-10T17:35:02.935 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.930+0000 7fd6e0d76440 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-08-10T17:35:02.935 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.930+0000 7fd6e0d76440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-10T17:35:02.935 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.930+0000 7fd6e0d76440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-10T17:35:02.935 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.930+0000 7fd6e0d76440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-10T17:35:02.936 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:02.931+0000 7fd6e0d76440 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-08-10T17:35:05.791 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-08-10T17:35:05.823 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:35:05.914 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.910+0000 7f8a721f3440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-08-10T17:35:05.915 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.910+0000 7f8a721f3440 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-08-10T17:35:05.915 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.910+0000 7f8a721f3440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-10T17:35:05.915 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.910+0000 7f8a721f3440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-10T17:35:05.915 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.910+0000 7f8a721f3440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-10T17:35:05.916 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:05.911+0000 7f8a721f3440 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-08-10T17:35:06.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:35:06.403 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:35:08.785 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-08-10T17:35:08.817 INFO:tasks.ceph:Reading keys from all nodes... 2022-08-10T17:35:08.818 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:08.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-08-10T17:35:08.850 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:08.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-08-10T17:35:08.921 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:08.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-08-10T17:35:08.990 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:08.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2022-08-10T17:35:09.059 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:09.059 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-08-10T17:35:09.129 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:09.129 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-08-10T17:35:09.198 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:09.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-08-10T17:35:09.267 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:09.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-08-10T17:35:09.335 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.336 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-08-10T17:35:09.368 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.369 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-08-10T17:35:09.438 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.439 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-08-10T17:35:09.508 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.509 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2022-08-10T17:35:09.577 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.578 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-08-10T17:35:09.645 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.646 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-08-10T17:35:09.715 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.715 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-08-10T17:35:09.788 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:09.788 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-08-10T17:35:09.855 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:09.856 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-08-10T17:35:09.877 INFO:tasks.ceph:Adding keys to all mons... 2022-08-10T17:35:09.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2022-08-10T17:35:09.920 DEBUG:teuthology.orchestra.run.smithi197:> sudo tee -a /etc/ceph/ceph.keyring 2022-08-10T17:35:09.946 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr.y] 2022-08-10T17:35:09.947 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNi2SpxABAALkMrQQ2ZqhNKh1ety9xksQ== 2022-08-10T17:35:09.947 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.a] 2022-08-10T17:35:09.947 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNiPXXPBxAA5JOy7Bx+k3mN3dnJJLd03g== 2022-08-10T17:35:09.947 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.c] 2022-08-10T17:35:09.948 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNiGRMWDxAAsUxq+ITW/IZWQMhhCQZ6Lg== 2022-08-10T17:35:09.948 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.e] 2022-08-10T17:35:09.948 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNibhZdFhAAZeH/d0vHVXMpabhUpiD6QQ== 2022-08-10T17:35:09.948 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.0] 2022-08-10T17:35:09.949 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAx7PNiEZ0cNxAAD9A7thnWh1NkwsfCcIjKaA== 2022-08-10T17:35:09.949 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.1] 2022-08-10T17:35:09.949 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQA07PNiVSY3OBAACWSlRk6TBbr6APG4Cks++Q== 2022-08-10T17:35:09.949 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.2] 2022-08-10T17:35:09.950 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQA37PNit2uTNhAAfM7J9vlJFkFfgrysawfIsw== 2022-08-10T17:35:09.950 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.3] 2022-08-10T17:35:09.950 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQA67PNilVs8NhAAXVrwHRLweodR7l2bfegySw== 2022-08-10T17:35:09.950 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr.x] 2022-08-10T17:35:09.951 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNi51lwBBAArWePHVpbPF0T4zcDy4jltw== 2022-08-10T17:35:09.951 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.b] 2022-08-10T17:35:09.951 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNieCRqGxAAYxMLGQzQ8dSTstDV5jH+rA== 2022-08-10T17:35:09.951 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.d] 2022-08-10T17:35:09.952 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNigDGzIhAAAquBwfS4f6xpMTT4v7bJoA== 2022-08-10T17:35:09.952 INFO:teuthology.orchestra.run.smithi197.stdout:[mds.f] 2022-08-10T17:35:09.952 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNiY+gBKhAAFK+f2HXznXLTIRP+xCwwMg== 2022-08-10T17:35:09.952 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.4] 2022-08-10T17:35:09.953 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBA7PNiZw14ORAAMCzCb2658SUqniQ6YR2hVw== 2022-08-10T17:35:09.953 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.5] 2022-08-10T17:35:09.953 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBD7PNiLlp+OBAAKf7blmmsMDQvJnA1lnNm+w== 2022-08-10T17:35:09.953 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.6] 2022-08-10T17:35:09.953 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBG7PNi4e2HNxAAn7Wy5Z7h5dLpctJLrpJUig== 2022-08-10T17:35:09.954 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.7] 2022-08-10T17:35:09.954 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBJ7PNieNZYNhAAc4GvAO+zadyKyYzmHYWs/g== 2022-08-10T17:35:09.954 INFO:teuthology.orchestra.run.smithi197.stdout:[client.0] 2022-08-10T17:35:09.954 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAu7PNiy5qGLhAA8fZuEzDVT5RV/6ZOFx/CEg== 2022-08-10T17:35:09.957 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2022-08-10T17:35:09.957 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNi2SpxABAALkMrQQ2ZqhNKh1ety9xksQ== 2022-08-10T17:35:09.958 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2022-08-10T17:35:09.958 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNiPXXPBxAA5JOy7Bx+k3mN3dnJJLd03g== 2022-08-10T17:35:09.958 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2022-08-10T17:35:09.958 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNiGRMWDxAAsUxq+ITW/IZWQMhhCQZ6Lg== 2022-08-10T17:35:09.959 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.e] 2022-08-10T17:35:09.959 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNibhZdFhAAZeH/d0vHVXMpabhUpiD6QQ== 2022-08-10T17:35:09.959 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2022-08-10T17:35:09.959 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAx7PNiEZ0cNxAAD9A7thnWh1NkwsfCcIjKaA== 2022-08-10T17:35:09.960 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2022-08-10T17:35:09.960 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA07PNiVSY3OBAACWSlRk6TBbr6APG4Cks++Q== 2022-08-10T17:35:09.960 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2022-08-10T17:35:09.960 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA37PNit2uTNhAAfM7J9vlJFkFfgrysawfIsw== 2022-08-10T17:35:09.961 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2022-08-10T17:35:09.961 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA67PNilVs8NhAAXVrwHRLweodR7l2bfegySw== 2022-08-10T17:35:09.961 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2022-08-10T17:35:09.961 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNi51lwBBAArWePHVpbPF0T4zcDy4jltw== 2022-08-10T17:35:09.962 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2022-08-10T17:35:09.962 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNieCRqGxAAYxMLGQzQ8dSTstDV5jH+rA== 2022-08-10T17:35:09.962 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2022-08-10T17:35:09.962 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNigDGzIhAAAquBwfS4f6xpMTT4v7bJoA== 2022-08-10T17:35:09.963 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.f] 2022-08-10T17:35:09.963 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNiY+gBKhAAFK+f2HXznXLTIRP+xCwwMg== 2022-08-10T17:35:09.963 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2022-08-10T17:35:09.963 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBA7PNiZw14ORAAMCzCb2658SUqniQ6YR2hVw== 2022-08-10T17:35:09.964 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2022-08-10T17:35:09.964 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBD7PNiLlp+OBAAKf7blmmsMDQvJnA1lnNm+w== 2022-08-10T17:35:09.964 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2022-08-10T17:35:09.964 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBG7PNi4e2HNxAAn7Wy5Z7h5dLpctJLrpJUig== 2022-08-10T17:35:09.965 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2022-08-10T17:35:09.965 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBJ7PNieNZYNhAAc4GvAO+zadyKyYzmHYWs/g== 2022-08-10T17:35:09.965 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2022-08-10T17:35:09.965 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAu7PNiy5qGLhAA8fZuEzDVT5RV/6ZOFx/CEg== 2022-08-10T17:35:09.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-10T17:35:10.000 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-10T17:35:10.055 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.058 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.117 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.173 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.176 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.232 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.236 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.289 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.291 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.347 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.402 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-10T17:35:10.457 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-10T17:35:10.509 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.512 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.567 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.570 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.630 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-08-10T17:35:10.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.688 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.744 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.799 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.852 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.855 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-10T17:35:10.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-10T17:35:10.910 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-10T17:35:10.965 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-08-10T17:35:10.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-08-10T17:35:10.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-10T17:35:11.090 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-08-10T17:35:11.117 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-08-10T17:35:11.144 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-10T17:35:11.241 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-08-10T17:35:11.268 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-08-10T17:35:11.335 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-10T17:35:11.433 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-08-10T17:35:11.460 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:35:11.463 DEBUG:teuthology.orchestra.run.smithi197:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-08-10T17:35:11.517 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-08-10T17:35:11.518 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:35:11.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:35:11.521 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:35:11.521 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-10T17:35:11.522 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-10T17:35:11.560 INFO:tasks.ceph.mon.b:Started 2022-08-10T17:35:11.560 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:35:11.561 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:35:11.563 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:35:11.563 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-08-10T17:35:11.564 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-08-10T17:35:11.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-08-10T17:35:11.566 INFO:tasks.ceph.mgr.y:Started 2022-08-10T17:35:11.567 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-08-10T17:35:11.567 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-08-10T17:35:11.569 INFO:tasks.ceph.mgr.x:Started 2022-08-10T17:35:11.570 INFO:tasks.ceph:Setting crush tunables to default 2022-08-10T17:35:11.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd crush tunables default 2022-08-10T17:35:11.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.689+0000 7f3f83133700 1 Processor -- start 2022-08-10T17:35:11.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.689+0000 7f3f83133700 1 -- start start 2022-08-10T17:35:11.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f83133700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 0x7f3f7c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f83133700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0c4dc0 con 0x7f3f7c150af0 2022-08-10T17:35:11.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f83133700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0c5940 con 0x7f3f7c15a570 2022-08-10T17:35:11.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f83133700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c0c9fc0 con 0x7f3f7c06c860 2022-08-10T17:35:11.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f7bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 0x7f3f7c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f80ecf700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3f7c150af0 0x7f3f7c159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41330/0 (socket says 172.21.15.150:41330) 2022-08-10T17:35:11.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f80ecf700 1 -- 172.21.15.150:0/1650980030 learned_addr learned my addr 172.21.15.150:0/1650980030 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:11.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f7bfff700 1 -- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 msgr2=0x7f3f7c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:35:11.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f7bfff700 1 -- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 msgr2=0x7f3f7c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:35:11.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.690+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 0x7f3f7c0c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:35:11.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.691+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 0x7f3f7c0c3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:35:11.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690605116 0 0) 0x7f3f7c0c4dc0 con 0x7f3f7c150af0 2022-08-10T17:35:11.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f60003430 con 0x7f3f7c150af0 2022-08-10T17:35:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153514761 0 0) 0x7f3f60003430 con 0x7f3f7c150af0 2022-08-10T17:35:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 msgr2=0x7f3f7c0c3ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:35:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 --2- 172.21.15.150:0/1650980030 >> v2:172.21.15.150:3300/0 conn(0x7f3f7c06c860 0x7f3f7c0c3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 >> v1:172.21.15.197:6789/0 conn(0x7f3f7c15a570 legacy=0x7f3f7c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c06f9a0 con 0x7f3f7c150af0 2022-08-10T17:35:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f3f70001670 con 0x7f3f7c150af0 2022-08-10T17:35:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 >> v1:172.21.15.150:6789/0 conn(0x7f3f7c150af0 legacy=0x7f3f7c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f60003880 0x7f3f60003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 0x7f3f60004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.869+0000 7f3f7b7fe700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600051a0 0x7f3f6000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0c9fc0 con 0x7f3f600046d0 2022-08-10T17:35:11.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6000c060 con 0x7f3f60003880 2022-08-10T17:35:11.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6000c220 con 0x7f3f600051a0 2022-08-10T17:35:11.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 0x7f3f60004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f80ecf700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f60003880 0x7f3f60003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f816d0700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600051a0 0x7f3f6000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 -- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600051a0 msgr2=0x7f3f6000b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:11.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600051a0 0x7f3f6000b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 -- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f60003880 msgr2=0x7f3f60003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:11.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f60003880 0x7f3f60003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 -- 172.21.15.150:0/1650980030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60003430 con 0x7f3f600046d0 2022-08-10T17:35:11.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f816d0700 1 -- 172.21.15.150:0/1650980030 reap_dead start 2022-08-10T17:35:11.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 0x7f3f60004b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800b8f0 tx=0x7f3f60005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4e98b71ae35c1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:11.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68018070 con 0x7f3f600046d0 2022-08-10T17:35:11.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68004020 con 0x7f3f600046d0 2022-08-10T17:35:11.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.870+0000 7f3f7b7fe700 1 -- 172.21.15.150:0/1650980030 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680041d0 con 0x7f3f600046d0 2022-08-10T17:35:11.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 -- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 msgr2=0x7f3f60004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 0x7f3f60004b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800b8f0 tx=0x7f3f60005700 comp rx=0 tx=0).stop 2022-08-10T17:35:11.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 -- 172.21.15.150:0/1650980030 shutdown_connections 2022-08-10T17:35:11.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 --2- 172.21.15.150:0/1650980030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600046d0 0x7f3f60004b40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 -- 172.21.15.150:0/1650980030 >> 172.21.15.150:0/1650980030 conn(0x7f3f7c0c92f0 msgr2=0x7f3f7c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 -- 172.21.15.150:0/1650980030 shutdown_connections 2022-08-10T17:35:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.871+0000 7f3f83133700 1 -- 172.21.15.150:0/1650980030 wait complete. 2022-08-10T17:35:11.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 Processor -- start 2022-08-10T17:35:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 -- start start 2022-08-10T17:35:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:11.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0baa80 con 0x7f3f7c1ece60 2022-08-10T17:35:11.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0ba4c0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.873+0000 7f3f83133700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0ba7a0 con 0x7f3f600046d0 2022-08-10T17:35:11.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f816d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f80ecf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:11.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f80ecf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:42894/0 (socket says 172.21.15.150:42894) 2022-08-10T17:35:11.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f816d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56908/0 (socket says 172.21.15.150:56908) 2022-08-10T17:35:11.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f80ecf700 1 -- 172.21.15.150:0/156751336 learned_addr learned my addr 172.21.15.150:0/156751336 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:39266/0 (socket says 172.21.15.150:39266) 2022-08-10T17:35:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 -- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 msgr2=0x7f3f7c0bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 -- 172.21.15.150:0/156751336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 msgr2=0x7f3f7c0bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 -- 172.21.15.150:0/156751336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0bd1d0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f816d0700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:11.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f80ecf700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:11.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.874+0000 7f3f7bfff700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f68017000 tx=0x7f3f68004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:11.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68018050 con 0x7f3f7c1451c0 2022-08-10T17:35:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68003de0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c0bd4b0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6801d680 con 0x7f3f7c1451c0 2022-08-10T17:35:11.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c1ed2d0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.880+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f3f6802f070 con 0x7f3f7c1451c0 2022-08-10T17:35:11.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.881+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c0ba4c0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.881+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3f6801d7e0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.885+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f3f680474b0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.956+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3f7c06d0e0 con 0x7f3f7c1451c0 2022-08-10T17:35:11.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.964+0000 7f3f797fa700 1 -- 172.21.15.150:0/156751336 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3f68036020 con 0x7f3f7c1451c0 2022-08-10T17:35:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 msgr2=0x7f3f7c0bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f68017000 tx=0x7f3f68004640 comp rx=0 tx=0).stop 2022-08-10T17:35:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 shutdown_connections 2022-08-10T17:35:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1ece60 0x7f3f7c0bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3f600046d0 0x7f3f7c0bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 --2- 172.21.15.150:0/156751336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3f7c1451c0 0x7f3f7c0bdcb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 >> 172.21.15.150:0/156751336 conn(0x7f3f7c0c92f0 msgr2=0x7f3f7c14d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:11.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 shutdown_connections 2022-08-10T17:35:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:11.965+0000 7f3f83133700 1 -- 172.21.15.150:0/156751336 wait complete. 2022-08-10T17:35:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:adjusted tunables profile to default 2022-08-10T17:35:11.980 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-08-10T17:35:11.981 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:11.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-08-10T17:35:11.992 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:11.989+0000 7f9d7e57c080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-08-10T17:35:12.007 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:12.008 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-08-10T17:35:12.055 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.052+0000 7f9d7e57c080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-08-10T17:35:12.073 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:12.074 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-08-10T17:35:12.129 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.125+0000 7f9d7e57c080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-08-10T17:35:12.139 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:35:12.140 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-08-10T17:35:12.206 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:12.206 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-08-10T17:35:12.207 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.202+0000 7f9d7e57c080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-08-10T17:35:12.233 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:12.233 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-08-10T17:35:12.300 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:12.300 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-08-10T17:35:12.352 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.349+0000 7f9d7e57c080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-08-10T17:35:12.355 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:12.351+0000 7f03fd4a6080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-08-10T17:35:12.366 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2022-08-10T17:35:12.366 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-08-10T17:35:12.419 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:12.415+0000 7f03fd4a6080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-08-10T17:35:12.433 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3 0 2022-08-10T17:35:12.492 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:12.488+0000 7f03fd4a6080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-08-10T17:35:12.569 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:12.565+0000 7f03fd4a6080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-08-10T17:35:12.593 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.589+0000 7f747f5b3700 1 Processor -- start 2022-08-10T17:35:12.593 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.589+0000 7f747f5b3700 1 -- start start 2022-08-10T17:35:12.596 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747f5b3700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7478150af0 0x7f7478159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.597 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747f5b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f747815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.597 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747f5b3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74780c4dc0 con 0x7f74780647d0 2022-08-10T17:35:12.597 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747f5b3700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74780c5940 con 0x7f7478150af0 2022-08-10T17:35:12.597 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747f5b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780c9fc0 con 0x7f747806c860 2022-08-10T17:35:12.597 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747d34f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7478150af0 0x7f7478159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.598 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747d34f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7478150af0 0x7f7478159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:40976/0 (socket says 172.21.15.197:40976) 2022-08-10T17:35:12.598 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747d34f700 1 -- 172.21.15.197:0/2911095716 learned_addr learned my addr 172.21.15.197:0/2911095716 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:12.598 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.590+0000 7f747cb4e700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f747815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.598 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747d34f700 1 -- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 msgr2=0x7f747815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:12.599 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747d34f700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f747815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.599 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747d34f700 1 -- 172.21.15.197:0/2911095716 >> v1:172.21.15.197:6789/0 conn(0x7f74780647d0 legacy=0x7f74780c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.599 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747d34f700 1 -- 172.21.15.197:0/2911095716 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747806f9a0 con 0x7f7478150af0 2022-08-10T17:35:12.599 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747cb4e700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f747815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:12.600 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f747d34f700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7478150af0 0x7f7478159e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7474006fd0 tx=0x7f7474009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53c3cc0d6836bf2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:12.600 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f7467fff700 1 -- 172.21.15.197:0/2911095716 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474004230 con 0x7f7478150af0 2022-08-10T17:35:12.600 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f7467fff700 1 -- 172.21.15.197:0/2911095716 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474004390 con 0x7f7478150af0 2022-08-10T17:35:12.600 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.591+0000 7f7467fff700 1 -- 172.21.15.197:0/2911095716 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474011830 con 0x7f7478150af0 2022-08-10T17:35:12.600 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 -- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7478150af0 msgr2=0x7f7478159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.601 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7478150af0 0x7f7478159e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7474006fd0 tx=0x7f7474009a60 comp rx=0 tx=0).stop 2022-08-10T17:35:12.601 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 -- 172.21.15.197:0/2911095716 shutdown_connections 2022-08-10T17:35:12.601 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7478150af0 0x7f7478159e60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.601 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 --2- 172.21.15.197:0/2911095716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f747815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.602 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 -- 172.21.15.197:0/2911095716 >> 172.21.15.197:0/2911095716 conn(0x7f74780c92f0 msgr2=0x7f74780c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:12.602 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 -- 172.21.15.197:0/2911095716 shutdown_connections 2022-08-10T17:35:12.602 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.592+0000 7f747f5b3700 1 -- 172.21.15.197:0/2911095716 wait complete. 2022-08-10T17:35:12.605 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.593+0000 7f747f5b3700 1 Processor -- start 2022-08-10T17:35:12.606 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.594+0000 7f747f5b3700 1 -- start start 2022-08-10T17:35:12.606 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 0x7f747814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.606 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.607 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 0x7f74780bb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.607 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780baa60 con 0x7f7478150af0 2022-08-10T17:35:12.607 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780ba450 con 0x7f74780647d0 2022-08-10T17:35:12.607 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780c8520 con 0x7f747806c860 2022-08-10T17:35:12.608 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.608 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:43962/0 (socket says 172.21.15.197:43962) 2022-08-10T17:35:12.608 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 -- 172.21.15.197:0/4021609224 learned_addr learned my addr 172.21.15.197:0/4021609224 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:12.608 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747d34f700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 0x7f747814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.609 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747db50700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 0x7f74780bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.609 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 -- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 msgr2=0x7f747814f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.609 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 0x7f747814f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.609 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 -- 172.21.15.197:0/4021609224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 msgr2=0x7f74780bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.609 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 0x7f74780bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.610 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 -- 172.21.15.197:0/4021609224 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468009310 con 0x7f747806c860 2022-08-10T17:35:12.610 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747db50700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 0x7f74780bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:12.610 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747d34f700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 0x7f747814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:12.610 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747cb4e700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f746800e8b0 tx=0x7f746800ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:12.611 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468013680 con 0x7f747806c860 2022-08-10T17:35:12.611 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74680137e0 con 0x7f747806c860 2022-08-10T17:35:12.611 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468013b90 con 0x7f747806c860 2022-08-10T17:35:12.611 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.595+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74740093e0 con 0x7f747806c860 2022-08-10T17:35:12.612 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.596+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74780c8240 con 0x7f747806c860 2022-08-10T17:35:12.612 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.596+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f7468019030 con 0x7f747806c860 2022-08-10T17:35:12.612 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.596+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7468003860 con 0x7f747806c860 2022-08-10T17:35:12.612 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.597+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747806e290 con 0x7f747806c860 2022-08-10T17:35:12.613 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.600+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f7468021060 con 0x7f747806c860 2022-08-10T17:35:12.686 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.682+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd new", "uuid": "98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3", "id": 0} v 0) v1 -- 0x7f7478072890 con 0x7f747806c860 2022-08-10T17:35:12.689 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.685+0000 7f9d7e57c080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-08-10T17:35:12.691 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.688+0000 7f7465ffb700 1 -- 172.21.15.197:0/4021609224 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7468017070 con 0x7f747806c860 2022-08-10T17:35:12.692 INFO:teuthology.orchestra.run.smithi197.stdout:0 2022-08-10T17:35:12.694 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 msgr2=0x7f74780baef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.695 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f746800e8b0 tx=0x7f746800ebc0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.695 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 shutdown_connections 2022-08-10T17:35:12.695 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478150af0 0x7f74780bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.696 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74780647d0 0x7f747814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.696 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 --2- 172.21.15.197:0/4021609224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f747806c860 0x7f74780baef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.697 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 >> 172.21.15.197:0/4021609224 conn(0x7f74780c92f0 msgr2=0x7f7478146820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:12.697 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 shutdown_connections 2022-08-10T17:35:12.697 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.689+0000 7f747f5b3700 1 -- 172.21.15.197:0/4021609224 wait complete. 2022-08-10T17:35:12.704 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new d2c1f294-f218-4559-b04e-a2a230c87196 1 2022-08-10T17:35:12.709 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:12.705+0000 7f03fd4a6080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-08-10T17:35:12.767 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.763+0000 7f9d7e57c080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-08-10T17:35:12.826 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 Processor -- start 2022-08-10T17:35:12.827 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 -- start start 2022-08-10T17:35:12.829 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f438c0bc830 0x7f438c068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.830 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c1563c0 con 0x7f438c070040 2022-08-10T17:35:12.830 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c150940 con 0x7f438c06c860 2022-08-10T17:35:12.830 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.823+0000 7f4392395700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c153590 con 0x7f438c0bc830 2022-08-10T17:35:12.830 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f438c0bc830 0x7f438c068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.831 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f438c0bc830 0x7f438c068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:40988/0 (socket says 172.21.15.197:40988) 2022-08-10T17:35:12.831 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438b7fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f438c06c860 0x7f438c152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.197:55538/0 (socket says 172.21.15.197:55538) 2022-08-10T17:35:12.831 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 -- 172.21.15.197:0/372982314 learned_addr learned my addr 172.21.15.197:0/372982314 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:12.831 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 -- 172.21.15.197:0/372982314 >> v1:172.21.15.197:6789/0 conn(0x7f438c06c860 legacy=0x7f438c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.832 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 -- 172.21.15.197:0/372982314 >> v1:172.21.15.150:6789/0 conn(0x7f438c070040 legacy=0x7f438c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.832 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 -- 172.21.15.197:0/372982314 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c068870 con 0x7f438c0bc830 2022-08-10T17:35:12.832 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438bfff700 1 --2- 172.21.15.197:0/372982314 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c0bc830 0x7f438c068110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796852397a3cf5e6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:12.832 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438affd700 1 -- 172.21.15.197:0/372982314 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c004290 con 0x7f438c0bc830 2022-08-10T17:35:12.832 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438affd700 1 -- 172.21.15.197:0/372982314 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c0043f0 con 0x7f438c0bc830 2022-08-10T17:35:12.833 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.824+0000 7f438affd700 1 -- 172.21.15.197:0/372982314 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c010820 con 0x7f438c0bc830 2022-08-10T17:35:12.833 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 -- 172.21.15.197:0/372982314 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c0bc830 msgr2=0x7f438c068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.833 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 --2- 172.21.15.197:0/372982314 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c0bc830 0x7f438c068110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c009a60 comp rx=0 tx=0).stop 2022-08-10T17:35:12.833 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 -- 172.21.15.197:0/372982314 shutdown_connections 2022-08-10T17:35:12.834 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 --2- 172.21.15.197:0/372982314 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c0bc830 0x7f438c068110 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.834 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 -- 172.21.15.197:0/372982314 >> 172.21.15.197:0/372982314 conn(0x7f438c0c92f0 msgr2=0x7f438c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:12.834 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 -- 172.21.15.197:0/372982314 shutdown_connections 2022-08-10T17:35:12.834 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.825+0000 7f4392395700 1 -- 172.21.15.197:0/372982314 wait complete. 2022-08-10T17:35:12.835 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.826+0000 7f4392395700 1 Processor -- start 2022-08-10T17:35:12.837 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.826+0000 7f4392395700 1 -- start start 2022-08-10T17:35:12.837 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.838 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.838 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438c0bc830 0x7f438c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:12.838 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0bdec0 con 0x7f438c0bc830 2022-08-10T17:35:12.838 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1f42e0 con 0x7f438c070040 2022-08-10T17:35:12.839 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4392395700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1f36d0 con 0x7f438c06c860 2022-08-10T17:35:12.839 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438b7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.839 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.839 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:43970/0 (socket says 172.21.15.197:43970) 2022-08-10T17:35:12.840 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438b7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:40994/0 (socket says 172.21.15.197:40994) 2022-08-10T17:35:12.840 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438bfff700 1 -- 172.21.15.197:0/3693993718 learned_addr learned my addr 172.21.15.197:0/3693993718 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:12.840 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f4390932700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438c0bc830 0x7f438c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:12.840 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.827+0000 7f438b7fe700 1 -- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 msgr2=0x7f438c0c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.841 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438b7fe700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.841 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438b7fe700 1 -- 172.21.15.197:0/3693993718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438c0bc830 msgr2=0x7f438c151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.841 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438b7fe700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438c0bc830 0x7f438c151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.841 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438b7fe700 1 -- 172.21.15.197:0/3693993718 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c0093e0 con 0x7f438c070040 2022-08-10T17:35:12.841 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438bfff700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:12.842 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f438b7fe700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f438000c3c0 tx=0x7f438000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:12.842 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43800072d0 con 0x7f438c070040 2022-08-10T17:35:12.843 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4380007430 con 0x7f438c070040 2022-08-10T17:35:12.843 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1f39b0 con 0x7f438c070040 2022-08-10T17:35:12.843 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43800048f0 con 0x7f438c070040 2022-08-10T17:35:12.843 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c1f3f70 con 0x7f438c070040 2022-08-10T17:35:12.844 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4380010070 con 0x7f438c070040 2022-08-10T17:35:12.844 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.828+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f43800139b0 con 0x7f438c070040 2022-08-10T17:35:12.844 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.829+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c072890 con 0x7f438c070040 2022-08-10T17:35:12.845 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.831+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f4380013b70 con 0x7f438c070040 2022-08-10T17:35:12.898 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.894+0000 7f9d7e57c080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-08-10T17:35:12.918 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.914+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2c1f294-f218-4559-b04e-a2a230c87196", "id": 1} v 0) v1 -- 0x7f438c1f4420 con 0x7f438c070040 2022-08-10T17:35:12.924 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.920+0000 7f4388ff9700 1 -- 172.21.15.197:0/3693993718 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2c1f294-f218-4559-b04e-a2a230c87196", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4380013d10 con 0x7f438c070040 2022-08-10T17:35:12.924 INFO:teuthology.orchestra.run.smithi197.stdout:1 2022-08-10T17:35:12.925 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 msgr2=0x7f438c0bf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:12.926 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f438000c3c0 tx=0x7f438000c6d0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.926 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 shutdown_connections 2022-08-10T17:35:12.926 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f438c0bc830 0x7f438c151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.926 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f438c06c860 0x7f438c0c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.927 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 --2- 172.21.15.197:0/3693993718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f438c070040 0x7f438c0bf590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:12.927 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 >> 172.21.15.197:0/3693993718 conn(0x7f438c0c92f0 msgr2=0x7f438c0c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:12.927 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 shutdown_connections 2022-08-10T17:35:12.927 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:12.921+0000 7f4392395700 1 -- 172.21.15.197:0/3693993718 wait complete. 2022-08-10T17:35:12.937 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 5d2a3df3-41d0-4150-97fc-7fad2adc3812 2 2022-08-10T17:35:12.993 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:12.990+0000 7f9d7e57c080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-08-10T17:35:13.052 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:13.048+0000 7f03fd4a6080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-08-10T17:35:13.058 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.054+0000 7fd00e4ab700 1 Processor -- start 2022-08-10T17:35:13.058 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.054+0000 7fd00e4ab700 1 -- start start 2022-08-10T17:35:13.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00e4ab700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00e4ab700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd0080c37e0 0x7fd008153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00e4ab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd008158dc0 con 0x7fd008068110 2022-08-10T17:35:13.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00e4ab700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd008070580 con 0x7fd0080c37e0 2022-08-10T17:35:13.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00e4ab700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00806fd90 con 0x7fd0080c3410 2022-08-10T17:35:13.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd007fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd0080c37e0 0x7fd008153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd007fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:43976/0 (socket says 172.21.15.197:43976) 2022-08-10T17:35:13.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd0080c37e0 0x7fd008153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41002/0 (socket says 172.21.15.197:41002) 2022-08-10T17:35:13.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd007fff700 1 -- 172.21.15.197:0/3334734727 learned_addr learned my addr 172.21.15.197:0/3334734727 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:13.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 -- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 msgr2=0x7fd0080c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:13.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 -- 172.21.15.197:0/3334734727 >> v1:172.21.15.150:6789/0 conn(0x7fd008068110 legacy=0x7fd008155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 -- 172.21.15.197:0/3334734727 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008158240 con 0x7fd0080c37e0 2022-08-10T17:35:13.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd007fff700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:13.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.055+0000 7fd00ca48700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c37e0 0x7fd008153d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd00000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6103bd38f519fb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd006ffd700 1 -- 172.21.15.197:0/3334734727 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000e070 con 0x7fd0080c37e0 2022-08-10T17:35:13.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd006ffd700 1 -- 172.21.15.197:0/3334734727 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000bb20 con 0x7fd0080c37e0 2022-08-10T17:35:13.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd006ffd700 1 -- 172.21.15.197:0/3334734727 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000012430 con 0x7fd0080c37e0 2022-08-10T17:35:13.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 -- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c37e0 msgr2=0x7fd008153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c37e0 0x7fd008153d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd00000b330 comp rx=0 tx=0).stop 2022-08-10T17:35:13.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 -- 172.21.15.197:0/3334734727 shutdown_connections 2022-08-10T17:35:13.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c37e0 0x7fd008153d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/3334734727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c3410 0x7fd0080c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 -- 172.21.15.197:0/3334734727 >> 172.21.15.197:0/3334734727 conn(0x7fd00806d0d0 msgr2=0x7fd0080c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 -- 172.21.15.197:0/3334734727 shutdown_connections 2022-08-10T17:35:13.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.056+0000 7fd00e4ab700 1 -- 172.21.15.197:0/3334734727 wait complete. 2022-08-10T17:35:13.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.057+0000 7fd00e4ab700 1 Processor -- start 2022-08-10T17:35:13.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 -- start start 2022-08-10T17:35:13.071 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd008068110 0x7fd008152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.071 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 0x7fd00814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080be430 con 0x7fd008068110 2022-08-10T17:35:13.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080be0d0 con 0x7fd0080c3410 2022-08-10T17:35:13.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00e4ab700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0081efcf0 con 0x7fd0080c37e0 2022-08-10T17:35:13.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd0077fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd0077fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41006/0 (socket says 172.21.15.197:41006) 2022-08-10T17:35:13.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd00ca48700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 0x7fd00814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd0077fe700 1 -- 172.21.15.197:0/594517226 learned_addr learned my addr 172.21.15.197:0/594517226 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:13.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.058+0000 7fd007fff700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd008068110 0x7fd008152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 -- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 msgr2=0x7fd00814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 0x7fd00814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 -- 172.21.15.197:0/594517226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd008068110 msgr2=0x7fd008152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd008068110 0x7fd008152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 -- 172.21.15.197:0/594517226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80093e0 con 0x7fd0080c3410 2022-08-10T17:35:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd00ca48700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 0x7fd00814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd0077fe700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c370 tx=0x7fcffc00c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0052d0 con 0x7fd0080c3410 2022-08-10T17:35:13.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc003500 con 0x7fd0080c3410 2022-08-10T17:35:13.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd000009a70 con 0x7fd0080c3410 2022-08-10T17:35:13.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0038b0 con 0x7fd0080c3410 2022-08-10T17:35:13.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.059+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0081eef30 con 0x7fd0080c3410 2022-08-10T17:35:13.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.060+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fcffc019030 con 0x7fd0080c3410 2022-08-10T17:35:13.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.060+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fcffc012840 con 0x7fd0080c3410 2022-08-10T17:35:13.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.060+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd008072890 con 0x7fd0080c3410 2022-08-10T17:35:13.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.062+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fcffc017070 con 0x7fd0080c3410 2022-08-10T17:35:13.124 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:13.121+0000 7f03fd4a6080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-08-10T17:35:13.148 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.144+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5d2a3df3-41d0-4150-97fc-7fad2adc3812", "id": 2} v 0) v1 -- 0x7fd0080c5b60 con 0x7fd0080c3410 2022-08-10T17:35:13.155 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.152+0000 7fd004ff9700 1 -- 172.21.15.197:0/594517226 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d2a3df3-41d0-4150-97fc-7fad2adc3812", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcffc012420 con 0x7fd0080c3410 2022-08-10T17:35:13.156 INFO:teuthology.orchestra.run.smithi197.stdout:2 2022-08-10T17:35:13.157 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 msgr2=0x7fd0081eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.157 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c370 tx=0x7fcffc00c680 comp rx=0 tx=0).stop 2022-08-10T17:35:13.158 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 shutdown_connections 2022-08-10T17:35:13.158 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd0080c37e0 0x7fd00814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.158 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd008068110 0x7fd008152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.158 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 --2- 172.21.15.197:0/594517226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd0080c3410 0x7fd0081eccb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 >> 172.21.15.197:0/594517226 conn(0x7fd00806d0d0 msgr2=0x7fd0080c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 shutdown_connections 2022-08-10T17:35:13.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.153+0000 7fd00e4ab700 1 -- 172.21.15.197:0/594517226 wait complete. 2022-08-10T17:35:13.170 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 26947788-cf56-4352-bd46-38000bf1d126 3 2022-08-10T17:35:13.253 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:13.249+0000 7f03fd4a6080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-08-10T17:35:13.291 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.287+0000 7f6658ba4700 1 Processor -- start 2022-08-10T17:35:13.291 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.287+0000 7f6658ba4700 1 -- start start 2022-08-10T17:35:13.297 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6658ba4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 0x7f6654068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6658ba4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f66540bd4b0 0x7f6654068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6658ba4700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540c6100 con 0x7f66541540f0 2022-08-10T17:35:13.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6658ba4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540c5270 con 0x7f66541544c0 2022-08-10T17:35:13.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6658ba4700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540c5e00 con 0x7f66540bd4b0 2022-08-10T17:35:13.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6652d9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f66540bd4b0 0x7f6654068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f665259c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f66541540f0 0x7f6654071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.197:55560/0 (socket says 172.21.15.197:55560) 2022-08-10T17:35:13.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6652d9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f66540bd4b0 0x7f6654068650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41014/0 (socket says 172.21.15.197:41014) 2022-08-10T17:35:13.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f665259c700 1 -- 172.21.15.197:0/700375030 learned_addr learned my addr 172.21.15.197:0/700375030 (peer_addr_for_me v1:172.21.15.197:0/0) 2022-08-10T17:35:13.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.288+0000 7f6651d9b700 1 --2- 172.21.15.197:0/700375030 >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 0x7f6654068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6652d9d700 1 -- 172.21.15.197:0/700375030 >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 msgr2=0x7f6654068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:13.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6652d9d700 1 --2- 172.21.15.197:0/700375030 >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 0x7f6654068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6652d9d700 1 -- 172.21.15.197:0/700375030 >> v1:172.21.15.197:6789/0 conn(0x7f66541540f0 legacy=0x7f6654071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.301 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6652d9d700 1 -- 172.21.15.197:0/700375030 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665406eb00 con 0x7f66540bd4b0 2022-08-10T17:35:13.301 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f665159a700 1 -- 172.21.15.197:0/700375030 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735306884 0 0) 0x7f66540c6100 con 0x7f66541540f0 2022-08-10T17:35:13.301 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6651d9b700 1 --2- 172.21.15.197:0/700375030 >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 0x7f6654068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:13.301 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6652d9d700 1 --2- 172.21.15.197:0/700375030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f6654068650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6654157c00 tx=0x7f6644009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a06e3736c69d75 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.302 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f665159a700 1 -- 172.21.15.197:0/700375030 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011830 con 0x7f66540bd4b0 2022-08-10T17:35:13.302 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f665159a700 1 -- 172.21.15.197:0/700375030 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644011990 con 0x7f66540bd4b0 2022-08-10T17:35:13.302 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f665159a700 1 -- 172.21.15.197:0/700375030 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011d40 con 0x7f66540bd4b0 2022-08-10T17:35:13.302 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 -- 172.21.15.197:0/700375030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 msgr2=0x7f6654068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.303 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 --2- 172.21.15.197:0/700375030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f6654068650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6654157c00 tx=0x7f6644009990 comp rx=0 tx=0).stop 2022-08-10T17:35:13.303 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 -- 172.21.15.197:0/700375030 shutdown_connections 2022-08-10T17:35:13.303 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 --2- 172.21.15.197:0/700375030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f6654068650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.303 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 --2- 172.21.15.197:0/700375030 >> v2:172.21.15.150:3300/0 conn(0x7f66541544c0 0x7f6654068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.289+0000 7f6658ba4700 1 -- 172.21.15.197:0/700375030 >> 172.21.15.197:0/700375030 conn(0x7f665406d0d0 msgr2=0x7f66540c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.290+0000 7f6658ba4700 1 -- 172.21.15.197:0/700375030 shutdown_connections 2022-08-10T17:35:13.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.290+0000 7f6658ba4700 1 -- 172.21.15.197:0/700375030 wait complete. 2022-08-10T17:35:13.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 Processor -- start 2022-08-10T17:35:13.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 -- start start 2022-08-10T17:35:13.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66541540f0 0x7f6654156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66541544c0 0x7f66541553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654154fc0 con 0x7f66541544c0 2022-08-10T17:35:13.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665414ee90 con 0x7f66540bd4b0 2022-08-10T17:35:13.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.291+0000 7f6658ba4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665414f170 con 0x7f66541540f0 2022-08-10T17:35:13.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6651d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66541540f0 0x7f6654156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41016/0 (socket says 172.21.15.197:41016) 2022-08-10T17:35:13.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 -- 172.21.15.197:0/1480250647 learned_addr learned my addr 172.21.15.197:0/1480250647 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:13.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6652d9d700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66541544c0 0x7f66541553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 -- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66541540f0 msgr2=0x7f6654156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66541540f0 0x7f6654156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 -- 172.21.15.197:0/1480250647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66541544c0 msgr2=0x7f66541553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66541544c0 0x7f66541553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 -- 172.21.15.197:0/1480250647 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009310 con 0x7f66540bd4b0 2022-08-10T17:35:13.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f665259c700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c7f0 tx=0x7f664c00cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c004e80 con 0x7f66540bd4b0 2022-08-10T17:35:13.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c0070d0 con 0x7f66540bd4b0 2022-08-10T17:35:13.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665414f450 con 0x7f66540bd4b0 2022-08-10T17:35:13.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c007480 con 0x7f66540bd4b0 2022-08-10T17:35:13.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665414fa10 con 0x7f66540bd4b0 2022-08-10T17:35:13.311 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f664c01a030 con 0x7f66540bd4b0 2022-08-10T17:35:13.311 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.292+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f664c007850 con 0x7f66540bd4b0 2022-08-10T17:35:13.311 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.293+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654072890 con 0x7f66540bd4b0 2022-08-10T17:35:13.312 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.295+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f664c018070 con 0x7f66540bd4b0 2022-08-10T17:35:13.331 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:13.328+0000 7f03fd4a6080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-08-10T17:35:13.381 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.377+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26947788-cf56-4352-bd46-38000bf1d126", "id": 3} v 0) v1 -- 0x7f66540c56b0 con 0x7f66540bd4b0 2022-08-10T17:35:13.388 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.385+0000 7f6642ffd700 1 -- 172.21.15.197:0/1480250647 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26947788-cf56-4352-bd46-38000bf1d126", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f664c012400 con 0x7f66540bd4b0 2022-08-10T17:35:13.389 INFO:teuthology.orchestra.run.smithi197.stdout:3 2022-08-10T17:35:13.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.385+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 msgr2=0x7f66541ef210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.385+0000 7f6658ba4700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c7f0 tx=0x7f664c00cb00 comp rx=0 tx=0).stop 2022-08-10T17:35:13.391 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 shutdown_connections 2022-08-10T17:35:13.391 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66541544c0 0x7f66541553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.391 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66540bd4b0 0x7f66541ef210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.391 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 --2- 172.21.15.197:0/1480250647 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66541540f0 0x7f6654156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.392 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 >> 172.21.15.197:0/1480250647 conn(0x7f665406d0d0 msgr2=0x7f66540c1150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.392 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 shutdown_connections 2022-08-10T17:35:13.392 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.386+0000 7f6658ba4700 1 -- 172.21.15.197:0/1480250647 wait complete. 2022-08-10T17:35:13.401 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 1a95c275-f6b5-48a8-bf9d-12912e5be6ea 4 2022-08-10T17:35:13.430 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:13.426+0000 7f9d7e57c080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-08-10T17:35:13.525 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.521+0000 7fc9cbf15700 1 Processor -- start 2022-08-10T17:35:13.526 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.521+0000 7fc9cbf15700 1 -- start start 2022-08-10T17:35:13.532 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9cbf15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9c40c1730 0x7fc9c40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.532 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9cbf15700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40c3020 con 0x7fc9c4070240 2022-08-10T17:35:13.532 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9cbf15700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c4156bd0 con 0x7fc9c40cda80 2022-08-10T17:35:13.532 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9cbf15700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c40c1b60 con 0x7fc9c40c1730 2022-08-10T17:35:13.533 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9ca4b2700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fc9c40cda80 0x7fc9c40691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.197:55576/0 (socket says 172.21.15.197:55576) 2022-08-10T17:35:13.533 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9ca4b2700 1 -- 172.21.15.197:0/983037512 learned_addr learned my addr 172.21.15.197:0/983037512 (peer_addr_for_me v1:172.21.15.197:0/0) 2022-08-10T17:35:13.533 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.522+0000 7fc9c94b0700 1 --2- 172.21.15.197:0/983037512 >> v2:172.21.15.150:3300/0 conn(0x7fc9c40c1730 0x7fc9c40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.533 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941184298 0 0) 0x7fc9c4156bd0 con 0x7fc9c40cda80 2022-08-10T17:35:13.534 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003430 con 0x7fc9c40cda80 2022-08-10T17:35:13.534 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324724173 0 0) 0x7fc9c40c3020 con 0x7fc9c4070240 2022-08-10T17:35:13.534 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c4156bd0 con 0x7fc9c4070240 2022-08-10T17:35:13.534 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c94b0700 1 -- 172.21.15.197:0/983037512 >> v1:172.21.15.197:6789/0 conn(0x7fc9c40cda80 legacy=0x7fc9c40691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.535 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c94b0700 1 -- 172.21.15.197:0/983037512 >> v1:172.21.15.150:6789/0 conn(0x7fc9c4070240 legacy=0x7fc9c4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.535 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c94b0700 1 -- 172.21.15.197:0/983037512 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c406f770 con 0x7fc9c40c1730 2022-08-10T17:35:13.535 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c94b0700 1 --2- 172.21.15.197:0/983037512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40c1730 0x7fc9c40cd540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40096b0 tx=0x7fc9b40099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44025f725f88394f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.535 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40107b0 con 0x7fc9c40c1730 2022-08-10T17:35:13.536 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4010910 con 0x7fc9c40c1730 2022-08-10T17:35:13.536 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.523+0000 7fc9c8caf700 1 -- 172.21.15.197:0/983037512 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4010cc0 con 0x7fc9c40c1730 2022-08-10T17:35:13.536 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 -- 172.21.15.197:0/983037512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40c1730 msgr2=0x7fc9c40cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.536 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/983037512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40c1730 0x7fc9c40cd540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40096b0 tx=0x7fc9b40099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.537 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 -- 172.21.15.197:0/983037512 shutdown_connections 2022-08-10T17:35:13.537 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/983037512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40c1730 0x7fc9c40cd540 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.537 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 -- 172.21.15.197:0/983037512 >> 172.21.15.197:0/983037512 conn(0x7fc9c4071e40 msgr2=0x7fc9c40cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.537 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 -- 172.21.15.197:0/983037512 shutdown_connections 2022-08-10T17:35:13.538 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.524+0000 7fc9cbf15700 1 -- 172.21.15.197:0/983037512 wait complete. 2022-08-10T17:35:13.538 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.525+0000 7fc9cbf15700 1 Processor -- start 2022-08-10T17:35:13.538 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.525+0000 7fc9cbf15700 1 -- start start 2022-08-10T17:35:13.538 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.539 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 0x7fc9c4148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.539 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 0x7fc9c4148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.539 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4155f80 con 0x7fc9c40cda80 2022-08-10T17:35:13.539 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c5770 con 0x7fc9c4070240 2022-08-10T17:35:13.540 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9cbf15700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c5a50 con 0x7fc9c40c1730 2022-08-10T17:35:13.540 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c9cb1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.540 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c9cb1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41028/0 (socket says 172.21.15.197:41028) 2022-08-10T17:35:13.540 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 0x7fc9c4148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.541 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c9cb1700 1 -- 172.21.15.197:0/739096718 learned_addr learned my addr 172.21.15.197:0/739096718 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:13.541 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9ca4b2700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 0x7fc9c4148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.541 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 -- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 msgr2=0x7fc9c41ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.541 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.542 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 -- 172.21.15.197:0/739096718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 msgr2=0x7fc9c4148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.542 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 0x7fc9c4148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.542 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c94b0700 1 -- 172.21.15.197:0/739096718 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009310 con 0x7fc9c40c1730 2022-08-10T17:35:13.543 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9ca4b2700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 0x7fc9c4148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:13.543 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.526+0000 7fc9c9cb1700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:13.543 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9c94b0700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 0x7fc9c4148510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4015000 tx=0x7fc9b40045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.543 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4010a80 con 0x7fc9c40c1730 2022-08-10T17:35:13.544 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b401f070 con 0x7fc9c40c1730 2022-08-10T17:35:13.544 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c41559e0 con 0x7fc9c40c1730 2022-08-10T17:35:13.544 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4026480 con 0x7fc9c40c1730 2022-08-10T17:35:13.544 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c41f04d0 con 0x7fc9c40c1730 2022-08-10T17:35:13.545 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fc9b400f070 con 0x7fc9c40c1730 2022-08-10T17:35:13.545 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.527+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc9b4021070 con 0x7fc9c40c1730 2022-08-10T17:35:13.545 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.528+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c4072890 con 0x7fc9c40c1730 2022-08-10T17:35:13.546 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.530+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fc9b402b020 con 0x7fc9c40c1730 2022-08-10T17:35:13.617 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.613+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a95c275-f6b5-48a8-bf9d-12912e5be6ea", "id": 4} v 0) v1 -- 0x7fc9c40c5b90 con 0x7fc9c40c1730 2022-08-10T17:35:13.623 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.619+0000 7fc9b27fc700 1 -- 172.21.15.197:0/739096718 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a95c275-f6b5-48a8-bf9d-12912e5be6ea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9b4026a50 con 0x7fc9c40c1730 2022-08-10T17:35:13.623 INFO:teuthology.orchestra.run.smithi197.stdout:4 2022-08-10T17:35:13.624 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 msgr2=0x7fc9c4148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.625 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 0x7fc9c4148510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4015000 tx=0x7fc9b40045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.625 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 shutdown_connections 2022-08-10T17:35:13.625 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c40cda80 0x7fc9c4148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.625 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9c4070240 0x7fc9c41ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.626 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 --2- 172.21.15.197:0/739096718 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9c40c1730 0x7fc9c4148510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.626 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 >> 172.21.15.197:0/739096718 conn(0x7fc9c4071e40 msgr2=0x7fc9c4150210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.626 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 shutdown_connections 2022-08-10T17:35:13.626 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.620+0000 7fc9cbf15700 1 -- 172.21.15.197:0/739096718 wait complete. 2022-08-10T17:35:13.636 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new cee7100d-1f0a-4ead-9832-217bbe1b483f 5 2022-08-10T17:35:13.754 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:13.750+0000 7f03fd4a6080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-08-10T17:35:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.791+0000 7f1a98bfd700 1 Processor -- start 2022-08-10T17:35:13.796 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.791+0000 7f1a98bfd700 1 -- start start 2022-08-10T17:35:13.798 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.792+0000 7f1a98bfd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 0x7f1a940c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.799 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.792+0000 7f1a98bfd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940b0060 con 0x7f1a94156a20 2022-08-10T17:35:13.799 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.792+0000 7f1a98bfd700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940afb00 con 0x7f1a940c0530 2022-08-10T17:35:13.799 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.792+0000 7f1a98bfd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94070690 con 0x7f1a940c48d0 2022-08-10T17:35:13.799 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a91d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 0x7f1a940c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.800 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9259c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f1a940c0530 0x7f1a9406ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.197:55584/0 (socket says 172.21.15.197:55584) 2022-08-10T17:35:13.800 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9259c700 1 -- 172.21.15.197:0/2089749931 learned_addr learned my addr 172.21.15.197:0/2089749931 (peer_addr_for_me v1:172.21.15.197:0/0) 2022-08-10T17:35:13.800 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9159a700 1 -- 172.21.15.197:0/2089749931 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570248636 0 0) 0x7f1a940afb00 con 0x7f1a940c0530 2022-08-10T17:35:13.800 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a91d9b700 1 -- 172.21.15.197:0/2089749931 >> v1:172.21.15.197:6789/0 conn(0x7f1a940c0530 legacy=0x7f1a9406ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.801 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a91d9b700 1 -- 172.21.15.197:0/2089749931 >> v1:172.21.15.150:6789/0 conn(0x7f1a94156a20 legacy=0x7f1a94156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.801 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a91d9b700 1 -- 172.21.15.197:0/2089749931 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940afda0 con 0x7f1a940c48d0 2022-08-10T17:35:13.801 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a91d9b700 1 --2- 172.21.15.197:0/2089749931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 0x7f1a940c4d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a880096e0 tx=0x7f1a880099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d3b0fec2c61c5a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.801 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9159a700 1 -- 172.21.15.197:0/2089749931 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88011830 con 0x7f1a940c48d0 2022-08-10T17:35:13.801 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9159a700 1 -- 172.21.15.197:0/2089749931 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88011990 con 0x7f1a940c48d0 2022-08-10T17:35:13.802 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.793+0000 7f1a9159a700 1 -- 172.21.15.197:0/2089749931 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88011d40 con 0x7f1a940c48d0 2022-08-10T17:35:13.802 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2089749931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 msgr2=0x7f1a940c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.802 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2089749931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 0x7f1a940c4d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a880096e0 tx=0x7f1a880099f0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.803 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2089749931 shutdown_connections 2022-08-10T17:35:13.803 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2089749931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a940c48d0 0x7f1a940c4d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.803 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2089749931 >> 172.21.15.197:0/2089749931 conn(0x7f1a940ca5a0 msgr2=0x7f1a940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.803 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2089749931 shutdown_connections 2022-08-10T17:35:13.804 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.794+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2089749931 wait complete. 2022-08-10T17:35:13.807 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.795+0000 7f1a98bfd700 1 Processor -- start 2022-08-10T17:35:13.807 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.795+0000 7f1a98bfd700 1 -- start start 2022-08-10T17:35:13.807 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.807 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a940c48d0 0x7f1a940c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.808 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:13.808 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940c3a80 con 0x7f1a940c48d0 2022-08-10T17:35:13.808 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941e9b80 con 0x7f1a940c0530 2022-08-10T17:35:13.808 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a98bfd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941e0ae0 con 0x7f1a94156a20 2022-08-10T17:35:13.809 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.809 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a9259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.809 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:44022/0 (socket says 172.21.15.197:44022) 2022-08-10T17:35:13.809 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 -- 172.21.15.197:0/2777703267 learned_addr learned my addr 172.21.15.197:0/2777703267 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:13.810 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a9259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41040/0 (socket says 172.21.15.197:41040) 2022-08-10T17:35:13.810 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a91d9b700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a940c48d0 0x7f1a940c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:13.810 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 -- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 msgr2=0x7f1a94156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.811 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.811 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 -- 172.21.15.197:0/2777703267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a940c48d0 msgr2=0x7f1a940c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.811 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a940c48d0 0x7f1a940c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.811 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 -- 172.21.15.197:0/2777703267 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009310 con 0x7f1a94156a20 2022-08-10T17:35:13.812 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a9259c700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:13.812 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.796+0000 7f1a92d9d700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00e8f0 tx=0x7f1a8c00ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:13.812 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.797+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c003a80 con 0x7f1a94156a20 2022-08-10T17:35:13.813 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.797+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c003be0 con 0x7f1a94156a20 2022-08-10T17:35:13.813 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.797+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940c1990 con 0x7f1a94156a20 2022-08-10T17:35:13.813 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.797+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0050d0 con 0x7f1a94156a20 2022-08-10T17:35:13.813 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.797+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a941e9530 con 0x7f1a94156a20 2022-08-10T17:35:13.814 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.798+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1a8c021070 con 0x7f1a94156a20 2022-08-10T17:35:13.814 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.798+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1a8c011470 con 0x7f1a94156a20 2022-08-10T17:35:13.814 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.798+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a940704b0 con 0x7f1a94156a20 2022-08-10T17:35:13.814 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.800+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f1a8c0394b0 con 0x7f1a94156a20 2022-08-10T17:35:13.918 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.914+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cee7100d-1f0a-4ead-9832-217bbe1b483f", "id": 5} v 0) v1 -- 0x7f1a940c43b0 con 0x7f1a94156a20 2022-08-10T17:35:13.921 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.918+0000 7f1a82ffd700 1 -- 172.21.15.197:0/2777703267 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cee7100d-1f0a-4ead-9832-217bbe1b483f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a8c028070 con 0x7f1a94156a20 2022-08-10T17:35:13.922 INFO:teuthology.orchestra.run.smithi197.stdout:5 2022-08-10T17:35:13.923 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 msgr2=0x7f1a941dfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:13.924 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00e8f0 tx=0x7f1a8c00ec00 comp rx=0 tx=0).stop 2022-08-10T17:35:13.924 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 shutdown_connections 2022-08-10T17:35:13.924 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a94156a20 0x7f1a941dfdf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.924 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a940c0530 0x7f1a94156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.925 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 --2- 172.21.15.197:0/2777703267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a940c48d0 0x7f1a940c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:13.925 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 >> 172.21.15.197:0/2777703267 conn(0x7f1a940ca5a0 msgr2=0x7f1a9414c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:13.925 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 shutdown_connections 2022-08-10T17:35:13.925 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:13.919+0000 7f1a98bfd700 1 -- 172.21.15.197:0/2777703267 wait complete. 2022-08-10T17:35:13.935 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 94b91e81-e45f-451c-b4a4-7a216eaba26f 6 2022-08-10T17:35:14.010 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:14.007+0000 7f9d7e57c080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-08-10T17:35:14.059 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.052+0000 7f4cee19c700 1 Processor -- start 2022-08-10T17:35:14.059 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 -- start start 2022-08-10T17:35:14.060 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.060 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ce8068110 0x7f4ce8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.060 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.060 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce8070580 con 0x7f4ce8068110 2022-08-10T17:35:14.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce8158dc0 con 0x7f4ce80c37e0 2022-08-10T17:35:14.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4cee19c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce806fd90 con 0x7f4ce80c3410 2022-08-10T17:35:14.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.053+0000 7f4ce77fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce7fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.061 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce7fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41050/0 (socket says 172.21.15.197:41050) 2022-08-10T17:35:14.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce7fff700 1 -- 172.21.15.197:0/2329507545 learned_addr learned my addr 172.21.15.197:0/2329507545 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:14.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/2329507545 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:44024/0 (socket says 172.21.15.197:44024) 2022-08-10T17:35:14.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4cdeffd700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.150:3300/0 conn(0x7f4ce8068110 0x7f4ce8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.062 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 -- 172.21.15.197:0/2329507545 >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 msgr2=0x7f4ce81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:14.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.063 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 -- 172.21.15.197:0/2329507545 >> v2:172.21.15.150:3300/0 conn(0x7f4ce8068110 msgr2=0x7f4ce8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:14.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.150:3300/0 conn(0x7f4ce8068110 0x7f4ce8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 -- 172.21.15.197:0/2329507545 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8158240 con 0x7f4ce80c3410 2022-08-10T17:35:14.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce7fff700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:14.064 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/2329507545 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80c7000 tx=0x7f4cd8009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba59bba6c8f97f9d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce6ffd700 1 -- 172.21.15.197:0/2329507545 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80107b0 con 0x7f4ce80c3410 2022-08-10T17:35:14.065 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce6ffd700 1 -- 172.21.15.197:0/2329507545 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8010910 con 0x7f4ce80c3410 2022-08-10T17:35:14.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.054+0000 7f4ce6ffd700 1 -- 172.21.15.197:0/2329507545 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8010cc0 con 0x7f4ce80c3410 2022-08-10T17:35:14.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 -- 172.21.15.197:0/2329507545 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 msgr2=0x7f4ce80c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.066 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 --2- 172.21.15.197:0/2329507545 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80c7000 tx=0x7f4cd8009990 comp rx=0 tx=0).stop 2022-08-10T17:35:14.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 -- 172.21.15.197:0/2329507545 shutdown_connections 2022-08-10T17:35:14.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.197:3300/0 conn(0x7f4ce80c37e0 0x7f4ce81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 --2- 172.21.15.197:0/2329507545 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce80c3410 0x7f4ce80c7070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.067 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 --2- 172.21.15.197:0/2329507545 >> v2:172.21.15.150:3300/0 conn(0x7f4ce8068110 0x7f4ce8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 -- 172.21.15.197:0/2329507545 >> 172.21.15.197:0/2329507545 conn(0x7f4ce806d0d0 msgr2=0x7f4ce80c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 -- 172.21.15.197:0/2329507545 shutdown_connections 2022-08-10T17:35:14.068 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.055+0000 7f4cee19c700 1 -- 172.21.15.197:0/2329507545 wait complete. 2022-08-10T17:35:14.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.056+0000 7f4cee19c700 1 Processor -- start 2022-08-10T17:35:14.072 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.056+0000 7f4cee19c700 1 -- start start 2022-08-10T17:35:14.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 0x7f4ce80c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4ce80c37e0 0x7f4ce80c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.073 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c9990 con 0x7f4ce80c3410 2022-08-10T17:35:14.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c1020 con 0x7f4ce80c37e0 2022-08-10T17:35:14.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cee19c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8151c80 con 0x7f4ce8068110 2022-08-10T17:35:14.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.074 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.197:44030/0 (socket says 172.21.15.197:44030) 2022-08-10T17:35:14.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 -- 172.21.15.197:0/3330927128 learned_addr learned my addr 172.21.15.197:0/3330927128 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:14.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cdeffd700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 0x7f4ce80c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce7fff700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4ce80c37e0 0x7f4ce80c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.075 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 -- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4ce80c37e0 msgr2=0x7f4ce80c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4ce80c37e0 0x7f4ce80c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 -- 172.21.15.197:0/3330927128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 msgr2=0x7f4ce80c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 0x7f4ce80c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4ce77fe700 1 -- 172.21.15.197:0/3330927128 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009b30 con 0x7f4ce8068110 2022-08-10T17:35:14.076 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.057+0000 7f4cdeffd700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 0x7f4ce80c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:14.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce77fe700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8000c00 tx=0x7f4cd80045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8004220 con 0x7f4ce8068110 2022-08-10T17:35:14.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd801f070 con 0x7f4ce8068110 2022-08-10T17:35:14.077 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011c40 con 0x7f4ce8068110 2022-08-10T17:35:14.078 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd8009310 con 0x7f4ce8068110 2022-08-10T17:35:14.078 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80c8010 con 0x7f4ce8068110 2022-08-10T17:35:14.078 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4cd800f070 con 0x7f4ce8068110 2022-08-10T17:35:14.078 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.058+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f4cd8021070 con 0x7f4ce8068110 2022-08-10T17:35:14.079 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.059+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8072890 con 0x7f4ce8068110 2022-08-10T17:35:14.079 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.061+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f4cd80444b0 con 0x7f4ce8068110 2022-08-10T17:35:14.148 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.144+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd new", "uuid": "94b91e81-e45f-451c-b4a4-7a216eaba26f", "id": 6} v 0) v1 -- 0x7f4ce80bd800 con 0x7f4ce8068110 2022-08-10T17:35:14.156 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.152+0000 7f4ce4ff9700 1 -- 172.21.15.197:0/3330927128 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94b91e81-e45f-451c-b4a4-7a216eaba26f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4cd8033070 con 0x7f4ce8068110 2022-08-10T17:35:14.157 INFO:teuthology.orchestra.run.smithi197.stdout:6 2022-08-10T17:35:14.158 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 msgr2=0x7f4ce80c03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8000c00 tx=0x7f4cd80045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 shutdown_connections 2022-08-10T17:35:14.159 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4ce80c37e0 0x7f4ce80c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.160 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce8068110 0x7f4ce80c03d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.160 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 --2- 172.21.15.197:0/3330927128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce80c3410 0x7f4ce80c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.160 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 >> 172.21.15.197:0/3330927128 conn(0x7f4ce806d0d0 msgr2=0x7f4ce80c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.161 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 shutdown_connections 2022-08-10T17:35:14.161 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.154+0000 7f4cee19c700 1 -- 172.21.15.197:0/3330927128 wait complete. 2022-08-10T17:35:14.169 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd new 2d1cd19c-4765-472f-b541-01dece4d9ec7 7 2022-08-10T17:35:14.174 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:14.170+0000 7f9d7e57c080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-08-10T17:35:14.290 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.286+0000 7ff3e3be4700 1 Processor -- start 2022-08-10T17:35:14.290 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.286+0000 7ff3e3be4700 1 -- start start 2022-08-10T17:35:14.293 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e3be4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e3be4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3dc0c2790 0x7ff3dc0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e3be4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0699c0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e3be4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0c5e10 con 0x7ff3dc0c2790 2022-08-10T17:35:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e3be4700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0c1c30 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.295 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.295 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41058/0 (socket says 172.21.15.197:41058) 2022-08-10T17:35:14.295 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 -- 172.21.15.197:0/2354752645 learned_addr learned my addr 172.21.15.197:0/2354752645 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:14.296 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e2181700 1 --2- 172.21.15.197:0/2354752645 >> v2:172.21.15.150:3300/0 conn(0x7ff3dc0c2790 0x7ff3dc0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.296 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 -- 172.21.15.197:0/2354752645 >> v2:172.21.15.150:3300/0 conn(0x7ff3dc0c2790 msgr2=0x7ff3dc0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:14.296 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 --2- 172.21.15.197:0/2354752645 >> v2:172.21.15.150:3300/0 conn(0x7ff3dc0c2790 0x7ff3dc0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.296 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 -- 172.21.15.197:0/2354752645 >> v1:172.21.15.150:6789/0 conn(0x7ff3dc0c7220 legacy=0x7ff3dc0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.297 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.287+0000 7ff3e1980700 1 -- 172.21.15.197:0/2354752645 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc068e40 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.297 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e1980700 1 --2- 172.21.15.197:0/2354752645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc06e3f0 tx=0x7ff3d8009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6d1d9a6bb413d4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.297 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e097e700 1 -- 172.21.15.197:0/2354752645 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8004230 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.297 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e097e700 1 -- 172.21.15.197:0/2354752645 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8004390 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e097e700 1 -- 172.21.15.197:0/2354752645 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011830 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 -- 172.21.15.197:0/2354752645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c4d90 msgr2=0x7ff3dc0c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/2354752645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc06e3f0 tx=0x7ff3d8009a60 comp rx=0 tx=0).stop 2022-08-10T17:35:14.298 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 -- 172.21.15.197:0/2354752645 shutdown_connections 2022-08-10T17:35:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/2354752645 >> v2:172.21.15.150:3300/0 conn(0x7ff3dc0c2790 0x7ff3dc0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/2354752645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc0c5160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 -- 172.21.15.197:0/2354752645 >> 172.21.15.197:0/2354752645 conn(0x7ff3dc06d0d0 msgr2=0x7ff3dc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 -- 172.21.15.197:0/2354752645 shutdown_connections 2022-08-10T17:35:14.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.288+0000 7ff3e3be4700 1 -- 172.21.15.197:0/2354752645 wait complete. 2022-08-10T17:35:14.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.289+0000 7ff3e3be4700 1 Processor -- start 2022-08-10T17:35:14.300 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 -- start start 2022-08-10T17:35:14.301 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:14.294+0000 7f03fd4a6080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-08-10T17:35:14.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 0x7ff3dc149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.304 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0beb90 con 0x7ff3dc0c4d90 2022-08-10T17:35:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1ec910 con 0x7ff3dc0c7220 2022-08-10T17:35:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e3be4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc14c880 con 0x7ff3dc0c2790 2022-08-10T17:35:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e2181700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e1980700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 0x7ff3dc149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e2181700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.197:41068/0 (socket says 172.21.15.197:41068) 2022-08-10T17:35:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e2181700 1 -- 172.21.15.197:0/3657536505 learned_addr learned my addr 172.21.15.197:0/3657536505 (peer_addr_for_me v2:172.21.15.197:0/0) 2022-08-10T17:35:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.290+0000 7ff3e117f700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 -- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 msgr2=0x7ff3dc149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 0x7ff3dc149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 -- 172.21.15.197:0/3657536505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc0c4d90 msgr2=0x7ff3dc154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.307 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 -- 172.21.15.197:0/3657536505 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d80093e0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e1980700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 0x7ff3dc149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:14.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e2181700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4007e30 tx=0x7ff3d400e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400ed30 con 0x7ff3dc0c7220 2022-08-10T17:35:14.308 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400ee90 con 0x7ff3dc0c7220 2022-08-10T17:35:14.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc0bee30 con 0x7ff3dc0c7220 2022-08-10T17:35:14.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4014660 con 0x7ff3dc0c7220 2022-08-10T17:35:14.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc0bf3f0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.309 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ff3d4012050 con 0x7ff3dc0c7220 2022-08-10T17:35:14.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.291+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7ff3d401ebb0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.292+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc0bf5b0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.310 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.294+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7ff3d4014cc0 con 0x7ff3dc0c7220 2022-08-10T17:35:14.379 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.375+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d1cd19c-4765-472f-b541-01dece4d9ec7", "id": 7} v 0) v1 -- 0x7ff3dc072890 con 0x7ff3dc0c7220 2022-08-10T17:35:14.386 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.383+0000 7ff3ca7fc700 1 -- 172.21.15.197:0/3657536505 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d1cd19c-4765-472f-b541-01dece4d9ec7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff3d401e550 con 0x7ff3dc0c7220 2022-08-10T17:35:14.387 INFO:teuthology.orchestra.run.smithi197.stdout:7 2022-08-10T17:35:14.388 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 msgr2=0x7ff3dc156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.389 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4007e30 tx=0x7ff3d400e3c0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.389 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 shutdown_connections 2022-08-10T17:35:14.389 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3dc0c7220 0x7ff3dc156b30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.389 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3dc0c2790 0x7ff3dc149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 --2- 172.21.15.197:0/3657536505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3dc0c4d90 0x7ff3dc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 >> 172.21.15.197:0/3657536505 conn(0x7ff3dc06d0d0 msgr2=0x7ff3dc0c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 shutdown_connections 2022-08-10T17:35:14.390 INFO:teuthology.orchestra.run.smithi197.stderr:2022-08-10T17:35:14.384+0000 7ff3e3be4700 1 -- 172.21.15.197:0/3657536505 wait complete. 2022-08-10T17:35:14.399 INFO:tasks.ceph.osd.0:Restarting daemon 2022-08-10T17:35:14.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-08-10T17:35:14.402 INFO:tasks.ceph.osd.0:Started 2022-08-10T17:35:14.403 INFO:tasks.ceph.osd.1:Restarting daemon 2022-08-10T17:35:14.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-08-10T17:35:14.405 INFO:tasks.ceph.osd.1:Started 2022-08-10T17:35:14.406 INFO:tasks.ceph.osd.2:Restarting daemon 2022-08-10T17:35:14.406 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-08-10T17:35:14.408 INFO:tasks.ceph.osd.2:Started 2022-08-10T17:35:14.409 INFO:tasks.ceph.osd.3:Restarting daemon 2022-08-10T17:35:14.410 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-08-10T17:35:14.412 INFO:tasks.ceph.osd.3:Started 2022-08-10T17:35:14.412 INFO:tasks.ceph.osd.4:Restarting daemon 2022-08-10T17:35:14.413 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-08-10T17:35:14.442 INFO:tasks.ceph.osd.4:Started 2022-08-10T17:35:14.442 INFO:tasks.ceph.osd.5:Restarting daemon 2022-08-10T17:35:14.442 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-08-10T17:35:14.445 INFO:tasks.ceph.osd.5:Started 2022-08-10T17:35:14.445 INFO:tasks.ceph.osd.6:Restarting daemon 2022-08-10T17:35:14.446 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-08-10T17:35:14.448 INFO:tasks.ceph.osd.6:Started 2022-08-10T17:35:14.449 INFO:tasks.ceph.osd.7:Restarting daemon 2022-08-10T17:35:14.450 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-08-10T17:35:14.453 INFO:tasks.ceph.osd.7:Started 2022-08-10T17:35:14.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:14.469 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:14.466+0000 7f03fd4a6080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-08-10T17:35:14.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.596+0000 7fb4e9613700 1 Processor -- start 2022-08-10T17:35:14.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.596+0000 7fb4e9613700 1 -- start start 2022-08-10T17:35:14.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e9613700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb4e406ef90 0x7fb4e40c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e9613700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e406c300 con 0x7fb4e414d780 2022-08-10T17:35:14.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e9613700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e406e3f0 con 0x7fb4e414db50 2022-08-10T17:35:14.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e9613700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e4154370 con 0x7fb4e406ef90 2022-08-10T17:35:14.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb4e414d780 0x7fb4e406b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41394/0 (socket says 172.21.15.150:41394) 2022-08-10T17:35:14.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e2ffd700 1 -- 172.21.15.150:0/2368696883 learned_addr learned my addr 172.21.15.150:0/2368696883 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:14.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.597+0000 7fb4e37fe700 1 --2- 172.21.15.150:0/2368696883 >> v2:172.21.15.197:3300/0 conn(0x7fb4e406ef90 0x7fb4e40c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832685868 0 0) 0x7fb4e406c300 con 0x7fb4e414d780 2022-08-10T17:35:14.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d0003430 con 0x7fb4e414d780 2022-08-10T17:35:14.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643226129 0 0) 0x7fb4e406e3f0 con 0x7fb4e414db50 2022-08-10T17:35:14.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e406c300 con 0x7fb4e414db50 2022-08-10T17:35:14.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913571979 0 0) 0x7fb4d0003430 con 0x7fb4e414d780 2022-08-10T17:35:14.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e37fe700 1 -- 172.21.15.150:0/2368696883 >> v1:172.21.15.197:6789/0 conn(0x7fb4e414db50 legacy=0x7fb4e406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e37fe700 1 -- 172.21.15.150:0/2368696883 >> v1:172.21.15.150:6789/0 conn(0x7fb4e414d780 legacy=0x7fb4e406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e37fe700 1 -- 172.21.15.150:0/2368696883 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e406c550 con 0x7fb4e406ef90 2022-08-10T17:35:14.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e37fe700 1 --2- 172.21.15.150:0/2368696883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e40c57d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009d90 tx=0x7fb4dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9618febc2d967d7f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00e070 con 0x7fb4e406ef90 2022-08-10T17:35:14.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00ba20 con 0x7fb4e406ef90 2022-08-10T17:35:14.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.598+0000 7fb4e1ffb700 1 -- 172.21.15.150:0/2368696883 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4001670 con 0x7fb4e406ef90 2022-08-10T17:35:14.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 -- 172.21.15.150:0/2368696883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 msgr2=0x7fb4e40c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 --2- 172.21.15.150:0/2368696883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e40c57d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009d90 tx=0x7fb4dc00b330 comp rx=0 tx=0).stop 2022-08-10T17:35:14.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 -- 172.21.15.150:0/2368696883 shutdown_connections 2022-08-10T17:35:14.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 --2- 172.21.15.150:0/2368696883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e40c57d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 -- 172.21.15.150:0/2368696883 >> 172.21.15.150:0/2368696883 conn(0x7fb4e40c92f0 msgr2=0x7fb4e40c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 -- 172.21.15.150:0/2368696883 shutdown_connections 2022-08-10T17:35:14.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.599+0000 7fb4e9613700 1 -- 172.21.15.150:0/2368696883 wait complete. 2022-08-10T17:35:14.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.600+0000 7fb4e9613700 1 Processor -- start 2022-08-10T17:35:14.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.600+0000 7fb4e9613700 1 -- start start 2022-08-10T17:35:14.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e41ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4e414d780 0x7fb4e41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:14.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4153750 con 0x7fb4e414db50 2022-08-10T17:35:14.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41dca70 con 0x7fb4e406ef90 2022-08-10T17:35:14.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e9613700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41dc050 con 0x7fb4e414d780 2022-08-10T17:35:14.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.601+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56956/0 (socket says 172.21.15.150:56956) 2022-08-10T17:35:14.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 -- 172.21.15.150:0/3344043813 learned_addr learned my addr 172.21.15.150:0/3344043813 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:14.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e2ffd700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e41ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e27fc700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4e414d780 0x7fb4e41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:14.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 -- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4e414d780 msgr2=0x7fb4e41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4e414d780 0x7fb4e41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 -- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 msgr2=0x7fb4e41ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e41ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 -- 172.21.15.150:0/3344043813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009a70 con 0x7fb4e414db50 2022-08-10T17:35:14.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e37fe700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc004000 tx=0x7fb4dc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:14.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc009410 con 0x7fb4e414db50 2022-08-10T17:35:14.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc01d470 con 0x7fb4e414db50 2022-08-10T17:35:14.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc01d7e0 con 0x7fb4e414db50 2022-08-10T17:35:14.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e41dc330 con 0x7fb4e414db50 2022-08-10T17:35:14.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e41ea370 con 0x7fb4e414db50 2022-08-10T17:35:14.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fb4dc018070 con 0x7fb4e414db50 2022-08-10T17:35:14.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.602+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fb4dc026410 con 0x7fb4e414db50 2022-08-10T17:35:14.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.603+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e41ea8c0 con 0x7fb4e414db50 2022-08-10T17:35:14.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.607+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7fb4dc021020 con 0x7fb4e414db50 2022-08-10T17:35:14.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.674+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4e406d980 con 0x7fb4e414db50 2022-08-10T17:35:14.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.675+0000 7fb4cb7fe700 1 -- 172.21.15.150:0/3344043813 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fb4dc016020 con 0x7fb4e414db50 2022-08-10T17:35:14.680 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:14.680 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":10,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:14.377554+0000","last_up_change":"0.000000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:14.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 msgr2=0x7fb4e40c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:14.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc004000 tx=0x7fb4dc004950 comp rx=0 tx=0).stop 2022-08-10T17:35:14.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 shutdown_connections 2022-08-10T17:35:14.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4e414db50 0x7fb4e40c1fb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4e406ef90 0x7fb4e41ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 --2- 172.21.15.150:0/3344043813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4e414d780 0x7fb4e41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:14.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 >> 172.21.15.150:0/3344043813 conn(0x7fb4e40c92f0 msgr2=0x7fb4e40c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:14.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 shutdown_connections 2022-08-10T17:35:14.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:14.676+0000 7fb4e9613700 1 -- 172.21.15.150:0/3344043813 wait complete. 2022-08-10T17:35:14.696 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-08-10T17:35:14.696 INFO:tasks.ceph:Waiting for OSDs to come up 2022-08-10T17:35:14.779 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:14.775+0000 7f9d7e57c080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-08-10T17:35:14.969 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:14.965+0000 7f9d7e57c080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-08-10T17:35:15.018 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:35:15.014+0000 7f2f97097440 -1 Falling back to public interface 2022-08-10T17:35:15.021 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:35:15.018+0000 7f3f13df7440 -1 Falling back to public interface 2022-08-10T17:35:15.027 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:35:15.023+0000 7f8e799fd440 -1 Falling back to public interface 2022-08-10T17:35:15.041 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:35:15.037+0000 7f962c09d440 -1 Falling back to public interface 2022-08-10T17:35:15.046 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:35:15.042+0000 7f6858a9c440 -1 Falling back to public interface 2022-08-10T17:35:15.053 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:15.050+0000 7f03fd4a6080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-08-10T17:35:15.055 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:35:15.051+0000 7fea9e6be440 -1 Falling back to public interface 2022-08-10T17:35:15.063 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:35:15.059+0000 7f43eef34440 -1 Falling back to public interface 2022-08-10T17:35:15.071 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:35:15.067+0000 7fc129f45440 -1 Falling back to public interface 2022-08-10T17:35:15.111 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:15.107+0000 7f9d7e57c080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-08-10T17:35:15.242 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:15.238+0000 7f03fd4a6080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-08-10T17:35:15.266 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:15.263+0000 7f9d7e57c080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-08-10T17:35:15.380 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:15.376+0000 7f03fd4a6080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-08-10T17:35:15.399 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:15.395+0000 7f9d7e57c080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-08-10T17:35:15.502 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:15.538 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:15.535+0000 7f03fd4a6080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-08-10T17:35:15.616 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.612+0000 7f28a0ac5700 1 Processor -- start 2022-08-10T17:35:15.616 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.612+0000 7f28a0ac5700 1 -- start start 2022-08-10T17:35:15.619 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.613+0000 7f28a0ac5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c157360 0x7f289c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:15.619 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.613+0000 7f28a0ac5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f289c05f7d0 0x7f289c0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:15.620 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.613+0000 7f28a0ac5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0b9450 con 0x7f289c0c42d0 2022-08-10T17:35:15.620 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.613+0000 7f28a0ac5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0b9730 con 0x7f289c05f7d0 2022-08-10T17:35:15.620 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.613+0000 7f28a0ac5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c06e100 con 0x7f289c157360 2022-08-10T17:35:15.620 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f289c05f7d0 0x7f289c0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:15.621 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289ad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f289c0c42d0 0x7f289c159e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41410/0 (socket says 172.21.15.150:41410) 2022-08-10T17:35:15.621 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289ad9d700 1 -- 172.21.15.150:0/2278767411 learned_addr learned my addr 172.21.15.150:0/2278767411 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:15.621 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289a59c700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c157360 0x7f289c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:15.621 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 -- 172.21.15.150:0/2278767411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c157360 msgr2=0x7f289c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:15.622 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c157360 0x7f289c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.622 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 -- 172.21.15.150:0/2278767411 >> v1:172.21.15.150:6789/0 conn(0x7f289c0c42d0 legacy=0x7f289c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:15.622 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289959a700 1 -- 172.21.15.150:0/2278767411 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341198904 0 0) 0x7f289c0b9450 con 0x7f289c0c42d0 2022-08-10T17:35:15.622 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 -- 172.21.15.150:0/2278767411 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c06e3e0 con 0x7f289c05f7d0 2022-08-10T17:35:15.623 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f2899d9b700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c05f7d0 0x7f289c0c5210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28900096b0 tx=0x7f28900099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fadda007ed09df9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:15.623 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289959a700 1 -- 172.21.15.150:0/2278767411 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900107b0 con 0x7f289c05f7d0 2022-08-10T17:35:15.623 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289959a700 1 -- 172.21.15.150:0/2278767411 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890010910 con 0x7f289c05f7d0 2022-08-10T17:35:15.623 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.614+0000 7f289959a700 1 -- 172.21.15.150:0/2278767411 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890010cc0 con 0x7f289c05f7d0 2022-08-10T17:35:15.623 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2278767411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c05f7d0 msgr2=0x7f289c0c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:15.624 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c05f7d0 0x7f289c0c5210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28900096b0 tx=0x7f28900099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.624 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2278767411 shutdown_connections 2022-08-10T17:35:15.624 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c157360 0x7f289c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.624 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2278767411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c05f7d0 0x7f289c0c5210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.624 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2278767411 >> 172.21.15.150:0/2278767411 conn(0x7f289c0c5ca0 msgr2=0x7f289c0c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:15.625 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2278767411 shutdown_connections 2022-08-10T17:35:15.625 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.615+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2278767411 wait complete. 2022-08-10T17:35:15.628 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 Processor -- start 2022-08-10T17:35:15.628 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 -- start start 2022-08-10T17:35:15.629 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c05f7d0 0x7f289c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:15.629 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:15.629 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f289c157360 0x7f289c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:15.629 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c8610 con 0x7f289c0c42d0 2022-08-10T17:35:15.630 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0b6550 con 0x7f289c157360 2022-08-10T17:35:15.630 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.617+0000 7f28a0ac5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c97e0 con 0x7f289c05f7d0 2022-08-10T17:35:15.630 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:15.630 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56966/0 (socket says 172.21.15.150:56966) 2022-08-10T17:35:15.631 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 -- 172.21.15.150:0/2759486553 learned_addr learned my addr 172.21.15.150:0/2759486553 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:15.631 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f289a59c700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c05f7d0 0x7f289c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:15.632 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f289ad9d700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f289c157360 0x7f289c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:15.632 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 -- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c05f7d0 msgr2=0x7f289c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:15.632 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c05f7d0 0x7f289c0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.632 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 -- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f289c157360 msgr2=0x7f289c159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:15.633 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f289c157360 0x7f289c159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.633 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 -- 172.21.15.150:0/2759486553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890009310 con 0x7f289c0c42d0 2022-08-10T17:35:15.633 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f2899d9b700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f28900090b0 tx=0x7f28900045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:15.633 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890010a80 con 0x7f289c0c42d0 2022-08-10T17:35:15.634 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890010be0 con 0x7f289c0c42d0 2022-08-10T17:35:15.634 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0c9ac0 con 0x7f289c0c42d0 2022-08-10T17:35:15.634 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890004270 con 0x7f289c0c42d0 2022-08-10T17:35:15.634 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.618+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0c82a0 con 0x7f289c0c42d0 2022-08-10T17:35:15.635 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.619+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f289002d070 con 0x7f289c0c42d0 2022-08-10T17:35:15.635 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.619+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f2890021030 con 0x7f289c0c42d0 2022-08-10T17:35:15.635 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.619+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c0c8100 con 0x7f289c0c42d0 2022-08-10T17:35:15.635 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.621+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70815 (secure 0 0 0) 0x7f289c0c8100 con 0x7f289c0c42d0 2022-08-10T17:35:15.676 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:15.672+0000 7f03fd4a6080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-08-10T17:35:15.694 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.690+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f289c0c9fe0 con 0x7f289c0c42d0 2022-08-10T17:35:15.695 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.691+0000 7f288affd700 1 -- 172.21.15.150:0/2759486553 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f289002b060 con 0x7f289c0c42d0 2022-08-10T17:35:15.695 INFO:teuthology.misc.health.smithi150.stdout: 2022-08-10T17:35:15.695 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":10,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:14.377554+0000","last_up_change":"0.000000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:15.697 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 msgr2=0x7f289c0bc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:15.697 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f28900090b0 tx=0x7f28900045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.697 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 shutdown_connections 2022-08-10T17:35:15.697 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f289c157360 0x7f289c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.698 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f289c05f7d0 0x7f289c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.698 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 --2- 172.21.15.150:0/2759486553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f289c0c42d0 0x7f289c0bc460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:15.698 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 >> 172.21.15.150:0/2759486553 conn(0x7f289c0c5ca0 msgr2=0x7f289c1dfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:15.698 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 shutdown_connections 2022-08-10T17:35:15.698 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:15.692+0000 7f28a0ac5700 1 -- 172.21.15.150:0/2759486553 wait complete. 2022-08-10T17:35:15.707 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-08-10T17:35:15.756 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:15.752+0000 7f9d7e57c080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-08-10T17:35:15.906 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:15.902+0000 7f9d7e57c080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-08-10T17:35:16.019 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:16.016+0000 7f9d7e57c080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-08-10T17:35:16.032 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.028+0000 7f03fd4a6080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-08-10T17:35:16.162 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:16.158+0000 7f9d7e57c080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-08-10T17:35:16.183 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.179+0000 7f03fd4a6080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-08-10T17:35:16.259 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:16.255+0000 7f9d7e57c080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-08-10T17:35:16.296 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.293+0000 7f03fd4a6080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-08-10T17:35:16.436 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:16.432+0000 7f9d7e57c080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-08-10T17:35:16.440 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.436+0000 7f03fd4a6080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-08-10T17:35:16.536 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.533+0000 7f03fd4a6080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-08-10T17:35:16.717 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:16.713+0000 7f03fd4a6080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-08-10T17:35:17.185 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:17.181+0000 7f9d7e57c080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-08-10T17:35:17.469 INFO:tasks.ceph.mgr.y.smithi150.stderr:2022-08-10T17:35:17.466+0000 7f03fd4a6080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-08-10T17:35:18.213 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:18.208+0000 7f9d36b9a700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-08-10T17:35:18.213 INFO:tasks.ceph.mgr.x.smithi197.stderr:2022-08-10T17:35:18.209+0000 7f9d36b9a700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-08-10T17:35:22.514 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:22.633 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.630+0000 7f5b94887700 1 Processor -- start 2022-08-10T17:35:22.634 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.630+0000 7f5b94887700 1 -- start start 2022-08-10T17:35:22.640 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b94887700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b90071550 0x7f5b9015a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.641 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b94887700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b900c4420 0x7f5b9015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.641 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b94887700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b900691b0 con 0x7f5b9006b620 2022-08-10T17:35:22.641 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b94887700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b90156d80 con 0x7f5b900c4420 2022-08-10T17:35:22.641 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b94887700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900c5630 con 0x7f5b90071550 2022-08-10T17:35:22.642 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b900c4420 0x7f5b9015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.642 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b900c4420 0x7f5b9015ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56978/0 (socket says 172.21.15.150:56978) 2022-08-10T17:35:22.642 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 -- 172.21.15.150:0/1359970636 learned_addr learned my addr 172.21.15.150:0/1359970636 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:22.643 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8e59c700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b90071550 0x7f5b9015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.643 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 -- 172.21.15.150:0/1359970636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b90071550 msgr2=0x7f5b9015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:22.643 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b90071550 0x7f5b9015a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.643 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 -- 172.21.15.150:0/1359970636 >> v1:172.21.15.197:6789/0 conn(0x7f5b9006b620 legacy=0x7f5b90153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.643 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 -- 172.21.15.150:0/1359970636 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900699c0 con 0x7f5b900c4420 2022-08-10T17:35:22.644 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8ed9d700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b900c4420 0x7f5b9015ae50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009e80 tx=0x7f5b8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf05f24142d998d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:22.644 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8d59a700 1 -- 172.21.15.150:0/1359970636 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800e070 con 0x7f5b900c4420 2022-08-10T17:35:22.644 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8d59a700 1 -- 172.21.15.150:0/1359970636 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8800b980 con 0x7f5b900c4420 2022-08-10T17:35:22.644 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.631+0000 7f5b8d59a700 1 -- 172.21.15.150:0/1359970636 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800bd30 con 0x7f5b900c4420 2022-08-10T17:35:22.645 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 -- 172.21.15.150:0/1359970636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b900c4420 msgr2=0x7f5b9015ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.645 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b900c4420 0x7f5b9015ae50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009e80 tx=0x7f5b8800b330 comp rx=0 tx=0).stop 2022-08-10T17:35:22.645 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 -- 172.21.15.150:0/1359970636 shutdown_connections 2022-08-10T17:35:22.645 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b900c4420 0x7f5b9015ae50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.646 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 --2- 172.21.15.150:0/1359970636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b90071550 0x7f5b9015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.646 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 -- 172.21.15.150:0/1359970636 >> 172.21.15.150:0/1359970636 conn(0x7f5b900ca4f0 msgr2=0x7f5b9006aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:22.646 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 -- 172.21.15.150:0/1359970636 shutdown_connections 2022-08-10T17:35:22.646 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.632+0000 7f5b94887700 1 -- 172.21.15.150:0/1359970636 wait complete. 2022-08-10T17:35:22.647 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.633+0000 7f5b94887700 1 Processor -- start 2022-08-10T17:35:22.647 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.633+0000 7f5b94887700 1 -- start start 2022-08-10T17:35:22.647 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 0x7f5b90153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.647 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.648 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b900c4420 0x7f5b90149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.648 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900af500 con 0x7f5b90071550 2022-08-10T17:35:22.648 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b901ebfb0 con 0x7f5b9006b620 2022-08-10T17:35:22.648 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b94887700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b901ef600 con 0x7f5b900c4420 2022-08-10T17:35:22.648 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.649 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56982/0 (socket says 172.21.15.150:56982) 2022-08-10T17:35:22.649 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 -- 172.21.15.150:0/550796102 learned_addr learned my addr 172.21.15.150:0/550796102 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:22.649 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8e59c700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 0x7f5b90153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.649 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8ed9d700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b900c4420 0x7f5b90149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.650 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 -- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b900c4420 msgr2=0x7f5b90149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.650 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b900c4420 0x7f5b90149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.650 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 -- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 msgr2=0x7f5b90153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.650 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 0x7f5b90153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.651 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8dd9b700 1 -- 172.21.15.150:0/550796102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88009b30 con 0x7f5b90071550 2022-08-10T17:35:22.651 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.634+0000 7f5b8e59c700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 0x7f5b90153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:22.651 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b8dd9b700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c3c0 tx=0x7f5b8400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:22.651 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b840052d0 con 0x7f5b90071550 2022-08-10T17:35:22.651 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b84007020 con 0x7f5b90071550 2022-08-10T17:35:22.652 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b901ef8c0 con 0x7f5b90071550 2022-08-10T17:35:22.652 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b840073d0 con 0x7f5b90071550 2022-08-10T17:35:22.652 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.635+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b901efe80 con 0x7f5b90071550 2022-08-10T17:35:22.652 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.636+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b901ec120 con 0x7f5b90071550 2022-08-10T17:35:22.653 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.636+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 83314+0+0 (secure 0 0 0) 0x7f5b84010050 con 0x7f5b90071550 2022-08-10T17:35:22.653 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.636+0000 7f5b7effd700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 0x7f5b6c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:22.653 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.637+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5b8407fcd0 con 0x7f5b90071550 2022-08-10T17:35:22.653 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.637+0000 7f5b8e59c700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 0x7f5b6c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:22.653 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.637+0000 7f5b8e59c700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 0x7f5b6c067540 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000b9d0 tx=0x7f5b80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:22.654 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.641+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5b840496b0 con 0x7f5b90071550 2022-08-10T17:35:22.864 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.860+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b9004cf10 con 0x7f5b90071550 2022-08-10T17:35:22.865 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.861+0000 7f5b7effd700 1 -- 172.21.15.150:0/550796102 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5b901ec120 con 0x7f5b90071550 2022-08-10T17:35:22.865 INFO:teuthology.misc.health.smithi150.stdout: 2022-08-10T17:35:22.866 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":10,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:14.377554+0000","last_up_change":"0.000000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:22.870 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 msgr2=0x7f5b6c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.870 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 0x7f5b6c067540 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000b9d0 tx=0x7f5b80008040 comp rx=0 tx=0).stop 2022-08-10T17:35:22.871 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 msgr2=0x7f5b9014f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:22.871 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c3c0 tx=0x7f5b8400c780 comp rx=0 tx=0).stop 2022-08-10T17:35:22.871 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 shutdown_connections 2022-08-10T17:35:22.871 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b6c065090 0x7f5b6c067540 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.872 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5b900c4420 0x7f5b90149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.872 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9006b620 0x7f5b90153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.872 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 --2- 172.21.15.150:0/550796102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b90071550 0x7f5b9014f0c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:22.872 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 >> 172.21.15.150:0/550796102 conn(0x7f5b900ca4f0 msgr2=0x7f5b900c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:22.873 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 shutdown_connections 2022-08-10T17:35:22.873 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:22.866+0000 7f5b94887700 1 -- 172.21.15.150:0/550796102 wait complete. 2022-08-10T17:35:22.917 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-08-10T17:35:23.519 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:35:23.515+0000 7f2f97097440 -1 osd.0 0 log_to_monitors true 2022-08-10T17:35:23.577 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:35:23.574+0000 7f6858a9c440 -1 osd.4 0 log_to_monitors true 2022-08-10T17:35:23.580 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:35:23.577+0000 7f8e799fd440 -1 osd.1 0 log_to_monitors true 2022-08-10T17:35:23.591 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:35:23.587+0000 7f962c09d440 -1 osd.3 0 log_to_monitors true 2022-08-10T17:35:23.592 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:35:23.589+0000 7f3f13df7440 -1 osd.2 0 log_to_monitors true 2022-08-10T17:35:23.628 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:35:23.624+0000 7fea9e6be440 -1 osd.5 0 log_to_monitors true 2022-08-10T17:35:23.635 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:35:23.632+0000 7fc129f45440 -1 osd.6 0 log_to_monitors true 2022-08-10T17:35:23.648 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:35:23.644+0000 7f43eef34440 -1 osd.7 0 log_to_monitors true 2022-08-10T17:35:25.852 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:35:25.848+0000 7f3f07bb4700 -1 osd.2 0 waiting for initial osdmap 2022-08-10T17:35:25.856 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:35:25.852+0000 7f2f8ae54700 -1 osd.0 0 waiting for initial osdmap 2022-08-10T17:35:25.865 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:35:25.862+0000 7f2f83a30700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.866 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:35:25.862+0000 7f3f00790700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.880 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:35:25.876+0000 7f8e6d7ba700 -1 osd.1 0 waiting for initial osdmap 2022-08-10T17:35:25.886 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:35:25.882+0000 7f961fe5a700 -1 osd.3 0 waiting for initial osdmap 2022-08-10T17:35:25.890 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:35:25.887+0000 7fea9247b700 -1 osd.5 0 waiting for initial osdmap 2022-08-10T17:35:25.893 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:35:25.890+0000 7f43e2cf1700 -1 osd.7 0 waiting for initial osdmap 2022-08-10T17:35:25.896 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:35:25.893+0000 7f8e66396700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.896 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:35:25.893+0000 7f9618a36700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.899 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:35:25.895+0000 7fc11dd02700 -1 osd.6 0 waiting for initial osdmap 2022-08-10T17:35:25.906 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:35:25.903+0000 7f684c859700 -1 osd.4 0 waiting for initial osdmap 2022-08-10T17:35:25.908 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:35:25.905+0000 7f43db8cd700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.909 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:35:25.905+0000 7fea8b057700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.913 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:35:25.910+0000 7fc1168de700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:25.925 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:35:25.922+0000 7f6845435700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-08-10T17:35:29.724 DEBUG:teuthology.orchestra.run.smithi150:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:29.836 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.833+0000 7efe987d8700 1 Processor -- start 2022-08-10T17:35:29.837 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.833+0000 7efe987d8700 1 -- start start 2022-08-10T17:35:29.847 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe987d8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe900c3250 0x7efe900c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:29.847 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe987d8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90068110 con 0x7efe900c7290 2022-08-10T17:35:29.847 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe987d8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900686d0 con 0x7efe900c3620 2022-08-10T17:35:29.848 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe987d8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900c6150 con 0x7efe900c3250 2022-08-10T17:35:29.848 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe95d73700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7efe900c7290 0x7efe90068b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41666/0 (socket says 172.21.15.150:41666) 2022-08-10T17:35:29.849 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe95d73700 1 -- 172.21.15.150:0/3784299064 learned_addr learned my addr 172.21.15.150:0/3784299064 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:29.849 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe96574700 1 --2- 172.21.15.150:0/3784299064 >> v2:172.21.15.150:3300/0 conn(0x7efe900c3250 0x7efe900c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:29.849 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe96574700 1 -- 172.21.15.150:0/3784299064 >> v1:172.21.15.197:6789/0 conn(0x7efe900c3620 legacy=0x7efe9015dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:29.850 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe96574700 1 -- 172.21.15.150:0/3784299064 >> v1:172.21.15.150:6789/0 conn(0x7efe900c7290 legacy=0x7efe90068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:29.850 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe96574700 1 -- 172.21.15.150:0/3784299064 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9006fe10 con 0x7efe900c3250 2022-08-10T17:35:29.850 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe96574700 1 --2- 172.21.15.150:0/3784299064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe900c3250 0x7efe900c4ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0096b0 tx=0x7efe8c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23601d0268dc0b5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:29.850 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe95572700 1 -- 172.21.15.150:0/3784299064 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c011830 con 0x7efe900c3250 2022-08-10T17:35:29.851 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe95572700 1 -- 172.21.15.150:0/3784299064 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c011990 con 0x7efe900c3250 2022-08-10T17:35:29.851 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.834+0000 7efe95572700 1 -- 172.21.15.150:0/3784299064 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c011d40 con 0x7efe900c3250 2022-08-10T17:35:29.851 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 -- 172.21.15.150:0/3784299064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe900c3250 msgr2=0x7efe900c4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:29.851 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 --2- 172.21.15.150:0/3784299064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe900c3250 0x7efe900c4ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0096b0 tx=0x7efe8c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:29.852 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 -- 172.21.15.150:0/3784299064 shutdown_connections 2022-08-10T17:35:29.852 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 --2- 172.21.15.150:0/3784299064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe900c3250 0x7efe900c4ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:29.852 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 -- 172.21.15.150:0/3784299064 >> 172.21.15.150:0/3784299064 conn(0x7efe900c65f0 msgr2=0x7efe900c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:29.852 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 -- 172.21.15.150:0/3784299064 shutdown_connections 2022-08-10T17:35:29.853 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.835+0000 7efe987d8700 1 -- 172.21.15.150:0/3784299064 wait complete. 2022-08-10T17:35:29.853 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.836+0000 7efe987d8700 1 Processor -- start 2022-08-10T17:35:29.853 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.836+0000 7efe987d8700 1 -- start start 2022-08-10T17:35:29.853 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 0x7efe901ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:29.853 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe900c7290 0x7efe90071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:29.854 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:29.854 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9014fca0 con 0x7efe90151670 2022-08-10T17:35:29.854 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90152960 con 0x7efe900c3250 2022-08-10T17:35:29.854 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe987d8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe901ed130 con 0x7efe900c7290 2022-08-10T17:35:29.855 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96574700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 0x7efe901ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:29.855 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:29.855 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96574700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 0x7efe901ecbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:39584/0 (socket says 172.21.15.150:39584) 2022-08-10T17:35:29.855 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57228/0 (socket says 172.21.15.150:57228) 2022-08-10T17:35:29.855 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 -- 172.21.15.150:0/433797796 learned_addr learned my addr 172.21.15.150:0/433797796 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:29.856 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe95d73700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe900c7290 0x7efe90071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:29.856 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 -- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe900c7290 msgr2=0x7efe90071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:29.856 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe900c7290 0x7efe90071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:29.856 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 -- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 msgr2=0x7efe901ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:29.857 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 0x7efe901ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:29.857 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 -- 172.21.15.150:0/433797796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c009310 con 0x7efe90151670 2022-08-10T17:35:29.857 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.837+0000 7efe96d75700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c730 tx=0x7efe8800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:29.857 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.838+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88003a80 con 0x7efe90151670 2022-08-10T17:35:29.857 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.838+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88003c00 con 0x7efe90151670 2022-08-10T17:35:29.858 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.838+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900c0dd0 con 0x7efe90151670 2022-08-10T17:35:29.858 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.838+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880050d0 con 0x7efe90151670 2022-08-10T17:35:29.858 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.838+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe901ec760 con 0x7efe90151670 2022-08-10T17:35:29.859 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.839+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe901ec8f0 con 0x7efe90151670 2022-08-10T17:35:29.859 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.839+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 83314+0+0 (secure 0 0 0) 0x7efe88019030 con 0x7efe90151670 2022-08-10T17:35:29.859 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.839+0000 7efe7effd700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 0x7efe70067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:29.860 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.840+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efe88080db0 con 0x7efe90151670 2022-08-10T17:35:29.860 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.840+0000 7efe96574700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 0x7efe70067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:29.860 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.840+0000 7efe96574700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 0x7efe70067540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe8c000c00 tx=0x7efe8c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:29.861 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:29.844+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7efe8804f5a0 con 0x7efe90151670 2022-08-10T17:35:30.028 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.024+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe9004cf10 con 0x7efe90151670 2022-08-10T17:35:30.029 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.025+0000 7efe7effd700 1 -- 172.21.15.150:0/433797796 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7efe88017020 con 0x7efe90151670 2022-08-10T17:35:30.029 INFO:teuthology.misc.health.smithi150.stdout: 2022-08-10T17:35:30.029 INFO:teuthology.misc.health.smithi150.stdout:{"epoch":16,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:29.955636+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:30.031 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 msgr2=0x7efe70067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.031 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 0x7efe70067540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe8c000c00 tx=0x7efe8c01c040 comp rx=0 tx=0).stop 2022-08-10T17:35:30.032 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 msgr2=0x7efe900718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.032 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c730 tx=0x7efe8800ca40 comp rx=0 tx=0).stop 2022-08-10T17:35:30.032 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 shutdown_connections 2022-08-10T17:35:30.032 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe90151670 0x7efe900718b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.033 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe900c3250 0x7efe901ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.033 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe70065090 0x7efe70067540 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.033 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 --2- 172.21.15.150:0/433797796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe900c7290 0x7efe90071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.033 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 >> 172.21.15.150:0/433797796 conn(0x7efe900c65f0 msgr2=0x7efe900c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:30.034 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 shutdown_connections 2022-08-10T17:35:30.034 INFO:teuthology.misc.health.smithi150.stderr:2022-08-10T17:35:30.027+0000 7efe987d8700 1 -- 172.21.15.150:0/433797796 wait complete. 2022-08-10T17:35:30.041 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-08-10T17:35:30.042 INFO:tasks.ceph:Creating RBD pool 2022-08-10T17:35:30.042 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd pool create rbd 8 2022-08-10T17:35:30.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.158+0000 7f8ed8816700 1 Processor -- start 2022-08-10T17:35:30.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.158+0000 7f8ed8816700 1 -- start start 2022-08-10T17:35:30.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed8816700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8ed40c4d90 0x7f8ed40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed8816700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed40699c0 con 0x7f8ed40c7220 2022-08-10T17:35:30.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed8816700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed4068e40 con 0x7f8ed40c2790 2022-08-10T17:35:30.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed8816700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed40c5e10 con 0x7f8ed40c4d90 2022-08-10T17:35:30.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed1d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8ed40c7220 0x7f8ed40c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41680/0 (socket says 172.21.15.150:41680) 2022-08-10T17:35:30.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed1d9b700 1 -- 172.21.15.150:0/2301850387 learned_addr learned my addr 172.21.15.150:0/2301850387 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:30.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745335483 0 0) 0x7f8ed40699c0 con 0x7f8ed40c7220 2022-08-10T17:35:30.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb8003430 con 0x7f8ed40c7220 2022-08-10T17:35:30.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2301850387 >> v2:172.21.15.197:3300/0 conn(0x7f8ed40c4d90 0x7f8ed40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122503606 0 0) 0x7f8eb8003430 con 0x7f8ed40c7220 2022-08-10T17:35:30.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 >> v2:172.21.15.197:3300/0 conn(0x7f8ed40c4d90 msgr2=0x7f8ed40c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:30.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.159+0000 7f8ed159a700 1 --2- 172.21.15.150:0/2301850387 >> v2:172.21.15.197:3300/0 conn(0x7f8ed40c4d90 0x7f8ed40c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 >> v1:172.21.15.197:6789/0 conn(0x7f8ed40c2790 legacy=0x7f8ed406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4069120 con 0x7f8ed40c7220 2022-08-10T17:35:30.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f8ec4001670 con 0x7f8ed40c7220 2022-08-10T17:35:30.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 >> v1:172.21.15.150:6789/0 conn(0x7f8ed40c7220 legacy=0x7f8ed40c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb8003880 0x7f8eb8003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 0x7f8eb8004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8eb8005080 0x7f8eb800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40c5e10 con 0x7f8eb80046d0 2022-08-10T17:35:30.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb800bee0 con 0x7f8eb8005080 2022-08-10T17:35:30.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb800c0a0 con 0x7f8eb8003880 2022-08-10T17:35:30.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 0x7f8eb8004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb8003880 0x7f8eb8003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed2d9d700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8eb8005080 0x7f8eb800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 -- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb8003880 msgr2=0x7f8eb8003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:30.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb8003880 0x7f8eb8003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 -- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8eb8005080 msgr2=0x7f8eb800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:30.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8eb8005080 0x7f8eb800b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 -- 172.21.15.150:0/2301850387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8003430 con 0x7f8eb80046d0 2022-08-10T17:35:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed2d9d700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8eb8005080 0x7f8eb800b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed2d9d700 1 -- 172.21.15.150:0/2301850387 reap_dead start 2022-08-10T17:35:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 0x7f8eb8004b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4007fd0 tx=0x7f8eb8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc7b16d8b8763a8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4007a90 con 0x7f8eb80046d0 2022-08-10T17:35:30.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400cc50 con 0x7f8eb80046d0 2022-08-10T17:35:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.160+0000 7f8ed159a700 1 -- 172.21.15.150:0/2301850387 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40070d0 con 0x7f8eb80046d0 2022-08-10T17:35:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 -- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 msgr2=0x7f8eb8004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 0x7f8eb8004b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4007fd0 tx=0x7f8eb8005700 comp rx=0 tx=0).stop 2022-08-10T17:35:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 -- 172.21.15.150:0/2301850387 shutdown_connections 2022-08-10T17:35:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2301850387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eb80046d0 0x7f8eb8004b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 -- 172.21.15.150:0/2301850387 >> 172.21.15.150:0/2301850387 conn(0x7f8ed406d0d0 msgr2=0x7f8ed40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:30.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 -- 172.21.15.150:0/2301850387 shutdown_connections 2022-08-10T17:35:30.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.161+0000 7f8ed8816700 1 -- 172.21.15.150:0/2301850387 wait complete. 2022-08-10T17:35:30.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.163+0000 7f8ed8816700 1 Processor -- start 2022-08-10T17:35:30.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.163+0000 7f8ed8816700 1 -- start start 2022-08-10T17:35:30.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.163+0000 7f8ed8816700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 0x7f8ed41e8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.163+0000 7f8ed8816700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 0x7f8ed414d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed41479f0 con 0x7f8ed41eb450 2022-08-10T17:35:30.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed41e8390 con 0x7f8ed414c9e0 2022-08-10T17:35:30.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4146fe0 con 0x7f8eb80046d0 2022-08-10T17:35:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57248/0 (socket says 172.21.15.150:57248) 2022-08-10T17:35:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 -- 172.21.15.150:0/2771220769 learned_addr learned my addr 172.21.15.150:0/2771220769 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:30.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 0x7f8ed41e8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 0x7f8ed414d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 -- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 msgr2=0x7f8ed41e8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 0x7f8ed41e8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 -- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 msgr2=0x7f8ed414d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 0x7f8ed414d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 -- 172.21.15.150:0/2771220769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed414ea60 con 0x7f8ed41eb450 2022-08-10T17:35:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 0x7f8ed41e8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:30.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed1d9b700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 0x7f8ed414d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed2d9d700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40c2bf0 tx=0x7f8ecc00e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00eeb0 con 0x7f8ed41eb450 2022-08-10T17:35:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc003a90 con 0x7f8ed41eb450 2022-08-10T17:35:30.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed414bd00 con 0x7f8ed41eb450 2022-08-10T17:35:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc003e60 con 0x7f8ed41eb450 2022-08-10T17:35:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.164+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed414c2c0 con 0x7f8ed41eb450 2022-08-10T17:35:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.165+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed4072890 con 0x7f8ed41eb450 2022-08-10T17:35:30.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.165+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 83314+0+0 (secure 0 0 0) 0x7f8ecc01b030 con 0x7f8ed41eb450 2022-08-10T17:35:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.166+0000 7f8ec2ffd700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 0x7f8eb0067500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.166+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ecc080eb0 con 0x7f8ed41eb450 2022-08-10T17:35:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.166+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 0x7f8eb0067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:30.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.166+0000 7f8ed259c700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 0x7f8eb0067500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009b50 tx=0x7f8ec8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:30.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.170+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8ecc04f6a0 con 0x7f8ed41eb450 2022-08-10T17:35:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.348+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f8ed414ec60 con 0x7f8ed41eb450 2022-08-10T17:35:30.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.972+0000 7f8ec2ffd700 1 -- 172.21.15.150:0/2771220769 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f8ecc019070 con 0x7f8ed41eb450 2022-08-10T17:35:30.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.974+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 msgr2=0x7f8eb0067500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.974+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 0x7f8eb0067500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009b50 tx=0x7f8ec8008040 comp rx=0 tx=0).stop 2022-08-10T17:35:30.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.974+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 msgr2=0x7f8ed41eb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:30.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.974+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40c2bf0 tx=0x7f8ecc00e860 comp rx=0 tx=0).stop 2022-08-10T17:35:30.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 shutdown_connections 2022-08-10T17:35:30.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed41eb450 0x7f8ed41eb8c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8eb0065050 0x7f8eb0067500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8eb80046d0 0x7f8ed41e8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 --2- 172.21.15.150:0/2771220769 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ed414c9e0 0x7f8ed414d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:30.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 >> 172.21.15.150:0/2771220769 conn(0x7f8ed406d0d0 msgr2=0x7f8ed4063cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:30.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 shutdown_connections 2022-08-10T17:35:30.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:30.975+0000 7f8ed8816700 1 -- 172.21.15.150:0/2771220769 wait complete. 2022-08-10T17:35:30.983 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'rbd' created 2022-08-10T17:35:30.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-08-10T17:35:31.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.113+0000 7fe91b415700 1 Processor -- start 2022-08-10T17:35:31.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.113+0000 7fe91b415700 1 -- start start 2022-08-10T17:35:31.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe91b415700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe914068e70 0x7fe91406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe91b415700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe914153c80 con 0x7fe914152c70 2022-08-10T17:35:31.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe91b415700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9140682d0 con 0x7fe91414cd60 2022-08-10T17:35:31.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe91b415700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140c4da0 con 0x7fe914068e70 2022-08-10T17:35:31.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe9189b0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe914152c70 0x7fe914068760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41702/0 (socket says 172.21.15.150:41702) 2022-08-10T17:35:31.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe9189b0700 1 -- 172.21.15.150:0/2248648352 learned_addr learned my addr 172.21.15.150:0/2248648352 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:31.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe9199b2700 1 --2- 172.21.15.150:0/2248648352 >> v2:172.21.15.197:3300/0 conn(0x7fe914068e70 0x7fe91406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006804466 0 0) 0x7fe914153c80 con 0x7fe914152c70 2022-08-10T17:35:31.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.114+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8fc003430 con 0x7fe914152c70 2022-08-10T17:35:31.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071796258 0 0) 0x7fe8fc003430 con 0x7fe914152c70 2022-08-10T17:35:31.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 >> v2:172.21.15.197:3300/0 conn(0x7fe914068e70 msgr2=0x7fe91406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:31.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 --2- 172.21.15.150:0/2248648352 >> v2:172.21.15.197:3300/0 conn(0x7fe914068e70 0x7fe91406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 >> v1:172.21.15.197:6789/0 conn(0x7fe91414cd60 legacy=0x7fe91406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914153100 con 0x7fe914152c70 2022-08-10T17:35:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fe910001670 con 0x7fe914152c70 2022-08-10T17:35:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 >> v1:172.21.15.150:6789/0 conn(0x7fe914152c70 legacy=0x7fe914068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 0x7fe8fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0046d0 0x7fe8fc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe8fc005080 0x7fe8fc00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c4da0 con 0x7fe8fc0038f0 2022-08-10T17:35:31.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc00bf60 con 0x7fe8fc005080 2022-08-10T17:35:31.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc00e330 con 0x7fe8fc0046d0 2022-08-10T17:35:31.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 0x7fe8fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9189b0700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0046d0 0x7fe8fc004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9199b2700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe8fc005080 0x7fe8fc00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 -- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0046d0 msgr2=0x7fe8fc004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:31.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0046d0 0x7fe8fc004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 -- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe8fc005080 msgr2=0x7fe8fc00b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:31.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe8fc005080 0x7fe8fc00b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 -- 172.21.15.150:0/2248648352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc003430 con 0x7fe8fc0038f0 2022-08-10T17:35:31.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9199b2700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe8fc005080 0x7fe8fc00b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:31.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9199b2700 1 -- 172.21.15.150:0/2248648352 reap_dead start 2022-08-10T17:35:31.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe9191b1700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 0x7fe8fc003d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe904001640 tx=0x7fe8fc005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22ca79a3aaef40e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:31.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040052d0 con 0x7fe8fc0038f0 2022-08-10T17:35:31.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904003500 con 0x7fe8fc0038f0 2022-08-10T17:35:31.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.115+0000 7fe903fff700 1 -- 172.21.15.150:0/2248648352 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040038b0 con 0x7fe8fc0038f0 2022-08-10T17:35:31.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 -- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 msgr2=0x7fe8fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 0x7fe8fc003d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe904001640 tx=0x7fe8fc005700 comp rx=0 tx=0).stop 2022-08-10T17:35:31.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 -- 172.21.15.150:0/2248648352 shutdown_connections 2022-08-10T17:35:31.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 --2- 172.21.15.150:0/2248648352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8fc0038f0 0x7fe8fc003d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 -- 172.21.15.150:0/2248648352 >> 172.21.15.150:0/2248648352 conn(0x7fe9140c9290 msgr2=0x7fe9140c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:31.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 -- 172.21.15.150:0/2248648352 shutdown_connections 2022-08-10T17:35:31.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.116+0000 7fe91b415700 1 -- 172.21.15.150:0/2248648352 wait complete. 2022-08-10T17:35:31.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 Processor -- start 2022-08-10T17:35:31.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 -- start start 2022-08-10T17:35:31.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0038f0 0x7fe91414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe914148e40 0x7fe914138af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe914147cf0 con 0x7fe9141470d0 2022-08-10T17:35:31.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91413ca40 con 0x7fe914148e40 2022-08-10T17:35:31.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.118+0000 7fe91b415700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91414c6d0 con 0x7fe8fc0038f0 2022-08-10T17:35:31.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57266/0 (socket says 172.21.15.150:57266) 2022-08-10T17:35:31.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 -- 172.21.15.150:0/1735521880 learned_addr learned my addr 172.21.15.150:0/1735521880 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:31.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9191b1700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0038f0 0x7fe91414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9199b2700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe914148e40 0x7fe914138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 -- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0038f0 msgr2=0x7fe91414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0038f0 0x7fe91414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 -- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe914148e40 msgr2=0x7fe914138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe914148e40 0x7fe914138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 -- 172.21.15.150:0/1735521880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914148640 con 0x7fe9141470d0 2022-08-10T17:35:31.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe9189b0700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe910007770 tx=0x7fe9100049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:31.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910012350 con 0x7fe9141470d0 2022-08-10T17:35:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100124b0 con 0x7fe9141470d0 2022-08-10T17:35:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910012860 con 0x7fe9141470d0 2022-08-10T17:35:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914142390 con 0x7fe9141470d0 2022-08-10T17:35:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.119+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91414be30 con 0x7fe9141470d0 2022-08-10T17:35:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.120+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe914072890 con 0x7fe9141470d0 2022-08-10T17:35:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.121+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 83314+0+0 (secure 0 0 0) 0x7fe9100129c0 con 0x7fe9141470d0 2022-08-10T17:35:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.121+0000 7fe901ffb700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 0x7fe8f4067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.121+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7fe910080fb0 con 0x7fe9141470d0 2022-08-10T17:35:31.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.121+0000 7fe9191b1700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 0x7fe8f4067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.122+0000 7fe9191b1700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 0x7fe8f4067510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe904000c00 tx=0x7fe904009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:31.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.125+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe91004f710 con 0x7fe9141470d0 2022-08-10T17:35:31.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.307+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe914148640 con 0x7fe9141470d0 2022-08-10T17:35:31.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.984+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe91007f5a0 con 0x7fe9141470d0 2022-08-10T17:35:31.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.985+0000 7fe901ffb700 1 -- 172.21.15.150:0/1735521880 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe910053140 con 0x7fe9141470d0 2022-08-10T17:35:31.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 msgr2=0x7fe8f4067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 0x7fe8f4067510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe904000c00 tx=0x7fe904009030 comp rx=0 tx=0).stop 2022-08-10T17:35:31.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 msgr2=0x7fe914148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:31.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe910007770 tx=0x7fe9100049d0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 shutdown_connections 2022-08-10T17:35:31.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe914148e40 0x7fe914138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe8f4065060 0x7fe8f4067510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe8fc0038f0 0x7fe91414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 --2- 172.21.15.150:0/1735521880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9141470d0 0x7fe914148900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:31.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.988+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 >> 172.21.15.150:0/1735521880 conn(0x7fe9140c9290 msgr2=0x7fe9140c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:31.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.989+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 shutdown_connections 2022-08-10T17:35:31.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:31.989+0000 7fe91b415700 1 -- 172.21.15.150:0/1735521880 wait complete. 2022-08-10T17:35:31.996 INFO:teuthology.orchestra.run.smithi150.stderr:enabled application 'rbd' on pool 'rbd' 2022-08-10T17:35:32.006 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-08-10T17:35:32.006 INFO:tasks.ceph.mds.a:Restarting daemon 2022-08-10T17:35:32.007 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-08-10T17:35:32.009 INFO:tasks.ceph.mds.a:Started 2022-08-10T17:35:32.010 INFO:tasks.ceph.mds.c:Restarting daemon 2022-08-10T17:35:32.010 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-08-10T17:35:32.012 INFO:tasks.ceph.mds.c:Started 2022-08-10T17:35:32.013 INFO:tasks.ceph.mds.e:Restarting daemon 2022-08-10T17:35:32.013 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-08-10T17:35:32.015 INFO:tasks.ceph.mds.e:Started 2022-08-10T17:35:32.016 INFO:tasks.ceph.mds.b:Restarting daemon 2022-08-10T17:35:32.016 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-08-10T17:35:32.019 INFO:tasks.ceph.mds.b:Started 2022-08-10T17:35:32.019 INFO:tasks.ceph.mds.d:Restarting daemon 2022-08-10T17:35:32.020 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-08-10T17:35:32.022 INFO:tasks.ceph.mds.d:Started 2022-08-10T17:35:32.023 INFO:tasks.ceph.mds.f:Restarting daemon 2022-08-10T17:35:32.023 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-08-10T17:35:32.025 INFO:tasks.ceph.mds.f:Started 2022-08-10T17:35:32.026 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-08-10T17:35:32.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:32.093 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2022-08-10T17:35:32.096 INFO:tasks.ceph.mds.e.smithi150.stdout:starting mds.e at 2022-08-10T17:35:32.096 INFO:tasks.ceph.mds.c.smithi150.stdout:starting mds.c at 2022-08-10T17:35:32.105 INFO:tasks.ceph.mds.d.smithi197.stdout:starting mds.d at 2022-08-10T17:35:32.106 INFO:tasks.ceph.mds.f.smithi197.stdout:starting mds.f at 2022-08-10T17:35:32.107 INFO:tasks.ceph.mds.b.smithi197.stdout:starting mds.b at 2022-08-10T17:35:32.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.155+0000 7f87da154700 1 Processor -- start 2022-08-10T17:35:32.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.155+0000 7f87da154700 1 -- start start 2022-08-10T17:35:32.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87da154700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87d41540f0 0x7f87d4071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87da154700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 0x7f87d40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87da154700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d40c6100 con 0x7f87d41544c0 2022-08-10T17:35:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87da154700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40c5270 con 0x7f87d41540f0 2022-08-10T17:35:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87da154700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40c5e00 con 0x7f87d4068820 2022-08-10T17:35:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87d41540f0 0x7f87d4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f87d41544c0 0x7f87d4068110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41758/0 (socket says 172.21.15.150:41758) 2022-08-10T17:35:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d2ffd700 1 -- 172.21.15.150:0/2190747846 learned_addr learned my addr 172.21.15.150:0/2190747846 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d3fff700 1 --2- 172.21.15.150:0/2190747846 >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 0x7f87d40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 -- 172.21.15.150:0/2190747846 >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 msgr2=0x7f87d40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:32.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 --2- 172.21.15.150:0/2190747846 >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 0x7f87d40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 -- 172.21.15.150:0/2190747846 >> v1:172.21.15.150:6789/0 conn(0x7f87d41544c0 legacy=0x7f87d4068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d27fc700 1 -- 172.21.15.150:0/2190747846 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73627945 0 0) 0x7f87d40c6100 con 0x7f87d41544c0 2022-08-10T17:35:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 -- 172.21.15.150:0/2190747846 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d406eb00 con 0x7f87d41540f0 2022-08-10T17:35:32.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d3fff700 1 --2- 172.21.15.150:0/2190747846 >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 0x7f87d40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:32.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.156+0000 7f87d37fe700 1 --2- 172.21.15.150:0/2190747846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d4071370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f87d4157c00 tx=0x7f87c8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4c9162fc88605b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87d27fc700 1 -- 172.21.15.150:0/2190747846 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011830 con 0x7f87d41540f0 2022-08-10T17:35:32.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87d27fc700 1 -- 172.21.15.150:0/2190747846 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8011990 con 0x7f87d41540f0 2022-08-10T17:35:32.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87d27fc700 1 -- 172.21.15.150:0/2190747846 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011d40 con 0x7f87d41540f0 2022-08-10T17:35:32.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 -- 172.21.15.150:0/2190747846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 msgr2=0x7f87d4071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 --2- 172.21.15.150:0/2190747846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d4071370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f87d4157c00 tx=0x7f87c8009990 comp rx=0 tx=0).stop 2022-08-10T17:35:32.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 -- 172.21.15.150:0/2190747846 shutdown_connections 2022-08-10T17:35:32.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 --2- 172.21.15.150:0/2190747846 >> v2:172.21.15.197:3300/0 conn(0x7f87d4068820 0x7f87d40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 --2- 172.21.15.150:0/2190747846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d4071370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 -- 172.21.15.150:0/2190747846 >> 172.21.15.150:0/2190747846 conn(0x7f87d406d0d0 msgr2=0x7f87d40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:32.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 -- 172.21.15.150:0/2190747846 shutdown_connections 2022-08-10T17:35:32.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.157+0000 7f87da154700 1 -- 172.21.15.150:0/2190747846 wait complete. 2022-08-10T17:35:32.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.158+0000 7f87da154700 1 Processor -- start 2022-08-10T17:35:32.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 -- start start 2022-08-10T17:35:32.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f87d4068820 0x7f87d41efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f87d41544c0 0x7f87d41dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d41563b0 con 0x7f87d41540f0 2022-08-10T17:35:32.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40c01c0 con 0x7f87d4068820 2022-08-10T17:35:32.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87da154700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4152700 con 0x7f87d41544c0 2022-08-10T17:35:32.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87d2ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87d2ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57316/0 (socket says 172.21.15.150:57316) 2022-08-10T17:35:32.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87d2ffd700 1 -- 172.21.15.150:0/3631019477 learned_addr learned my addr 172.21.15.150:0/3631019477 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:32.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.159+0000 7f87d37fe700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f87d4068820 0x7f87d41efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d3fff700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f87d41544c0 0x7f87d41dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 -- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f87d41544c0 msgr2=0x7f87d41dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f87d41544c0 0x7f87d41dfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 -- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f87d4068820 msgr2=0x7f87d41efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f87d4068820 0x7f87d41efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 -- 172.21.15.150:0/3631019477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009310 con 0x7f87d41540f0 2022-08-10T17:35:32.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87d2ffd700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c440 tx=0x7f87c400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40072d0 con 0x7f87d41540f0 2022-08-10T17:35:32.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c4007450 con 0x7f87d41540f0 2022-08-10T17:35:32.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d40c0640 con 0x7f87d41540f0 2022-08-10T17:35:32.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40075c0 con 0x7f87d41540f0 2022-08-10T17:35:32.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.160+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d40c0c00 con 0x7f87d41540f0 2022-08-10T17:35:32.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.161+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d41564f0 con 0x7f87d41540f0 2022-08-10T17:35:32.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.161+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f87c401a020 con 0x7f87d41540f0 2022-08-10T17:35:32.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.162+0000 7f87bbfff700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 0x7f87b4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.162+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f87c4081550 con 0x7f87d41540f0 2022-08-10T17:35:32.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.162+0000 7f87d37fe700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 0x7f87b4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.162+0000 7f87d37fe700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 0x7f87b4067590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87c80090b0 tx=0x7f87c801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.166+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f87d41564f0 con 0x7f87d41540f0 2022-08-10T17:35:32.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.344+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87d4064640 con 0x7f87d41540f0 2022-08-10T17:35:32.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.345+0000 7f87bbfff700 1 -- 172.21.15.150:0/3631019477 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13708 (secure 0 0 0) 0x7f87c404faa0 con 0x7f87d41540f0 2022-08-10T17:35:32.349 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:32.349 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":18,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:31.970598+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:32.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 msgr2=0x7f87b4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 0x7f87b4067590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87c80090b0 tx=0x7f87c801c040 comp rx=0 tx=0).stop 2022-08-10T17:35:32.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 msgr2=0x7f87d41521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c440 tx=0x7f87c400c750 comp rx=0 tx=0).stop 2022-08-10T17:35:32.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 shutdown_connections 2022-08-10T17:35:32.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f87b40650e0 0x7f87b4067590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f87d41544c0 0x7f87d41dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f87d4068820 0x7f87d41efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 --2- 172.21.15.150:0/3631019477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d41540f0 0x7f87d41521c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 >> 172.21.15.150:0/3631019477 conn(0x7f87d406d0d0 msgr2=0x7f87d4068110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:32.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 shutdown_connections 2022-08-10T17:35:32.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.347+0000 7f87da154700 1 -- 172.21.15.150:0/3631019477 wait complete. 2022-08-10T17:35:32.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-08-10T17:35:27.251819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-08-10T17:35:30.366555+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-08-10T17:35:32.364 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-08-10T17:35:32.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 Processor -- start 2022-08-10T17:35:32.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 -- start start 2022-08-10T17:35:32.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0c1f40 con 0x7f0d8c151290 2022-08-10T17:35:32.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c7d90 con 0x7f0d8c068bf0 2022-08-10T17:35:32.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.483+0000 7f0d9196a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c2220 con 0x7f0d8c158170 2022-08-10T17:35:32.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8b7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8b7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:39686/0 (socket says 172.21.15.150:39686) 2022-08-10T17:35:32.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:43314/0 (socket says 172.21.15.150:43314) 2022-08-10T17:35:32.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8b7fe700 1 -- 172.21.15.150:0/3728502927 learned_addr learned my addr 172.21.15.150:0/3728502927 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:32.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8affd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f0d8c151290 0x7f0d8c157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:56354/0 (socket says 172.21.15.150:56354) 2022-08-10T17:35:32.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d89ffb700 1 -- 172.21.15.150:0/3728502927 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014408696 0 0) 0x7f0d8c0c1f40 con 0x7f0d8c151290 2022-08-10T17:35:32.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d89ffb700 1 -- 172.21.15.150:0/3728502927 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d78003430 con 0x7f0d8c151290 2022-08-10T17:35:32.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 -- 172.21.15.150:0/3728502927 >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 msgr2=0x7f0d8c0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:32.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 --2- 172.21.15.150:0/3728502927 >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 -- 172.21.15.150:0/3728502927 >> v1:172.21.15.197:6789/0 conn(0x7f0d8c151290 legacy=0x7f0d8c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 -- 172.21.15.150:0/3728502927 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0c2500 con 0x7f0d8c158170 2022-08-10T17:35:32.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8b7fe700 1 --2- 172.21.15.150:0/3728502927 >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:32.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d8a7fc700 1 --2- 172.21.15.150:0/3728502927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d800096b0 tx=0x7f0d800099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba45d2c7932088d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d89ffb700 1 -- 172.21.15.150:0/3728502927 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800107b0 con 0x7f0d8c158170 2022-08-10T17:35:32.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d89ffb700 1 -- 172.21.15.150:0/3728502927 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80010910 con 0x7f0d8c158170 2022-08-10T17:35:32.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.484+0000 7f0d89ffb700 1 -- 172.21.15.150:0/3728502927 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80010c80 con 0x7f0d8c158170 2022-08-10T17:35:32.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 -- 172.21.15.150:0/3728502927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 msgr2=0x7f0d8c0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 --2- 172.21.15.150:0/3728502927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d800096b0 tx=0x7f0d800099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 -- 172.21.15.150:0/3728502927 shutdown_connections 2022-08-10T17:35:32.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 --2- 172.21.15.150:0/3728502927 >> v2:172.21.15.197:3300/0 conn(0x7f0d8c068bf0 0x7f0d8c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 --2- 172.21.15.150:0/3728502927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c0c7850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 -- 172.21.15.150:0/3728502927 >> 172.21.15.150:0/3728502927 conn(0x7f0d8c06f880 msgr2=0x7f0d8c06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:32.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 -- 172.21.15.150:0/3728502927 shutdown_connections 2022-08-10T17:35:32.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.485+0000 7f0d9196a700 1 -- 172.21.15.150:0/3728502927 wait complete. 2022-08-10T17:35:32.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.486+0000 7f0d9196a700 1 Processor -- start 2022-08-10T17:35:32.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.486+0000 7f0d9196a700 1 -- start start 2022-08-10T17:35:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d8c151290 0x7f0d8c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c154e40 con 0x7f0d8c068bf0 2022-08-10T17:35:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0cdc80 con 0x7f0d8c151290 2022-08-10T17:35:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d9196a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0cd6c0 con 0x7f0d8c158170 2022-08-10T17:35:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d8affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d8affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57328/0 (socket says 172.21.15.150:57328) 2022-08-10T17:35:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d8affd700 1 -- 172.21.15.150:0/845454840 learned_addr learned my addr 172.21.15.150:0/845454840 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d8a7fc700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d8c151290 0x7f0d8c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.487+0000 7f0d8b7fe700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 -- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 msgr2=0x7f0d8c155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 -- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d8c151290 msgr2=0x7f0d8c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d8c151290 0x7f0d8c1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 -- 172.21.15.150:0/845454840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84009b30 con 0x7f0d8c068bf0 2022-08-10T17:35:32.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8b7fe700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:32.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d8affd700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c390 tx=0x7f0d7c001ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0072d0 con 0x7f0d8c068bf0 2022-08-10T17:35:32.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c007450 con 0x7f0d8c068bf0 2022-08-10T17:35:32.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d80009310 con 0x7f0d8c068bf0 2022-08-10T17:35:32.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c004980 con 0x7f0d8c068bf0 2022-08-10T17:35:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.488+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c154a60 con 0x7f0d8c068bf0 2022-08-10T17:35:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.489+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c156bd0 con 0x7f0d8c068bf0 2022-08-10T17:35:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.489+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0d7c010070 con 0x7f0d8c068bf0 2022-08-10T17:35:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.489+0000 7f0d73fff700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 0x7f0d6c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.490+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0d7c081290 con 0x7f0d8c068bf0 2022-08-10T17:35:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.490+0000 7f0d8a7fc700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 0x7f0d6c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.490+0000 7f0d8a7fc700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 0x7f0d6c067590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d8001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.494+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0d7c04f850 con 0x7f0d8c068bf0 2022-08-10T17:35:32.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.670+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d8c1550b0 con 0x7f0d8c068bf0 2022-08-10T17:35:32.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.670+0000 7f0d73fff700 1 -- 172.21.15.150:0/845454840 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d7c052e70 con 0x7f0d8c068bf0 2022-08-10T17:35:32.675 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2022-08-10T17:35:32.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 msgr2=0x7f0d6c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 0x7f0d6c067590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d8001c040 comp rx=0 tx=0).stop 2022-08-10T17:35:32.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 msgr2=0x7f0d8c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c390 tx=0x7f0d7c001ec0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 shutdown_connections 2022-08-10T17:35:32.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d6c0650e0 0x7f0d6c067590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d8c158170 0x7f0d8c155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c068bf0 0x7f0d8c153e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 --2- 172.21.15.150:0/845454840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d8c151290 0x7f0d8c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 >> 172.21.15.150:0/845454840 conn(0x7f0d8c06f880 msgr2=0x7f0d8c0c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:32.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 shutdown_connections 2022-08-10T17:35:32.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.672+0000 7f0d9196a700 1 -- 172.21.15.150:0/845454840 wait complete. 2022-08-10T17:35:32.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-08-10T17:35:32.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.806+0000 7faea3ab7700 1 Processor -- start 2022-08-10T17:35:32.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 -- start start 2022-08-10T17:35:32.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 0x7fae9c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae9c0c76b0 0x7fae9c0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0c8220 con 0x7fae9c06c5b0 2022-08-10T17:35:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0c2190 con 0x7fae9c0c76b0 2022-08-10T17:35:32.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.807+0000 7faea3ab7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0c2470 con 0x7fae9c06c980 2022-08-10T17:35:32.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea1853700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fae9c06c5b0 0x7fae9c0c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41784/0 (socket says 172.21.15.150:41784) 2022-08-10T17:35:32.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea1853700 1 -- 172.21.15.150:0/2543994122 learned_addr learned my addr 172.21.15.150:0/2543994122 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:32.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 --2- 172.21.15.150:0/2543994122 >> v2:172.21.15.150:3300/0 conn(0x7fae9c0c76b0 0x7fae9c0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea1052700 1 --2- 172.21.15.150:0/2543994122 >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 0x7fae9c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 -- 172.21.15.150:0/2543994122 >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 msgr2=0x7fae9c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 --2- 172.21.15.150:0/2543994122 >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 0x7fae9c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 -- 172.21.15.150:0/2543994122 >> v1:172.21.15.150:6789/0 conn(0x7fae9c06c5b0 legacy=0x7fae9c0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea0851700 1 -- 172.21.15.150:0/2543994122 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793491428 0 0) 0x7fae9c0c8220 con 0x7fae9c06c5b0 2022-08-10T17:35:32.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 -- 172.21.15.150:0/2543994122 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0c2750 con 0x7fae9c0c76b0 2022-08-10T17:35:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea1052700 1 --2- 172.21.15.150:0/2543994122 >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 0x7fae9c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea2054700 1 --2- 172.21.15.150:0/2543994122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c0c7b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae9c067280 tx=0x7fae9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691cf92b35e2bb7e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea0851700 1 -- 172.21.15.150:0/2543994122 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400e070 con 0x7fae9c0c76b0 2022-08-10T17:35:32.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea0851700 1 -- 172.21.15.150:0/2543994122 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400bbd0 con 0x7fae9c0c76b0 2022-08-10T17:35:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.808+0000 7faea0851700 1 -- 172.21.15.150:0/2543994122 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94012430 con 0x7fae9c0c76b0 2022-08-10T17:35:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 -- 172.21.15.150:0/2543994122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 msgr2=0x7fae9c0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 --2- 172.21.15.150:0/2543994122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c0c7b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae9c067280 tx=0x7fae9400b330 comp rx=0 tx=0).stop 2022-08-10T17:35:32.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 -- 172.21.15.150:0/2543994122 shutdown_connections 2022-08-10T17:35:32.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 --2- 172.21.15.150:0/2543994122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c0c7b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 --2- 172.21.15.150:0/2543994122 >> v2:172.21.15.197:3300/0 conn(0x7fae9c06c980 0x7fae9c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 -- 172.21.15.150:0/2543994122 >> 172.21.15.150:0/2543994122 conn(0x7fae9c06e1f0 msgr2=0x7fae9c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:32.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 -- 172.21.15.150:0/2543994122 shutdown_connections 2022-08-10T17:35:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.809+0000 7faea3ab7700 1 -- 172.21.15.150:0/2543994122 wait complete. 2022-08-10T17:35:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.810+0000 7faea3ab7700 1 Processor -- start 2022-08-10T17:35:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.810+0000 7faea3ab7700 1 -- start start 2022-08-10T17:35:32.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 0x7fae9c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 0x7fae9c0c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1ebee0 con 0x7fae9c0c76b0 2022-08-10T17:35:32.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c151ed0 con 0x7fae9c06c5b0 2022-08-10T17:35:32.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c1eb560 con 0x7fae9c06c980 2022-08-10T17:35:32.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57346/0 (socket says 172.21.15.150:57346) 2022-08-10T17:35:32.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 -- 172.21.15.150:0/1942231730 learned_addr learned my addr 172.21.15.150:0/1942231730 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:32.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea1853700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 0x7fae9c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea1052700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 0x7fae9c0c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 -- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 msgr2=0x7fae9c0c0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 0x7fae9c0c0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 -- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 msgr2=0x7fae9c0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:32.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 0x7fae9c0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:32.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 -- 172.21.15.150:0/1942231730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009a70 con 0x7fae9c0c76b0 2022-08-10T17:35:32.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea1052700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 0x7fae9c0c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:32.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea1853700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 0x7fae9c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:32.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea2054700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b730 tx=0x7fae94004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94004450 con 0x7fae9c0c76b0 2022-08-10T17:35:32.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae94020070 con 0x7fae9c0c76b0 2022-08-10T17:35:32.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.811+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c1e0ca0 con 0x7fae9c0c76b0 2022-08-10T17:35:32.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.812+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940125e0 con 0x7fae9c0c76b0 2022-08-10T17:35:32.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.812+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c0ca330 con 0x7fae9c0c76b0 2022-08-10T17:35:32.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.813+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c1ec020 con 0x7fae9c0c76b0 2022-08-10T17:35:32.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.813+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fae94012740 con 0x7fae9c0c76b0 2022-08-10T17:35:32.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.813+0000 7fae8a7fc700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 0x7fae7c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:32.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.813+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fae94022070 con 0x7fae9c0c76b0 2022-08-10T17:35:32.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.813+0000 7faea1853700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 0x7fae7c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:32.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.814+0000 7faea1853700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 0x7fae7c067590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae98007fd0 tx=0x7fae98007b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:32.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.817+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fae9c1ec020 con 0x7fae9c0c76b0 2022-08-10T17:35:32.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.993+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae9c1ec020 con 0x7fae9c0c76b0 2022-08-10T17:35:32.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.994+0000 7fae8a7fc700 1 -- 172.21.15.150:0/1942231730 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae9c1ec020 con 0x7fae9c0c76b0 2022-08-10T17:35:32.998 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 8 2022-08-10T17:35:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 msgr2=0x7fae7c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 0x7fae7c067590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae98007fd0 tx=0x7fae98007b20 comp rx=0 tx=0).stop 2022-08-10T17:35:33.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 msgr2=0x7fae9c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b730 tx=0x7fae94004950 comp rx=0 tx=0).stop 2022-08-10T17:35:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 shutdown_connections 2022-08-10T17:35:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae9c0c76b0 0x7fae9c14e700 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae9c06c5b0 0x7fae9c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae7c0650e0 0x7fae7c067590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 --2- 172.21.15.150:0/1942231730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae9c06c980 0x7fae9c0c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 >> 172.21.15.150:0/1942231730 conn(0x7fae9c06e1f0 msgr2=0x7fae9c0c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 shutdown_connections 2022-08-10T17:35:33.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:32.996+0000 7faea3ab7700 1 -- 172.21.15.150:0/1942231730 wait complete. 2022-08-10T17:35:33.011 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:35:33.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.129+0000 7f437ac29700 1 Processor -- start 2022-08-10T17:35:33.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 -- start start 2022-08-10T17:35:33.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f43740c8170 0x7f43740c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43740c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f437406d3a0 0x7f437406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740c6be0 con 0x7f437406d3a0 2022-08-10T17:35:33.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740c2260 con 0x7f43740c8170 2022-08-10T17:35:33.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f437ac29700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740c5a40 con 0x7f43740c70a0 2022-08-10T17:35:33.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.130+0000 7f43791c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f437406d3a0 0x7f437406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f437406d3a0 0x7f437406d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57358/0 (socket says 172.21.15.150:57358) 2022-08-10T17:35:33.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 -- 172.21.15.150:0/2021212264 learned_addr learned my addr 172.21.15.150:0/2021212264 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43789c5700 1 --2- 172.21.15.150:0/2021212264 >> v2:172.21.15.197:3300/0 conn(0x7f43740c8170 0x7f43740c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f4373fff700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43740c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 -- 172.21.15.150:0/2021212264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 msgr2=0x7f43740c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:33.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43740c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 -- 172.21.15.150:0/2021212264 >> v2:172.21.15.197:3300/0 conn(0x7f43740c8170 msgr2=0x7f43740c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:33.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 --2- 172.21.15.150:0/2021212264 >> v2:172.21.15.197:3300/0 conn(0x7f43740c8170 0x7f43740c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 -- 172.21.15.150:0/2021212264 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740c6840 con 0x7f437406d3a0 2022-08-10T17:35:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43791c6700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f437406d3a0 0x7f437406d7c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f437406eff0 tx=0x7f436c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ccd3832b749388 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43737fe700 1 -- 172.21.15.150:0/2021212264 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00e070 con 0x7f437406d3a0 2022-08-10T17:35:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43737fe700 1 -- 172.21.15.150:0/2021212264 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00b910 con 0x7f437406d3a0 2022-08-10T17:35:33.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.131+0000 7f43737fe700 1 -- 172.21.15.150:0/2021212264 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00bcc0 con 0x7f437406d3a0 2022-08-10T17:35:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 -- 172.21.15.150:0/2021212264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f437406d3a0 msgr2=0x7f437406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f437406d3a0 0x7f437406d7c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f437406eff0 tx=0x7f436c00b330 comp rx=0 tx=0).stop 2022-08-10T17:35:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 -- 172.21.15.150:0/2021212264 shutdown_connections 2022-08-10T17:35:33.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f437406d3a0 0x7f437406d7c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 --2- 172.21.15.150:0/2021212264 >> v2:172.21.15.197:3300/0 conn(0x7f43740c8170 0x7f43740c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 --2- 172.21.15.150:0/2021212264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43740c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 -- 172.21.15.150:0/2021212264 >> 172.21.15.150:0/2021212264 conn(0x7f437406fba0 msgr2=0x7f437406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 -- 172.21.15.150:0/2021212264 shutdown_connections 2022-08-10T17:35:33.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.132+0000 7f437ac29700 1 -- 172.21.15.150:0/2021212264 wait complete. 2022-08-10T17:35:33.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.133+0000 7f437ac29700 1 Processor -- start 2022-08-10T17:35:33.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.133+0000 7f437ac29700 1 -- start start 2022-08-10T17:35:33.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f437406d3a0 0x7f437406b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43741ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43740ac4b0 con 0x7f43740c8170 2022-08-10T17:35:33.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374068110 con 0x7f437406d3a0 2022-08-10T17:35:33.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740683f0 con 0x7f43740c70a0 2022-08-10T17:35:33.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57364/0 (socket says 172.21.15.150:57364) 2022-08-10T17:35:33.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 -- 172.21.15.150:0/1401477926 learned_addr learned my addr 172.21.15.150:0/1401477926 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43789c5700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f437406d3a0 0x7f437406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f4373fff700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43741ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 -- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 msgr2=0x7f43741ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43741ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 -- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f437406d3a0 msgr2=0x7f437406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f437406d3a0 0x7f437406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 -- 172.21.15.150:0/1401477926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009b30 con 0x7f43740c8170 2022-08-10T17:35:33.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43791c6700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f437406f140 tx=0x7f436c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0092e0 con 0x7f43740c8170 2022-08-10T17:35:33.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00ce80 con 0x7f43740c8170 2022-08-10T17:35:33.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0044b0 con 0x7f43740c8170 2022-08-10T17:35:33.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437406a950 con 0x7f43740c8170 2022-08-10T17:35:33.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.134+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437406af10 con 0x7f43740c8170 2022-08-10T17:35:33.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.135+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43740ca090 con 0x7f43740c8170 2022-08-10T17:35:33.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.136+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f436c004610 con 0x7f43740c8170 2022-08-10T17:35:33.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.136+0000 7f43717fa700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 0x7f435c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.136+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f436c083210 con 0x7f43740c8170 2022-08-10T17:35:33.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.136+0000 7f43789c5700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 0x7f435c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.137+0000 7f43789c5700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 0x7f435c067560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43680099b0 tx=0x7f43680090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.140+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f436c051880 con 0x7f43740c8170 2022-08-10T17:35:33.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.361+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43740c4760 con 0x7f43740c8170 2022-08-10T17:35:33.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.361+0000 7f43717fa700 1 -- 172.21.15.150:0/1401477926 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5048 (secure 0 0 0) 0x7f436c020070 con 0x7f43740c8170 2022-08-10T17:35:33.366 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:33.366 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4317,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-08-10T17:35:33.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.363+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 msgr2=0x7f435c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.363+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 0x7f435c067560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43680099b0 tx=0x7f43680090e0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.363+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 msgr2=0x7f4374158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.363+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f437406f140 tx=0x7f436c004950 comp rx=0 tx=0).stop 2022-08-10T17:35:33.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 shutdown_connections 2022-08-10T17:35:33.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43740c8170 0x7f4374158f40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f437406d3a0 0x7f437406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f435c0650b0 0x7f435c067560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 --2- 172.21.15.150:0/1401477926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43740c70a0 0x7f43741ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 >> 172.21.15.150:0/1401477926 conn(0x7f437406fba0 msgr2=0x7f43740c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 shutdown_connections 2022-08-10T17:35:33.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.364+0000 7f437ac29700 1 -- 172.21.15.150:0/1401477926 wait complete. 2022-08-10T17:35:33.371 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 3 2022-08-10T17:35:33.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:33.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 Processor -- start 2022-08-10T17:35:33.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 -- start start 2022-08-10T17:35:33.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8c40691a0 0x7fa8c40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40c3020 con 0x7fa8c40c1730 2022-08-10T17:35:33.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c4156bd0 con 0x7fa8c4070240 2022-08-10T17:35:33.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.497+0000 7fa8caa60700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c40c1b60 con 0x7fa8c40691a0 2022-08-10T17:35:33.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8c40691a0 0x7fa8c40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8c40691a0 0x7fa8c40695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57372/0 (socket says 172.21.15.150:57372) 2022-08-10T17:35:33.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 -- 172.21.15.150:0/2124480153 learned_addr learned my addr 172.21.15.150:0/2124480153 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c37fe700 1 --1- 172.21.15.150:0/2124480153 >> v1:172.21.15.150:6789/0 conn(0x7fa8c40c1730 0x7fa8c40cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41818/0 (socket says 172.21.15.150:41818) 2022-08-10T17:35:33.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 -- 172.21.15.150:0/2124480153 >> v1:172.21.15.197:6789/0 conn(0x7fa8c4070240 legacy=0x7fa8c4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 -- 172.21.15.150:0/2124480153 >> v1:172.21.15.150:6789/0 conn(0x7fa8c40c1730 legacy=0x7fa8c40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c2ffd700 1 -- 172.21.15.150:0/2124480153 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131770698 0 0) 0x7fa8c40c3020 con 0x7fa8c40c1730 2022-08-10T17:35:33.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 -- 172.21.15.150:0/2124480153 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c406f770 con 0x7fa8c40691a0 2022-08-10T17:35:33.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c8ffd700 1 --2- 172.21.15.150:0/2124480153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c40691a0 0x7fa8c40695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009e50 tx=0x7fa8bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14154565b0a997bd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c2ffd700 1 -- 172.21.15.150:0/2124480153 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00e070 con 0x7fa8c40691a0 2022-08-10T17:35:33.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c2ffd700 1 -- 172.21.15.150:0/2124480153 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00b9c0 con 0x7fa8c40691a0 2022-08-10T17:35:33.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.498+0000 7fa8c2ffd700 1 -- 172.21.15.150:0/2124480153 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00bd70 con 0x7fa8c40691a0 2022-08-10T17:35:33.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 -- 172.21.15.150:0/2124480153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c40691a0 msgr2=0x7fa8c40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 --2- 172.21.15.150:0/2124480153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c40691a0 0x7fa8c40695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009e50 tx=0x7fa8bc00b330 comp rx=0 tx=0).stop 2022-08-10T17:35:33.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 -- 172.21.15.150:0/2124480153 shutdown_connections 2022-08-10T17:35:33.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 --2- 172.21.15.150:0/2124480153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c40691a0 0x7fa8c40695e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 -- 172.21.15.150:0/2124480153 >> 172.21.15.150:0/2124480153 conn(0x7fa8c4071e40 msgr2=0x7fa8c40cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 -- 172.21.15.150:0/2124480153 shutdown_connections 2022-08-10T17:35:33.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.499+0000 7fa8caa60700 1 -- 172.21.15.150:0/2124480153 wait complete. 2022-08-10T17:35:33.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.500+0000 7fa8caa60700 1 Processor -- start 2022-08-10T17:35:33.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.500+0000 7fa8caa60700 1 -- start start 2022-08-10T17:35:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 0x7fa8c415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8c40c1730 0x7fa8c4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4157ea0 con 0x7fa8c4070240 2022-08-10T17:35:33.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4152b80 con 0x7fa8c40c1730 2022-08-10T17:35:33.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8caa60700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4158140 con 0x7fa8c40691a0 2022-08-10T17:35:33.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57376/0 (socket says 172.21.15.150:57376) 2022-08-10T17:35:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 -- 172.21.15.150:0/366014226 learned_addr learned my addr 172.21.15.150:0/366014226 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c3fff700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 0x7fa8c415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c8ffd700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8c40c1730 0x7fa8c4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 -- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 msgr2=0x7fa8c415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 0x7fa8c415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 -- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8c40c1730 msgr2=0x7fa8c4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8c40c1730 0x7fa8c4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 -- 172.21.15.150:0/366014226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009b30 con 0x7fa8c4070240 2022-08-10T17:35:33.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c3fff700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 0x7fa8c415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:33.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.501+0000 7fa8c37fe700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c410 tx=0x7fa8b800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.502+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80074e0 con 0x7fa8c4070240 2022-08-10T17:35:33.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.502+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80046f0 con 0x7fa8c4070240 2022-08-10T17:35:33.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.502+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c4158420 con 0x7fa8c4070240 2022-08-10T17:35:33.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.502+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8004aa0 con 0x7fa8c4070240 2022-08-10T17:35:33.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.502+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c41558f0 con 0x7fa8c4070240 2022-08-10T17:35:33.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.503+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c4153060 con 0x7fa8c4070240 2022-08-10T17:35:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.503+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa8b801a020 con 0x7fa8c4070240 2022-08-10T17:35:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.503+0000 7fa8c0ff9700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 0x7fa8a4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.503+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa8b8081650 con 0x7fa8c4070240 2022-08-10T17:35:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.504+0000 7fa8c3fff700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 0x7fa8a4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.504+0000 7fa8c3fff700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 0x7fa8a4067590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4000f60 tx=0x7fa8b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.507+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa8c4153060 con 0x7fa8c4070240 2022-08-10T17:35:33.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.686+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c4072890 con 0x7fa8c4070240 2022-08-10T17:35:33.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.686+0000 7fa8c0ff9700 1 -- 172.21.15.150:0/366014226 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13695 (secure 0 0 0) 0x7fa8b804fd50 con 0x7fa8c4070240 2022-08-10T17:35:33.690 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":19,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:32.978582+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:33.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 msgr2=0x7fa8a4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 0x7fa8a4067590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4000f60 tx=0x7fa8b4009040 comp rx=0 tx=0).stop 2022-08-10T17:35:33.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 msgr2=0x7fa8c4153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c410 tx=0x7fa8b800c7d0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 shutdown_connections 2022-08-10T17:35:33.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8c40c1730 0x7fa8c4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8a40650e0 0x7fa8a4067590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8c40691a0 0x7fa8c415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 --2- 172.21.15.150:0/366014226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c4070240 0x7fa8c4153340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 >> 172.21.15.150:0/366014226 conn(0x7fa8c4071e40 msgr2=0x7fa8c41544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 shutdown_connections 2022-08-10T17:35:33.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.688+0000 7fa8caa60700 1 -- 172.21.15.150:0/366014226 wait complete. 2022-08-10T17:35:33.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-08-10T17:35:27.251819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-08-10T17:35:30.366555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-08-10T17:35:33.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-08-10T17:35:33.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.823+0000 7fa8e377d700 1 Processor -- start 2022-08-10T17:35:33.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 -- start start 2022-08-10T17:35:33.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8dc158170 0x7fa8dc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc068bf0 0x7fa8dc0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0c1f40 con 0x7fa8dc151290 2022-08-10T17:35:33.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c7d90 con 0x7fa8dc158170 2022-08-10T17:35:33.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e377d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c2220 con 0x7fa8dc068bf0 2022-08-10T17:35:33.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e0d18700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8dc158170 0x7fa8dc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.824+0000 7fa8e0d18700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8dc158170 0x7fa8dc0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57384/0 (socket says 172.21.15.150:57384) 2022-08-10T17:35:33.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 -- 172.21.15.150:0/2866765010 learned_addr learned my addr 172.21.15.150:0/2866765010 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 -- 172.21.15.150:0/2866765010 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc068bf0 msgr2=0x7fa8dc0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:33.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e1d1a700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc068bf0 0x7fa8dc0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc068bf0 0x7fa8dc0c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 -- 172.21.15.150:0/2866765010 >> v1:172.21.15.197:6789/0 conn(0x7fa8dc151290 legacy=0x7fa8dc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:33.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 -- 172.21.15.150:0/2866765010 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0c2500 con 0x7fa8dc158170 2022-08-10T17:35:33.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8e0d18700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc158170 0x7fa8dc0c7850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006fd0 tx=0x7fa8cc009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4704785ed0e47642 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8cbfff700 1 -- 172.21.15.150:0/2866765010 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011830 con 0x7fa8dc158170 2022-08-10T17:35:33.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8cbfff700 1 -- 172.21.15.150:0/2866765010 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0119b0 con 0x7fa8dc158170 2022-08-10T17:35:33.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.825+0000 7fa8cbfff700 1 -- 172.21.15.150:0/2866765010 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011d60 con 0x7fa8dc158170 2022-08-10T17:35:33.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 -- 172.21.15.150:0/2866765010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc158170 msgr2=0x7fa8dc0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc158170 0x7fa8dc0c7850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006fd0 tx=0x7fa8cc009a60 comp rx=0 tx=0).stop 2022-08-10T17:35:33.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 -- 172.21.15.150:0/2866765010 shutdown_connections 2022-08-10T17:35:33.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc068bf0 0x7fa8dc0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 --2- 172.21.15.150:0/2866765010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc158170 0x7fa8dc0c7850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 -- 172.21.15.150:0/2866765010 >> 172.21.15.150:0/2866765010 conn(0x7fa8dc06f880 msgr2=0x7fa8dc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:33.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 -- 172.21.15.150:0/2866765010 shutdown_connections 2022-08-10T17:35:33.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.826+0000 7fa8e377d700 1 -- 172.21.15.150:0/2866765010 wait complete. 2022-08-10T17:35:33.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.827+0000 7fa8e377d700 1 Processor -- start 2022-08-10T17:35:33.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.827+0000 7fa8e377d700 1 -- start start 2022-08-10T17:35:33.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.827+0000 7fa8e377d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc151290 0x7fa8dc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8dc158170 0x7fa8dc1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc14b5e0 con 0x7fa8dc068bf0 2022-08-10T17:35:33.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc14be40 con 0x7fa8dc158170 2022-08-10T17:35:33.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0b1250 con 0x7fa8dc151290 2022-08-10T17:35:33.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57388/0 (socket says 172.21.15.150:57388) 2022-08-10T17:35:33.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 -- 172.21.15.150:0/3183525177 learned_addr learned my addr 172.21.15.150:0/3183525177 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:33.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1d1a700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8dc158170 0x7fa8dc1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e0d18700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc151290 0x7fa8dc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 -- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc151290 msgr2=0x7fa8dc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc151290 0x7fa8dc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 -- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8dc158170 msgr2=0x7fa8dc1f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:33.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8dc158170 0x7fa8dc1f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:33.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 -- 172.21.15.150:0/3183525177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0093e0 con 0x7fa8dc068bf0 2022-08-10T17:35:33.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e1519700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800b410 tx=0x7fa8d800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8011620 con 0x7fa8dc068bf0 2022-08-10T17:35:33.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8011780 con 0x7fa8dc068bf0 2022-08-10T17:35:33.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0b1530 con 0x7fa8dc068bf0 2022-08-10T17:35:33.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8011b30 con 0x7fa8dc068bf0 2022-08-10T17:35:33.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.828+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc14bad0 con 0x7fa8dc068bf0 2022-08-10T17:35:33.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.829+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc071e10 con 0x7fa8dc068bf0 2022-08-10T17:35:33.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.830+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa8d8021070 con 0x7fa8dc068bf0 2022-08-10T17:35:33.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.830+0000 7fa8c9ffb700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 0x7fa8bc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:33.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.830+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa8d8081870 con 0x7fa8dc068bf0 2022-08-10T17:35:33.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.830+0000 7fa8e0d18700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 0x7fa8bc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:33.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.831+0000 7fa8e0d18700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 0x7fa8bc067560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006fd0 tx=0x7fa8cc01d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:33.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:33.834+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa8d804feb0 con 0x7fa8dc068bf0 2022-08-10T17:35:34.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.012+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8dc072890 con 0x7fa8dc068bf0 2022-08-10T17:35:34.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.013+0000 7fa8c9ffb700 1 -- 172.21.15.150:0/3183525177 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8d8015020 con 0x7fa8dc068bf0 2022-08-10T17:35:34.018 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2022-08-10T17:35:34.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 msgr2=0x7fa8bc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 0x7fa8bc067560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006fd0 tx=0x7fa8cc01d040 comp rx=0 tx=0).stop 2022-08-10T17:35:34.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 msgr2=0x7fa8dc13ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800b410 tx=0x7fa8d800b720 comp rx=0 tx=0).stop 2022-08-10T17:35:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 shutdown_connections 2022-08-10T17:35:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa8dc158170 0x7fa8dc1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8dc068bf0 0x7fa8dc13ffa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8bc0650b0 0x7fa8bc067560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 --2- 172.21.15.150:0/3183525177 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa8dc151290 0x7fa8dc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 >> 172.21.15.150:0/3183525177 conn(0x7fa8dc06f880 msgr2=0x7fa8dc0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 shutdown_connections 2022-08-10T17:35:34.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.015+0000 7fa8e377d700 1 -- 172.21.15.150:0/3183525177 wait complete. 2022-08-10T17:35:34.031 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-08-10T17:35:34.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.151+0000 7fe5c9116700 1 Processor -- start 2022-08-10T17:35:34.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.151+0000 7fe5c9116700 1 -- start start 2022-08-10T17:35:34.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c4d90 0x7fe5c40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5c40c7220 0x7fe5c40c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe5c40c2080 0x7fe5c40c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40c5e10 con 0x7fe5c40c7220 2022-08-10T17:35:34.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40c1c30 con 0x7fe5c40c2080 2022-08-10T17:35:34.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c9116700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40c2a60 con 0x7fe5c40c4d90 2022-08-10T17:35:34.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5c40c7220 0x7fe5c40c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5c40c7220 0x7fe5c40c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57396/0 (socket says 172.21.15.150:57396) 2022-08-10T17:35:34.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 -- 172.21.15.150:0/2064780197 learned_addr learned my addr 172.21.15.150:0/2064780197 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c359e700 1 --2- 172.21.15.150:0/2064780197 >> v2:172.21.15.197:3300/0 conn(0x7fe5c40c2080 0x7fe5c40c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c2d9d700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c4d90 0x7fe5c40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 -- 172.21.15.150:0/2064780197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c4d90 msgr2=0x7fe5c40c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:34.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c4d90 0x7fe5c40c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 -- 172.21.15.150:0/2064780197 >> v2:172.21.15.197:3300/0 conn(0x7fe5c40c2080 msgr2=0x7fe5c40c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:34.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 --2- 172.21.15.150:0/2064780197 >> v2:172.21.15.197:3300/0 conn(0x7fe5c40c2080 0x7fe5c40c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 -- 172.21.15.150:0/2064780197 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40699c0 con 0x7fe5c40c7220 2022-08-10T17:35:34.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.152+0000 7fe5c259c700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c7220 0x7fe5c40c56a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009780 tx=0x7fe5b4009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc09baad55954cd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c1d9b700 1 -- 172.21.15.150:0/2064780197 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4004230 con 0x7fe5c40c7220 2022-08-10T17:35:34.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c1d9b700 1 -- 172.21.15.150:0/2064780197 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4004390 con 0x7fe5c40c7220 2022-08-10T17:35:34.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c1d9b700 1 -- 172.21.15.150:0/2064780197 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40107f0 con 0x7fe5c40c7220 2022-08-10T17:35:34.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 -- 172.21.15.150:0/2064780197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c7220 msgr2=0x7fe5c40c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c7220 0x7fe5c40c56a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009780 tx=0x7fe5b4009a90 comp rx=0 tx=0).stop 2022-08-10T17:35:34.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 -- 172.21.15.150:0/2064780197 shutdown_connections 2022-08-10T17:35:34.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 --2- 172.21.15.150:0/2064780197 >> v2:172.21.15.197:3300/0 conn(0x7fe5c40c2080 0x7fe5c40c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c4d90 0x7fe5c40c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 --2- 172.21.15.150:0/2064780197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c7220 0x7fe5c40c56a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 -- 172.21.15.150:0/2064780197 >> 172.21.15.150:0/2064780197 conn(0x7fe5c406d0d0 msgr2=0x7fe5c40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 -- 172.21.15.150:0/2064780197 shutdown_connections 2022-08-10T17:35:34.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.153+0000 7fe5c9116700 1 -- 172.21.15.150:0/2064780197 wait complete. 2022-08-10T17:35:34.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 Processor -- start 2022-08-10T17:35:34.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 -- start start 2022-08-10T17:35:34.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c2080 0x7fe5c41efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 0x7fe5c41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41f0010 con 0x7fe5c40c4d90 2022-08-10T17:35:34.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4155690 con 0x7fe5c40c7220 2022-08-10T17:35:34.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c9116700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41566f0 con 0x7fe5c40c2080 2022-08-10T17:35:34.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57404/0 (socket says 172.21.15.150:57404) 2022-08-10T17:35:34.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.155+0000 7fe5c259c700 1 -- 172.21.15.150:0/918126520 learned_addr learned my addr 172.21.15.150:0/918126520 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c359e700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 0x7fe5c41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c2d9d700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c2080 0x7fe5c41efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 -- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c2080 msgr2=0x7fe5c41efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c2080 0x7fe5c41efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 -- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 msgr2=0x7fe5c41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 0x7fe5c41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 -- 172.21.15.150:0/918126520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40093e0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c359e700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 0x7fe5c41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:35:34.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c259c700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4003520 con 0x7fe5c40c4d90 2022-08-10T17:35:34.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b40036a0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4155930 con 0x7fe5c40c4d90 2022-08-10T17:35:34.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4003a50 con 0x7fe5c40c4d90 2022-08-10T17:35:34.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.156+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c4155ef0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.157+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c40c5be0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.157+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe5b402c070 con 0x7fe5c40c4d90 2022-08-10T17:35:34.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.158+0000 7fe5ab7fe700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 0x7fe5a4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.158+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe5b4082c70 con 0x7fe5c40c4d90 2022-08-10T17:35:34.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.158+0000 7fe5c2d9d700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 0x7fe5a4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.158+0000 7fe5c2d9d700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 0x7fe5a4067590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009900 tx=0x7fe5b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.162+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe5b40512b0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.337+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5c4072890 con 0x7fe5c40c4d90 2022-08-10T17:35:34.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.337+0000 7fe5ab7fe700 1 -- 172.21.15.150:0/918126520 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5b402a0a0 con 0x7fe5c40c4d90 2022-08-10T17:35:34.341 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 8 2022-08-10T17:35:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 msgr2=0x7fe5a4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 0x7fe5a4067590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009900 tx=0x7fe5b8008040 comp rx=0 tx=0).stop 2022-08-10T17:35:34.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 msgr2=0x7fe5c4153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b40045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 shutdown_connections 2022-08-10T17:35:34.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5c40c7220 0x7fe5c41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe5a40650e0 0x7fe5a4067590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5c40c2080 0x7fe5c41efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 --2- 172.21.15.150:0/918126520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5c40c4d90 0x7fe5c4153630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 >> 172.21.15.150:0/918126520 conn(0x7fe5c406d0d0 msgr2=0x7fe5c40c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 shutdown_connections 2022-08-10T17:35:34.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.339+0000 7fe5c9116700 1 -- 172.21.15.150:0/918126520 wait complete. 2022-08-10T17:35:34.355 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-08-10T17:35:34.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.470+0000 7fc796ed3700 1 Processor -- start 2022-08-10T17:35:34.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.470+0000 7fc796ed3700 1 -- start start 2022-08-10T17:35:34.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc796ed3700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 0x7fc790159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc796ed3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7900647d0 0x7fc79015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc796ed3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7900c4dc0 con 0x7fc79006c860 2022-08-10T17:35:34.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc796ed3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900c5940 con 0x7fc7900647d0 2022-08-10T17:35:34.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc796ed3700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900c9fc0 con 0x7fc790150af0 2022-08-10T17:35:34.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7900647d0 0x7fc79015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7900647d0 0x7fc79015a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57412/0 (socket says 172.21.15.150:57412) 2022-08-10T17:35:34.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 -- 172.21.15.150:0/3731868031 learned_addr learned my addr 172.21.15.150:0/3731868031 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc794c6f700 1 --2- 172.21.15.150:0/3731868031 >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 0x7fc790159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 -- 172.21.15.150:0/3731868031 >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 msgr2=0x7fc790159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 --2- 172.21.15.150:0/3731868031 >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 0x7fc790159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 -- 172.21.15.150:0/3731868031 >> v1:172.21.15.197:6789/0 conn(0x7fc79006c860 legacy=0x7fc7900c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 -- 172.21.15.150:0/3731868031 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79006f9a0 con 0x7fc7900647d0 2022-08-10T17:35:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc794c6f700 1 --2- 172.21.15.150:0/3731868031 >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 0x7fc790159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc795470700 1 --2- 172.21.15.150:0/3731868031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc79015a3a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7900707d0 tx=0x7fc78800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7fd5ab254e0c3b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.471+0000 7fc78f7fe700 1 -- 172.21.15.150:0/3731868031 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800e070 con 0x7fc7900647d0 2022-08-10T17:35:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc78f7fe700 1 -- 172.21.15.150:0/3731868031 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800b9c0 con 0x7fc7900647d0 2022-08-10T17:35:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc78f7fe700 1 -- 172.21.15.150:0/3731868031 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800bd70 con 0x7fc7900647d0 2022-08-10T17:35:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 -- 172.21.15.150:0/3731868031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 msgr2=0x7fc79015a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3731868031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc79015a3a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7900707d0 tx=0x7fc78800b330 comp rx=0 tx=0).stop 2022-08-10T17:35:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 -- 172.21.15.150:0/3731868031 shutdown_connections 2022-08-10T17:35:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3731868031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc79015a3a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3731868031 >> v2:172.21.15.197:3300/0 conn(0x7fc790150af0 0x7fc790159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 -- 172.21.15.150:0/3731868031 >> 172.21.15.150:0/3731868031 conn(0x7fc7900c92f0 msgr2=0x7fc7900c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 -- 172.21.15.150:0/3731868031 shutdown_connections 2022-08-10T17:35:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.472+0000 7fc796ed3700 1 -- 172.21.15.150:0/3731868031 wait complete. 2022-08-10T17:35:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.473+0000 7fc796ed3700 1 Processor -- start 2022-08-10T17:35:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.473+0000 7fc796ed3700 1 -- start start 2022-08-10T17:35:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc79006c860 0x7fc79014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 0x7fc7901579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7900bbd60 con 0x7fc7900647d0 2022-08-10T17:35:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7900bb370 con 0x7fc790150af0 2022-08-10T17:35:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc796ed3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901f0780 con 0x7fc79006c860 2022-08-10T17:35:34.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57414/0 (socket says 172.21.15.150:57414) 2022-08-10T17:35:34.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 -- 172.21.15.150:0/3524967078 learned_addr learned my addr 172.21.15.150:0/3524967078 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc795470700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 0x7fc7901579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc78ffff700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc79006c860 0x7fc79014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 -- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc79006c860 msgr2=0x7fc79014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc79006c860 0x7fc79014f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 -- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 msgr2=0x7fc7901579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 0x7fc7901579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc794c6f700 1 -- 172.21.15.150:0/3524967078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788009b30 con 0x7fc7900647d0 2022-08-10T17:35:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.474+0000 7fc795470700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 0x7fc7901579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:34.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc794c6f700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc78400d5a0 tx=0x7fc78400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784004030 con 0x7fc7900647d0 2022-08-10T17:35:34.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840041b0 con 0x7fc7900647d0 2022-08-10T17:35:34.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc790140b20 con 0x7fc7900647d0 2022-08-10T17:35:34.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840125f0 con 0x7fc7900647d0 2022-08-10T17:35:34.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.475+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7900ba760 con 0x7fc7900647d0 2022-08-10T17:35:34.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.476+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7900bb650 con 0x7fc7900647d0 2022-08-10T17:35:34.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.476+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc784012750 con 0x7fc7900647d0 2022-08-10T17:35:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.476+0000 7fc78d7fa700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 0x7fc778067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.477+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc784081cc0 con 0x7fc7900647d0 2022-08-10T17:35:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.477+0000 7fc78ffff700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 0x7fc778067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.477+0000 7fc78ffff700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 0x7fc778067560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc790143070 tx=0x7fc77c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.480+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc7840502a0 con 0x7fc7900647d0 2022-08-10T17:35:34.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.659+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc7901437f0 con 0x7fc7900647d0 2022-08-10T17:35:34.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.659+0000 7fc78d7fa700 1 -- 172.21.15.150:0/3524967078 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc7840538c0 con 0x7fc7900647d0 2022-08-10T17:35:34.665 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:34.666 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2022-08-10T17:35:34.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:35:34.666 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2022-08-10T17:35:34.667 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2022-08-10T17:35:34.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:35:34.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:35:34.668 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 2, 2022-08-10T17:35:34.668 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": "rbd" 2022-08-10T17:35:34.669 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:35:34.669 INFO:teuthology.orchestra.run.smithi150.stdout:] 2022-08-10T17:35:34.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 msgr2=0x7fc778067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 0x7fc778067560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc790143070 tx=0x7fc77c009040 comp rx=0 tx=0).stop 2022-08-10T17:35:34.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 msgr2=0x7fc7901f0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc78400d5a0 tx=0x7fc78400d960 comp rx=0 tx=0).stop 2022-08-10T17:35:34.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 shutdown_connections 2022-08-10T17:35:34.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc790150af0 0x7fc7901579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900647d0 0x7fc7901f0240 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc7780650b0 0x7fc778067560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 --2- 172.21.15.150:0/3524967078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc79006c860 0x7fc79014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 >> 172.21.15.150:0/3524967078 conn(0x7fc7900c92f0 msgr2=0x7fc790145df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 shutdown_connections 2022-08-10T17:35:34.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.661+0000 7fc796ed3700 1 -- 172.21.15.150:0/3524967078 wait complete. 2022-08-10T17:35:34.678 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-08-10T17:35:34.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-08-10T17:35:34.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.799+0000 7f9976517700 1 Processor -- start 2022-08-10T17:35:34.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.799+0000 7f9976517700 1 -- start start 2022-08-10T17:35:34.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9976517700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c6a0 0x7f997006baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9976517700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f997006c030 0x7f9970156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9976517700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997006cad0 con 0x7f9970150c80 2022-08-10T17:35:34.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9976517700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9970064ba0 con 0x7f997006c030 2022-08-10T17:35:34.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9976517700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99700c5950 con 0x7f997006c6a0 2022-08-10T17:35:34.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9974ab4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f997006c030 0x7f9970156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9974ab4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f997006c030 0x7f9970156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57426/0 (socket says 172.21.15.150:57426) 2022-08-10T17:35:34.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f9974ab4700 1 -- 172.21.15.150:0/3099024664 learned_addr learned my addr 172.21.15.150:0/3099024664 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.800+0000 7f996f7fe700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c6a0 0x7f997006baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9974ab4700 1 -- 172.21.15.150:0/3099024664 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c6a0 msgr2=0x7f997006baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:34.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9974ab4700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c6a0 0x7f997006baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9974ab4700 1 -- 172.21.15.150:0/3099024664 >> v1:172.21.15.197:6789/0 conn(0x7f9970150c80 legacy=0x7f997006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9974ab4700 1 -- 172.21.15.150:0/3099024664 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99700645e0 con 0x7f997006c030 2022-08-10T17:35:34.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9974ab4700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c030 0x7f9970156a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9968009e80 tx=0x7f996800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf59b85979756c7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f996effd700 1 -- 172.21.15.150:0/3099024664 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800e070 con 0x7f997006c030 2022-08-10T17:35:34.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f996effd700 1 -- 172.21.15.150:0/3099024664 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800b980 con 0x7f997006c030 2022-08-10T17:35:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f996effd700 1 -- 172.21.15.150:0/3099024664 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800bd30 con 0x7f997006c030 2022-08-10T17:35:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 -- 172.21.15.150:0/3099024664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c030 msgr2=0x7f9970156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c030 0x7f9970156a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9968009e80 tx=0x7f996800b330 comp rx=0 tx=0).stop 2022-08-10T17:35:34.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 -- 172.21.15.150:0/3099024664 shutdown_connections 2022-08-10T17:35:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c030 0x7f9970156a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 --2- 172.21.15.150:0/3099024664 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c6a0 0x7f997006baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 -- 172.21.15.150:0/3099024664 >> 172.21.15.150:0/3099024664 conn(0x7f99700c9290 msgr2=0x7f99700c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:34.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.801+0000 7f9976517700 1 -- 172.21.15.150:0/3099024664 shutdown_connections 2022-08-10T17:35:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.802+0000 7f9976517700 1 -- 172.21.15.150:0/3099024664 wait complete. 2022-08-10T17:35:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 Processor -- start 2022-08-10T17:35:34.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 -- start start 2022-08-10T17:35:34.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 0x7f99700c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9970150c80 0x7f99701df430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99701ec6e0 con 0x7f997006c6a0 2022-08-10T17:35:34.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99700c8200 con 0x7f9970150c80 2022-08-10T17:35:34.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.803+0000 7f9976517700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99701ecb70 con 0x7f997006c030 2022-08-10T17:35:34.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57430/0 (socket says 172.21.15.150:57430) 2022-08-10T17:35:34.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 -- 172.21.15.150:0/329853663 learned_addr learned my addr 172.21.15.150:0/329853663 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:34.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f9974ab4700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9970150c80 0x7f99701df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996ffff700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 0x7f99700c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 -- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 msgr2=0x7f99700c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 0x7f99700c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 -- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9970150c80 msgr2=0x7f99701df430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:34.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9970150c80 0x7f99701df430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:34.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 -- 172.21.15.150:0/329853663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009b30 con 0x7f997006c6a0 2022-08-10T17:35:34.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996ffff700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 0x7f99700c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:34.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996f7fe700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f996000d800 tx=0x7f996000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960012630 con 0x7f997006c6a0 2022-08-10T17:35:34.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9960012790 con 0x7f997006c6a0 2022-08-10T17:35:34.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99701ebdb0 con 0x7f997006c6a0 2022-08-10T17:35:34.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960012b40 con 0x7f997006c6a0 2022-08-10T17:35:34.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.804+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99701ec370 con 0x7f997006c6a0 2022-08-10T17:35:34.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.805+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99701ec530 con 0x7f997006c6a0 2022-08-10T17:35:34.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.805+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9960012ca0 con 0x7f997006c6a0 2022-08-10T17:35:34.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.806+0000 7f996cff9700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 0x7f9950067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:34.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.806+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9960081ce0 con 0x7f997006c6a0 2022-08-10T17:35:34.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.806+0000 7f996ffff700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 0x7f9950067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:34.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.806+0000 7f996ffff700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 0x7f9950067560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9964000f60 tx=0x7f9964009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:34.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.810+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f99600503d0 con 0x7f997006c6a0 2022-08-10T17:35:34.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:34.990+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9970072890 con 0x7f997006c6a0 2022-08-10T17:35:36.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:35.997+0000 7f996cff9700 1 -- 172.21.15.150:0/329853663 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f99600539f0 con 0x7f997006c6a0 2022-08-10T17:35:36.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 msgr2=0x7f9950067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 0x7f9950067560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9964000f60 tx=0x7f9964009040 comp rx=0 tx=0).stop 2022-08-10T17:35:36.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 msgr2=0x7f9970156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f996000d800 tx=0x7f996000db10 comp rx=0 tx=0).stop 2022-08-10T17:35:36.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 shutdown_connections 2022-08-10T17:35:36.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9970150c80 0x7f99701df430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f99500650b0 0x7f9950067560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f997006c030 0x7f99700c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 --2- 172.21.15.150:0/329853663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997006c6a0 0x7f9970156990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.001+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 >> 172.21.15.150:0/329853663 conn(0x7f99700c9290 msgr2=0x7f99700c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:36.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.003+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 shutdown_connections 2022-08-10T17:35:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.003+0000 7f9976517700 1 -- 172.21.15.150:0/329853663 wait complete. 2022-08-10T17:35:36.009 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2022-08-10T17:35:36.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2022-08-10T17:35:36.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.153+0000 7f723cfdd700 1 Processor -- start 2022-08-10T17:35:36.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.153+0000 7f723cfdd700 1 -- start start 2022-08-10T17:35:36.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723cfdd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f723814ed40 0x7f7238157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:36.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723cfdd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380681b0 con 0x7f72380c3bd0 2022-08-10T17:35:36.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723cfdd700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723806be70 con 0x7f723814e970 2022-08-10T17:35:36.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723cfdd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723806c100 con 0x7f723814ed40 2022-08-10T17:35:36.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7235d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f723814ed40 0x7f7238157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:36.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7236d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f72380c3bd0 0x7f72381581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41888/0 (socket says 172.21.15.150:41888) 2022-08-10T17:35:36.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7236d9d700 1 -- 172.21.15.150:0/14903082 learned_addr learned my addr 172.21.15.150:0/14903082 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:36.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7235d9b700 1 -- 172.21.15.150:0/14903082 >> v1:172.21.15.197:6789/0 conn(0x7f723814e970 legacy=0x7f7238068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:36.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7235d9b700 1 -- 172.21.15.150:0/14903082 >> v1:172.21.15.150:6789/0 conn(0x7f72380c3bd0 legacy=0x7f72381581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723559a700 1 -- 172.21.15.150:0/14903082 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343811200 0 0) 0x7f72380681b0 con 0x7f72380c3bd0 2022-08-10T17:35:36.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7235d9b700 1 -- 172.21.15.150:0/14903082 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723806c3a0 con 0x7f723814ed40 2022-08-10T17:35:36.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f7235d9b700 1 --2- 172.21.15.150:0/14903082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814ed40 0x7f7238157ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72280096b0 tx=0x7f72280099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fdb806fe8589c3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:36.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723559a700 1 -- 172.21.15.150:0/14903082 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228004230 con 0x7f723814ed40 2022-08-10T17:35:36.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723559a700 1 -- 172.21.15.150:0/14903082 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228004390 con 0x7f723814ed40 2022-08-10T17:35:36.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.154+0000 7f723559a700 1 -- 172.21.15.150:0/14903082 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228011870 con 0x7f723814ed40 2022-08-10T17:35:36.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 -- 172.21.15.150:0/14903082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814ed40 msgr2=0x7f7238157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 --2- 172.21.15.150:0/14903082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814ed40 0x7f7238157ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72280096b0 tx=0x7f72280099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 -- 172.21.15.150:0/14903082 shutdown_connections 2022-08-10T17:35:36.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 --2- 172.21.15.150:0/14903082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814ed40 0x7f7238157ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 -- 172.21.15.150:0/14903082 >> 172.21.15.150:0/14903082 conn(0x7f72380c92f0 msgr2=0x7f72380c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:36.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 -- 172.21.15.150:0/14903082 shutdown_connections 2022-08-10T17:35:36.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.155+0000 7f723cfdd700 1 -- 172.21.15.150:0/14903082 wait complete. 2022-08-10T17:35:36.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.156+0000 7f723cfdd700 1 Processor -- start 2022-08-10T17:35:36.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.156+0000 7f723cfdd700 1 -- start start 2022-08-10T17:35:36.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 0x7f72381eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:36.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:36.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 0x7f7238149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:36.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723806eea0 con 0x7f723814e970 2022-08-10T17:35:36.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381479b0 con 0x7f723814ed40 2022-08-10T17:35:36.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723cfdd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7238148340 con 0x7f72380c3bd0 2022-08-10T17:35:36.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:36.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57442/0 (socket says 172.21.15.150:57442) 2022-08-10T17:35:36.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 -- 172.21.15.150:0/544257857 learned_addr learned my addr 172.21.15.150:0/544257857 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:36.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f723659c700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 0x7f72381eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:36.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7236d9d700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 0x7f7238149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:36.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 -- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 msgr2=0x7f72381eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 0x7f72381eed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 -- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 msgr2=0x7f7238149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:36.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 0x7f7238149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:36.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.157+0000 7f7235d9b700 1 -- 172.21.15.150:0/544257857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228009310 con 0x7f723814e970 2022-08-10T17:35:36.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f723659c700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 0x7f72381eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:36.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f7236d9d700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 0x7f7238149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:36.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f7235d9b700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f72280045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:36.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228003520 con 0x7f723814e970 2022-08-10T17:35:36.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722801f070 con 0x7f723814e970 2022-08-10T17:35:36.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723814a210 con 0x7f723814e970 2022-08-10T17:35:36.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280038e0 con 0x7f723814e970 2022-08-10T17:35:36.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.158+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723806ea10 con 0x7f723814e970 2022-08-10T17:35:36.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.159+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723806ecf0 con 0x7f723814e970 2022-08-10T17:35:36.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.159+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f722802a020 con 0x7f723814e970 2022-08-10T17:35:36.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.160+0000 7f7226ffd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 0x7f7214067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:36.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.160+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f7228083470 con 0x7f723814e970 2022-08-10T17:35:36.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.160+0000 7f723659c700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 0x7f7214067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:36.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.160+0000 7f723659c700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 0x7f7214067590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f722c003d20 tx=0x7f722c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:36.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.164+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7228051940 con 0x7f723814e970 2022-08-10T17:35:36.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:36.341+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f723806ecf0 con 0x7f723814e970 2022-08-10T17:35:36.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:35:36.476 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:35:37.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.007+0000 7f7226ffd700 1 -- 172.21.15.150:0/544257857 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7228054f60 con 0x7f723814e970 2022-08-10T17:35:37.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 msgr2=0x7f7214067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 0x7f7214067590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f722c003d20 tx=0x7f722c009040 comp rx=0 tx=0).stop 2022-08-10T17:35:37.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 msgr2=0x7f7238147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f72280045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 shutdown_connections 2022-08-10T17:35:37.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f723814ed40 0x7f7238149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72140650e0 0x7f7214067590 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f722c003d20 tx=0x7f722c009040 comp rx=0 tx=0).stop 2022-08-10T17:35:37.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72380c3bd0 0x7f72381eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 --2- 172.21.15.150:0/544257857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723814e970 0x7f7238147e00 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f72280045d0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.011+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 >> 172.21.15.150:0/544257857 conn(0x7f72380c92f0 msgr2=0x7f72380c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:37.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.012+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 shutdown_connections 2022-08-10T17:35:37.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.012+0000 7f723cfdd700 1 -- 172.21.15.150:0/544257857 wait complete. 2022-08-10T17:35:37.020 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2022-08-10T17:35:37.038 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-08-10T17:35:37.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.160+0000 7f531f0ba700 1 Processor -- start 2022-08-10T17:35:37.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.160+0000 7f531f0ba700 1 -- start start 2022-08-10T17:35:37.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531f0ba700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f531806c860 0x7f53180c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531f0ba700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180c4dc0 con 0x7f531815a570 2022-08-10T17:35:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531f0ba700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180c5940 con 0x7f5318150af0 2022-08-10T17:35:37.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531f0ba700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180c9fc0 con 0x7f531806c860 2022-08-10T17:35:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531d657700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f531815a570 0x7f53180c4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41908/0 (socket says 172.21.15.150:41908) 2022-08-10T17:35:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f531d657700 1 -- 172.21.15.150:0/607951484 learned_addr learned my addr 172.21.15.150:0/607951484 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f5317fff700 1 --2- 172.21.15.150:0/607951484 >> v2:172.21.15.197:3300/0 conn(0x7f531806c860 0x7f53180c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442974053 0 0) 0x7f53180c4dc0 con 0x7f531815a570 2022-08-10T17:35:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc003430 con 0x7f531815a570 2022-08-10T17:35:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364437576 0 0) 0x7f53180c5940 con 0x7f5318150af0 2022-08-10T17:35:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53180c4dc0 con 0x7f5318150af0 2022-08-10T17:35:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f5317fff700 1 -- 172.21.15.150:0/607951484 >> v1:172.21.15.197:6789/0 conn(0x7f5318150af0 legacy=0x7f5318159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f5317fff700 1 -- 172.21.15.150:0/607951484 >> v1:172.21.15.150:6789/0 conn(0x7f531815a570 legacy=0x7f53180c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.161+0000 7f5317fff700 1 -- 172.21.15.150:0/607951484 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531806f9a0 con 0x7f531806c860 2022-08-10T17:35:37.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f5317fff700 1 --2- 172.21.15.150:0/607951484 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f531806c860 0x7f53180c3ec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53040096b0 tx=0x7f53040099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7c1e2abb50c0157 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040107b0 con 0x7f531806c860 2022-08-10T17:35:37.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304010910 con 0x7f531806c860 2022-08-10T17:35:37.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f53177fe700 1 -- 172.21.15.150:0/607951484 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304010cc0 con 0x7f531806c860 2022-08-10T17:35:37.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 -- 172.21.15.150:0/607951484 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f531806c860 msgr2=0x7f53180c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 --2- 172.21.15.150:0/607951484 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f531806c860 0x7f53180c3ec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53040096b0 tx=0x7f53040099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 -- 172.21.15.150:0/607951484 shutdown_connections 2022-08-10T17:35:37.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 --2- 172.21.15.150:0/607951484 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f531806c860 0x7f53180c3ec0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 -- 172.21.15.150:0/607951484 >> 172.21.15.150:0/607951484 conn(0x7f53180c92f0 msgr2=0x7f53180c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:37.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 -- 172.21.15.150:0/607951484 shutdown_connections 2022-08-10T17:35:37.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.162+0000 7f531f0ba700 1 -- 172.21.15.150:0/607951484 wait complete. 2022-08-10T17:35:37.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.163+0000 7f531f0ba700 1 Processor -- start 2022-08-10T17:35:37.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.163+0000 7f531f0ba700 1 -- start start 2022-08-10T17:35:37.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5318150af0 0x7f53181ec490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f531815a570 0x7f53181ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53180be5e0 con 0x7f531806c860 2022-08-10T17:35:37.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53181574e0 con 0x7f5318150af0 2022-08-10T17:35:37.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531f0ba700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53181ef720 con 0x7f531815a570 2022-08-10T17:35:37.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531ce56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531ce56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57462/0 (socket says 172.21.15.150:57462) 2022-08-10T17:35:37.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.164+0000 7f531ce56700 1 -- 172.21.15.150:0/1460187137 learned_addr learned my addr 172.21.15.150:0/1460187137 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:37.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531d657700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f531815a570 0x7f53181ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f5317fff700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5318150af0 0x7f53181ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 -- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f531815a570 msgr2=0x7f53181ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f531815a570 0x7f53181ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 -- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5318150af0 msgr2=0x7f53181ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5318150af0 0x7f53181ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 -- 172.21.15.150:0/1460187137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304009310 con 0x7f531806c860 2022-08-10T17:35:37.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531ce56700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c430 tx=0x7f530c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0052d0 con 0x7f531806c860 2022-08-10T17:35:37.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c003500 con 0x7f531806c860 2022-08-10T17:35:37.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318157710 con 0x7f531806c860 2022-08-10T17:35:37.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0038b0 con 0x7f531806c860 2022-08-10T17:35:37.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.165+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53181efc80 con 0x7f531806c860 2022-08-10T17:35:37.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.166+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531806e290 con 0x7f531806c860 2022-08-10T17:35:37.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.166+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f530c019030 con 0x7f531806c860 2022-08-10T17:35:37.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.167+0000 7f53157fa700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 0x7f5300067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.167+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f530c0810d0 con 0x7f531806c860 2022-08-10T17:35:37.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.167+0000 7f5317fff700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 0x7f5300067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.168+0000 7f5317fff700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 0x7f5300067560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53040090b0 tx=0x7f5304008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.171+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f530c04f3c0 con 0x7f531806c860 2022-08-10T17:35:37.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.391+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5318072890 con 0x7f531806c860 2022-08-10T17:35:37.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.397+0000 7f53157fa700 1 -- 172.21.15.150:0/1460187137 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f530c0529e0 con 0x7f531806c860 2022-08-10T17:35:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 msgr2=0x7f5300067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 0x7f5300067560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53040090b0 tx=0x7f5304008030 comp rx=0 tx=0).stop 2022-08-10T17:35:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 msgr2=0x7f53180644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c430 tx=0x7f530c00c740 comp rx=0 tx=0).stop 2022-08-10T17:35:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 shutdown_connections 2022-08-10T17:35:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53000650b0 0x7f5300067560 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53040090b0 tx=0x7f5304008030 comp rx=0 tx=0).stop 2022-08-10T17:35:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f531815a570 0x7f53181ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f531806c860 0x7f53180644e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 --2- 172.21.15.150:0/1460187137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5318150af0 0x7f53181ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.403+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 >> 172.21.15.150:0/1460187137 conn(0x7f53180c92f0 msgr2=0x7f531814e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:37.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.404+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 shutdown_connections 2022-08-10T17:35:37.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.405+0000 7f531f0ba700 1 -- 172.21.15.150:0/1460187137 wait complete. 2022-08-10T17:35:37.415 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 3 and data pool 4 2022-08-10T17:35:37.431 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-08-10T17:35:37.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2022-08-10T17:35:37.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.552+0000 7fa9f2a5c700 1 Processor -- start 2022-08-10T17:35:37.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.552+0000 7fa9f2a5c700 1 -- start start 2022-08-10T17:35:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f2a5c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa9ec150d50 0x7fa9ec0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f2a5c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f2a5c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec0c4750 con 0x7fa9ec0cda40 2022-08-10T17:35:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f2a5c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec0c81b0 con 0x7fa9ec150d50 2022-08-10T17:35:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f2a5c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0c8490 con 0x7fa9ec0c8770 2022-08-10T17:35:37.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f0ff9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9ebfff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa9ec150d50 0x7fa9ec0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9eb7fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fa9ec0cda40 0x7fa9ec159d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:56504/0 (socket says 172.21.15.150:56504) 2022-08-10T17:35:37.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.553+0000 7fa9f0ff9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:43462/0 (socket says 172.21.15.150:43462) 2022-08-10T17:35:37.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9eb7fe700 1 -- 172.21.15.150:0/2849647697 learned_addr learned my addr 172.21.15.150:0/2849647697 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:37.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9ebfff700 1 -- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 msgr2=0x7fa9ec15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:37.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9ebfff700 1 -- 172.21.15.150:0/2849647697 >> v1:172.21.15.197:6789/0 conn(0x7fa9ec0cda40 legacy=0x7fa9ec159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9eaffd700 1 -- 172.21.15.150:0/2849647697 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790044068 0 0) 0x7fa9ec0c4750 con 0x7fa9ec0cda40 2022-08-10T17:35:37.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9ebfff700 1 -- 172.21.15.150:0/2849647697 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0ccc80 con 0x7fa9ec150d50 2022-08-10T17:35:37.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9f0ff9700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:35:37.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec150d50 0x7fa9ec0c4210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00096b0 tx=0x7fa9e00099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a4d14e50bfba303 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9eaffd700 1 -- 172.21.15.150:0/2849647697 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00107b0 con 0x7fa9ec150d50 2022-08-10T17:35:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9eaffd700 1 -- 172.21.15.150:0/2849647697 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0010910 con 0x7fa9ec150d50 2022-08-10T17:35:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.554+0000 7fa9eaffd700 1 -- 172.21.15.150:0/2849647697 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0010cc0 con 0x7fa9ec150d50 2022-08-10T17:35:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec150d50 msgr2=0x7fa9ec0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec150d50 0x7fa9ec0c4210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00096b0 tx=0x7fa9e00099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/2849647697 shutdown_connections 2022-08-10T17:35:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0c8770 0x7fa9ec15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/2849647697 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec150d50 0x7fa9ec0c4210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/2849647697 >> 172.21.15.150:0/2849647697 conn(0x7fa9ec071370 msgr2=0x7fa9ec071740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/2849647697 shutdown_connections 2022-08-10T17:35:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.555+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/2849647697 wait complete. 2022-08-10T17:35:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.556+0000 7fa9f2a5c700 1 Processor -- start 2022-08-10T17:35:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.556+0000 7fa9f2a5c700 1 -- start start 2022-08-10T17:35:37.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 0x7fa9ec1dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 0x7fa9ec0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec1e0440 con 0x7fa9ec150d50 2022-08-10T17:35:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec1ec010 con 0x7fa9ec0c8770 2022-08-10T17:35:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f2a5c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0c3a90 con 0x7fa9ec0cda40 2022-08-10T17:35:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57480/0 (socket says 172.21.15.150:57480) 2022-08-10T17:35:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 -- 172.21.15.150:0/4176387908 learned_addr learned my addr 172.21.15.150:0/4176387908 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 0x7fa9ec1dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9eb7fe700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 0x7fa9ec0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 -- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 msgr2=0x7fa9ec0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 0x7fa9ec0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 -- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 msgr2=0x7fa9ec1dfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 0x7fa9ec1dfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 -- 172.21.15.150:0/4176387908 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4009a70 con 0x7fa9ec150d50 2022-08-10T17:35:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 0x7fa9ec1dfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9eb7fe700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 0x7fa9ec0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.557+0000 7fa9f0ff9700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400efc0 tx=0x7fa9e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.558+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4009d70 con 0x7fa9ec150d50 2022-08-10T17:35:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.558+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e400f040 con 0x7fa9ec150d50 2022-08-10T17:35:37.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.558+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e0009310 con 0x7fa9ec150d50 2022-08-10T17:35:37.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.558+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e400ce00 con 0x7fa9ec150d50 2022-08-10T17:35:37.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.558+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec1ec500 con 0x7fa9ec150d50 2022-08-10T17:35:37.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.559+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec14afa0 con 0x7fa9ec150d50 2022-08-10T17:35:37.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.559+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa9e4014480 con 0x7fa9ec150d50 2022-08-10T17:35:37.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.559+0000 7fa9e8ff9700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 0x7fa9cc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:37.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.559+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9e40829b0 con 0x7fa9ec150d50 2022-08-10T17:35:37.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.560+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 0x7fa9cc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:37.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.560+0000 7fa9ebfff700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 0x7fa9cc067590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00090b0 tx=0x7fa9e0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:37.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.563+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa9e4050c40 con 0x7fa9ec150d50 2022-08-10T17:35:37.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:37.752+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa9ec072890 con 0x7fa9ec150d50 2022-08-10T17:35:38.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.397+0000 7fa9e8ff9700 1 -- 172.21.15.150:0/4176387908 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa9e40180e0 con 0x7fa9ec150d50 2022-08-10T17:35:38.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 msgr2=0x7fa9cc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 0x7fa9cc067590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00090b0 tx=0x7fa9e0008030 comp rx=0 tx=0).stop 2022-08-10T17:35:38.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 msgr2=0x7fa9ec14b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400efc0 tx=0x7fa9e400c3a0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 shutdown_connections 2022-08-10T17:35:38.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec150d50 0x7fa9ec14b150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9ec0c8770 0x7fa9ec1dfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9cc0650e0 0x7fa9cc067590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 --2- 172.21.15.150:0/4176387908 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9ec0cda40 0x7fa9ec0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 >> 172.21.15.150:0/4176387908 conn(0x7fa9ec071370 msgr2=0x7fa9ec152220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:38.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 shutdown_connections 2022-08-10T17:35:38.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.400+0000 7fa9f2a5c700 1 -- 172.21.15.150:0/4176387908 wait complete. 2022-08-10T17:35:38.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2022-08-10T17:35:38.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.548+0000 7f29a0a4d700 1 Processor -- start 2022-08-10T17:35:38.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.548+0000 7f29a0a4d700 1 -- start start 2022-08-10T17:35:38.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f29a0a4d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f299c1541c0 0x7f299c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f29a0a4d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c06ece0 0x7f299c06f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f29a0a4d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0ca5c0 con 0x7f299c0c99f0 2022-08-10T17:35:38.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f29a0a4d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0c9e20 con 0x7f299c1541c0 2022-08-10T17:35:38.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f29a0a4d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0bd460 con 0x7f299c06ece0 2022-08-10T17:35:38.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f299a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f299c1541c0 0x7f299c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f2999d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f299c0c99f0 0x7f299c06fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41936/0 (socket says 172.21.15.150:41936) 2022-08-10T17:35:38.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.549+0000 7f2999d9b700 1 -- 172.21.15.150:0/2971138229 learned_addr learned my addr 172.21.15.150:0/2971138229 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:38.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299ad9d700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c06ece0 0x7f299c06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299a59c700 1 -- 172.21.15.150:0/2971138229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c06ece0 msgr2=0x7f299c06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:38.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299a59c700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c06ece0 0x7f299c06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299a59c700 1 -- 172.21.15.150:0/2971138229 >> v1:172.21.15.150:6789/0 conn(0x7f299c0c99f0 legacy=0x7f299c06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299a59c700 1 -- 172.21.15.150:0/2971138229 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0c4420 con 0x7f299c1541c0 2022-08-10T17:35:38.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299959a700 1 -- 172.21.15.150:0/2971138229 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189907936 0 0) 0x7f299c0ca5c0 con 0x7f299c0c99f0 2022-08-10T17:35:38.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299a59c700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c0c5fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f298c0096b0 tx=0x7f298c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f31e8708e8a38a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:38.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299959a700 1 -- 172.21.15.150:0/2971138229 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c011830 con 0x7f299c1541c0 2022-08-10T17:35:38.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299959a700 1 -- 172.21.15.150:0/2971138229 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c011990 con 0x7f299c1541c0 2022-08-10T17:35:38.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.550+0000 7f299959a700 1 -- 172.21.15.150:0/2971138229 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c011d40 con 0x7f299c1541c0 2022-08-10T17:35:38.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 -- 172.21.15.150:0/2971138229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 msgr2=0x7f299c0c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c0c5fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f298c0096b0 tx=0x7f298c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 -- 172.21.15.150:0/2971138229 shutdown_connections 2022-08-10T17:35:38.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c06ece0 0x7f299c06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/2971138229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c0c5fa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 -- 172.21.15.150:0/2971138229 >> 172.21.15.150:0/2971138229 conn(0x7f299c068110 msgr2=0x7f299c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:38.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 -- 172.21.15.150:0/2971138229 shutdown_connections 2022-08-10T17:35:38.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.551+0000 7f29a0a4d700 1 -- 172.21.15.150:0/2971138229 wait complete. 2022-08-10T17:35:38.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.552+0000 7f29a0a4d700 1 Processor -- start 2022-08-10T17:35:38.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.552+0000 7f29a0a4d700 1 -- start start 2022-08-10T17:35:38.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f299c06ece0 0x7f299c147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c0c99f0 0x7f299c150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c14fb80 con 0x7f299c1541c0 2022-08-10T17:35:38.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1503e0 con 0x7f299c06ece0 2022-08-10T17:35:38.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1506c0 con 0x7f299c0c99f0 2022-08-10T17:35:38.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57496/0 (socket says 172.21.15.150:57496) 2022-08-10T17:35:38.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 -- 172.21.15.150:0/1021011614 learned_addr learned my addr 172.21.15.150:0/1021011614 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:38.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299a59c700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f299c06ece0 0x7f299c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f2999d9b700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c0c99f0 0x7f299c150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 -- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c0c99f0 msgr2=0x7f299c150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c0c99f0 0x7f299c150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 -- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f299c06ece0 msgr2=0x7f299c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:38.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f299c06ece0 0x7f299c147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:38.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 -- 172.21.15.150:0/1021011614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009310 con 0x7f299c1541c0 2022-08-10T17:35:38.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f299ad9d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2994007e60 tx=0x7f299400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:38.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400ede0 con 0x7f299c1541c0 2022-08-10T17:35:38.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994014420 con 0x7f299c1541c0 2022-08-10T17:35:38.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c1509a0 con 0x7f299c1541c0 2022-08-10T17:35:38.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940147d0 con 0x7f299c1541c0 2022-08-10T17:35:38.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.553+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c157c80 con 0x7f299c1541c0 2022-08-10T17:35:38.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.554+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c157ea0 con 0x7f299c1541c0 2022-08-10T17:35:38.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.555+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2994012050 con 0x7f299c1541c0 2022-08-10T17:35:38.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.555+0000 7f298affd700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 0x7f2978067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:38.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.555+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f29940826d0 con 0x7f299c1541c0 2022-08-10T17:35:38.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.555+0000 7f299a59c700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 0x7f2978067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:38.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.556+0000 7f299a59c700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 0x7f2978067590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f298c009a00 tx=0x7f298c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:38.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.559+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f29940508e0 con 0x7f299c1541c0 2022-08-10T17:35:38.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:38.736+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f299c0ca3a0 con 0x7f299c1541c0 2022-08-10T17:35:40.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.406+0000 7f298affd700 1 -- 172.21.15.150:0/1021011614 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2994053f00 con 0x7f299c1541c0 2022-08-10T17:35:40.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.411+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 msgr2=0x7f2978067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.411+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 0x7f2978067590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f298c009a00 tx=0x7f298c01c040 comp rx=0 tx=0).stop 2022-08-10T17:35:40.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.411+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 msgr2=0x7f299c14d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.411+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2994007e60 tx=0x7f299400e3c0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.411+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 shutdown_connections 2022-08-10T17:35:40.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.412+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f299c1541c0 0x7f299c14d1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.412+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f299c06ece0 0x7f299c147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.412+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f29780650e0 0x7f2978067590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.412+0000 7f29a0a4d700 1 --2- 172.21.15.150:0/1021011614 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f299c0c99f0 0x7f299c150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.412+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 >> 172.21.15.150:0/1021011614 conn(0x7f299c068110 msgr2=0x7f299c151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:40.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.413+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 shutdown_connections 2022-08-10T17:35:40.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.414+0000 7f29a0a4d700 1 -- 172.21.15.150:0/1021011614 wait complete. 2022-08-10T17:35:40.422 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data_ec' created 2022-08-10T17:35:40.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2022-08-10T17:35:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.563+0000 7fc2ef574700 1 Processor -- start 2022-08-10T17:35:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.563+0000 7fc2ef574700 1 -- start start 2022-08-10T17:35:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ef574700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc2e80c4c30 0x7fc2e80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ef574700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e80c5000 con 0x7fc2e815a130 2022-08-10T17:35:40.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ef574700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e80c1590 con 0x7fc2e80c0f80 2022-08-10T17:35:40.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ef574700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e80c5fc0 con 0x7fc2e80c4c30 2022-08-10T17:35:40.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ecb0f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc2e815a130 0x7fc2e80c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41948/0 (socket says 172.21.15.150:41948) 2022-08-10T17:35:40.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ecb0f700 1 -- 172.21.15.150:0/3822632058 learned_addr learned my addr 172.21.15.150:0/3822632058 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:40.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.564+0000 7fc2ed310700 1 --2- 172.21.15.150:0/3822632058 >> v2:172.21.15.197:3300/0 conn(0x7fc2e80c4c30 0x7fc2e80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186796546 0 0) 0x7fc2e80c5000 con 0x7fc2e815a130 2022-08-10T17:35:40.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d0003430 con 0x7fc2e815a130 2022-08-10T17:35:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038412319 0 0) 0x7fc2e80c1590 con 0x7fc2e80c0f80 2022-08-10T17:35:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e80c5000 con 0x7fc2e80c0f80 2022-08-10T17:35:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2962439955 0 0) 0x7fc2d0003430 con 0x7fc2e815a130 2022-08-10T17:35:40.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 >> v2:172.21.15.197:3300/0 conn(0x7fc2e80c4c30 msgr2=0x7fc2e80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:40.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 --2- 172.21.15.150:0/3822632058 >> v2:172.21.15.197:3300/0 conn(0x7fc2e80c4c30 0x7fc2e80c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 >> v1:172.21.15.197:6789/0 conn(0x7fc2e80c0f80 legacy=0x7fc2e8161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80c5620 con 0x7fc2e815a130 2022-08-10T17:35:40.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fc2e4001670 con 0x7fc2e815a130 2022-08-10T17:35:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 >> v1:172.21.15.150:6789/0 conn(0x7fc2e815a130 legacy=0x7fc2e80c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 0x7fc2d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2d00046d0 0x7fc2d0004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0005080 0x7fc2d000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80c5fc0 con 0x7fc2d0003a80 2022-08-10T17:35:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d000bf60 con 0x7fc2d0005080 2022-08-10T17:35:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d000c120 con 0x7fc2d00046d0 2022-08-10T17:35:40.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2edb11700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0005080 0x7fc2d000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 0x7fc2d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ecb0f700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2d00046d0 0x7fc2d0004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 -- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2d00046d0 msgr2=0x7fc2d0004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:40.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2d00046d0 0x7fc2d0004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 -- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0005080 msgr2=0x7fc2d000b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0005080 0x7fc2d000b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2edb11700 1 -- 172.21.15.150:0/3822632058 reap_dead start 2022-08-10T17:35:40.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 -- 172.21.15.150:0/3822632058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0003430 con 0x7fc2d0003a80 2022-08-10T17:35:40.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2ed310700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 0x7fc2d0003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009990 tx=0x7fc2d0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687d2214bc9e0ad9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:40.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.565+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80058a0 con 0x7fc2d0003a80 2022-08-10T17:35:40.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8005a00 con 0x7fc2d0003a80 2022-08-10T17:35:40.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2d7fff700 1 -- 172.21.15.150:0/3822632058 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8005d70 con 0x7fc2d0003a80 2022-08-10T17:35:40.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 -- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 msgr2=0x7fc2d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 0x7fc2d0003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009990 tx=0x7fc2d0005700 comp rx=0 tx=0).stop 2022-08-10T17:35:40.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 -- 172.21.15.150:0/3822632058 shutdown_connections 2022-08-10T17:35:40.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 --2- 172.21.15.150:0/3822632058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0003a80 0x7fc2d0003e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 -- 172.21.15.150:0/3822632058 >> 172.21.15.150:0/3822632058 conn(0x7fc2e806d700 msgr2=0x7fc2e806db00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:40.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 -- 172.21.15.150:0/3822632058 shutdown_connections 2022-08-10T17:35:40.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.566+0000 7fc2ef574700 1 -- 172.21.15.150:0/3822632058 wait complete. 2022-08-10T17:35:40.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.567+0000 7fc2ef574700 1 Processor -- start 2022-08-10T17:35:40.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.567+0000 7fc2ef574700 1 -- start start 2022-08-10T17:35:40.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0003a80 0x7fc2e8153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2e8154a40 0x7fc2e81ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8154540 con 0x7fc2e81506b0 2022-08-10T17:35:40.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e814fb50 con 0x7fc2d0003a80 2022-08-10T17:35:40.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ef574700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e81501b0 con 0x7fc2e8154a40 2022-08-10T17:35:40.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57514/0 (socket says 172.21.15.150:57514) 2022-08-10T17:35:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 -- 172.21.15.150:0/113357240 learned_addr learned my addr 172.21.15.150:0/113357240 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ed310700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0003a80 0x7fc2e8153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2edb11700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2e8154a40 0x7fc2e81ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 -- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2e8154a40 msgr2=0x7fc2e81ebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2e8154a40 0x7fc2e81ebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 -- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0003a80 msgr2=0x7fc2e8153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:40.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0003a80 0x7fc2e8153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:40.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.568+0000 7fc2ecb0f700 1 -- 172.21.15.150:0/113357240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e81547e0 con 0x7fc2e81506b0 2022-08-10T17:35:40.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2ecb0f700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4001860 tx=0x7fc2e40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:40.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4012560 con 0x7fc2e81506b0 2022-08-10T17:35:40.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40126c0 con 0x7fc2e81506b0 2022-08-10T17:35:40.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e814fdf0 con 0x7fc2e81506b0 2022-08-10T17:35:40.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4012a50 con 0x7fc2e81506b0 2022-08-10T17:35:40.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.569+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e8155eb0 con 0x7fc2e81506b0 2022-08-10T17:35:40.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.570+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8072890 con 0x7fc2e81506b0 2022-08-10T17:35:40.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.570+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc2e4012bb0 con 0x7fc2e81506b0 2022-08-10T17:35:40.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.570+0000 7fc2d5ffb700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 0x7fc2c8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:40.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.571+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc2e40822e0 con 0x7fc2e81506b0 2022-08-10T17:35:40.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.571+0000 7fc2ed310700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 0x7fc2c8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:40.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.571+0000 7fc2ed310700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 0x7fc2c8067590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800a010 tx=0x7fc2d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:40.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.575+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc2e4050300 con 0x7fc2e81506b0 2022-08-10T17:35:40.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:40.751+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc2e80c5900 con 0x7fc2e81506b0 2022-08-10T17:35:41.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.417+0000 7fc2d5ffb700 1 -- 172.21.15.150:0/113357240 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2e4053920 con 0x7fc2e81506b0 2022-08-10T17:35:41.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.422+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 msgr2=0x7fc2c8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.422+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 0x7fc2c8067590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800a010 tx=0x7fc2d8008030 comp rx=0 tx=0).stop 2022-08-10T17:35:41.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.422+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 msgr2=0x7fc2e8155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.422+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4001860 tx=0x7fc2e40049d0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 shutdown_connections 2022-08-10T17:35:41.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc2c80650e0 0x7fc2c8067590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc2e8154a40 0x7fc2e81ebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc2d0003a80 0x7fc2e8153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 --2- 172.21.15.150:0/113357240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e81506b0 0x7fc2e8155970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.424+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 >> 172.21.15.150:0/113357240 conn(0x7fc2e806d700 msgr2=0x7fc2e815a580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:41.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.425+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 shutdown_connections 2022-08-10T17:35:41.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.425+0000 7fc2ef574700 1 -- 172.21.15.150:0/113357240 wait complete. 2022-08-10T17:35:41.443 INFO:teuthology.orchestra.run.smithi150.stderr:set pool 5 allow_ec_overwrites to true 2022-08-10T17:35:41.456 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2022-08-10T17:35:41.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.578+0000 7f11b7668700 1 Processor -- start 2022-08-10T17:35:41.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.578+0000 7f11b7668700 1 -- start start 2022-08-10T17:35:41.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b7668700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c4d90 0x7f11b00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b7668700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11b00c2790 0x7f11b00c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b7668700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00699c0 con 0x7f11b00c7220 2022-08-10T17:35:41.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b7668700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00c5e10 con 0x7f11b00c2790 2022-08-10T17:35:41.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b7668700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c1c30 con 0x7f11b00c4d90 2022-08-10T17:35:41.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11b00c2790 0x7f11b00c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11b00c2790 0x7f11b00c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57524/0 (socket says 172.21.15.150:57524) 2022-08-10T17:35:41.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 -- 172.21.15.150:0/1487589321 learned_addr learned my addr 172.21.15.150:0/1487589321 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:41.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5404700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c4d90 0x7f11b00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 -- 172.21.15.150:0/1487589321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c4d90 msgr2=0x7f11b00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:41.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c4d90 0x7f11b00c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f11b5c05700 1 -- 172.21.15.150:0/1487589321 >> v1:172.21.15.150:6789/0 conn(0x7f11b00c7220 legacy=0x7f11b00c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b5c05700 1 -- 172.21.15.150:0/1487589321 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0068e40 con 0x7f11b00c2790 2022-08-10T17:35:41.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.579+0000 7f119ffff700 1 -- 172.21.15.150:0/1487589321 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100021507 0 0) 0x7f11b00699c0 con 0x7f11b00c7220 2022-08-10T17:35:41.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b5c05700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c2790 0x7f11b00c56a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009e80 tx=0x7f11a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663cad621a44f571 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f119ffff700 1 -- 172.21.15.150:0/1487589321 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800e070 con 0x7f11b00c2790 2022-08-10T17:35:41.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f119ffff700 1 -- 172.21.15.150:0/1487589321 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a800b980 con 0x7f11b00c2790 2022-08-10T17:35:41.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f119ffff700 1 -- 172.21.15.150:0/1487589321 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800bd30 con 0x7f11b00c2790 2022-08-10T17:35:41.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 -- 172.21.15.150:0/1487589321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c2790 msgr2=0x7f11b00c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c2790 0x7f11b00c56a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009e80 tx=0x7f11a800b330 comp rx=0 tx=0).stop 2022-08-10T17:35:41.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 -- 172.21.15.150:0/1487589321 shutdown_connections 2022-08-10T17:35:41.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c2790 0x7f11b00c56a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 --2- 172.21.15.150:0/1487589321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c4d90 0x7f11b00c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.580+0000 7f11b7668700 1 -- 172.21.15.150:0/1487589321 >> 172.21.15.150:0/1487589321 conn(0x7f11b006d0d0 msgr2=0x7f11b00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.581+0000 7f11b7668700 1 -- 172.21.15.150:0/1487589321 shutdown_connections 2022-08-10T17:35:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.581+0000 7f11b7668700 1 -- 172.21.15.150:0/1487589321 wait complete. 2022-08-10T17:35:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 Processor -- start 2022-08-10T17:35:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 -- start start 2022-08-10T17:35:41.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c2790 0x7f11b01ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f11b00c7220 0x7f11b01eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b014dd60 con 0x7f11b00c4d90 2022-08-10T17:35:41.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00be550 con 0x7f11b00c7220 2022-08-10T17:35:41.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b7668700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b014d1c0 con 0x7f11b00c2790 2022-08-10T17:35:41.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.582+0000 7f11b4c03700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57528/0 (socket says 172.21.15.150:57528) 2022-08-10T17:35:41.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 -- 172.21.15.150:0/2722604382 learned_addr learned my addr 172.21.15.150:0/2722604382 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:41.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b5404700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c2790 0x7f11b01ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b5c05700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f11b00c7220 0x7f11b01eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 -- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c2790 msgr2=0x7f11b01ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c2790 0x7f11b01ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 -- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f11b00c7220 msgr2=0x7f11b01eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f11b00c7220 0x7f11b01eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 -- 172.21.15.150:0/2722604382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8009b30 con 0x7f11b00c4d90 2022-08-10T17:35:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b4c03700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c410 tx=0x7f11ac00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0052d0 con 0x7f11b00c4d90 2022-08-10T17:35:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac003500 con 0x7f11b00c4d90 2022-08-10T17:35:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b014c5b0 con 0x7f11b00c4d90 2022-08-10T17:35:41.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0038b0 con 0x7f11b00c4d90 2022-08-10T17:35:41.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.583+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b014cb70 con 0x7f11b00c4d90 2022-08-10T17:35:41.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.584+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b014d330 con 0x7f11b00c4d90 2022-08-10T17:35:41.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.585+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f11ac019030 con 0x7f11b00c4d90 2022-08-10T17:35:41.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.585+0000 7f119dffb700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 0x7f1190067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.585+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f11ac0812f0 con 0x7f11b00c4d90 2022-08-10T17:35:41.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.585+0000 7f11b5404700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 0x7f1190067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.586+0000 7f11b5404700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 0x7f1190067560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a00069a0 tx=0x7f11a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.589+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f11ac04f310 con 0x7f11b00c4d90 2022-08-10T17:35:41.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.811+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f11b0072890 con 0x7f11b00c4d90 2022-08-10T17:35:41.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.817+0000 7f119dffb700 1 -- 172.21.15.150:0/2722604382 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7f11ac017020 con 0x7f11b00c4d90 2022-08-10T17:35:41.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 msgr2=0x7f1190067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 0x7f1190067560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a00069a0 tx=0x7f11a0008040 comp rx=0 tx=0).stop 2022-08-10T17:35:41.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 msgr2=0x7f11b00bdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c410 tx=0x7f11ac00c720 comp rx=0 tx=0).stop 2022-08-10T17:35:41.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 shutdown_connections 2022-08-10T17:35:41.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f11b00c7220 0x7f11b01eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f11900650b0 0x7f1190067560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f11b00c2790 0x7f11b01ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 --2- 172.21.15.150:0/2722604382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11b00c4d90 0x7f11b00bdba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 >> 172.21.15.150:0/2722604382 conn(0x7f11b006d0d0 msgr2=0x7f11b006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:41.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 shutdown_connections 2022-08-10T17:35:41.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.819+0000 7f11b7668700 1 -- 172.21.15.150:0/2722604382 wait complete. 2022-08-10T17:35:41.826 INFO:teuthology.orchestra.run.smithi150.stderr:added data pool 5 to fsmap 2022-08-10T17:35:41.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:35:41.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.951+0000 7fd677c7e700 1 Processor -- start 2022-08-10T17:35:41.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.951+0000 7fd677c7e700 1 -- start start 2022-08-10T17:35:41.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd67006c5b0 0x7fd670157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 0x7fd6700c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6700c3770 0x7fd6700c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700c8220 con 0x7fd67006c5b0 2022-08-10T17:35:41.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700c2190 con 0x7fd67006c980 2022-08-10T17:35:41.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd677c7e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700c2470 con 0x7fd6700c3770 2022-08-10T17:35:41.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd675a1a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd67006c5b0 0x7fd670157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd675a1a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd67006c5b0 0x7fd670157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57534/0 (socket says 172.21.15.150:57534) 2022-08-10T17:35:41.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.952+0000 7fd675a1a700 1 -- 172.21.15.150:0/3495144879 learned_addr learned my addr 172.21.15.150:0/3495144879 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:41.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd67621b700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6700c3770 0x7fd6700c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675219700 1 --2- 172.21.15.150:0/3495144879 >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 0x7fd6700c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 -- 172.21.15.150:0/3495144879 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6700c3770 msgr2=0x7fd6700c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:41.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6700c3770 0x7fd6700c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 -- 172.21.15.150:0/3495144879 >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 msgr2=0x7fd6700c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:41.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 --2- 172.21.15.150:0/3495144879 >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 0x7fd6700c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 -- 172.21.15.150:0/3495144879 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700c2750 con 0x7fd67006c5b0 2022-08-10T17:35:41.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675219700 1 --2- 172.21.15.150:0/3495144879 >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 0x7fd6700c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:41.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd675a1a700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67006c5b0 0x7fd670157820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd670067280 tx=0x7fd660009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17240c6c2305853 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd674a18700 1 -- 172.21.15.150:0/3495144879 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660004230 con 0x7fd67006c5b0 2022-08-10T17:35:41.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd674a18700 1 -- 172.21.15.150:0/3495144879 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660004390 con 0x7fd67006c5b0 2022-08-10T17:35:41.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.953+0000 7fd674a18700 1 -- 172.21.15.150:0/3495144879 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660011850 con 0x7fd67006c5b0 2022-08-10T17:35:41.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 -- 172.21.15.150:0/3495144879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67006c5b0 msgr2=0x7fd670157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67006c5b0 0x7fd670157820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd670067280 tx=0x7fd660009a60 comp rx=0 tx=0).stop 2022-08-10T17:35:41.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 -- 172.21.15.150:0/3495144879 shutdown_connections 2022-08-10T17:35:41.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6700c3770 0x7fd6700c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 --2- 172.21.15.150:0/3495144879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd67006c5b0 0x7fd670157820 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 --2- 172.21.15.150:0/3495144879 >> v2:172.21.15.197:3300/0 conn(0x7fd67006c980 0x7fd6700c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 -- 172.21.15.150:0/3495144879 >> 172.21.15.150:0/3495144879 conn(0x7fd67006e1f0 msgr2=0x7fd67006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:41.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 -- 172.21.15.150:0/3495144879 shutdown_connections 2022-08-10T17:35:41.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.954+0000 7fd677c7e700 1 -- 172.21.15.150:0/3495144879 wait complete. 2022-08-10T17:35:41.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.955+0000 7fd677c7e700 1 Processor -- start 2022-08-10T17:35:41.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.955+0000 7fd677c7e700 1 -- start start 2022-08-10T17:35:41.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd67006c5b0 0x7fd6700c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd67006c980 0x7fd6701dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701de460 con 0x7fd6700c3770 2022-08-10T17:35:41.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701ef560 con 0x7fd67006c980 2022-08-10T17:35:41.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701efaa0 con 0x7fd67006c5b0 2022-08-10T17:35:41.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57544/0 (socket says 172.21.15.150:57544) 2022-08-10T17:35:41.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 -- 172.21.15.150:0/4280997205 learned_addr learned my addr 172.21.15.150:0/4280997205 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:41.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd675219700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd67006c980 0x7fd6701dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd675a1a700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd67006c5b0 0x7fd6700c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 -- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd67006c5b0 msgr2=0x7fd6700c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd67006c5b0 0x7fd6700c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 -- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd67006c980 msgr2=0x7fd6701dd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:41.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd67006c980 0x7fd6701dd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:41.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 -- 172.21.15.150:0/4280997205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600093e0 con 0x7fd6700c3770 2022-08-10T17:35:41.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd67621b700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd66800efc0 tx=0x7fd66800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66800cad0 con 0x7fd6700c3770 2022-08-10T17:35:41.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66800f040 con 0x7fd6700c3770 2022-08-10T17:35:41.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6701ec580 con 0x7fd6700c3770 2022-08-10T17:35:41.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66800ce70 con 0x7fd6700c3770 2022-08-10T17:35:41.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.956+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6701eb7c0 con 0x7fd6700c3770 2022-08-10T17:35:41.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.957+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd670072890 con 0x7fd6700c3770 2022-08-10T17:35:41.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.958+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd668014480 con 0x7fd6700c3770 2022-08-10T17:35:41.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.958+0000 7fd65e7fc700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 0x7fd650067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:41.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.958+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd668082ca0 con 0x7fd6700c3770 2022-08-10T17:35:41.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.958+0000 7fd675a1a700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 0x7fd650067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:41.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.959+0000 7fd675a1a700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 0x7fd650067560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd660009fd0 tx=0x7fd660008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:41.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:41.962+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd668087070 con 0x7fd6700c3770 2022-08-10T17:35:42.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.183+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd67006baa0 con 0x7fd6700c3770 2022-08-10T17:35:42.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.183+0000 7fd65e7fc700 1 -- 172.21.15.150:0/4280997205 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6119 (secure 0 0 0) 0x7fd668054670 con 0x7fd6700c3770 2022-08-10T17:35:42.188 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:42.188 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:35:41.813357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:35:42.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 msgr2=0x7fd650067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 0x7fd650067560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd660009fd0 tx=0x7fd660008030 comp rx=0 tx=0).stop 2022-08-10T17:35:42.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 msgr2=0x7fd67014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd66800efc0 tx=0x7fd66800c0c0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 shutdown_connections 2022-08-10T17:35:42.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6700c3770 0x7fd67014b590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6500650b0 0x7fd650067560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd67006c5b0 0x7fd6700c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 --2- 172.21.15.150:0/4280997205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd67006c980 0x7fd6701dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 >> 172.21.15.150:0/4280997205 conn(0x7fd67006e1f0 msgr2=0x7fd6700c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 shutdown_connections 2022-08-10T17:35:42.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.185+0000 7fd677c7e700 1 -- 172.21.15.150:0/4280997205 wait complete. 2022-08-10T17:35:42.193 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 5 2022-08-10T17:35:42.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.317+0000 7fd306009700 1 Processor -- start 2022-08-10T17:35:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.317+0000 7fd306009700 1 -- start start 2022-08-10T17:35:42.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd306009700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd300068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd306009700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3001563c0 con 0x7fd300070040 2022-08-10T17:35:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd306009700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd300150940 con 0x7fd30006c860 2022-08-10T17:35:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd306009700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd300153590 con 0x7fd3000bc830 2022-08-10T17:35:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd300070040 0x7fd3000c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41998/0 (socket says 172.21.15.150:41998) 2022-08-10T17:35:42.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fffff700 1 -- 172.21.15.150:0/3015752296 learned_addr learned my addr 172.21.15.150:0/3015752296 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:42.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648101712 0 0) 0x7fd3001563c0 con 0x7fd300070040 2022-08-10T17:35:42.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2ff7fe700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd300068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2ec003430 con 0x7fd300070040 2022-08-10T17:35:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838923027 0 0) 0x7fd2ec003430 con 0x7fd300070040 2022-08-10T17:35:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 msgr2=0x7fd300068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd300068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 >> v1:172.21.15.197:6789/0 conn(0x7fd30006c860 legacy=0x7fd300152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300068870 con 0x7fd300070040 2022-08-10T17:35:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fd2f80019f0 con 0x7fd300070040 2022-08-10T17:35:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 >> v1:172.21.15.150:6789/0 conn(0x7fd300070040 legacy=0x7fd3000c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd2ec0038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2ec003e30 0x7fd2ec0046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2ec004c10 0x7fd2ec005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec00b940 con 0x7fd2ec004c10 2022-08-10T17:35:42.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec00bab0 con 0x7fd2ec003e30 2022-08-10T17:35:42.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec00bc70 con 0x7fd3000bc830 2022-08-10T17:35:42.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.318+0000 7fd2fffff700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2ec004c10 0x7fd2ec005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2ff7fe700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd2ec0038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2feffd700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2ec003e30 0x7fd2ec0046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 -- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 msgr2=0x7fd2ec0038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000bc830 0x7fd2ec0038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 -- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2ec003e30 msgr2=0x7fd2ec0046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2ec003e30 0x7fd2ec0046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 -- 172.21.15.150:0/3015752296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec003430 con 0x7fd2ec004c10 2022-08-10T17:35:42.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2ec004c10 0x7fd2ec005080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d400 tx=0x7fd2ec005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62816c8d33f7350b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007ea0 con 0x7fd2ec004c10 2022-08-10T17:35:42.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f800dda0 con 0x7fd2ec004c10 2022-08-10T17:35:42.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fe7fc700 1 -- 172.21.15.150:0/3015752296 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8005da0 con 0x7fd2ec004c10 2022-08-10T17:35:42.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd306009700 1 -- 172.21.15.150:0/3015752296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2ec004c10 msgr2=0x7fd2ec005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd306009700 1 --2- 172.21.15.150:0/3015752296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2ec004c10 0x7fd2ec005080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d400 tx=0x7fd2ec005700 comp rx=0 tx=0).stop 2022-08-10T17:35:42.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.319+0000 7fd2fffff700 1 -- 172.21.15.150:0/3015752296 reap_dead start 2022-08-10T17:35:42.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.320+0000 7fd306009700 1 -- 172.21.15.150:0/3015752296 shutdown_connections 2022-08-10T17:35:42.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.320+0000 7fd306009700 1 -- 172.21.15.150:0/3015752296 >> 172.21.15.150:0/3015752296 conn(0x7fd3000c92f0 msgr2=0x7fd3000c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.320+0000 7fd306009700 1 -- 172.21.15.150:0/3015752296 shutdown_connections 2022-08-10T17:35:42.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.320+0000 7fd306009700 1 -- 172.21.15.150:0/3015752296 wait complete. 2022-08-10T17:35:42.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.321+0000 7fd306009700 1 Processor -- start 2022-08-10T17:35:42.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.321+0000 7fd306009700 1 -- start start 2022-08-10T17:35:42.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd30014d360 0x7fd3001ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 0x7fd3001ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30014ca30 con 0x7fd30014cf90 2022-08-10T17:35:42.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3000c26a0 con 0x7fd30014d360 2022-08-10T17:35:42.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3000c23c0 con 0x7fd3000c86b0 2022-08-10T17:35:42.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57560/0 (socket says 172.21.15.150:57560) 2022-08-10T17:35:42.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 -- 172.21.15.150:0/503904124 learned_addr learned my addr 172.21.15.150:0/503904124 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:42.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2feffd700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd30014d360 0x7fd3001ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2fffff700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 0x7fd3001ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 -- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 msgr2=0x7fd3001ea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 0x7fd3001ea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 -- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd30014d360 msgr2=0x7fd3001ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd30014d360 0x7fd3001ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 -- 172.21.15.150:0/503904124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3000c0560 con 0x7fd30014cf90 2022-08-10T17:35:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2fffff700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 0x7fd3001ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:35:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2ff7fe700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0011960 tx=0x7fd2f0011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0011e50 con 0x7fd30014cf90 2022-08-10T17:35:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000f940 con 0x7fd30014cf90 2022-08-10T17:35:42.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3000c0840 con 0x7fd30014cf90 2022-08-10T17:35:42.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000fcd0 con 0x7fd30014cf90 2022-08-10T17:35:42.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.322+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3000c5cf0 con 0x7fd30014cf90 2022-08-10T17:35:42.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.323+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3000c03c0 con 0x7fd30014cf90 2022-08-10T17:35:42.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.324+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd2f0014440 con 0x7fd30014cf90 2022-08-10T17:35:42.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.324+0000 7fd2e7fff700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 0x7fd2e0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.324+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd2f0082950 con 0x7fd30014cf90 2022-08-10T17:35:42.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.324+0000 7fd2feffd700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 0x7fd2e0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.325+0000 7fd2feffd700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 0x7fd2e0067560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007fa0 tx=0x7fd2f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.328+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd3000c03c0 con 0x7fd30014cf90 2022-08-10T17:35:42.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.510+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3000c03c0 con 0x7fd30014cf90 2022-08-10T17:35:42.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.511+0000 7fd2e7fff700 1 -- 172.21.15.150:0/503904124 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18755 (secure 0 0 0) 0x7fd3000c03c0 con 0x7fd30014cf90 2022-08-10T17:35:42.515 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:42.516 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:41.813125+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 msgr2=0x7fd2e0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 0x7fd2e0067560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007fa0 tx=0x7fd2f4009040 comp rx=0 tx=0).stop 2022-08-10T17:35:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 msgr2=0x7fd30014c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0011960 tx=0x7fd2f0011c70 comp rx=0 tx=0).stop 2022-08-10T17:35:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 shutdown_connections 2022-08-10T17:35:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e00650b0 0x7fd2e0067560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd3000c86b0 0x7fd3001ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30014cf90 0x7fd30014c4f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 --2- 172.21.15.150:0/503904124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd30014d360 0x7fd3001ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 >> 172.21.15.150:0/503904124 conn(0x7fd3000c92f0 msgr2=0x7fd3000c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 shutdown_connections 2022-08-10T17:35:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.513+0000 7fd306009700 1 -- 172.21.15.150:0/503904124 wait complete. 2022-08-10T17:35:42.529 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:35:42.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.645+0000 7f1ac695a700 1 Processor -- start 2022-08-10T17:35:42.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.645+0000 7f1ac695a700 1 -- start start 2022-08-10T17:35:42.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1ac695a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1ac01580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1ac695a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac00c4770 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1ac695a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac00c3e60 con 0x7f1ac00c42f0 2022-08-10T17:35:42.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1ac695a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00c3b60 con 0x7f1ac00c5e80 2022-08-10T17:35:42.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1abffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1ac00b0ae0 0x7f1ac00c4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42016/0 (socket says 172.21.15.150:42016) 2022-08-10T17:35:42.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.646+0000 7f1abffff700 1 -- 172.21.15.150:0/4251047455 learned_addr learned my addr 172.21.15.150:0/4251047455 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:42.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abf7fe700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1ac01580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700963314 0 0) 0x7f1ab0001110 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa0003430 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777994473 0 0) 0x7f1ac00c3e60 con 0x7f1ac00c42f0 2022-08-10T17:35:42.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab0001110 con 0x7f1ac00c42f0 2022-08-10T17:35:42.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389765912 0 0) 0x7f1aa0003430 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 msgr2=0x7f1ac01580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1ac01580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 >> v1:172.21.15.197:6789/0 conn(0x7f1ac00c42f0 legacy=0x7f1ac00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac006d450 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f1ab0001800 con 0x7f1ac00b0ae0 2022-08-10T17:35:42.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 >> v1:172.21.15.150:6789/0 conn(0x7f1ac00b0ae0 legacy=0x7f1ac00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1aa0003a40 0x7f1aa0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1aa00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0004c10 0x7f1aa0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00c3b60 con 0x7f1aa0004c10 2022-08-10T17:35:42.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000b940 con 0x7f1aa0003a40 2022-08-10T17:35:42.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000bab0 con 0x7f1ac00c5e80 2022-08-10T17:35:42.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0004c10 0x7f1aa0005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abffff700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1aa0003a40 0x7f1aa0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1abf7fe700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1aa00046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 -- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 msgr2=0x7f1aa00046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1ac00c5e80 0x7f1aa00046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 -- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1aa0003a40 msgr2=0x7f1aa0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1aa0003a40 0x7f1aa0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.647+0000 7f1ac4ef7700 1 -- 172.21.15.150:0/4251047455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0003430 con 0x7f1aa0004c10 2022-08-10T17:35:42.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac4ef7700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0004c10 0x7f1aa0005080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001ee0 tx=0x7f1aa0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2b53e710798c38 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80019a0 con 0x7f1aa0004c10 2022-08-10T17:35:42.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8006ca0 con 0x7f1aa0004c10 2022-08-10T17:35:42.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1abeffd700 1 -- 172.21.15.150:0/4251047455 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8003ac0 con 0x7f1aa0004c10 2022-08-10T17:35:42.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 -- 172.21.15.150:0/4251047455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0004c10 msgr2=0x7f1aa0005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 --2- 172.21.15.150:0/4251047455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0004c10 0x7f1aa0005080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001ee0 tx=0x7f1aa0005700 comp rx=0 tx=0).stop 2022-08-10T17:35:42.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac4ef7700 1 -- 172.21.15.150:0/4251047455 reap_dead start 2022-08-10T17:35:42.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 -- 172.21.15.150:0/4251047455 shutdown_connections 2022-08-10T17:35:42.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 -- 172.21.15.150:0/4251047455 >> 172.21.15.150:0/4251047455 conn(0x7f1ac00644b0 msgr2=0x7f1ac006fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 -- 172.21.15.150:0/4251047455 shutdown_connections 2022-08-10T17:35:42.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.648+0000 7f1ac695a700 1 -- 172.21.15.150:0/4251047455 wait complete. 2022-08-10T17:35:42.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.650+0000 7f1ac695a700 1 Processor -- start 2022-08-10T17:35:42.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.650+0000 7f1ac695a700 1 -- start start 2022-08-10T17:35:42.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1aa0004c10 0x7f1ac01eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1ac014c740 0x7f1ac014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00be680 con 0x7f1ac00c17a0 2022-08-10T17:35:42.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac014d0f0 con 0x7f1ac014c740 2022-08-10T17:35:42.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac695a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00c0b70 con 0x7f1aa0004c10 2022-08-10T17:35:42.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57580/0 (socket says 172.21.15.150:57580) 2022-08-10T17:35:42.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 -- 172.21.15.150:0/1218849840 learned_addr learned my addr 172.21.15.150:0/1218849840 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:42.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abffff700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1aa0004c10 0x7f1ac01eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1ac4ef7700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1ac014c740 0x7f1ac014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 -- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1aa0004c10 msgr2=0x7f1ac01eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1aa0004c10 0x7f1ac01eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 -- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1ac014c740 msgr2=0x7f1ac014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1ac014c740 0x7f1ac014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 -- 172.21.15.150:0/1218849840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac014b490 con 0x7f1ac00c17a0 2022-08-10T17:35:42.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abf7fe700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8011960 tx=0x7f1aa8011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.651+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80136a0 con 0x7f1ac00c17a0 2022-08-10T17:35:42.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.652+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8013800 con 0x7f1ac00c17a0 2022-08-10T17:35:42.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.652+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8013b90 con 0x7f1ac00c17a0 2022-08-10T17:35:42.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.652+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac014b770 con 0x7f1ac00c17a0 2022-08-10T17:35:42.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.652+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac014bf40 con 0x7f1ac00c17a0 2022-08-10T17:35:42.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.653+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac006edf0 con 0x7f1ac00c17a0 2022-08-10T17:35:42.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.653+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1aa8013cf0 con 0x7f1ac00c17a0 2022-08-10T17:35:42.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.653+0000 7f1abcff9700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 0x7f1aa4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.653+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1aa80828b0 con 0x7f1ac00c17a0 2022-08-10T17:35:42.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.653+0000 7f1abffff700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 0x7f1aa4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.654+0000 7f1abffff700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 0x7f1aa4067560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0007d90 tx=0x7f1ab00078b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.657+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1aa8050970 con 0x7f1ac00c17a0 2022-08-10T17:35:42.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.836+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ac0073340 con 0x7f1ac00c17a0 2022-08-10T17:35:42.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.837+0000 7f1abcff9700 1 -- 172.21.15.150:0/1218849840 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18755 (secure 0 0 0) 0x7f1aa8022020 con 0x7f1ac00c17a0 2022-08-10T17:35:42.841 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:42.841 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:35:41.813125+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:35:42.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 msgr2=0x7f1aa4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 0x7f1aa4067560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0007d90 tx=0x7f1ab00078b0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 msgr2=0x7f1ac00be140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8011960 tx=0x7f1aa8011c70 comp rx=0 tx=0).stop 2022-08-10T17:35:42.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 shutdown_connections 2022-08-10T17:35:42.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1ac014c740 0x7f1ac014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1aa40650b0 0x7f1aa4067560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1aa0004c10 0x7f1ac01eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 --2- 172.21.15.150:0/1218849840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ac00c17a0 0x7f1ac00be140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 >> 172.21.15.150:0/1218849840 conn(0x7f1ac00644b0 msgr2=0x7f1ac006fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 shutdown_connections 2022-08-10T17:35:42.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.839+0000 7f1ac695a700 1 -- 172.21.15.150:0/1218849840 wait complete. 2022-08-10T17:35:42.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:35:42.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.983+0000 7fc9669f8700 1 Processor -- start 2022-08-10T17:35:42.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.983+0000 7fc9669f8700 1 -- start start 2022-08-10T17:35:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc9669f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc9669f8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9601553b0 0x7fc9601542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc9669f8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc960154810 con 0x7fc9600c3410 2022-08-10T17:35:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc9669f8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc960157f30 con 0x7fc9601553b0 2022-08-10T17:35:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc9669f8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601581d0 con 0x7fc9600ca840 2022-08-10T17:35:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9601553b0 0x7fc9601542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc95ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc9600c3410 0x7fc960154ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42036/0 (socket says 172.21.15.150:42036) 2022-08-10T17:35:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc95ffff700 1 -- 172.21.15.150:0/2388161135 learned_addr learned my addr 172.21.15.150:0/2388161135 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc95f7fe700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 -- 172.21.15.150:0/2388161135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 msgr2=0x7fc960153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 -- 172.21.15.150:0/2388161135 >> v1:172.21.15.150:6789/0 conn(0x7fc9600c3410 legacy=0x7fc960154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 -- 172.21.15.150:0/2388161135 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9601584b0 con 0x7fc9601553b0 2022-08-10T17:35:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc95effd700 1 -- 172.21.15.150:0/2388161135 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756683949 0 0) 0x7fc960154810 con 0x7fc9600c3410 2022-08-10T17:35:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc964f95700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9601553b0 0x7fc9601542d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0e2e98fbf59afc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:42.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.984+0000 7fc95effd700 1 -- 172.21.15.150:0/2388161135 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800e070 con 0x7fc9601553b0 2022-08-10T17:35:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc95effd700 1 -- 172.21.15.150:0/2388161135 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800bbd0 con 0x7fc9601553b0 2022-08-10T17:35:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc95effd700 1 -- 172.21.15.150:0/2388161135 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012430 con 0x7fc9601553b0 2022-08-10T17:35:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 -- 172.21.15.150:0/2388161135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9601553b0 msgr2=0x7fc9601542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:42.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9601553b0 0x7fc9601542d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).stop 2022-08-10T17:35:42.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 -- 172.21.15.150:0/2388161135 shutdown_connections 2022-08-10T17:35:42.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9601553b0 0x7fc9601542d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 --2- 172.21.15.150:0/2388161135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:42.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 -- 172.21.15.150:0/2388161135 >> 172.21.15.150:0/2388161135 conn(0x7fc960068110 msgr2=0x7fc960068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:42.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 -- 172.21.15.150:0/2388161135 shutdown_connections 2022-08-10T17:35:42.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.985+0000 7fc9669f8700 1 -- 172.21.15.150:0/2388161135 wait complete. 2022-08-10T17:35:42.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.986+0000 7fc9669f8700 1 Processor -- start 2022-08-10T17:35:42.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.986+0000 7fc9669f8700 1 -- start start 2022-08-10T17:35:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9601553b0 0x7fc960156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96014fba0 con 0x7fc9600c3410 2022-08-10T17:35:42.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601562e0 con 0x7fc9601553b0 2022-08-10T17:35:43.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc9669f8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c1150 con 0x7fc9600ca840 2022-08-10T17:35:43.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:43.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57594/0 (socket says 172.21.15.150:57594) 2022-08-10T17:35:43.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 -- 172.21.15.150:0/4145328899 learned_addr learned my addr 172.21.15.150:0/4145328899 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:43.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95f7fe700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:43.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 -- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 msgr2=0x7fc960157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:43.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 -- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9601553b0 msgr2=0x7fc960156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:43.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9601553b0 0x7fc960156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.987+0000 7fc95ffff700 1 -- 172.21.15.150:0/4145328899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009a70 con 0x7fc9600c3410 2022-08-10T17:35:43.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc95ffff700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9540011e0 tx=0x7fc95400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:43.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9540074e0 con 0x7fc9600c3410 2022-08-10T17:35:43.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9540046f0 con 0x7fc9600c3410 2022-08-10T17:35:43.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600c1430 con 0x7fc9600c3410 2022-08-10T17:35:43.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954004a60 con 0x7fc9600c3410 2022-08-10T17:35:43.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.988+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600c07c0 con 0x7fc9600c3410 2022-08-10T17:35:43.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.989+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc960072890 con 0x7fc9600c3410 2022-08-10T17:35:43.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.989+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc95401a020 con 0x7fc9600c3410 2022-08-10T17:35:43.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.989+0000 7fc95cff9700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 0x7fc940067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:43.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.989+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc954081d60 con 0x7fc9600c3410 2022-08-10T17:35:43.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.990+0000 7fc95f7fe700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 0x7fc940067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:43.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.990+0000 7fc95f7fe700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 0x7fc940067590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9600c8ed0 tx=0x7fc950008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:43.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:42.993+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc95404fd60 con 0x7fc9600c3410 2022-08-10T17:35:43.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.210+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc96006ee20 con 0x7fc9600c3410 2022-08-10T17:35:43.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.211+0000 7fc95cff9700 1 -- 172.21.15.150:0/4145328899 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6119 (secure 0 0 0) 0x7fc954053380 con 0x7fc9600c3410 2022-08-10T17:35:43.215 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:43.215 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:35:41.813357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:35:43.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 msgr2=0x7fc940067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:43.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 0x7fc940067590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9600c8ed0 tx=0x7fc950008040 comp rx=0 tx=0).stop 2022-08-10T17:35:43.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 msgr2=0x7fc96014f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:43.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9540011e0 tx=0x7fc95400c7e0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 shutdown_connections 2022-08-10T17:35:43.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9601553b0 0x7fc960156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600c3410 0x7fc96014f4d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9400650e0 0x7fc940067590 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 --2- 172.21.15.150:0/4145328899 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9600ca840 0x7fc960157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:43.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 >> 172.21.15.150:0/4145328899 conn(0x7fc960068110 msgr2=0x7fc9600c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:43.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 shutdown_connections 2022-08-10T17:35:43.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:43.213+0000 7fc9669f8700 1 -- 172.21.15.150:0/4145328899 wait complete. 2022-08-10T17:35:43.220 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 5 2022-08-10T17:35:43.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-08-10T17:35:37.393269+0000', 'modified': '2022-08-10T17:35:41.813357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4317': {'gid': 4317, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.197:6835/1505577177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6834', 'nonce': 1505577177}, {'type': 'v1', 'addr': '172.21.15.197:6835', 'nonce': 1505577177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-08-10T17:35:43.833 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4317:up:creating 2022-08-10T17:35:44.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:35:44.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.964+0000 7f5d8ba59700 1 Processor -- start 2022-08-10T17:35:44.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.964+0000 7f5d8ba59700 1 -- start start 2022-08-10T17:35:44.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d8ba59700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5d84070240 0x7f5d840c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d8ba59700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 0x7f5d84157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d8ba59700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d840c3020 con 0x7f5d840cd540 2022-08-10T17:35:44.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d8ba59700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d84156930 con 0x7f5d84070240 2022-08-10T17:35:44.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d8ba59700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d84156bd0 con 0x7f5d84157060 2022-08-10T17:35:44.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5d84070240 0x7f5d840c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d89ff6700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5d840cd540 0x7f5d840691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42050/0 (socket says 172.21.15.150:42050) 2022-08-10T17:35:44.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d89ff6700 1 -- 172.21.15.150:0/2199349735 learned_addr learned my addr 172.21.15.150:0/2199349735 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:44.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d88ff4700 1 --2- 172.21.15.150:0/2199349735 >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 0x7f5d84157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 -- 172.21.15.150:0/2199349735 >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 msgr2=0x7f5d84157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:44.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 --2- 172.21.15.150:0/2199349735 >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 0x7f5d84157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:44.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 -- 172.21.15.150:0/2199349735 >> v1:172.21.15.150:6789/0 conn(0x7f5d840cd540 legacy=0x7f5d840691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:44.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 -- 172.21.15.150:0/2199349735 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8406f770 con 0x7f5d84070240 2022-08-10T17:35:44.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d88ff4700 1 --2- 172.21.15.150:0/2199349735 >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 0x7f5d84157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:35:44.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d897f5700 1 --2- 172.21.15.150:0/2199349735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84070240 0x7f5d840c1730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c7400 tx=0x7f5d80009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8745df41dbf10c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:44.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d73fff700 1 -- 172.21.15.150:0/2199349735 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80011830 con 0x7f5d84070240 2022-08-10T17:35:44.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d73fff700 1 -- 172.21.15.150:0/2199349735 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80011990 con 0x7f5d84070240 2022-08-10T17:35:44.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.965+0000 7f5d73fff700 1 -- 172.21.15.150:0/2199349735 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80011d40 con 0x7f5d84070240 2022-08-10T17:35:44.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 -- 172.21.15.150:0/2199349735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84070240 msgr2=0x7f5d840c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:44.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/2199349735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84070240 0x7f5d840c1730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c7400 tx=0x7f5d80009990 comp rx=0 tx=0).stop 2022-08-10T17:35:44.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 -- 172.21.15.150:0/2199349735 shutdown_connections 2022-08-10T17:35:44.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/2199349735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84070240 0x7f5d840c1730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:44.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/2199349735 >> v2:172.21.15.197:3300/0 conn(0x7f5d84157060 0x7f5d84157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:44.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 -- 172.21.15.150:0/2199349735 >> 172.21.15.150:0/2199349735 conn(0x7f5d84071e40 msgr2=0x7f5d840cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:44.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 -- 172.21.15.150:0/2199349735 shutdown_connections 2022-08-10T17:35:44.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.966+0000 7f5d8ba59700 1 -- 172.21.15.150:0/2199349735 wait complete. 2022-08-10T17:35:44.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.967+0000 7f5d8ba59700 1 Processor -- start 2022-08-10T17:35:44.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.967+0000 7f5d8ba59700 1 -- start start 2022-08-10T17:35:44.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 0x7f5d84157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 0x7f5d8414c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c41c0 con 0x7f5d84157060 2022-08-10T17:35:44.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8414bec0 con 0x7f5d840cd540 2022-08-10T17:35:44.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d8ba59700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c49d0 con 0x7f5d84070240 2022-08-10T17:35:44.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57608/0 (socket says 172.21.15.150:57608) 2022-08-10T17:35:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 -- 172.21.15.150:0/1766471535 learned_addr learned my addr 172.21.15.150:0/1766471535 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d897f5700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 0x7f5d84157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d88ff4700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 0x7f5d8414c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 -- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 msgr2=0x7f5d84157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 0x7f5d84157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 -- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 msgr2=0x7f5d8414c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 0x7f5d8414c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d89ff6700 1 -- 172.21.15.150:0/1766471535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009310 con 0x7f5d84157060 2022-08-10T17:35:44.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d897f5700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 0x7f5d84157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:35:44.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.968+0000 7f5d88ff4700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 0x7f5d8414c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:35:44.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d89ff6700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c790 tx=0x7f5d7c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:44.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0070f0 con 0x7f5d84157060 2022-08-10T17:35:44.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c007250 con 0x7f5d84157060 2022-08-10T17:35:44.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8414d010 con 0x7f5d84157060 2022-08-10T17:35:44.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0075c0 con 0x7f5d84157060 2022-08-10T17:35:44.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.969+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d840c46f0 con 0x7f5d84157060 2022-08-10T17:35:44.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.970+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d84072890 con 0x7f5d84157060 2022-08-10T17:35:44.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.970+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5d7c019030 con 0x7f5d84157060 2022-08-10T17:35:44.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.970+0000 7f5d71ffb700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 0x7f5d64067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:44.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.970+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5d7c081650 con 0x7f5d84157060 2022-08-10T17:35:44.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.971+0000 7f5d897f5700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 0x7f5d64067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:44.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.971+0000 7f5d897f5700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 0x7f5d64067590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d800099d0 tx=0x7f5d8001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:44.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:44.974+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5d7c04a6b0 con 0x7f5d84157060 2022-08-10T17:35:45.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.195+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d8414c000 con 0x7f5d84157060 2022-08-10T17:35:45.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.196+0000 7f5d71ffb700 1 -- 172.21.15.150:0/1766471535 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6117 (secure 0 0 0) 0x7f5d7c04f6a0 con 0x7f5d84157060 2022-08-10T17:35:45.200 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:35:45.200 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:35:43.411648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-08-10T17:35:45.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.197+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 msgr2=0x7f5d64067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.197+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 0x7f5d64067590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d800099d0 tx=0x7f5d8001c040 comp rx=0 tx=0).stop 2022-08-10T17:35:45.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 msgr2=0x7f5d8414c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c790 tx=0x7f5d7c00cb50 comp rx=0 tx=0).stop 2022-08-10T17:35:45.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 shutdown_connections 2022-08-10T17:35:45.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d84157060 0x7f5d8414c890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5d640650e0 0x7f5d64067590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5d84070240 0x7f5d84157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 --2- 172.21.15.150:0/1766471535 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5d840cd540 0x7f5d8414c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 >> 172.21.15.150:0/1766471535 conn(0x7f5d84071e40 msgr2=0x7f5d84069750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:45.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 shutdown_connections 2022-08-10T17:35:45.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.198+0000 7f5d8ba59700 1 -- 172.21.15.150:0/1766471535 wait complete. 2022-08-10T17:35:45.205 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 7 2022-08-10T17:35:45.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-08-10T17:35:37.393269+0000', 'modified': '2022-08-10T17:35:43.411648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4317': {'gid': 4317, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.197:6835/1505577177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6834', 'nonce': 1505577177}, {'type': 'v1', 'addr': '172.21.15.197:6835', 'nonce': 1505577177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-08-10T17:35:45.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-08-10T17:35:45.819 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2022-08-10T17:35:45.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.948+0000 7f5a117c6700 1 Processor -- start 2022-08-10T17:35:45.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.948+0000 7f5a117c6700 1 -- start start 2022-08-10T17:35:45.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a117c6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f5a0c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a117c6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c0c4dc0 con 0x7f5a0c150af0 2022-08-10T17:35:45.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a117c6700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c0c5940 con 0x7f5a0c06c860 2022-08-10T17:35:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a117c6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c9fc0 con 0x7f5a0c15a570 2022-08-10T17:35:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a0affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5a0c150af0 0x7f5a0c159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42060/0 (socket says 172.21.15.150:42060) 2022-08-10T17:35:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a0affd700 1 -- 172.21.15.150:0/2236484905 learned_addr learned my addr 172.21.15.150:0/2236484905 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:35:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f5a0c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415404560 0 0) 0x7f5a0c0c4dc0 con 0x7f5a0c150af0 2022-08-10T17:35:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.949+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f8003430 con 0x7f5a0c150af0 2022-08-10T17:35:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965310144 0 0) 0x7f59f8003430 con 0x7f5a0c150af0 2022-08-10T17:35:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 msgr2=0x7f5a0c0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f5a0c0c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 >> v1:172.21.15.197:6789/0 conn(0x7f5a0c06c860 legacy=0x7f5a0c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c06f9a0 con 0x7f5a0c150af0 2022-08-10T17:35:45.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5a00001670 con 0x7f5a0c150af0 2022-08-10T17:35:45.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 >> v1:172.21.15.150:6789/0 conn(0x7f5a0c150af0 legacy=0x7f5a0c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80038b0 0x7f59f8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59f80046d0 0x7f59f8004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f59f80050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c9fc0 con 0x7f59f80046d0 2022-08-10T17:35:45.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f800b990 con 0x7f59f80038b0 2022-08-10T17:35:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f800bb50 con 0x7f5a0c15a570 2022-08-10T17:35:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59f80046d0 0x7f59f8004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0affd700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80038b0 0x7f59f8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f59f80050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 msgr2=0x7f59f80050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c15a570 0x7f59f80050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80038b0 msgr2=0x7f59f8003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80038b0 0x7f59f8003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/2236484905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8003430 con 0x7f59f80046d0 2022-08-10T17:35:45.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59f80046d0 0x7f59f8004b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001640 tx=0x7f59f8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde5aacf6b08116 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:45.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc0052d0 con 0x7f59f80046d0 2022-08-10T17:35:45.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc003500 con 0x7f59f80046d0 2022-08-10T17:35:45.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.950+0000 7f5a09ffb700 1 -- 172.21.15.150:0/2236484905 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc0038b0 con 0x7f59f80046d0 2022-08-10T17:35:45.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 -- 172.21.15.150:0/2236484905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59f80046d0 msgr2=0x7f59f8004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 --2- 172.21.15.150:0/2236484905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59f80046d0 0x7f59f8004b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001640 tx=0x7f59f8005700 comp rx=0 tx=0).stop 2022-08-10T17:35:45.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2236484905 reap_dead start 2022-08-10T17:35:45.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 -- 172.21.15.150:0/2236484905 shutdown_connections 2022-08-10T17:35:45.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 -- 172.21.15.150:0/2236484905 >> 172.21.15.150:0/2236484905 conn(0x7f5a0c0c92f0 msgr2=0x7f5a0c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:45.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 -- 172.21.15.150:0/2236484905 shutdown_connections 2022-08-10T17:35:45.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.951+0000 7f5a117c6700 1 -- 172.21.15.150:0/2236484905 wait complete. 2022-08-10T17:35:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.952+0000 7f5a117c6700 1 Processor -- start 2022-08-10T17:35:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 -- start start 2022-08-10T17:35:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80046d0 0x7f5a0c1efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a0c0bfe10 0x7f5a0c0ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c1ebe10 0x7f5a0c1ec430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c14cee0 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0baf80 con 0x7f59f80046d0 2022-08-10T17:35:45.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a117c6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c14c6d0 con 0x7f5a0c1ebe10 2022-08-10T17:35:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a0a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a0c0bfe10 0x7f5a0c0ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a0a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a0c0bfe10 0x7f5a0c0ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57624/0 (socket says 172.21.15.150:57624) 2022-08-10T17:35:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/4160998731 learned_addr learned my addr 172.21.15.150:0/4160998731 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c1ebe10 0x7f5a0c1ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.953+0000 7f5a0affd700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80046d0 0x7f5a0c1efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c1ebe10 msgr2=0x7f5a0c1ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a0c1ebe10 0x7f5a0c1ec430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80046d0 msgr2=0x7f5a0c1efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59f80046d0 0x7f5a0c1efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/4160998731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c1ef860 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a0c0bfe10 0x7f5a0c0ba500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59fc003950 tx=0x7f59fc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:45.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f59f37fe700 1 -- 172.21.15.150:0/4160998731 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc01e450 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f59f37fe700 1 -- 172.21.15.150:0/4160998731 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc01e5b0 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f59f37fe700 1 -- 172.21.15.150:0/4160998731 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc01e940 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a117c6700 1 -- 172.21.15.150:0/4160998731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c1f0230 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.954+0000 7f5a117c6700 1 -- 172.21.15.150:0/4160998731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c14cc00 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.955+0000 7f59f37fe700 1 -- 172.21.15.150:0/4160998731 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f59fc02e070 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.956+0000 7f59f37fe700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec0650e0 0x7f59ec067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.956+0000 7f59f37fe700 1 -- 172.21.15.150:0/4160998731 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f59fc083770 con 0x7f5a0c0bfe10 2022-08-10T17:35:45.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.956+0000 7f5a0affd700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec0650e0 0x7f59ec067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.956+0000 7f5a0affd700 1 --2- 172.21.15.150:0/4160998731 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec0650e0 0x7f59ec067590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001c90 tx=0x7f5a00000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:45.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 Processor -- start 2022-08-10T17:35:45.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 -- start start 2022-08-10T17:35:45.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7881690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df7728c10 con 0x557df787cf30 2022-08-10T17:35:45.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df7792c40 con 0x557df787cb60 2022-08-10T17:35:45.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.958+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557df778c440 con 0x557df783e4a0 2022-08-10T17:35:45.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57636/0 (socket says 172.21.15.150:57636) 2022-08-10T17:35:45.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2908851447 learned_addr learned my addr 172.21.15.150:0/2908851447 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:45.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0affd700 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7881690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 msgr2=0x557df7877d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 msgr2=0x557df7881690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7881690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2908851447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df76155e0 con 0x557df787cf30 2022-08-10T17:35:45.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c15a9d0 tx=0x7f5a04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16654d914ffa392f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:45.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f59f0ff9700 1 -- 172.21.15.150:0/2908851447 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400e040 con 0x557df787cf30 2022-08-10T17:35:45.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f59f0ff9700 1 -- 172.21.15.150:0/2908851447 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400f040 con 0x557df787cf30 2022-08-10T17:35:45.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.959+0000 7f59f0ff9700 1 -- 172.21.15.150:0/2908851447 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0401e840 con 0x557df787cf30 2022-08-10T17:35:45.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2908851447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 msgr2=0x557df7838060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:45.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c15a9d0 tx=0x7f5a04009750 comp rx=0 tx=0).stop 2022-08-10T17:35:45.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2908851447 shutdown_connections 2022-08-10T17:35:45.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7838060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7881690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2908851447 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2908851447 >> 172.21.15.150:0/2908851447 conn(0x557df7832db0 msgr2=0x557df783b780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:45.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2908851447 shutdown_connections 2022-08-10T17:35:45.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.960+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2908851447 wait complete. 2022-08-10T17:35:45.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 -- start start 2022-08-10T17:35:45.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 Processor -- start 2022-08-10T17:35:45.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7890ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df767b0c0 con 0x557df787cf30 2022-08-10T17:35:45.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df7881960 con 0x557df787cb60 2022-08-10T17:35:45.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.961+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557df7877890 con 0x557df783e4a0 2022-08-10T17:35:45.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a1d71cb80 10 client.0 _ll_register_callbacks cb 0x557df7639240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:35:45.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57642/0 (socket says 172.21.15.150:57642) 2022-08-10T17:35:45.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/1633504381 learned_addr learned my addr 172.21.15.150:0/1633504381 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:45.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7890ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 msgr2=0x557df7877350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 msgr2=0x557df7890ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:45.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7890ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:45.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/1633504381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04009df0 con 0x557df787cf30 2022-08-10T17:35:45.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401c000 tx=0x7f5a04004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3bf648ee7ffc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:45.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f59e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:35:45.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400e040 con 0x557df787cf30 2022-08-10T17:35:45.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5a0401a070 con 0x557df787cf30 2022-08-10T17:35:45.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557df7830570 con 0x557df787cf30 2022-08-10T17:35:45.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a04009410 con 0x557df787cf30 2022-08-10T17:35:45.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a1d71cb80 10 client.4473 fetch_fsmap learned FSMap version 7 2022-08-10T17:35:45.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557df75c1d90 con 0x557df787cf30 2022-08-10T17:35:45.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.962+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557df7830570 con 0x557df787cf30 2022-08-10T17:35:45.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 7) v1 ==== 4198+0+0 (secure 0 0 0) 0x7f5a040038a0 con 0x557df787cf30 2022-08-10T17:35:45.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 10 client.4473 fetch_fsmap finished waiting for FSMap version 7 2022-08-10T17:35:45.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 10 client.4473 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:35:45.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 20 client.4473 populate_metadata read hostname 'smithi150' 2022-08-10T17:35:45.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df786f5b0 0x557df786f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:45.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 4 client.4473 mds_command: new command op to 4317 tid=0[{"prefix": "get_command_descriptions"}] 2022-08-10T17:35:45.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557df772ece0 con 0x557df786f5b0 2022-08-10T17:35:45.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df786f5b0 0x557df786f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:45.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f59e5ffb700 10 client.4473 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:35:45.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:45.963+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df786f5b0 0x557df786f980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbee9ccd2d39edfd server_cookie=be9847bd84bd85f8 in_seq=0 out_seq=0 2022-08-10T17:35:48.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.421+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1633504381 <== mds.0 v2:172.21.15.197:6834/1505577177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x557df772ece0 con 0x557df786f5b0 2022-08-10T17:35:48.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f59e5ffb700 10 client.4473 handle_command_reply: tid=0 2022-08-10T17:35:48.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 client.4473 shutdown 2022-08-10T17:35:48.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 msgr2=0x557df7880940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:48.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401c000 tx=0x7f5a04004950 comp rx=0 tx=0).stop 2022-08-10T17:35:48.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 shutdown_connections 2022-08-10T17:35:48.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7880940 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df786f5b0 0x557df786f980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df783e4a0 0x557df7877350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1633504381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df7890ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 >> 172.21.15.150:0/1633504381 conn(0x557df7832db0 msgr2=0x557df783b710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:48.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f59e5ffb700 0 client.4473 ms_handle_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:35:48.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 shutdown_connections 2022-08-10T17:35:48.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1633504381 wait complete. 2022-08-10T17:35:48.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.422+0000 7f5a1d71cb80 20 client.4473 trim_cache size 0 max 16384 2022-08-10T17:35:48.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 Processor -- start 2022-08-10T17:35:48.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 -- start start 2022-08-10T17:35:48.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 0x557df78732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cb60 0x557df78779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df787c4a0 con 0x557df787cf30 2022-08-10T17:35:48.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df787ae30 con 0x557df783e4a0 2022-08-10T17:35:48.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557df7890d10 con 0x557df787cb60 2022-08-10T17:35:48.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.441+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57654/0 (socket says 172.21.15.150:57654) 2022-08-10T17:35:48.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2913916253 learned_addr learned my addr 172.21.15.150:0/2913916253 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:48.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cb60 0x557df78779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0affd700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 0x557df78732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cb60 msgr2=0x557df78779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:48.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cb60 0x557df78779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 msgr2=0x557df78732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:48.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 0x557df78732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 -- 172.21.15.150:0/2913916253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df75c0260 con 0x557df787cf30 2022-08-10T17:35:48.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0affd700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 0x557df78732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:35:48.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009890 tx=0x7f5a04025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9989cffde7478275 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:48.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f59f17fa700 1 -- 172.21.15.150:0/2913916253 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040038a0 con 0x557df787cf30 2022-08-10T17:35:48.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f59f17fa700 1 -- 172.21.15.150:0/2913916253 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04003a00 con 0x557df787cf30 2022-08-10T17:35:48.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.442+0000 7f59f17fa700 1 -- 172.21.15.150:0/2913916253 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0401ea00 con 0x557df787cf30 2022-08-10T17:35:48.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2913916253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 msgr2=0x557df7877f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:35:48.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009890 tx=0x7f5a04025000 comp rx=0 tx=0).stop 2022-08-10T17:35:48.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2913916253 shutdown_connections 2022-08-10T17:35:48.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df787cf30 0x557df7877f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df783e4a0 0x557df78732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/2913916253 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cb60 0x557df78779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2913916253 >> 172.21.15.150:0/2913916253 conn(0x557df7832db0 msgr2=0x557df7877160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:35:48.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2913916253 shutdown_connections 2022-08-10T17:35:48.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.443+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/2913916253 wait complete. 2022-08-10T17:35:48.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.444+0000 7f5a1d71cb80 1 -- start start 2022-08-10T17:35:48.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.444+0000 7f5a1d71cb80 1 Processor -- start 2022-08-10T17:35:48.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df783e4a0 0x557df788fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df78780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cf30 0x557df78dc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df7890240 con 0x557df783e4a0 2022-08-10T17:35:48.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df7878630 con 0x557df787cb60 2022-08-10T17:35:48.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557df7878a90 con 0x557df787cf30 2022-08-10T17:35:48.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 10 client.0 _ll_register_callbacks cb 0x7f59fc051770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:35:48.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df783e4a0 0x557df788fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df783e4a0 0x557df788fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57656/0 (socket says 172.21.15.150:57656) 2022-08-10T17:35:48.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 -- 172.21.15.150:0/1950283883 learned_addr learned my addr 172.21.15.150:0/1950283883 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:35:48.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df78780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0b7fe700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cf30 0x557df78dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 -- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cf30 msgr2=0x557df78dc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:48.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557df787cf30 0x557df78dc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 -- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 msgr2=0x557df78780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:35:48.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557df787cb60 0x557df78780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:35:48.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 -- 172.21.15.150:0/1950283883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557df75c1d90 con 0x557df783e4a0 2022-08-10T17:35:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a0affd700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557df783e4a0 0x557df788fd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005d40 tx=0x7f5a00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f241c38bae2178b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:35:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f59e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:35:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1950283883 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00029070 con 0x557df783e4a0 2022-08-10T17:35:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1950283883 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5a00005e30 con 0x557df783e4a0 2022-08-10T17:35:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.445+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1950283883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557df772ea00 con 0x557df783e4a0 2022-08-10T17:35:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1950283883 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0001a040 con 0x557df783e4a0 2022-08-10T17:35:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 10 client.4479 fetch_fsmap learned FSMap version 7 2022-08-10T17:35:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1950283883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557df768ea30 con 0x557df783e4a0 2022-08-10T17:35:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1950283883 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557df772ea00 con 0x557df783e4a0 2022-08-10T17:35:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f59e5ffb700 1 -- 172.21.15.150:0/1950283883 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 7) v1 ==== 4198+0+0 (secure 0 0 0) 0x7f5a00015a60 con 0x557df783e4a0 2022-08-10T17:35:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 10 client.4479 fetch_fsmap finished waiting for FSMap version 7 2022-08-10T17:35:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 10 client.4479 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:35:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 20 client.4479 populate_metadata read hostname 'smithi150' 2022-08-10T17:35:48.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:35:48.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 4 client.4479 mds_command: new command op to 4317 tid=0[{"prefix": "status"}] 2022-08-10T17:35:48.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a1d71cb80 1 -- 172.21.15.150:0/1950283883 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557df7617f10 con 0x557df7837870 2022-08-10T17:35:48.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.446+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f59e5ffb700 10 client.4479 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:35:48.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28add43ab5d9f56f server_cookie=8aa109e97aa1b3bd in_seq=0 out_seq=0 2022-08-10T17:35:48.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 msgr2=0x557df7837c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2022-08-10T17:35:48.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 -- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 msgr2=0x557df7837c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:35:48.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:35:48.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 unknown :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2022-08-10T17:35:48.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 unknown :-1 s=BANNER_CONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:35:48.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 crc :-1 s=SESSION_RECONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2022-08-10T17:35:48.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 crc :-1 s=SESSION_RECONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2022-08-10T17:35:48.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f59e5ffb700 0 client.4479 ms_handle_remote_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:35:48.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f59e5ffb700 10 client.4479 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:35:48.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:35:48.447+0000 7f5a0a7fc700 1 --2- 172.21.15.150:0/1950283883 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557df7837870 0x557df7837c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b361f0d2f8a56f9 server_cookie=d6575ac028b4297f in_seq=0 out_seq=0 2022-08-10T17:35:53.115 INFO:tasks.ceph.mds.d.smithi197.stderr:2022-08-10T17:35:53.111+0000 7f88c6672700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-08-10T17:36:06.545 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:36:06.548 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:36:36.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:36:36.632 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:37:06.691 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:37:06.696 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:37:36.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:37:36.773 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:37:45.857 DEBUG:teuthology.orchestra.run:got remote process result: 124 2022-08-10T17:37:46.860 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:37:46.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.989+0000 7f380bed0700 1 Processor -- start 2022-08-10T17:37:46.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.989+0000 7f380bed0700 1 -- start start 2022-08-10T17:37:47.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380bed0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3804150aa0 0x7f3804071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380bed0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38040c89e0 con 0x7f38040c79e0 2022-08-10T17:37:47.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380bed0700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38040c8cc0 con 0x7f38040c80e0 2022-08-10T17:37:47.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380bed0700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38040c8fa0 con 0x7f3804150aa0 2022-08-10T17:37:47.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380a46d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f38040c79e0 0x7f3804156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42194/0 (socket says 172.21.15.150:42194) 2022-08-10T17:37:47.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f380a46d700 1 -- 172.21.15.150:0/3735509919 learned_addr learned my addr 172.21.15.150:0/3735509919 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:47.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f3809c6c700 1 --2- 172.21.15.150:0/3735509919 >> v2:172.21.15.197:3300/0 conn(0x7f3804150aa0 0x7f3804071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439740345 0 0) 0x7f38040c89e0 con 0x7f38040c79e0 2022-08-10T17:37:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.990+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ec003430 con 0x7f38040c79e0 2022-08-10T17:37:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4082814325 0 0) 0x7f37ec003430 con 0x7f38040c79e0 2022-08-10T17:37:47.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 >> v2:172.21.15.197:3300/0 conn(0x7f3804150aa0 msgr2=0x7f3804071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 --2- 172.21.15.150:0/3735509919 >> v2:172.21.15.197:3300/0 conn(0x7f3804150aa0 0x7f3804071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 >> v1:172.21.15.197:6789/0 conn(0x7f38040c80e0 legacy=0x7f38040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040c9280 con 0x7f38040c79e0 2022-08-10T17:37:47.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f37fc0019f0 con 0x7f38040c79e0 2022-08-10T17:37:47.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 >> v1:172.21.15.150:6789/0 conn(0x7f38040c79e0 legacy=0x7f3804156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f37ec003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f37ec0046d0 0x7f37ec004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f37ec005080 0x7f37ec00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38040c8fa0 con 0x7f37ec0038d0 2022-08-10T17:37:47.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00bf60 con 0x7f37ec0046d0 2022-08-10T17:37:47.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00c120 con 0x7f37ec005080 2022-08-10T17:37:47.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f37ec003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f380946b700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f37ec0046d0 0x7f37ec004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f380a46d700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f37ec005080 0x7f37ec00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 -- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f37ec005080 msgr2=0x7f37ec00b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f37ec005080 0x7f37ec00b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 -- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f37ec0046d0 msgr2=0x7f37ec004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f37ec0046d0 0x7f37ec004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 -- 172.21.15.150:0/3735509919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec003430 con 0x7f37ec0038d0 2022-08-10T17:37:47.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f380a46d700 1 -- 172.21.15.150:0/3735509919 reap_dead start 2022-08-10T17:37:47.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f380946b700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f37ec0046d0 0x7f37ec004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:47.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3809c6c700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f37ec003ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37f40099a0 tx=0x7f37ec005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94144b14304b94dd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400e4d0 con 0x7f37ec0038d0 2022-08-10T17:37:47.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f400e630 con 0x7f37ec0038d0 2022-08-10T17:37:47.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.991+0000 7f3808c6a700 1 -- 172.21.15.150:0/3735509919 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400e9e0 con 0x7f37ec0038d0 2022-08-10T17:37:47.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 -- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 msgr2=0x7f37ec003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f37ec003ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37f40099a0 tx=0x7f37ec005700 comp rx=0 tx=0).stop 2022-08-10T17:37:47.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 -- 172.21.15.150:0/3735509919 shutdown_connections 2022-08-10T17:37:47.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 --2- 172.21.15.150:0/3735509919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f37ec003ce0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 -- 172.21.15.150:0/3735509919 >> 172.21.15.150:0/3735509919 conn(0x7f3804068d60 msgr2=0x7f3804071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:47.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 -- 172.21.15.150:0/3735509919 shutdown_connections 2022-08-10T17:37:47.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.992+0000 7f380bed0700 1 -- 172.21.15.150:0/3735509919 wait complete. 2022-08-10T17:37:47.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.993+0000 7f380bed0700 1 Processor -- start 2022-08-10T17:37:47.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.993+0000 7f380bed0700 1 -- start start 2022-08-10T17:37:47.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 0x7f3804153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 0x7f380414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38041f49c0 con 0x7f37ec0038d0 2022-08-10T17:37:47.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38040b2680 con 0x7f38041f1040 2022-08-10T17:37:47.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380bed0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38041f3d40 con 0x7f380414c310 2022-08-10T17:37:47.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57754/0 (socket says 172.21.15.150:57754) 2022-08-10T17:37:47.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 -- 172.21.15.150:0/1234067889 learned_addr learned my addr 172.21.15.150:0/1234067889 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:47.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380946b700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 0x7f3804153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380a46d700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 0x7f380414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 -- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 msgr2=0x7f380414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 0x7f380414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 -- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 msgr2=0x7f3804153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 0x7f3804153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f3809c6c700 1 -- 172.21.15.150:0/1234067889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38041f4020 con 0x7f37ec0038d0 2022-08-10T17:37:47.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380a46d700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 0x7f380414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:47.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.994+0000 7f380946b700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 0x7f3804153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:47.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f3809c6c700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37f4006960 tx=0x7f37f4004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4013900 con 0x7f37ec0038d0 2022-08-10T17:37:47.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4013a80 con 0x7f37ec0038d0 2022-08-10T17:37:47.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38041f4300 con 0x7f37ec0038d0 2022-08-10T17:37:47.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4013e30 con 0x7f37ec0038d0 2022-08-10T17:37:47.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.995+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38041f14b0 con 0x7f37ec0038d0 2022-08-10T17:37:47.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.996+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380414f3d0 con 0x7f37ec0038d0 2022-08-10T17:37:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.996+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f37f4019030 con 0x7f37ec0038d0 2022-08-10T17:37:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.996+0000 7f37f27fc700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 0x7f37e4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.997+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f37f4083800 con 0x7f37ec0038d0 2022-08-10T17:37:47.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.997+0000 7f380946b700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 0x7f37e4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:46.997+0000 7f380946b700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 0x7f37e4067560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f380406e700 tx=0x7f3800009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.001+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f37f40517e0 con 0x7f37ec0038d0 2022-08-10T17:37:47.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.219+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3804072890 con 0x7f37ec0038d0 2022-08-10T17:37:47.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.220+0000 7f37f27fc700 1 -- 172.21.15.150:0/1234067889 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6117 (secure 0 0 0) 0x7f37f4017020 con 0x7f37ec0038d0 2022-08-10T17:37:47.224 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:47.225 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:35:43.411648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-08-10T17:37:47.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 msgr2=0x7f37e4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 0x7f37e4067560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f380406e700 tx=0x7f3800009040 comp rx=0 tx=0).stop 2022-08-10T17:37:47.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 msgr2=0x7f38040b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37f4006960 tx=0x7f37f4004640 comp rx=0 tx=0).stop 2022-08-10T17:37:47.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 shutdown_connections 2022-08-10T17:37:47.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f37e40650b0 0x7f37e4067560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f380414c310 0x7f380414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37ec0038d0 0x7f38040b2060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 --2- 172.21.15.150:0/1234067889 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38041f1040 0x7f3804153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 >> 172.21.15.150:0/1234067889 conn(0x7f3804068d60 msgr2=0x7f3804156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:47.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 shutdown_connections 2022-08-10T17:37:47.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.222+0000 7f380bed0700 1 -- 172.21.15.150:0/1234067889 wait complete. 2022-08-10T17:37:47.230 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 7 2022-08-10T17:37:47.842 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-08-10T17:35:37.393269+0000', 'modified': '2022-08-10T17:35:43.411648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4317': {'gid': 4317, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.197:6835/1505577177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6834', 'nonce': 1505577177}, {'type': 'v1', 'addr': '172.21.15.197:6835', 'nonce': 1505577177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-08-10T17:37:47.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-08-10T17:37:47.844 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2022-08-10T17:37:47.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.966+0000 7febd40b9700 1 Processor -- start 2022-08-10T17:37:47.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.966+0000 7febd40b9700 1 -- start start 2022-08-10T17:37:47.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd40b9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc06c860 0x7febcc068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd40b9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febcc070040 0x7febcc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd40b9700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc1563c0 con 0x7febcc0bc830 2022-08-10T17:37:47.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd40b9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc153590 con 0x7febcc070040 2022-08-10T17:37:47.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd40b9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc068650 con 0x7febcc06c860 2022-08-10T17:37:47.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febcc070040 0x7febcc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febcc070040 0x7febcc0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57766/0 (socket says 172.21.15.150:57766) 2022-08-10T17:37:47.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 -- 172.21.15.150:0/3792285932 learned_addr learned my addr 172.21.15.150:0/3792285932 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:47.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd1654700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc06c860 0x7febcc068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 -- 172.21.15.150:0/3792285932 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc06c860 msgr2=0x7febcc068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc06c860 0x7febcc068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 -- 172.21.15.150:0/3792285932 >> v1:172.21.15.197:6789/0 conn(0x7febcc0bc830 legacy=0x7febcc152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 -- 172.21.15.150:0/3792285932 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc150940 con 0x7febcc070040 2022-08-10T17:37:47.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd2656700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc070040 0x7febcc0c3bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febc400d180 tx=0x7febc400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa7eb1461ecc20 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd0e53700 1 -- 172.21.15.150:0/3792285932 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4010070 con 0x7febcc070040 2022-08-10T17:37:47.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd0e53700 1 -- 172.21.15.150:0/3792285932 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400dd70 con 0x7febcc070040 2022-08-10T17:37:47.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.967+0000 7febd0e53700 1 -- 172.21.15.150:0/3792285932 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400b310 con 0x7febcc070040 2022-08-10T17:37:47.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 -- 172.21.15.150:0/3792285932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc070040 msgr2=0x7febcc0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc070040 0x7febcc0c3bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febc400d180 tx=0x7febc400d490 comp rx=0 tx=0).stop 2022-08-10T17:37:47.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 -- 172.21.15.150:0/3792285932 shutdown_connections 2022-08-10T17:37:47.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc070040 0x7febcc0c3bd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 --2- 172.21.15.150:0/3792285932 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc06c860 0x7febcc068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 -- 172.21.15.150:0/3792285932 >> 172.21.15.150:0/3792285932 conn(0x7febcc0c92f0 msgr2=0x7febcc0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:47.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 -- 172.21.15.150:0/3792285932 shutdown_connections 2022-08-10T17:37:47.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.968+0000 7febd40b9700 1 -- 172.21.15.150:0/3792285932 wait complete. 2022-08-10T17:37:47.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.969+0000 7febd40b9700 1 Processor -- start 2022-08-10T17:37:47.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.969+0000 7febd40b9700 1 -- start start 2022-08-10T17:37:47.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 0x7febcc1eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc070040 0x7febcc146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0bd4b0 con 0x7febcc0bc830 2022-08-10T17:37:47.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1e7650 con 0x7febcc06c860 2022-08-10T17:37:47.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd40b9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0bd1d0 con 0x7febcc070040 2022-08-10T17:37:47.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57772/0 (socket says 172.21.15.150:57772) 2022-08-10T17:37:47.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 -- 172.21.15.150:0/3735124247 learned_addr learned my addr 172.21.15.150:0/3735124247 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:47.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd1654700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc070040 0x7febcc146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 -- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc070040 msgr2=0x7febcc146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd1e55700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 0x7febcc1eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc070040 0x7febcc146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 -- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 msgr2=0x7febcc1eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:47.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 0x7febcc1eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd2656700 1 -- 172.21.15.150:0/3735124247 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc400bd40 con 0x7febcc0bc830 2022-08-10T17:37:47.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.970+0000 7febd1e55700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 0x7febcc1eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:47.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febd2656700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febcc0654b0 tx=0x7febc4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febba7fc700 1 -- 172.21.15.150:0/3735124247 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400b4c0 con 0x7febcc0bc830 2022-08-10T17:37:47.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febba7fc700 1 -- 172.21.15.150:0/3735124247 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc4004240 con 0x7febcc0bc830 2022-08-10T17:37:47.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc1e7860 con 0x7febcc0bc830 2022-08-10T17:37:47.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febba7fc700 1 -- 172.21.15.150:0/3735124247 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40045f0 con 0x7febcc0bc830 2022-08-10T17:37:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.971+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1e7e20 con 0x7febcc0bc830 2022-08-10T17:37:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.972+0000 7febba7fc700 1 -- 172.21.15.150:0/3735124247 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7febc4009520 con 0x7febcc0bc830 2022-08-10T17:37:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.972+0000 7febba7fc700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 0x7febac067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.973+0000 7febba7fc700 1 -- 172.21.15.150:0/3735124247 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7febc40858e0 con 0x7febcc0bc830 2022-08-10T17:37:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.973+0000 7febd1e55700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 0x7febac067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.973+0000 7febd1e55700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 0x7febac067560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febc800a750 tx=0x7febc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.974+0000 7febe000fb80 1 Processor -- start 2022-08-10T17:37:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.974+0000 7febe000fb80 1 -- start start 2022-08-10T17:37:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddb60 0x557cd35e2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd3489c10 con 0x557cd35ddf30 2022-08-10T17:37:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd34f3c40 con 0x557cd359f4a0 2022-08-10T17:37:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd34ed440 con 0x557cd35ddb60 2022-08-10T17:37:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd2656700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd2656700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57780/0 (socket says 172.21.15.150:57780) 2022-08-10T17:37:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd2656700 1 -- 172.21.15.150:0/552052080 learned_addr learned my addr 172.21.15.150:0/552052080 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd1654700 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd1e55700 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddb60 0x557cd35e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd2656700 1 -- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddb60 msgr2=0x557cd35e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.975+0000 7febd2656700 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddb60 0x557cd35e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febd2656700 1 -- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 msgr2=0x557cd35d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febd2656700 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febd2656700 1 -- 172.21.15.150:0/552052080 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd33765e0 con 0x557cd35ddf30 2022-08-10T17:37:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febd2656700 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7febc4013410 tx=0x7febc4013440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6285acd2e4eb13 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febab7fe700 1 -- 172.21.15.150:0/552052080 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40556c0 con 0x557cd35ddf30 2022-08-10T17:37:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febab7fe700 1 -- 172.21.15.150:0/552052080 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc405ae90 con 0x557cd35ddf30 2022-08-10T17:37:48.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febab7fe700 1 -- 172.21.15.150:0/552052080 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4053c90 con 0x557cd35ddf30 2022-08-10T17:37:48.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 -- 172.21.15.150:0/552052080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 msgr2=0x557cd3599060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7febc4013410 tx=0x7febc4013440 comp rx=0 tx=0).stop 2022-08-10T17:37:48.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 -- 172.21.15.150:0/552052080 shutdown_connections 2022-08-10T17:37:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddf30 0x557cd3599060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddb60 0x557cd35e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 --2- 172.21.15.150:0/552052080 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.976+0000 7febe000fb80 1 -- 172.21.15.150:0/552052080 >> 172.21.15.150:0/552052080 conn(0x557cd3593db0 msgr2=0x557cd359c780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.977+0000 7febe000fb80 1 -- 172.21.15.150:0/552052080 shutdown_connections 2022-08-10T17:37:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.977+0000 7febe000fb80 1 -- 172.21.15.150:0/552052080 wait complete. 2022-08-10T17:37:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.977+0000 7febe000fb80 1 -- start start 2022-08-10T17:37:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.977+0000 7febe000fb80 1 Processor -- start 2022-08-10T17:37:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd3599370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd35e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd33dc0c0 con 0x557cd35ddb60 2022-08-10T17:37:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd35ee4d0 con 0x557cd35ddf30 2022-08-10T17:37:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd35d51e0 con 0x557cd359f4a0 2022-08-10T17:37:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febe000fb80 10 client.0 _ll_register_callbacks cb 0x557cd339a240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:37:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57784/0 (socket says 172.21.15.150:57784) 2022-08-10T17:37:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 -- 172.21.15.150:0/2621615905 learned_addr learned my addr 172.21.15.150:0/2621615905 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:48.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd2656700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd35e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1e55700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd3599370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 -- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 msgr2=0x557cd3599370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd3599370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 -- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 msgr2=0x557cd35e20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd35e20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd1654700 1 -- 172.21.15.150:0/2621615905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1e7e20 con 0x557cd35ddb60 2022-08-10T17:37:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.978+0000 7febd2656700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd35e20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febd1654700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7febbc009d80 tx=0x7febbc011540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf9e4124a1b2f8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:37:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00c070 con 0x557cd35ddb60 2022-08-10T17:37:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7febbc015460 con 0x557cd35ddb60 2022-08-10T17:37:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cd3591570 con 0x557cd35ddb60 2022-08-10T17:37:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7febbc015620 con 0x557cd35ddb60 2022-08-10T17:37:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 10 client.4497 fetch_fsmap learned FSMap version 7 2022-08-10T17:37:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557cd3322d90 con 0x557cd35ddb60 2022-08-10T17:37:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cd3591570 con 0x557cd35ddb60 2022-08-10T17:37:48.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 7) v1 ==== 4198+0+0 (secure 0 0 0) 0x7febbc015780 con 0x557cd35ddb60 2022-08-10T17:37:48.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 10 client.4497 fetch_fsmap finished waiting for FSMap version 7 2022-08-10T17:37:48.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 10 client.4497 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:37:48.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 20 client.4497 populate_metadata read hostname 'smithi150' 2022-08-10T17:37:48.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd35e2600 0x557cd35f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 4 client.4497 mds_command: new command op to 4317 tid=0[{"prefix": "get_command_descriptions"}] 2022-08-10T17:37:48.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cd348fce0 con 0x557cd35e2600 2022-08-10T17:37:48.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.979+0000 7febd1e55700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd35e2600 0x557cd35f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.980+0000 7feba8ff9700 10 client.4497 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:37:48.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.980+0000 7febd1e55700 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd35e2600 0x557cd35f1eb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193b24f48f0227b5 server_cookie=d5603b4dec300a7 in_seq=0 out_seq=0 2022-08-10T17:37:48.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.980+0000 7feba8ff9700 1 -- 172.21.15.150:0/2621615905 <== mds.0 v2:172.21.15.197:6834/1505577177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x557cd348fce0 con 0x557cd35e2600 2022-08-10T17:37:48.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.980+0000 7feba8ff9700 10 client.4497 handle_command_reply: tid=0 2022-08-10T17:37:48.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 client.4497 shutdown 2022-08-10T17:37:48.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 msgr2=0x557cd35ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7febbc009d80 tx=0x7febbc011540 comp rx=0 tx=0).stop 2022-08-10T17:37:48.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 shutdown_connections 2022-08-10T17:37:48.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd35e20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd35e2600 0x557cd35f1eb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd3599370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7feba8ff9700 0 client.4497 ms_handle_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:37:48.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 --2- 172.21.15.150:0/2621615905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd35ee8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 >> 172.21.15.150:0/2621615905 conn(0x557cd3593db0 msgr2=0x557cd35a0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 shutdown_connections 2022-08-10T17:37:48.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 1 -- 172.21.15.150:0/2621615905 wait complete. 2022-08-10T17:37:48.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.981+0000 7febe000fb80 20 client.4497 trim_cache size 0 max 16384 2022-08-10T17:37:48.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.998+0000 7febe000fb80 1 Processor -- start 2022-08-10T17:37:48.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.998+0000 7febe000fb80 1 -- start start 2022-08-10T17:37:48.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 0x557cd359a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd35f88d0 con 0x557cd35ddb60 2022-08-10T17:37:48.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd35d4cc0 con 0x557cd359f4a0 2022-08-10T17:37:48.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd359e720 con 0x557cd35ddf30 2022-08-10T17:37:48.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57792/0 (socket says 172.21.15.150:57792) 2022-08-10T17:37:48.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 -- 172.21.15.150:0/124420862 learned_addr learned my addr 172.21.15.150:0/124420862 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:48.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1e55700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd2656700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 0x557cd359a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 -- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 msgr2=0x557cd359a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 0x557cd359a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 -- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 msgr2=0x557cd35dbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35dbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 -- 172.21.15.150:0/124420862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd3321260 con 0x557cd35ddb60 2022-08-10T17:37:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd2656700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 0x557cd359a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febd1654700 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febbc0069b0 tx=0x7febbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0c6524c990c92 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febabfff700 1 -- 172.21.15.150:0/124420862 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc011940 con 0x557cd35ddb60 2022-08-10T17:37:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febabfff700 1 -- 172.21.15.150:0/124420862 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc015ce0 con 0x557cd35ddb60 2022-08-10T17:37:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:47.999+0000 7febabfff700 1 -- 172.21.15.150:0/124420862 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc004020 con 0x557cd35ddb60 2022-08-10T17:37:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- 172.21.15.150:0/124420862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 msgr2=0x557cd359a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febbc0069b0 tx=0x7febbc016000 comp rx=0 tx=0).stop 2022-08-10T17:37:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- 172.21.15.150:0/124420862 shutdown_connections 2022-08-10T17:37:48.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd35ddf30 0x557cd359a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd359f4a0 0x557cd35dbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 --2- 172.21.15.150:0/124420862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd359a240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- 172.21.15.150:0/124420862 >> 172.21.15.150:0/124420862 conn(0x557cd3593db0 msgr2=0x557cd35df600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- 172.21.15.150:0/124420862 shutdown_connections 2022-08-10T17:37:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- 172.21.15.150:0/124420862 wait complete. 2022-08-10T17:37:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.000+0000 7febe000fb80 1 -- start start 2022-08-10T17:37:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 Processor -- start 2022-08-10T17:37:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd363daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd359a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd36478f0 con 0x557cd35ddb60 2022-08-10T17:37:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd35da680 con 0x557cd35ddf30 2022-08-10T17:37:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd35da940 con 0x557cd359f4a0 2022-08-10T17:37:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febe000fb80 10 client.0 _ll_register_callbacks cb 0x7febbc009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:37:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febd1654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57798/0 (socket says 172.21.15.150:57798) 2022-08-10T17:37:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.001+0000 7febd1654700 1 -- 172.21.15.150:0/4264176326 learned_addr learned my addr 172.21.15.150:0/4264176326 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd2656700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd359a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1e55700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd363daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 -- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 msgr2=0x557cd363daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd363daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 -- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 msgr2=0x557cd359a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd359a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 -- 172.21.15.150:0/4264176326 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cd3322d90 con 0x557cd35ddb60 2022-08-10T17:37:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febd1654700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f61629c879e92f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:37:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc015460 con 0x557cd35ddb60 2022-08-10T17:37:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7febbc000e40 con 0x557cd35ddb60 2022-08-10T17:37:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febc405ae90 con 0x557cd35ddb60 2022-08-10T17:37:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7febbc0155c0 con 0x557cd35ddb60 2022-08-10T17:37:48.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 10 client.4503 fetch_fsmap learned FSMap version 7 2022-08-10T17:37:48.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557cd33efa30 con 0x557cd35ddb60 2022-08-10T17:37:48.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc405ae90 con 0x557cd35ddb60 2022-08-10T17:37:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 7) v1 ==== 4198+0+0 (secure 0 0 0) 0x7febbc015720 con 0x557cd35ddb60 2022-08-10T17:37:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 10 client.4503 fetch_fsmap finished waiting for FSMap version 7 2022-08-10T17:37:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 10 client.4503 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:37:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 20 client.4503 populate_metadata read hostname 'smithi150' 2022-08-10T17:37:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd359a620 0x557cd35eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 4 client.4503 mds_command: new command op to 4317 tid=0[{"prefix": "status"}] 2022-08-10T17:37:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.002+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557cd348fa00 con 0x557cd359a620 2022-08-10T17:37:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febd1e55700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd359a620 0x557cd35eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febd1e55700 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd359a620 0x557cd35eacf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29f6538badf5372a server_cookie=8acdea89fe8cc3d0 in_seq=0 out_seq=0 2022-08-10T17:37:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7feba8ff9700 10 client.4503 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:37:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7feba8ff9700 1 -- 172.21.15.150:0/4264176326 <== mds.0 v2:172.21.15.197:6834/1505577177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557cd348fa00 con 0x557cd359a620 2022-08-10T17:37:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7feba8ff9700 10 client.4503 handle_command_reply: tid=0 2022-08-10T17:37:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 client.4503 shutdown 2022-08-10T17:37:48.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 msgr2=0x557cd3646ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 shutdown_connections 2022-08-10T17:37:48.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x557cd35ddf30 0x557cd359a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x557cd359a620 0x557cd35eacf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x557cd359f4a0 0x557cd363daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7feba8ff9700 0 client.4503 ms_handle_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:37:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 --2- 172.21.15.150:0/4264176326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cd35ddb60 0x557cd3646ee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.003+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 >> 172.21.15.150:0/4264176326 conn(0x557cd3593db0 msgr2=0x557cd35d7290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 shutdown_connections 2022-08-10T17:37:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febe000fb80 1 -- 172.21.15.150:0/4264176326 wait complete. 2022-08-10T17:37:48.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febe000fb80 20 client.4503 trim_cache size 0 max 16384 2022-08-10T17:37:48.043 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:37:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:37:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2022-08-10T17:37:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4317, 2022-08-10T17:37:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2022-08-10T17:37:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2022-08-10T17:37:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2022-08-10T17:37:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 130.60961199299999, 2022-08-10T17:37:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 6, 2022-08-10T17:37:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 29, 2022-08-10T17:37:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 27, 2022-08-10T17:37:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 135.89944847199999 2022-08-10T17:37:48.045 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:37:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 msgr2=0x7febac067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 0x7febac067560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febc800a750 tx=0x7febc8008040 comp rx=0 tx=0).stop 2022-08-10T17:37:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 msgr2=0x7febcc0c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febcc0654b0 tx=0x7febc4004950 comp rx=0 tx=0).stop 2022-08-10T17:37:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 shutdown_connections 2022-08-10T17:37:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febcc0bc830 0x7febcc0c6270 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7febcc06c860 0x7febcc1eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7febac0650b0 0x7febac067560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 --2- 172.21.15.150:0/3735124247 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7febcc070040 0x7febcc146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 >> 172.21.15.150:0/3735124247 conn(0x7febcc0c92f0 msgr2=0x7febcc150110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 shutdown_connections 2022-08-10T17:37:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.004+0000 7febd40b9700 1 -- 172.21.15.150:0/3735124247 wait complete. 2022-08-10T17:37:48.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-08-10T17:37:48.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.168+0000 7ff5cbbaf700 1 Processor -- start 2022-08-10T17:37:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.168+0000 7ff5cbbaf700 1 -- start start 2022-08-10T17:37:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5cbbaf700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 0x7ff5c4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5cbbaf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5cbbaf700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c40c48e0 con 0x7ff5c414e970 2022-08-10T17:37:48.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5cbbaf700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c40c13a0 con 0x7ff5c406c8a0 2022-08-10T17:37:48.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5cbbaf700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40bcd00 con 0x7ff5c414ed40 2022-08-10T17:37:48.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5c914a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 0x7ff5c4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:43798/0 (socket says 172.21.15.150:43798) 2022-08-10T17:37:48.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 -- 172.21.15.150:0/2644269334 learned_addr learned my addr 172.21.15.150:0/2644269334 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:48.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 -- 172.21.15.150:0/2644269334 >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 msgr2=0x7ff5c4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:48.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 --2- 172.21.15.150:0/2644269334 >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 0x7ff5c4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 -- 172.21.15.150:0/2644269334 >> v1:172.21.15.197:6789/0 conn(0x7ff5c414e970 legacy=0x7ff5c40689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5ca14c700 1 -- 172.21.15.150:0/2644269334 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4064550 con 0x7ff5c414ed40 2022-08-10T17:37:48.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.169+0000 7ff5c914a700 1 --2- 172.21.15.150:0/2644269334 >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 0x7ff5c4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:37:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5ca14c700 1 --2- 172.21.15.150:0/2644269334 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009e50 tx=0x7ff5bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203d792bc6c6ed71 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5c8949700 1 -- 172.21.15.150:0/2644269334 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00e070 con 0x7ff5c414ed40 2022-08-10T17:37:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5c8949700 1 -- 172.21.15.150:0/2644269334 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00b910 con 0x7ff5c414ed40 2022-08-10T17:37:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5c8949700 1 -- 172.21.15.150:0/2644269334 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bcc0 con 0x7ff5c414ed40 2022-08-10T17:37:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/2644269334 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 msgr2=0x7ff5c4158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/2644269334 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009e50 tx=0x7ff5bc00b330 comp rx=0 tx=0).stop 2022-08-10T17:37:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/2644269334 shutdown_connections 2022-08-10T17:37:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/2644269334 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414ed40 0x7ff5c4158250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/2644269334 >> v2:172.21.15.197:3300/0 conn(0x7ff5c406c8a0 0x7ff5c4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/2644269334 >> 172.21.15.150:0/2644269334 conn(0x7ff5c40c92f0 msgr2=0x7ff5c40c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/2644269334 shutdown_connections 2022-08-10T17:37:48.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.170+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/2644269334 wait complete. 2022-08-10T17:37:48.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 Processor -- start 2022-08-10T17:37:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 -- start start 2022-08-10T17:37:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 0x7ff5c4141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 0x7ff5c4142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4143d40 con 0x7ff5c406c8a0 2022-08-10T17:37:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41415b0 con 0x7ff5c414ed40 2022-08-10T17:37:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5cbbaf700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4144880 con 0x7ff5c414e970 2022-08-10T17:37:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5c994b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5c994b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57810/0 (socket says 172.21.15.150:57810) 2022-08-10T17:37:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.172+0000 7ff5c994b700 1 -- 172.21.15.150:0/967645138 learned_addr learned my addr 172.21.15.150:0/967645138 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5ca14c700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 0x7ff5c4142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c914a700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 0x7ff5c4141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 -- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 msgr2=0x7ff5c4141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 0x7ff5c4141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 -- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 msgr2=0x7ff5c4142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 0x7ff5c4142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 -- 172.21.15.150:0/967645138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009310 con 0x7ff5c406c8a0 2022-08-10T17:37:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5ca14c700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 0x7ff5c4142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c914a700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 0x7ff5c4141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5c994b700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c3c0 tx=0x7ff5c000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00052d0 con 0x7ff5c406c8a0 2022-08-10T17:37:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000ce70 con 0x7ff5c406c8a0 2022-08-10T17:37:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00117b0 con 0x7ff5c406c8a0 2022-08-10T17:37:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc009b30 con 0x7ff5c406c8a0 2022-08-10T17:37:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.173+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c40ba940 con 0x7ff5c406c8a0 2022-08-10T17:37:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.174+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c4072890 con 0x7ff5c406c8a0 2022-08-10T17:37:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.174+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff5c0019030 con 0x7ff5c406c8a0 2022-08-10T17:37:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.175+0000 7ff5b27fc700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 0x7ff5a4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.175+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff5c0081480 con 0x7ff5c406c8a0 2022-08-10T17:37:48.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.175+0000 7ff5c914a700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 0x7ff5a4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:48.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.175+0000 7ff5c914a700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 0x7ff5a4067590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4064bd0 tx=0x7ff5b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:48.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.179+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff5c004f460 con 0x7ff5c406c8a0 2022-08-10T17:37:48.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.397+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5c40bacd0 con 0x7ff5c406c8a0 2022-08-10T17:37:48.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.397+0000 7ff5b27fc700 1 -- 172.21.15.150:0/967645138 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff5c0017070 con 0x7ff5c406c8a0 2022-08-10T17:37:48.401 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-08-10T17:37:48.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 msgr2=0x7ff5a4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 0x7ff5a4067590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4064bd0 tx=0x7ff5b4008040 comp rx=0 tx=0).stop 2022-08-10T17:37:48.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 msgr2=0x7ff5c40ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:48.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c3c0 tx=0x7ff5c000c780 comp rx=0 tx=0).stop 2022-08-10T17:37:48.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 shutdown_connections 2022-08-10T17:37:48.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5c414ed40 0x7ff5c4142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c406c8a0 0x7ff5c40ba320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5a40650e0 0x7ff5a4067590 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 --2- 172.21.15.150:0/967645138 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5c414e970 0x7ff5c4141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 >> 172.21.15.150:0/967645138 conn(0x7ff5c40c92f0 msgr2=0x7ff5c40c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 shutdown_connections 2022-08-10T17:37:48.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:48.399+0000 7ff5cbbaf700 1 -- 172.21.15.150:0/967645138 wait complete. 2022-08-10T17:37:48.414 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2022-08-10T17:37:48.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-08-10T17:37:48.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2022-08-10T17:37:48.416 INFO:tasks.cephfs.mount:self.client.name = client.admin 2022-08-10T17:37:48.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:48.416 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2022-08-10T17:37:48.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-08-10T17:37:48.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-08-10T17:37:48.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2022-08-10T17:37:48.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.418 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2022-08-10T17:37:48.435 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-08-10T17:37:48.436 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-08-10T17:37:48.436 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2022-08-10T17:37:48.436 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:37:48.436 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2022-08-10T17:37:48.437 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:37:48.437 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:37:48.437 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2022-08-10T17:37:48.437 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:37:48.437 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2022-08-10T17:37:48.438 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:37:48.438 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2022-08-10T17:37:48.438 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-08-10T17:37:48.438 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2022-08-10T17:37:48.439 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-08-10T17:37:48.439 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42387sec preferred_lft 42387sec 2022-08-10T17:37:48.439 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5670:4ef8:a295:d5cc/64 scope link noprefixroute 2022-08-10T17:37:48.439 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:37:48.440 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-08-10T17:37:48.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.441 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:37:48.442 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:37:48.442 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2022-08-10T17:37:48.442 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2022-08-10T17:37:48.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2022-08-10T17:37:48.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-08-10T17:37:48.444 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:37:48.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.602 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-08-10T17:37:48.630 INFO:teuthology.orchestra.run.smithi150.stdout:1 2022-08-10T17:37:48.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.632 DEBUG:teuthology.orchestra.run.smithi150:> route 2022-08-10T17:37:48.702 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2022-08-10T17:37:48.703 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-08-10T17:37:48.703 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-08-10T17:37:48.703 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-08-10T17:37:48.703 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-08-10T17:37:48.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.705 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:37:48.705 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:37:48.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-08-10T17:37:48.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-08-10T17:37:48.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-08-10T17:37:48.707 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:37:48.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.926 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2022-08-10T17:37:48.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:48.945 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2022-08-10T17:37:49.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:49.001 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:37:49.001 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:37:49.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-08-10T17:37:49.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2022-08-10T17:37:49.003 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:37:49.095 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2022-08-10T17:37:49.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:49.097 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:37:49.097 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:37:49.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2022-08-10T17:37:49.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-08-10T17:37:49.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2022-08-10T17:37:49.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2022-08-10T17:37:49.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2022-08-10T17:37:49.099 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:37:49.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:49.304 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:37:49.304 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:37:49.305 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2022-08-10T17:37:49.305 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2022-08-10T17:37:49.305 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:37:49.417 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2022-08-10T17:37:49.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-08-10T17:37:49.418 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2022-08-10T17:37:49.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-08-10T17:37:49.443 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:49.499 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2022-08-10T17:37:49.566 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-08-10T17:37:49.567 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-08-10T17:37:49.632 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-08-10T17:37:49.633 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-08-10T17:37:49.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:49.634 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2022-08-10T17:37:49.691 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-08-10T17:37:49.692 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2022-08-10T17:37:49.734 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2022-08-10T17:37:49.760 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-08-10T17:37:49.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-08-10T17:37:49.826 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-08-10T17:37:49.827 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-08-10T17:37:49.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:49.828 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2022-08-10T17:37:49.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:2022-08-10T17:37:49.836+0000 7f7b6c5e9400 -1 init, newargv = 0x5571de29cd90 newargc=15 2022-08-10T17:37:49.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[104176]: starting ceph client 2022-08-10T17:37:49.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[104176]: starting fuse 2022-08-10T17:37:49.857 INFO:teuthology.orchestra.run.smithi150.stdout:47 2022-08-10T17:37:49.858 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2022-08-10T17:37:49.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-08-10T17:37:49.859 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2022-08-10T17:37:49.859 DEBUG:teuthology.orchestra.run.smithi150:> import re 2022-08-10T17:37:49.860 DEBUG:teuthology.orchestra.run.smithi150:> import os 2022-08-10T17:37:49.860 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2022-08-10T17:37:49.860 DEBUG:teuthology.orchestra.run.smithi150:> 2022-08-10T17:37:49.861 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2022-08-10T17:37:49.861 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2022-08-10T17:37:49.862 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2022-08-10T17:37:49.862 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2022-08-10T17:37:49.863 DEBUG:teuthology.orchestra.run.smithi150:> 2022-08-10T17:37:49.863 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2022-08-10T17:37:49.864 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2022-08-10T17:37:49.864 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2022-08-10T17:37:49.864 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2022-08-10T17:37:49.865 DEBUG:teuthology.orchestra.run.smithi150:> 2022-08-10T17:37:49.865 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2022-08-10T17:37:49.866 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-08-10T17:37:49.866 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2022-08-10T17:37:49.867 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-08-10T17:37:49.867 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2022-08-10T17:37:49.867 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2022-08-10T17:37:49.868 DEBUG:teuthology.orchestra.run.smithi150:> return f 2022-08-10T17:37:49.868 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-08-10T17:37:49.869 DEBUG:teuthology.orchestra.run.smithi150:> 2022-08-10T17:37:49.869 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.admin")) 2022-08-10T17:37:49.870 DEBUG:teuthology.orchestra.run.smithi150:> ' 2022-08-10T17:37:49.980 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.admin.104176.asok 2022-08-10T17:37:50.162 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.104176.asok 2022-08-10T17:37:50.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.163 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.104176.asok status 2022-08-10T17:37:50.317 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:37:50.318 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2022-08-10T17:37:50.318 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "5662b52dca13a9032ec3c7fc11184d542141fc45", 2022-08-10T17:37:50.318 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 17.0.0-14135-g5662b52d (5662b52dca13a9032ec3c7fc11184d542141fc45) quincy (dev)", 2022-08-10T17:37:50.318 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "admin", 2022-08-10T17:37:50.318 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2022-08-10T17:37:50.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2022-08-10T17:37:50.319 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "104176", 2022-08-10T17:37:50.319 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2022-08-10T17:37:50.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:37:50.320 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2022-08-10T17:37:50.320 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2022-08-10T17:37:50.320 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4515, 2022-08-10T17:37:50.320 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2022-08-10T17:37:50.321 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2022-08-10T17:37:50.321 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2022-08-10T17:37:50.321 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4515 2022-08-10T17:37:50.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:37:50.322 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2022-08-10T17:37:50.322 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:37:50.322 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2022-08-10T17:37:50.322 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2605726772 2022-08-10T17:37:50.322 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:37:50.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:37:50.323 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2022-08-10T17:37:50.323 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:37:50.323 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2022-08-10T17:37:50.324 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2605726772 2022-08-10T17:37:50.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:37:50.324 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4515 192.168.0.1:0/2605726772", 2022-08-10T17:37:50.324 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/2605726772", 2022-08-10T17:37:50.324 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2022-08-10T17:37:50.325 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 6, 2022-08-10T17:37:50.325 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 29, 2022-08-10T17:37:50.325 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2022-08-10T17:37:50.325 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2022-08-10T17:37:50.326 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2022-08-10T17:37:50.326 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:37:50.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.328 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2022-08-10T17:37:50.328 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:50.345 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2022-08-10T17:37:50.346 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:50.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.347 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:50.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.413 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2022-08-10T17:37:50.511 INFO:teuthology.orchestra.run.smithi150.stdout:# file: . 2022-08-10T17:37:50.511 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2022-08-10T17:37:50.512 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:50.512 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2022-08-10T17:37:50.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2022-08-10T17:37:50.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[104176]: fuse finished with error 0 and tester_r 0 2022-08-10T17:37:50.545 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:37:50.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:37:50.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:37:50.629 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2022-08-10T17:37:50.657 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:37:50.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.813+0000 7ff0d4996700 1 Processor -- start 2022-08-10T17:37:50.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.813+0000 7ff0d4996700 1 -- start start 2022-08-10T17:37:50.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0d4996700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0d00c1730 0x7ff0d00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0d4996700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff0d00cda80 0x7ff0d00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0d4996700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00c3020 con 0x7ff0d0070240 2022-08-10T17:37:50.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0d4996700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00c1b60 con 0x7ff0d00c1730 2022-08-10T17:37:50.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0d4996700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d0156930 con 0x7ff0d00cda80 2022-08-10T17:37:50.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0cdd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0d00c1730 0x7ff0d00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0ce59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff0d0070240 0x7ff0d0157060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42288/0 (socket says 172.21.15.150:42288) 2022-08-10T17:37:50.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.814+0000 7ff0ce59c700 1 -- 172.21.15.150:0/993604754 learned_addr learned my addr 172.21.15.150:0/993604754 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:50.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cd59a700 1 -- 172.21.15.150:0/993604754 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348711516 0 0) 0x7ff0d00c3020 con 0x7ff0d0070240 2022-08-10T17:37:50.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cd59a700 1 -- 172.21.15.150:0/993604754 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b0003430 con 0x7ff0d0070240 2022-08-10T17:37:50.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0ced9d700 1 --2- 172.21.15.150:0/993604754 >> v2:172.21.15.197:3300/0 conn(0x7ff0d00cda80 0x7ff0d00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cdd9b700 1 -- 172.21.15.150:0/993604754 >> v2:172.21.15.197:3300/0 conn(0x7ff0d00cda80 msgr2=0x7ff0d00691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:50.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cdd9b700 1 --2- 172.21.15.150:0/993604754 >> v2:172.21.15.197:3300/0 conn(0x7ff0d00cda80 0x7ff0d00691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:50.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cdd9b700 1 -- 172.21.15.150:0/993604754 >> v1:172.21.15.150:6789/0 conn(0x7ff0d0070240 legacy=0x7ff0d0157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:50.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cdd9b700 1 -- 172.21.15.150:0/993604754 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0156bd0 con 0x7ff0d00c1730 2022-08-10T17:37:50.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cdd9b700 1 --2- 172.21.15.150:0/993604754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00c1730 0x7ff0d00cd540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0068bf0 tx=0x7ff0c0009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4c31e5cb8f8d93 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:50.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cd59a700 1 -- 172.21.15.150:0/993604754 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00107b0 con 0x7ff0d00c1730 2022-08-10T17:37:50.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cd59a700 1 -- 172.21.15.150:0/993604754 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0010910 con 0x7ff0d00c1730 2022-08-10T17:37:50.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.815+0000 7ff0cd59a700 1 -- 172.21.15.150:0/993604754 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0010cc0 con 0x7ff0d00c1730 2022-08-10T17:37:50.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 -- 172.21.15.150:0/993604754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00c1730 msgr2=0x7ff0d00cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:50.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 --2- 172.21.15.150:0/993604754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00c1730 0x7ff0d00cd540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0068bf0 tx=0x7ff0c0009990 comp rx=0 tx=0).stop 2022-08-10T17:37:50.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 -- 172.21.15.150:0/993604754 shutdown_connections 2022-08-10T17:37:50.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 --2- 172.21.15.150:0/993604754 >> v2:172.21.15.197:3300/0 conn(0x7ff0d00cda80 0x7ff0d00691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:50.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 --2- 172.21.15.150:0/993604754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00c1730 0x7ff0d00cd540 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:50.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 -- 172.21.15.150:0/993604754 >> 172.21.15.150:0/993604754 conn(0x7ff0d0071e40 msgr2=0x7ff0d00cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:50.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 -- 172.21.15.150:0/993604754 shutdown_connections 2022-08-10T17:37:50.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.816+0000 7ff0d4996700 1 -- 172.21.15.150:0/993604754 wait complete. 2022-08-10T17:37:50.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.817+0000 7ff0d4996700 1 Processor -- start 2022-08-10T17:37:50.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.817+0000 7ff0d4996700 1 -- start start 2022-08-10T17:37:50.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0d0070240 0x7ff0d00c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 0x7ff0d0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00c4c80 con 0x7ff0d00cda80 2022-08-10T17:37:50.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d01ecbf0 con 0x7ff0d0070240 2022-08-10T17:37:50.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d014b260 con 0x7ff0d00c1730 2022-08-10T17:37:50.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57846/0 (socket says 172.21.15.150:57846) 2022-08-10T17:37:50.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 -- 172.21.15.150:0/1442195409 learned_addr learned my addr 172.21.15.150:0/1442195409 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:50.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ce59c700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0d0070240 0x7ff0d00c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0cdd9b700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 0x7ff0d0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 -- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 msgr2=0x7ff0d0149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:50.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 0x7ff0d0149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:50.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 -- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0d0070240 msgr2=0x7ff0d00c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:50.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0d0070240 0x7ff0d00c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:50.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 -- 172.21.15.150:0/1442195409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0009310 con 0x7ff0d00cda80 2022-08-10T17:37:50.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0cdd9b700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 0x7ff0d0149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:50.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0ced9d700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800cc30 tx=0x7ff0c800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:50.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800aac0 con 0x7ff0d00cda80 2022-08-10T17:37:50.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800ac20 con 0x7ff0d00cda80 2022-08-10T17:37:50.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d01ec270 con 0x7ff0d00cda80 2022-08-10T17:37:50.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.818+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80038a0 con 0x7ff0d00cda80 2022-08-10T17:37:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.819+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d01ec530 con 0x7ff0d00cda80 2022-08-10T17:37:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.820+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d0072890 con 0x7ff0d00cda80 2022-08-10T17:37:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.820+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff0c801f070 con 0x7ff0d00cda80 2022-08-10T17:37:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.820+0000 7ff0c6ffd700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 0x7ff0b4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:50.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.820+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff0c8082270 con 0x7ff0d00cda80 2022-08-10T17:37:50.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.820+0000 7ff0ce59c700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 0x7ff0b4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:50.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.821+0000 7ff0ce59c700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 0x7ff0b4067590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005790 tx=0x7ff0b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:50.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:50.824+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff0c8050250 con 0x7ff0d00cda80 2022-08-10T17:37:51.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.008+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d01551f0 con 0x7ff0d00cda80 2022-08-10T17:37:51.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.009+0000 7ff0c6ffd700 1 -- 172.21.15.150:0/1442195409 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7ff0c801d070 con 0x7ff0d00cda80 2022-08-10T17:37:51.013 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:51.013 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:37:51.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 msgr2=0x7ff0b4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 0x7ff0b4067590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005790 tx=0x7ff0b8009040 comp rx=0 tx=0).stop 2022-08-10T17:37:51.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 msgr2=0x7ff0d0149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800cc30 tx=0x7ff0c800cf40 comp rx=0 tx=0).stop 2022-08-10T17:37:51.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 shutdown_connections 2022-08-10T17:37:51.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d00cda80 0x7ff0d0149130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0d0070240 0x7ff0d00c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff0b40650e0 0x7ff0b4067590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 --2- 172.21.15.150:0/1442195409 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0d00c1730 0x7ff0d0149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 >> 172.21.15.150:0/1442195409 conn(0x7ff0d0071e40 msgr2=0x7ff0d0150210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:51.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 shutdown_connections 2022-08-10T17:37:51.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.011+0000 7ff0d4996700 1 -- 172.21.15.150:0/1442195409 wait complete. 2022-08-10T17:37:51.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:37:51.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.144+0000 7f817f3e2700 1 Processor -- start 2022-08-10T17:37:51.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.144+0000 7f817f3e2700 1 -- start start 2022-08-10T17:37:51.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817f3e2700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f81781540f0 0x7f8178071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817f3e2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 0x7f81780718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817f3e2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81780c6100 con 0x7f81780bd4b0 2022-08-10T17:37:51.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817f3e2700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780c5270 con 0x7f81781540f0 2022-08-10T17:37:51.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817f3e2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780c5e00 con 0x7f81781544c0 2022-08-10T17:37:51.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817c97d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 0x7f81780718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.145+0000 7f817d17e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f81781540f0 0x7f8178071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817c97d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 0x7f81780718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:43846/0 (socket says 172.21.15.150:43846) 2022-08-10T17:37:51.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f81781540f0 0x7f8178071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40214/0 (socket says 172.21.15.150:40214) 2022-08-10T17:37:51.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817c97d700 1 -- 172.21.15.150:0/1680375310 learned_addr learned my addr 172.21.15.150:0/1680375310 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:51.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 -- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 msgr2=0x7f81780718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:51.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 --2- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 0x7f81780718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 -- 172.21.15.150:0/1680375310 >> v1:172.21.15.197:6789/0 conn(0x7f81780bd4b0 legacy=0x7f8178068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 -- 172.21.15.150:0/1680375310 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817806eb00 con 0x7f81781540f0 2022-08-10T17:37:51.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f816bfff700 1 -- 172.21.15.150:0/1680375310 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188931934 0 0) 0x7f81780c6100 con 0x7f81780bd4b0 2022-08-10T17:37:51.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f817d17e700 1 --2- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781540f0 0x7f8178071370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f816c0096b0 tx=0x7f816c0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35c9aad7beee7f2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f816bfff700 1 -- 172.21.15.150:0/1680375310 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0107b0 con 0x7f81781540f0 2022-08-10T17:37:51.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f816bfff700 1 -- 172.21.15.150:0/1680375310 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c010910 con 0x7f81781540f0 2022-08-10T17:37:51.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.146+0000 7f816bfff700 1 -- 172.21.15.150:0/1680375310 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c010cc0 con 0x7f81781540f0 2022-08-10T17:37:51.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 -- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781540f0 msgr2=0x7f8178071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781540f0 0x7f8178071370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f816c0096b0 tx=0x7f816c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 -- 172.21.15.150:0/1680375310 shutdown_connections 2022-08-10T17:37:51.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781540f0 0x7f8178071370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1680375310 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781544c0 0x7f81780718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 -- 172.21.15.150:0/1680375310 >> 172.21.15.150:0/1680375310 conn(0x7f817806d0d0 msgr2=0x7f81780c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:51.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 -- 172.21.15.150:0/1680375310 shutdown_connections 2022-08-10T17:37:51.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.147+0000 7f817f3e2700 1 -- 172.21.15.150:0/1680375310 wait complete. 2022-08-10T17:37:51.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.148+0000 7f817f3e2700 1 Processor -- start 2022-08-10T17:37:51.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.148+0000 7f817f3e2700 1 -- start start 2022-08-10T17:37:51.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781540f0 0x7f817814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781544c0 0x7f81781473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817815a6a0 con 0x7f81780bd4b0 2022-08-10T17:37:51.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81781f0220 con 0x7f81781544c0 2022-08-10T17:37:51.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817814b900 con 0x7f81781540f0 2022-08-10T17:37:51.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57860/0 (socket says 172.21.15.150:57860) 2022-08-10T17:37:51.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 -- 172.21.15.150:0/1414725671 learned_addr learned my addr 172.21.15.150:0/1414725671 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:51.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817c97d700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781540f0 0x7f817814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d97f700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781544c0 0x7f81781473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 -- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781540f0 msgr2=0x7f817814fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781540f0 0x7f817814fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 -- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781544c0 msgr2=0x7f81781473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781544c0 0x7f81781473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 -- 172.21.15.150:0/1414725671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009310 con 0x7f81780bd4b0 2022-08-10T17:37:51.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817d17e700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f816c0090b0 tx=0x7f816c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c010a80 con 0x7f81780bd4b0 2022-08-10T17:37:51.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c01f070 con 0x7f81780bd4b0 2022-08-10T17:37:51.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81781478e0 con 0x7f81780bd4b0 2022-08-10T17:37:51.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.149+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c004020 con 0x7f81780bd4b0 2022-08-10T17:37:51.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.150+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781efc90 con 0x7f81780bd4b0 2022-08-10T17:37:51.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.151+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817814f980 con 0x7f81780bd4b0 2022-08-10T17:37:51.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.151+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f816c00f070 con 0x7f81780bd4b0 2022-08-10T17:37:51.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.151+0000 7f8169ffb700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 0x7f8158067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.151+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f816c021070 con 0x7f81780bd4b0 2022-08-10T17:37:51.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.151+0000 7f817c97d700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 0x7f8158067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.152+0000 7f817c97d700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 0x7f8158067590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8178158a80 tx=0x7f8174009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.155+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f816c051900 con 0x7f81780bd4b0 2022-08-10T17:37:51.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.334+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8178072890 con 0x7f81780bd4b0 2022-08-10T17:37:51.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.335+0000 7f8169ffb700 1 -- 172.21.15.150:0/1414725671 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7f816c02a020 con 0x7f81780bd4b0 2022-08-10T17:37:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:51.339 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:37:51.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 msgr2=0x7f8158067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 0x7f8158067590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8178158a80 tx=0x7f8174009190 comp rx=0 tx=0).stop 2022-08-10T17:37:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 msgr2=0x7f81781581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f816c0090b0 tx=0x7f816c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 shutdown_connections 2022-08-10T17:37:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f81781544c0 0x7f81781473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81780bd4b0 0x7f81781581f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81580650e0 0x7f8158067590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 --2- 172.21.15.150:0/1414725671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f81781540f0 0x7f817814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 >> 172.21.15.150:0/1414725671 conn(0x7f817806d0d0 msgr2=0x7f8178153210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 shutdown_connections 2022-08-10T17:37:51.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.337+0000 7f817f3e2700 1 -- 172.21.15.150:0/1414725671 wait complete. 2022-08-10T17:37:51.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-08-10T17:37:51.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.473+0000 7f75b2cfe700 1 Processor -- start 2022-08-10T17:37:51.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.473+0000 7f75b2cfe700 1 -- start start 2022-08-10T17:37:51.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b2cfe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 0x7f75ac157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b2cfe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c8220 con 0x7f75ac0c76b0 2022-08-10T17:37:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b2cfe700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c2190 con 0x7f75ac06c5b0 2022-08-10T17:37:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b2cfe700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0c2470 con 0x7f75ac06c980 2022-08-10T17:37:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b129b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f75ac0c76b0 0x7f75ac159400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42320/0 (socket says 172.21.15.150:42320) 2022-08-10T17:37:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75b129b700 1 -- 172.21.15.150:0/1541265417 learned_addr learned my addr 172.21.15.150:0/1541265417 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75abfff700 1 --2- 172.21.15.150:0/1541265417 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 0x7f75ac157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229910460 0 0) 0x7f75ac0c8220 con 0x7f75ac0c76b0 2022-08-10T17:37:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7590003430 con 0x7f75ac0c76b0 2022-08-10T17:37:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187682330 0 0) 0x7f75ac0c2190 con 0x7f75ac06c5b0 2022-08-10T17:37:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ac0c8220 con 0x7f75ac06c5b0 2022-08-10T17:37:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75abfff700 1 -- 172.21.15.150:0/1541265417 >> v1:172.21.15.197:6789/0 conn(0x7f75ac06c5b0 legacy=0x7f75ac0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053887610 0 0) 0x7f7590003430 con 0x7f75ac0c76b0 2022-08-10T17:37:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75abfff700 1 -- 172.21.15.150:0/1541265417 >> v1:172.21.15.150:6789/0 conn(0x7f75ac0c76b0 legacy=0x7f75ac159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.474+0000 7f75abfff700 1 -- 172.21.15.150:0/1541265417 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0c2750 con 0x7f75ac06c980 2022-08-10T17:37:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75abfff700 1 --2- 172.21.15.150:0/1541265417 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 0x7f75ac157820 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75980096e0 tx=0x7f75980099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611673548d833fc2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40019f0 con 0x7f75ac06c980 2022-08-10T17:37:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598004030 con 0x7f75ac06c980 2022-08-10T17:37:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75ab7fe700 1 -- 172.21.15.150:0/1541265417 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980043c0 con 0x7f75ac06c980 2022-08-10T17:37:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1541265417 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 msgr2=0x7f75ac157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1541265417 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 0x7f75ac157820 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75980096e0 tx=0x7f75980099f0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1541265417 shutdown_connections 2022-08-10T17:37:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1541265417 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac06c980 0x7f75ac157820 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1541265417 >> 172.21.15.150:0/1541265417 conn(0x7f75ac06e1f0 msgr2=0x7f75ac06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1541265417 shutdown_connections 2022-08-10T17:37:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.475+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1541265417 wait complete. 2022-08-10T17:37:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.476+0000 7f75b2cfe700 1 Processor -- start 2022-08-10T17:37:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 -- start start 2022-08-10T17:37:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75ac06c980 0x7f75ac1ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac0c76b0 0x7f75ac068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac069b30 con 0x7f75ac06c5b0 2022-08-10T17:37:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac154b60 con 0x7f75ac06c980 2022-08-10T17:37:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b2cfe700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac14e360 con 0x7f75ac0c76b0 2022-08-10T17:37:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b0a9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b0a9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57874/0 (socket says 172.21.15.150:57874) 2022-08-10T17:37:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.477+0000 7f75b0a9a700 1 -- 172.21.15.150:0/1050412860 learned_addr learned my addr 172.21.15.150:0/1050412860 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75abfff700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75ac06c980 0x7f75ac1ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b129b700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac0c76b0 0x7f75ac068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 -- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac0c76b0 msgr2=0x7f75ac068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac0c76b0 0x7f75ac068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 -- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75ac06c980 msgr2=0x7f75ac1ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75ac06c980 0x7f75ac1ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 -- 172.21.15.150:0/1050412860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009310 con 0x7f75ac06c5b0 2022-08-10T17:37:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b0a9a700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c430 tx=0x7f75a000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a00052d0 con 0x7f75ac06c5b0 2022-08-10T17:37:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0003500 con 0x7f75ac06c5b0 2022-08-10T17:37:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac1e0b50 con 0x7f75ac06c5b0 2022-08-10T17:37:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a00038b0 con 0x7f75ac06c5b0 2022-08-10T17:37:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.478+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac14da30 con 0x7f75ac06c5b0 2022-08-10T17:37:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.479+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac072890 con 0x7f75ac06c5b0 2022-08-10T17:37:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.479+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f75a0019030 con 0x7f75ac06c5b0 2022-08-10T17:37:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.480+0000 7f75a97fa700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 0x7f7594067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.480+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f75a0081450 con 0x7f75ac06c5b0 2022-08-10T17:37:51.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.480+0000 7f75abfff700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 0x7f7594067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:51.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.480+0000 7f75abfff700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 0x7f7594067560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7598014040 tx=0x7f7598008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:51.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.484+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f75a004f3b0 con 0x7f75ac06c5b0 2022-08-10T17:37:51.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:51.706+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f75ac0c2a30 con 0x7f75ac06c5b0 2022-08-10T17:37:52.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.638+0000 7f75a97fa700 1 -- 172.21.15.150:0/1050412860 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f75a00170b0 con 0x7f75ac06c5b0 2022-08-10T17:37:52.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 msgr2=0x7f7594067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 0x7f7594067560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7598014040 tx=0x7f7598008030 comp rx=0 tx=0).stop 2022-08-10T17:37:52.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 msgr2=0x7f75ac1e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c430 tx=0x7f75a000c740 comp rx=0 tx=0).stop 2022-08-10T17:37:52.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 shutdown_connections 2022-08-10T17:37:52.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75940650b0 0x7f7594067560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75ac0c76b0 0x7f75ac068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75ac06c5b0 0x7f75ac1e04a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 --2- 172.21.15.150:0/1050412860 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75ac06c980 0x7f75ac1ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 >> 172.21.15.150:0/1050412860 conn(0x7f75ac06e1f0 msgr2=0x7f75ac155090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:52.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 shutdown_connections 2022-08-10T17:37:52.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.641+0000 7f75b2cfe700 1 -- 172.21.15.150:0/1050412860 wait complete. 2022-08-10T17:37:52.659 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2022-08-10T17:37:52.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2022-08-10T17:37:52.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.786+0000 7fc1011cb700 1 Processor -- start 2022-08-10T17:37:52.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.786+0000 7fc1011cb700 1 -- start start 2022-08-10T17:37:52.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc1011cb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc0fc0c4d90 0x7fc0fc0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc1011cb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0fc0c2790 0x7fc0fc0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc1011cb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0fc0699c0 con 0x7fc0fc0c7220 2022-08-10T17:37:52.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc1011cb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0fc0c5e10 con 0x7fc0fc0c2790 2022-08-10T17:37:52.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc1011cb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0fc0c1c30 con 0x7fc0fc0c4d90 2022-08-10T17:37:52.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fa59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc0fc0c7220 0x7fc0fc0c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42330/0 (socket says 172.21.15.150:42330) 2022-08-10T17:37:52.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0fc0c2790 0x7fc0fc0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fa59c700 1 -- 172.21.15.150:0/1960238875 learned_addr learned my addr 172.21.15.150:0/1960238875 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:52.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 -- 172.21.15.150:0/1960238875 >> v2:172.21.15.197:3300/0 conn(0x7fc0fc0c4d90 msgr2=0x7fc0fc0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fad9d700 1 --2- 172.21.15.150:0/1960238875 >> v2:172.21.15.197:3300/0 conn(0x7fc0fc0c4d90 0x7fc0fc0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 --2- 172.21.15.150:0/1960238875 >> v2:172.21.15.197:3300/0 conn(0x7fc0fc0c4d90 0x7fc0fc0c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 -- 172.21.15.150:0/1960238875 >> v1:172.21.15.150:6789/0 conn(0x7fc0fc0c7220 legacy=0x7fc0fc0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0f9d9b700 1 -- 172.21.15.150:0/1960238875 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925309681 0 0) 0x7fc0fc0699c0 con 0x7fc0fc0c7220 2022-08-10T17:37:52.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 -- 172.21.15.150:0/1960238875 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc068e40 con 0x7fc0fc0c2790 2022-08-10T17:37:52.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0fb59e700 1 --2- 172.21.15.150:0/1960238875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc0c56a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc06e3f0 tx=0x7fc0f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e85b4d31e2f9522 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:52.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0f9d9b700 1 -- 172.21.15.150:0/1960238875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400e070 con 0x7fc0fc0c2790 2022-08-10T17:37:52.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.787+0000 7fc0f9d9b700 1 -- 172.21.15.150:0/1960238875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400bbd0 con 0x7fc0fc0c2790 2022-08-10T17:37:52.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc0f9d9b700 1 -- 172.21.15.150:0/1960238875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4012430 con 0x7fc0fc0c2790 2022-08-10T17:37:52.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 -- 172.21.15.150:0/1960238875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c2790 msgr2=0x7fc0fc0c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 --2- 172.21.15.150:0/1960238875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc0c56a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc06e3f0 tx=0x7fc0f400b330 comp rx=0 tx=0).stop 2022-08-10T17:37:52.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 -- 172.21.15.150:0/1960238875 shutdown_connections 2022-08-10T17:37:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 --2- 172.21.15.150:0/1960238875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc0c56a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 --2- 172.21.15.150:0/1960238875 >> v2:172.21.15.197:3300/0 conn(0x7fc0fc0c4d90 0x7fc0fc0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 -- 172.21.15.150:0/1960238875 >> 172.21.15.150:0/1960238875 conn(0x7fc0fc06d0d0 msgr2=0x7fc0fc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 -- 172.21.15.150:0/1960238875 shutdown_connections 2022-08-10T17:37:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.788+0000 7fc1011cb700 1 -- 172.21.15.150:0/1960238875 wait complete. 2022-08-10T17:37:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.789+0000 7fc1011cb700 1 Processor -- start 2022-08-10T17:37:52.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 -- start start 2022-08-10T17:37:52.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc1ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 0x7fc0fc14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc14c420 con 0x7fc0fc0c7220 2022-08-10T17:37:52.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc1ec900 con 0x7fc0fc0c2790 2022-08-10T17:37:52.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc1011cb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc157c10 con 0x7fc0fc0c4d90 2022-08-10T17:37:52.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc0fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc0fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57890/0 (socket says 172.21.15.150:57890) 2022-08-10T17:37:52.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc0fb59e700 1 -- 172.21.15.150:0/311664215 learned_addr learned my addr 172.21.15.150:0/311664215 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:52.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc0fad9d700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc1ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.790+0000 7fc0fa59c700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 0x7fc0fc14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 -- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 msgr2=0x7fc0fc14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 0x7fc0fc14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 -- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0fc0c2790 msgr2=0x7fc0fc1ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:52.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc1ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:52.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 -- 172.21.15.150:0/311664215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009a70 con 0x7fc0fc0c7220 2022-08-10T17:37:52.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fa59c700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 0x7fc0fc14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:52.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0fb59e700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4013000 tx=0x7fc0f4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:52.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40044d0 con 0x7fc0fc0c7220 2022-08-10T17:37:52.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4020070 con 0x7fc0fc0c7220 2022-08-10T17:37:52.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc155e20 con 0x7fc0fc0c7220 2022-08-10T17:37:52.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40125e0 con 0x7fc0fc0c7220 2022-08-10T17:37:52.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.791+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc157930 con 0x7fc0fc0c7220 2022-08-10T17:37:52.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.792+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc072890 con 0x7fc0fc0c7220 2022-08-10T17:37:52.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.792+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc0f4012740 con 0x7fc0fc0c7220 2022-08-10T17:37:52.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.793+0000 7fc0e37fe700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 0x7fc0dc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:52.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.793+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc0f4022070 con 0x7fc0fc0c7220 2022-08-10T17:37:52.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.793+0000 7fc0fad9d700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 0x7fc0dc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:52.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.793+0000 7fc0fad9d700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 0x7fc0dc067590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000a9e0 tx=0x7fc0f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:52.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:52.797+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc0f4052830 con 0x7fc0fc0c7220 2022-08-10T17:37:53.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.017+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fc0fc069120 con 0x7fc0fc0c7220 2022-08-10T17:37:53.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.847+0000 7fc0e37fe700 1 -- 172.21.15.150:0/311664215 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc0f4055e50 con 0x7fc0fc0c7220 2022-08-10T17:37:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 msgr2=0x7fc0dc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 0x7fc0dc067590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000a9e0 tx=0x7fc0f0008040 comp rx=0 tx=0).stop 2022-08-10T17:37:53.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 msgr2=0x7fc0fc1e10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:53.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4013000 tx=0x7fc0f4004950 comp rx=0 tx=0).stop 2022-08-10T17:37:53.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 shutdown_connections 2022-08-10T17:37:53.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0fc0c7220 0x7fc0fc1e10a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:53.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0fc0c2790 0x7fc0fc1ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:53.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0dc0650e0 0x7fc0dc067590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:53.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 --2- 172.21.15.150:0/311664215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc0fc0c4d90 0x7fc0fc14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:53.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 >> 172.21.15.150:0/311664215 conn(0x7fc0fc06d0d0 msgr2=0x7fc0fc0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:53.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 shutdown_connections 2022-08-10T17:37:53.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.850+0000 7fc1011cb700 1 -- 172.21.15.150:0/311664215 wait complete. 2022-08-10T17:37:53.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-08-10T17:37:53.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.991+0000 7f3d82c79700 1 Processor -- start 2022-08-10T17:37:53.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.991+0000 7f3d82c79700 1 -- start start 2022-08-10T17:37:53.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 0x7f3d7c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:53.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d7c06c860 0x7f3d7c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:53.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c0647d0 0x7f3d7c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:53.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c0c4dc0 con 0x7f3d7c06c860 2022-08-10T17:37:54.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c0c5940 con 0x7f3d7c150af0 2022-08-10T17:37:54.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d82c79700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0c9fc0 con 0x7f3d7c0647d0 2022-08-10T17:37:54.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d7c06c860 0x7f3d7c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d7c06c860 0x7f3d7c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57896/0 (socket says 172.21.15.150:57896) 2022-08-10T17:37:54.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 -- 172.21.15.150:0/3815628339 learned_addr learned my addr 172.21.15.150:0/3815628339 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:54.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3815628339 >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 0x7f3d7c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d81216700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c0647d0 0x7f3d7c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 -- 172.21.15.150:0/3815628339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c0647d0 msgr2=0x7f3d7c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c0647d0 0x7f3d7c0c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 -- 172.21.15.150:0/3815628339 >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 msgr2=0x7f3d7c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 --2- 172.21.15.150:0/3815628339 >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 0x7f3d7c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d7bfff700 1 -- 172.21.15.150:0/3815628339 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c06f9a0 con 0x7f3d7c06c860 2022-08-10T17:37:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.992+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3815628339 >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 0x7f3d7c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:54.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d7bfff700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c06c860 0x7f3d7c15a3a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0707d0 tx=0x7f3d68009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbef0ae425afe81c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d7b7fe700 1 -- 172.21.15.150:0/3815628339 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68004230 con 0x7f3d7c06c860 2022-08-10T17:37:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d7b7fe700 1 -- 172.21.15.150:0/3815628339 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68004390 con 0x7f3d7c06c860 2022-08-10T17:37:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d7b7fe700 1 -- 172.21.15.150:0/3815628339 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68011830 con 0x7f3d7c06c860 2022-08-10T17:37:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 -- 172.21.15.150:0/3815628339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c06c860 msgr2=0x7f3d7c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:54.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c06c860 0x7f3d7c15a3a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0707d0 tx=0x7f3d68009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 -- 172.21.15.150:0/3815628339 shutdown_connections 2022-08-10T17:37:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c0647d0 0x7f3d7c0c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3815628339 >> v2:172.21.15.197:3300/0 conn(0x7f3d7c150af0 0x7f3d7c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3815628339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c06c860 0x7f3d7c15a3a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 -- 172.21.15.150:0/3815628339 >> 172.21.15.150:0/3815628339 conn(0x7f3d7c0c92f0 msgr2=0x7f3d7c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 -- 172.21.15.150:0/3815628339 shutdown_connections 2022-08-10T17:37:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.993+0000 7f3d82c79700 1 -- 172.21.15.150:0/3815628339 wait complete. 2022-08-10T17:37:54.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.995+0000 7f3d82c79700 1 Processor -- start 2022-08-10T17:37:54.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.995+0000 7f3d82c79700 1 -- start start 2022-08-10T17:37:54.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 0x7f3d7c14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:54.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c06c860 0x7f3d7c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:54.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:54.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0ba320 con 0x7f3d7c150af0 2022-08-10T17:37:54.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0ba550 con 0x7f3d7c0647d0 2022-08-10T17:37:54.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d82c79700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0ba830 con 0x7f3d7c06c860 2022-08-10T17:37:54.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57904/0 (socket says 172.21.15.150:57904) 2022-08-10T17:37:54.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 -- 172.21.15.150:0/3101338287 learned_addr learned my addr 172.21.15.150:0/3101338287 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:54.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d7bfff700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c06c860 0x7f3d7c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 0x7f3d7c14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 -- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c06c860 msgr2=0x7f3d7c149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:54.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c06c860 0x7f3d7c149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 -- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 msgr2=0x7f3d7c14c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:54.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 0x7f3d7c14c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d81216700 1 -- 172.21.15.150:0/3101338287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d680093e0 con 0x7f3d7c150af0 2022-08-10T17:37:54.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.996+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 0x7f3d7c14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:54.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d81216700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400cb80 tx=0x7f3d7400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:54.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400a8e0 con 0x7f3d7c150af0 2022-08-10T17:37:54.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7400aa40 con 0x7f3d7c150af0 2022-08-10T17:37:54.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c0bab10 con 0x7f3d7c150af0 2022-08-10T17:37:54.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400ae30 con 0x7f3d7c150af0 2022-08-10T17:37:54.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.997+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c0bb0d0 con 0x7f3d7c150af0 2022-08-10T17:37:54.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.998+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c06e290 con 0x7f3d7c150af0 2022-08-10T17:37:54.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.998+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3d74021070 con 0x7f3d7c150af0 2022-08-10T17:37:54.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.999+0000 7f3d797fa700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 0x7f3d64067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:54.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.999+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3d74082380 con 0x7f3d7c150af0 2022-08-10T17:37:54.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.999+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 0x7f3d64067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:54.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:53.999+0000 7f3d80a15700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 0x7f3d64067560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b840 tx=0x7f3d70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:54.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.003+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f3d74050270 con 0x7f3d7c150af0 2022-08-10T17:37:54.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.225+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d7c072890 con 0x7f3d7c150af0 2022-08-10T17:37:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.852+0000 7f3d797fa700 1 -- 172.21.15.150:0/3101338287 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d7401f0c0 con 0x7f3d7c150af0 2022-08-10T17:37:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 msgr2=0x7f3d64067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 0x7f3d64067560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b840 tx=0x7f3d70008040 comp rx=0 tx=0).stop 2022-08-10T17:37:54.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 msgr2=0x7f3d7c14a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:54.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400cb80 tx=0x7f3d7400cf40 comp rx=0 tx=0).stop 2022-08-10T17:37:54.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 shutdown_connections 2022-08-10T17:37:54.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d7c150af0 0x7f3d7c14a520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d7c0647d0 0x7f3d7c14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d640650b0 0x7f3d64067560 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 --2- 172.21.15.150:0/3101338287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d7c06c860 0x7f3d7c149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:54.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.854+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 >> 172.21.15.150:0/3101338287 conn(0x7f3d7c0c92f0 msgr2=0x7f3d7c146890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:54.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.855+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 shutdown_connections 2022-08-10T17:37:54.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.855+0000 7f3d82c79700 1 -- 172.21.15.150:0/3101338287 wait complete. 2022-08-10T17:37:54.873 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-08-10T17:37:55.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.998+0000 7f20e3932700 1 Processor -- start 2022-08-10T17:37:55.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e3932700 1 -- start start 2022-08-10T17:37:55.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e3932700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d90 0x7f20dc0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:55.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e3932700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0699c0 con 0x7f20dc0c2790 2022-08-10T17:37:55.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e3932700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc068e40 con 0x7f20dc0c7220 2022-08-10T17:37:55.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e3932700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc0c5e10 con 0x7f20dc0c4d90 2022-08-10T17:37:55.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e16ce700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d90 0x7f20dc0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:55.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e1ecf700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f20dc0c2790 0x7f20dc06fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42360/0 (socket says 172.21.15.150:42360) 2022-08-10T17:37:55.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:54.999+0000 7f20e1ecf700 1 -- 172.21.15.150:0/1715893625 learned_addr learned my addr 172.21.15.150:0/1715893625 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:55.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e16ce700 1 -- 172.21.15.150:0/1715893625 >> v1:172.21.15.197:6789/0 conn(0x7f20dc0c7220 legacy=0x7f20dc0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:55.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e16ce700 1 -- 172.21.15.150:0/1715893625 >> v1:172.21.15.150:6789/0 conn(0x7f20dc0c2790 legacy=0x7f20dc06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e16ce700 1 -- 172.21.15.150:0/1715893625 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc069120 con 0x7f20dc0c4d90 2022-08-10T17:37:55.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20cbfff700 1 -- 172.21.15.150:0/1715893625 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470718551 0 0) 0x7f20dc0699c0 con 0x7f20dc0c2790 2022-08-10T17:37:55.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e16ce700 1 --2- 172.21.15.150:0/1715893625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c4d90 0x7f20dc0c5160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0096b0 tx=0x7f20cc0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2335b49ca92055f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:55.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20cbfff700 1 -- 172.21.15.150:0/1715893625 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc004230 con 0x7f20dc0c4d90 2022-08-10T17:37:55.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20cbfff700 1 -- 172.21.15.150:0/1715893625 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc004390 con 0x7f20dc0c4d90 2022-08-10T17:37:55.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20cbfff700 1 -- 172.21.15.150:0/1715893625 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc011870 con 0x7f20dc0c4d90 2022-08-10T17:37:55.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e3932700 1 -- 172.21.15.150:0/1715893625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c4d90 msgr2=0x7f20dc0c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.000+0000 7f20e3932700 1 --2- 172.21.15.150:0/1715893625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c4d90 0x7f20dc0c5160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0096b0 tx=0x7f20cc0099c0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.001+0000 7f20e3932700 1 -- 172.21.15.150:0/1715893625 shutdown_connections 2022-08-10T17:37:55.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.001+0000 7f20e3932700 1 --2- 172.21.15.150:0/1715893625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c4d90 0x7f20dc0c5160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.001+0000 7f20e3932700 1 -- 172.21.15.150:0/1715893625 >> 172.21.15.150:0/1715893625 conn(0x7f20dc06d0d0 msgr2=0x7f20dc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:55.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.001+0000 7f20e3932700 1 -- 172.21.15.150:0/1715893625 shutdown_connections 2022-08-10T17:37:55.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.001+0000 7f20e3932700 1 -- 172.21.15.150:0/1715893625 wait complete. 2022-08-10T17:37:55.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 Processor -- start 2022-08-10T17:37:55.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 -- start start 2022-08-10T17:37:55.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:55.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20dc0c4d90 0x7f20dc14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:55.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc0c7220 0x7f20dc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:55.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc142cc0 con 0x7f20dc0c2790 2022-08-10T17:37:55.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc141940 con 0x7f20dc0c7220 2022-08-10T17:37:55.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e3932700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc141c20 con 0x7f20dc0c4d90 2022-08-10T17:37:55.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.002+0000 7f20e16ce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:55.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57914/0 (socket says 172.21.15.150:57914) 2022-08-10T17:37:55.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 -- 172.21.15.150:0/2617499513 learned_addr learned my addr 172.21.15.150:0/2617499513 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:55.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e1ecf700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc0c7220 0x7f20dc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:55.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e0ecd700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20dc0c4d90 0x7f20dc14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:55.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 -- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20dc0c4d90 msgr2=0x7f20dc14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20dc0c4d90 0x7f20dc14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 -- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc0c7220 msgr2=0x7f20dc156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc0c7220 0x7f20dc156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 -- 172.21.15.150:0/2617499513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009310 con 0x7f20dc0c2790 2022-08-10T17:37:55.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e16ce700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f20cc000c00 tx=0x7f20cc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:55.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc003720 con 0x7f20dc0c2790 2022-08-10T17:37:55.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc01e070 con 0x7f20dc0c2790 2022-08-10T17:37:55.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc141f00 con 0x7f20dc0c2790 2022-08-10T17:37:55.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc003ae0 con 0x7f20dc0c2790 2022-08-10T17:37:55.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.003+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc1424c0 con 0x7f20dc0c2790 2022-08-10T17:37:55.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.004+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc072890 con 0x7f20dc0c2790 2022-08-10T17:37:55.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.005+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f20cc017020 con 0x7f20dc0c2790 2022-08-10T17:37:55.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.005+0000 7f20c9ffb700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 0x7f20bc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:55.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.005+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f20cc083450 con 0x7f20dc0c2790 2022-08-10T17:37:55.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.005+0000 7f20e0ecd700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 0x7f20bc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:55.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.006+0000 7f20e0ecd700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 0x7f20bc067590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0c5730 tx=0x7f20d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:55.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.009+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f20cc051430 con 0x7f20dc0c2790 2022-08-10T17:37:55.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.229+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f20dc06df80 con 0x7f20dc0c2790 2022-08-10T17:37:55.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.857+0000 7f20c9ffb700 1 -- 172.21.15.150:0/2617499513 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f20cc020020 con 0x7f20dc0c2790 2022-08-10T17:37:55.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 msgr2=0x7f20bc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 0x7f20bc067590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0c5730 tx=0x7f20d8009040 comp rx=0 tx=0).stop 2022-08-10T17:37:55.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 msgr2=0x7f20dc0bc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:55.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f20cc000c00 tx=0x7f20cc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 shutdown_connections 2022-08-10T17:37:55.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc0c7220 0x7f20dc156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0c2790 0x7f20dc0bc570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20bc0650e0 0x7f20bc067590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 --2- 172.21.15.150:0/2617499513 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20dc0c4d90 0x7f20dc14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:55.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 >> 172.21.15.150:0/2617499513 conn(0x7f20dc06d0d0 msgr2=0x7f20dc0c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:55.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 shutdown_connections 2022-08-10T17:37:55.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.860+0000 7f20e3932700 1 -- 172.21.15.150:0/2617499513 wait complete. 2022-08-10T17:37:55.876 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2022-08-10T17:37:55.876 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:37:55.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 Processor -- start 2022-08-10T17:37:55.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 -- start start 2022-08-10T17:37:56.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e8150af0 0x7f82e8159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82e80647d0 0x7f82e815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80c4dc0 con 0x7f82e806c860 2022-08-10T17:37:56.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e80c5940 con 0x7f82e80647d0 2022-08-10T17:37:56.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82eedc0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c9fc0 con 0x7f82e8150af0 2022-08-10T17:37:56.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.994+0000 7f82ed35d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82e80647d0 0x7f82e815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82e80647d0 0x7f82e815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57926/0 (socket says 172.21.15.150:57926) 2022-08-10T17:37:56.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 -- 172.21.15.150:0/1652919852 learned_addr learned my addr 172.21.15.150:0/1652919852 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:56.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ecb5c700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e8150af0 0x7f82e8159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 -- 172.21.15.150:0/1652919852 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e8150af0 msgr2=0x7f82e8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e8150af0 0x7f82e8159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 -- 172.21.15.150:0/1652919852 >> v1:172.21.15.197:6789/0 conn(0x7f82e806c860 legacy=0x7f82e80c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 -- 172.21.15.150:0/1652919852 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e806f9a0 con 0x7f82e80647d0 2022-08-10T17:37:56.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82ed35d700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e80647d0 0x7f82e815a3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009e50 tx=0x7f82e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fdf6b45eab148a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82e77fe700 1 -- 172.21.15.150:0/1652919852 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000e070 con 0x7f82e80647d0 2022-08-10T17:37:56.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82e77fe700 1 -- 172.21.15.150:0/1652919852 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b910 con 0x7f82e80647d0 2022-08-10T17:37:56.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.995+0000 7f82e77fe700 1 -- 172.21.15.150:0/1652919852 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bcc0 con 0x7f82e80647d0 2022-08-10T17:37:56.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 -- 172.21.15.150:0/1652919852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e80647d0 msgr2=0x7f82e815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e80647d0 0x7f82e815a3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009e50 tx=0x7f82e000b330 comp rx=0 tx=0).stop 2022-08-10T17:37:56.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 -- 172.21.15.150:0/1652919852 shutdown_connections 2022-08-10T17:37:56.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e80647d0 0x7f82e815a3a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 --2- 172.21.15.150:0/1652919852 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e8150af0 0x7f82e8159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 -- 172.21.15.150:0/1652919852 >> 172.21.15.150:0/1652919852 conn(0x7f82e80c92f0 msgr2=0x7f82e80c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 -- 172.21.15.150:0/1652919852 shutdown_connections 2022-08-10T17:37:56.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.996+0000 7f82eedc0700 1 -- 172.21.15.150:0/1652919852 wait complete. 2022-08-10T17:37:56.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.997+0000 7f82eedc0700 1 Processor -- start 2022-08-10T17:37:56.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.997+0000 7f82eedc0700 1 -- start start 2022-08-10T17:37:56.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e80647d0 0x7f82e81ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 0x7f82e8143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80bb330 con 0x7f82e806c860 2022-08-10T17:37:56.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80ba4a0 con 0x7f82e8150af0 2022-08-10T17:37:56.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82eedc0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81ecd50 con 0x7f82e80647d0 2022-08-10T17:37:56.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57930/0 (socket says 172.21.15.150:57930) 2022-08-10T17:37:56.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 -- 172.21.15.150:0/3816021352 learned_addr learned my addr 172.21.15.150:0/3816021352 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:56.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82ecb5c700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e80647d0 0x7f82e81ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82ed35d700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 0x7f82e8143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 -- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e80647d0 msgr2=0x7f82e81ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e80647d0 0x7f82e81ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 -- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 msgr2=0x7f82e8143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 0x7f82e8143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 -- 172.21.15.150:0/3816021352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009b30 con 0x7f82e806c860 2022-08-10T17:37:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82ed35d700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 0x7f82e8143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.998+0000 7f82e7fff700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c3c0 tx=0x7f82d400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.999+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4005220 con 0x7f82e806c860 2022-08-10T17:37:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.999+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4005380 con 0x7f82e806c860 2022-08-10T17:37:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.999+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80ba740 con 0x7f82e806c860 2022-08-10T17:37:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.999+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4007270 con 0x7f82e806c860 2022-08-10T17:37:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:55.999+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e80bace0 con 0x7f82e806c860 2022-08-10T17:37:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.000+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e806e290 con 0x7f82e806c860 2022-08-10T17:37:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.000+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f82d4010050 con 0x7f82e806c860 2022-08-10T17:37:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.000+0000 7f82e57fa700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 0x7f82d0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.000+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f82d40812d0 con 0x7f82e806c860 2022-08-10T17:37:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.001+0000 7f82ecb5c700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 0x7f82d0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.001+0000 7f82ecb5c700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 0x7f82d0067560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.005+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f82d404f2b0 con 0x7f82e806c860 2022-08-10T17:37:56.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.225+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82e8072890 con 0x7f82e806c860 2022-08-10T17:37:56.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.226+0000 7f82e57fa700 1 -- 172.21.15.150:0/3816021352 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f82d40528d0 con 0x7f82e806c860 2022-08-10T17:37:56.230 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:56.230 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:37:55.852124+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4317,"mds_1":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:37:56.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.227+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 msgr2=0x7f82d0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.227+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 0x7f82d0067560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc0090e0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.227+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 msgr2=0x7f82e80c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.227+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c3c0 tx=0x7f82d400c6d0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 shutdown_connections 2022-08-10T17:37:56.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f82e8150af0 0x7f82e8143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f82d00650b0 0x7f82d0067560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f82e80647d0 0x7f82e81ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 --2- 172.21.15.150:0/3816021352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e806c860 0x7f82e80c8930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 >> 172.21.15.150:0/3816021352 conn(0x7f82e80c92f0 msgr2=0x7f82e814d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 shutdown_connections 2022-08-10T17:37:56.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.228+0000 7f82eedc0700 1 -- 172.21.15.150:0/3816021352 wait complete. 2022-08-10T17:37:56.235 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 12 2022-08-10T17:37:56.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:37:56.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.360+0000 7fd55d862700 1 Processor -- start 2022-08-10T17:37:56.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.360+0000 7fd55d862700 1 -- start start 2022-08-10T17:37:56.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd55d862700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 0x7fd558071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd55d862700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd558068820 0x7fd5580718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd55d862700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5580c6100 con 0x7fd5581544c0 2022-08-10T17:37:56.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd55d862700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5580c5270 con 0x7fd558068820 2022-08-10T17:37:56.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd55d862700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5580c5e00 con 0x7fd5581540f0 2022-08-10T17:37:56.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd5577fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd558068820 0x7fd5580718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd5577fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd558068820 0x7fd5580718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57940/0 (socket says 172.21.15.150:57940) 2022-08-10T17:37:56.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd5577fe700 1 -- 172.21.15.150:0/1443354771 learned_addr learned my addr 172.21.15.150:0/1443354771 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:56.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.361+0000 7fd556ffd700 1 --2- 172.21.15.150:0/1443354771 >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 0x7fd558071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd5577fe700 1 -- 172.21.15.150:0/1443354771 >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 msgr2=0x7fd558071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd5577fe700 1 --2- 172.21.15.150:0/1443354771 >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 0x7fd558071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd5577fe700 1 -- 172.21.15.150:0/1443354771 >> v1:172.21.15.197:6789/0 conn(0x7fd5581544c0 legacy=0x7fd558068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd5577fe700 1 -- 172.21.15.150:0/1443354771 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55806eb00 con 0x7fd558068820 2022-08-10T17:37:56.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd556ffd700 1 --2- 172.21.15.150:0/1443354771 >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 0x7fd558071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:56.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd5577fe700 1 --2- 172.21.15.150:0/1443354771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd558068820 0x7fd5580718b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd558064cd0 tx=0x7fd55000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed84d2dda059d0f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd555ffb700 1 -- 172.21.15.150:0/1443354771 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000e070 con 0x7fd558068820 2022-08-10T17:37:56.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd555ffb700 1 -- 172.21.15.150:0/1443354771 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55000b980 con 0x7fd558068820 2022-08-10T17:37:56.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd555ffb700 1 -- 172.21.15.150:0/1443354771 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000bd30 con 0x7fd558068820 2022-08-10T17:37:56.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 -- 172.21.15.150:0/1443354771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd558068820 msgr2=0x7fd5580718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 --2- 172.21.15.150:0/1443354771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd558068820 0x7fd5580718b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd558064cd0 tx=0x7fd55000b330 comp rx=0 tx=0).stop 2022-08-10T17:37:56.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 -- 172.21.15.150:0/1443354771 shutdown_connections 2022-08-10T17:37:56.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 --2- 172.21.15.150:0/1443354771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd558068820 0x7fd5580718b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 --2- 172.21.15.150:0/1443354771 >> v2:172.21.15.197:3300/0 conn(0x7fd5581540f0 0x7fd558071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 -- 172.21.15.150:0/1443354771 >> 172.21.15.150:0/1443354771 conn(0x7fd55806d0d0 msgr2=0x7fd5580c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 -- 172.21.15.150:0/1443354771 shutdown_connections 2022-08-10T17:37:56.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.362+0000 7fd55d862700 1 -- 172.21.15.150:0/1443354771 wait complete. 2022-08-10T17:37:56.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 Processor -- start 2022-08-10T17:37:56.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 -- start start 2022-08-10T17:37:56.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd558068820 0x7fd558155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5581540f0 0x7fd5581e1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581556b0 con 0x7fd5581544c0 2022-08-10T17:37:56.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558156010 con 0x7fd5581540f0 2022-08-10T17:37:56.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.364+0000 7fd55d862700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581ecfb0 con 0x7fd558068820 2022-08-10T17:37:56.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57946/0 (socket says 172.21.15.150:57946) 2022-08-10T17:37:56.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 -- 172.21.15.150:0/2635263473 learned_addr learned my addr 172.21.15.150:0/2635263473 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:56.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5567fc700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5581540f0 0x7fd5581e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd556ffd700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd558068820 0x7fd558155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 -- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd558068820 msgr2=0x7fd558155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd558068820 0x7fd558155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 -- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5581540f0 msgr2=0x7fd5581e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5581540f0 0x7fd5581e1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 -- 172.21.15.150:0/2635263473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550009b30 con 0x7fd5581544c0 2022-08-10T17:37:56.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd5577fe700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd55000b370 tx=0x7fd550004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500092e0 con 0x7fd5581544c0 2022-08-10T17:37:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5500094d0 con 0x7fd5581544c0 2022-08-10T17:37:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5581ed290 con 0x7fd5581544c0 2022-08-10T17:37:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550004460 con 0x7fd5581544c0 2022-08-10T17:37:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.365+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd558154ff0 con 0x7fd5581544c0 2022-08-10T17:37:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.366+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5581557f0 con 0x7fd5581544c0 2022-08-10T17:37:56.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.367+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd5500045c0 con 0x7fd5581544c0 2022-08-10T17:37:56.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.367+0000 7fd53ffff700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 0x7fd538067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.367+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd5500834c0 con 0x7fd5581544c0 2022-08-10T17:37:56.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.367+0000 7fd556ffd700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 0x7fd538067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.367+0000 7fd556ffd700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 0x7fd538067560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006fd0 tx=0x7fd54c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.371+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd5581557f0 con 0x7fd5581544c0 2022-08-10T17:37:56.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.550+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5581557f0 con 0x7fd5581544c0 2022-08-10T17:37:56.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.551+0000 7fd53ffff700 1 -- 172.21.15.150:0/2635263473 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7fd5581557f0 con 0x7fd5581544c0 2022-08-10T17:37:56.555 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:56.555 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:37:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 msgr2=0x7fd538067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 0x7fd538067560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006fd0 tx=0x7fd54c008040 comp rx=0 tx=0).stop 2022-08-10T17:37:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 msgr2=0x7fd5580bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd55000b370 tx=0x7fd550004950 comp rx=0 tx=0).stop 2022-08-10T17:37:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 shutdown_connections 2022-08-10T17:37:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5581544c0 0x7fd5580bfcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5380650b0 0x7fd538067560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd558068820 0x7fd558155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 --2- 172.21.15.150:0/2635263473 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5581540f0 0x7fd5581e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 >> 172.21.15.150:0/2635263473 conn(0x7fd55806d0d0 msgr2=0x7fd558071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 shutdown_connections 2022-08-10T17:37:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.553+0000 7fd55d862700 1 -- 172.21.15.150:0/2635263473 wait complete. 2022-08-10T17:37:56.569 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-08-10T17:37:56.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:37:56.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.686+0000 7f5eb877e700 1 Processor -- start 2022-08-10T17:37:56.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.686+0000 7f5eb877e700 1 -- start start 2022-08-10T17:37:56.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb877e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f5eb006ef90 0x7f5eb00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb877e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb006c300 con 0x7f5eb014db50 2022-08-10T17:37:56.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb877e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb006e3f0 con 0x7f5eb014d780 2022-08-10T17:37:56.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb877e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb0154370 con 0x7f5eb006ef90 2022-08-10T17:37:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5d19700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5eb014db50 0x7f5eb006e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42398/0 (socket says 172.21.15.150:42398) 2022-08-10T17:37:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5d19700 1 -- 172.21.15.150:0/843178491 learned_addr learned my addr 172.21.15.150:0/843178491 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> v2:172.21.15.197:3300/0 conn(0x7f5eb006ef90 0x7f5eb00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622173147 0 0) 0x7f5eb006c300 con 0x7f5eb014db50 2022-08-10T17:37:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e98003430 con 0x7f5eb014db50 2022-08-10T17:37:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231629928 0 0) 0x7f5e98003430 con 0x7f5eb014db50 2022-08-10T17:37:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 >> v2:172.21.15.197:3300/0 conn(0x7f5eb006ef90 msgr2=0x7f5eb00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 --2- 172.21.15.150:0/843178491 >> v2:172.21.15.197:3300/0 conn(0x7f5eb006ef90 0x7f5eb00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 >> v1:172.21.15.197:6789/0 conn(0x7f5eb014d780 legacy=0x7f5eb006b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb006c550 con 0x7f5eb014db50 2022-08-10T17:37:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5ea0001670 con 0x7f5eb014db50 2022-08-10T17:37:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> v2:172.21.15.197:3300/0 conn(0x7f5eb006ef90 0x7f5eb00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:37:56.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.687+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 >> v1:172.21.15.150:6789/0 conn(0x7f5eb014db50 legacy=0x7f5eb006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e98003880 0x7f5e98003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e980046d0 0x7f5e98004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5e9800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0154370 con 0x7f5e98005080 2022-08-10T17:37:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9800bf90 con 0x7f5e980046d0 2022-08-10T17:37:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9800e360 con 0x7f5e98003880 2022-08-10T17:37:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5e9800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5d19700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e980046d0 0x7f5e98004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb651a700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e98003880 0x7f5e98003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 -- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e98003880 msgr2=0x7f5e98003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e98003880 0x7f5e98003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 -- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e980046d0 msgr2=0x7f5e98004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e980046d0 0x7f5e98004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 -- 172.21.15.150:0/843178491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98003430 con 0x7f5e98005080 2022-08-10T17:37:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 -- 172.21.15.150:0/843178491 reap_dead start 2022-08-10T17:37:56.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5e9800b890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e320 tx=0x7f5e98005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c30533aa0b843f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800edc0 con 0x7f5e98005080 2022-08-10T17:37:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800f040 con 0x7f5e98005080 2022-08-10T17:37:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.688+0000 7f5eb5518700 1 -- 172.21.15.150:0/843178491 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8003ae0 con 0x7f5e98005080 2022-08-10T17:37:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 -- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 msgr2=0x7f5e9800b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5e9800b890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e320 tx=0x7f5e98005700 comp rx=0 tx=0).stop 2022-08-10T17:37:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 -- 172.21.15.150:0/843178491 shutdown_connections 2022-08-10T17:37:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 --2- 172.21.15.150:0/843178491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5e9800b890 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 -- 172.21.15.150:0/843178491 >> 172.21.15.150:0/843178491 conn(0x7f5eb00c92f0 msgr2=0x7f5eb00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 -- 172.21.15.150:0/843178491 shutdown_connections 2022-08-10T17:37:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.689+0000 7f5eb877e700 1 -- 172.21.15.150:0/843178491 wait complete. 2022-08-10T17:37:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.690+0000 7f5eb877e700 1 Processor -- start 2022-08-10T17:37:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.690+0000 7f5eb877e700 1 -- start start 2022-08-10T17:37:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5eb01e7dd0 0x7f5eb01d9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5eb00c1a30 0x7f5eb00c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00bdc00 con 0x7f5e98005080 2022-08-10T17:37:56.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00c15a0 con 0x7f5eb00c1a30 2022-08-10T17:37:56.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00c23e0 con 0x7f5eb01e7dd0 2022-08-10T17:37:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57962/0 (socket says 172.21.15.150:57962) 2022-08-10T17:37:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 -- 172.21.15.150:0/1726413014 learned_addr learned my addr 172.21.15.150:0/1726413014 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb5d19700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5eb01e7dd0 0x7f5eb01d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb6d1b700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5eb00c1a30 0x7f5eb00c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 -- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5eb01e7dd0 msgr2=0x7f5eb01d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5eb01e7dd0 0x7f5eb01d9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 -- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5eb00c1a30 msgr2=0x7f5eb00c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5eb00c1a30 0x7f5eb00c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 -- 172.21.15.150:0/1726413014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00bdde0 con 0x7f5e98005080 2022-08-10T17:37:56.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb651a700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00f520 tx=0x7f5eac00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0052e0 con 0x7f5e98005080 2022-08-10T17:37:56.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac003500 con 0x7f5e98005080 2022-08-10T17:37:56.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb00be0c0 con 0x7f5e98005080 2022-08-10T17:37:56.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac003890 con 0x7f5e98005080 2022-08-10T17:37:56.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.691+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb00c1230 con 0x7f5e98005080 2022-08-10T17:37:56.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.692+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb00c13c0 con 0x7f5e98005080 2022-08-10T17:37:56.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.693+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5eac0039f0 con 0x7f5e98005080 2022-08-10T17:37:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.693+0000 7f5e9effd700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 0x7f5e90067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.693+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5eac081e90 con 0x7f5e98005080 2022-08-10T17:37:56.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.693+0000 7f5eb5d19700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 0x7f5e90067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.694+0000 7f5eb5d19700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 0x7f5e90067590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00c3dd0 tx=0x7f5ea0000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:56.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.697+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5eac04fe70 con 0x7f5e98005080 2022-08-10T17:37:56.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.871+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5eb00c0dd0 con 0x7f5e900650e0 2022-08-10T17:37:56.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.884+0000 7f5e9effd700 1 -- 172.21.15.150:0/1726413014 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392417 (secure 0 0 0) 0x7f5ea00075e0 con 0x7f5e900650e0 2022-08-10T17:37:56.893 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:56.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 msgr2=0x7f5e90067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 0x7f5e90067590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00c3dd0 tx=0x7f5ea0000ed0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 msgr2=0x7f5eb00bd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:56.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00f520 tx=0x7f5eac00f830 comp rx=0 tx=0).stop 2022-08-10T17:37:56.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 shutdown_connections 2022-08-10T17:37:56.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5eb00c1a30 0x7f5eb00c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e98005080 0x7f5eb00bd6c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e900650e0 0x7f5e90067590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 --2- 172.21.15.150:0/1726413014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5eb01e7dd0 0x7f5eb01d9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 >> 172.21.15.150:0/1726413014 conn(0x7f5eb00c92f0 msgr2=0x7f5eb00c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 shutdown_connections 2022-08-10T17:37:56.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:56.888+0000 7f5eb877e700 1 -- 172.21.15.150:0/1726413014 wait complete. 2022-08-10T17:37:56.901 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:37:56.904 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2022-08-10T17:37:55.247042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594899,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70688,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754904032,"statfs":{"total":773094113280,"available":773021728768,"internally_reserved":0,"allocated":2719744,"data_stored":2259318,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2201,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674245+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:36:17.674245+0000","last_peered":"2022-08-10T17:36:17.674245+0000","last_clean":"2022-08-10T17:36:17.674245+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:36:17.674245+0000","last_undegraded":"2022-08-10T17:36:17.674245+0000","last_fullsized":"2022-08-10T17:36:17.674245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680953+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:36:17.680953+0000","last_peered":"2022-08-10T17:36:17.680953+0000","last_clean":"2022-08-10T17:36:17.680953+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:36:17.680953+0000","last_undegraded":"2022-08-10T17:36:17.680953+0000","last_fullsized":"2022-08-10T17:36:17.680953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675981+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:17.675981+0000","last_peered":"2022-08-10T17:36:17.675981+0000","last_clean":"2022-08-10T17:36:17.675981+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:17.675981+0000","last_undegraded":"2022-08-10T17:36:17.675981+0000","last_fullsized":"2022-08-10T17:36:17.675981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690304+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:36:17.690304+0000","last_peered":"2022-08-10T17:36:17.690304+0000","last_clean":"2022-08-10T17:36:17.690304+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:36:17.690304+0000","last_undegraded":"2022-08-10T17:36:17.690304+0000","last_fullsized":"2022-08-10T17:36:17.690304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673965+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:36:17.673965+0000","last_peered":"2022-08-10T17:36:17.673965+0000","last_clean":"2022-08-10T17:36:17.673965+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:36:17.673965+0000","last_undegraded":"2022-08-10T17:36:17.673965+0000","last_fullsized":"2022-08-10T17:36:17.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'3","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690924+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:17.690924+0000","last_peered":"2022-08-10T17:36:17.690924+0000","last_clean":"2022-08-10T17:36:17.690924+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:17.690924+0000","last_undegraded":"2022-08-10T17:36:17.690924+0000","last_fullsized":"2022-08-10T17:36:17.690924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:50.505566+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:50.505566+0000","last_peered":"2022-08-10T17:37:50.505566+0000","last_clean":"2022-08-10T17:37:50.505566+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:50.505566+0000","last_undegraded":"2022-08-10T17:37:50.505566+0000","last_fullsized":"2022-08-10T17:37:50.505566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690616+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:36:17.690616+0000","last_peered":"2022-08-10T17:36:17.690616+0000","last_clean":"2022-08-10T17:36:17.690616+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:36:17.690616+0000","last_undegraded":"2022-08-10T17:36:17.690616+0000","last_fullsized":"2022-08-10T17:36:17.690616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689763+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:36:17.689763+0000","last_peered":"2022-08-10T17:36:17.689763+0000","last_clean":"2022-08-10T17:36:17.689763+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:36:17.689763+0000","last_undegraded":"2022-08-10T17:36:17.689763+0000","last_fullsized":"2022-08-10T17:36:17.689763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690205+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:36:17.690205+0000","last_peered":"2022-08-10T17:36:17.690205+0000","last_clean":"2022-08-10T17:36:17.690205+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:36:17.690205+0000","last_undegraded":"2022-08-10T17:36:17.690205+0000","last_fullsized":"2022-08-10T17:36:17.690205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'8","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689854+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:36:17.689854+0000","last_peered":"2022-08-10T17:36:17.689854+0000","last_clean":"2022-08-10T17:36:17.689854+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:36:17.689854+0000","last_undegraded":"2022-08-10T17:36:17.689854+0000","last_fullsized":"2022-08-10T17:36:17.689854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690766+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:17.690766+0000","last_peered":"2022-08-10T17:36:17.690766+0000","last_clean":"2022-08-10T17:36:17.690766+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:17.690766+0000","last_undegraded":"2022-08-10T17:36:17.690766+0000","last_fullsized":"2022-08-10T17:36:17.690766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674011+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:36:17.674011+0000","last_peered":"2022-08-10T17:36:17.674011+0000","last_clean":"2022-08-10T17:36:17.674011+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:36:17.674011+0000","last_undegraded":"2022-08-10T17:36:17.674011+0000","last_fullsized":"2022-08-10T17:36:17.674011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675758+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:36:17.675758+0000","last_peered":"2022-08-10T17:36:17.675758+0000","last_clean":"2022-08-10T17:36:17.675758+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:36:17.675758+0000","last_undegraded":"2022-08-10T17:36:17.675758+0000","last_fullsized":"2022-08-10T17:36:17.675758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690719+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:17.690719+0000","last_peered":"2022-08-10T17:36:17.690719+0000","last_clean":"2022-08-10T17:36:17.690719+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:17.690719+0000","last_undegraded":"2022-08-10T17:36:17.690719+0000","last_fullsized":"2022-08-10T17:36:17.690719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673450+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:36:17.673450+0000","last_peered":"2022-08-10T17:36:17.673450+0000","last_clean":"2022-08-10T17:36:17.673450+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:36:17.673450+0000","last_undegraded":"2022-08-10T17:36:17.673450+0000","last_fullsized":"2022-08-10T17:36:17.673450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675875+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:36:17.675875+0000","last_peered":"2022-08-10T17:36:17.675875+0000","last_clean":"2022-08-10T17:36:17.675875+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:36:17.675875+0000","last_undegraded":"2022-08-10T17:36:17.675875+0000","last_fullsized":"2022-08-10T17:36:17.675875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673917+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:17.673917+0000","last_peered":"2022-08-10T17:36:17.673917+0000","last_clean":"2022-08-10T17:36:17.673917+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:17.673917+0000","last_undegraded":"2022-08-10T17:36:17.673917+0000","last_fullsized":"2022-08-10T17:36:17.673917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674586+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:36:17.674586+0000","last_peered":"2022-08-10T17:36:17.674586+0000","last_clean":"2022-08-10T17:36:17.674586+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:36:17.674586+0000","last_undegraded":"2022-08-10T17:36:17.674586+0000","last_fullsized":"2022-08-10T17:36:17.674586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680912+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:36:17.680912+0000","last_peered":"2022-08-10T17:36:17.680912+0000","last_clean":"2022-08-10T17:36:17.680912+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:36:17.680912+0000","last_undegraded":"2022-08-10T17:36:17.680912+0000","last_fullsized":"2022-08-10T17:36:17.680912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675709+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:17.675709+0000","last_peered":"2022-08-10T17:36:17.675709+0000","last_clean":"2022-08-10T17:36:17.675709+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:17.675709+0000","last_undegraded":"2022-08-10T17:36:17.675709+0000","last_fullsized":"2022-08-10T17:36:17.675709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689677+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:36:17.689677+0000","last_peered":"2022-08-10T17:36:17.689677+0000","last_clean":"2022-08-10T17:36:17.689677+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:36:17.689677+0000","last_undegraded":"2022-08-10T17:36:17.689677+0000","last_fullsized":"2022-08-10T17:36:17.689677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676402+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:36:17.676402+0000","last_peered":"2022-08-10T17:36:17.676402+0000","last_clean":"2022-08-10T17:36:17.676402+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:36:17.676402+0000","last_undegraded":"2022-08-10T17:36:17.676402+0000","last_fullsized":"2022-08-10T17:36:17.676402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690229+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:36:17.690229+0000","last_peered":"2022-08-10T17:36:17.690229+0000","last_clean":"2022-08-10T17:36:17.690229+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:36:17.690229+0000","last_undegraded":"2022-08-10T17:36:17.690229+0000","last_fullsized":"2022-08-10T17:36:17.690229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690057+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:36:17.690057+0000","last_peered":"2022-08-10T17:36:17.690057+0000","last_clean":"2022-08-10T17:36:17.690057+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:36:17.690057+0000","last_undegraded":"2022-08-10T17:36:17.690057+0000","last_fullsized":"2022-08-10T17:36:17.690057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673777+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:36:17.673777+0000","last_peered":"2022-08-10T17:36:17.673777+0000","last_clean":"2022-08-10T17:36:17.673777+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:36:17.673777+0000","last_undegraded":"2022-08-10T17:36:17.673777+0000","last_fullsized":"2022-08-10T17:36:17.673777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676303+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:17.676303+0000","last_peered":"2022-08-10T17:36:17.676303+0000","last_clean":"2022-08-10T17:36:17.676303+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:17.676303+0000","last_undegraded":"2022-08-10T17:36:17.676303+0000","last_fullsized":"2022-08-10T17:36:17.676303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690394+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:36:17.690394+0000","last_peered":"2022-08-10T17:36:17.690394+0000","last_clean":"2022-08-10T17:36:17.690394+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:36:17.690394+0000","last_undegraded":"2022-08-10T17:36:17.690394+0000","last_fullsized":"2022-08-10T17:36:17.690394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4531,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9304,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362536,"statfs":{"total":96636764160,"available":96627236864,"internally_reserved":0,"allocated":409600,"data_stored":728023,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.371}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.501},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.436},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.502}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.374}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.247},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35499999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76300000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":385024,"data_stored":724624,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.307}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.435},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.5}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.376},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42499999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.497},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8704,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363136,"statfs":{"total":96636764160,"available":96627851264,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.23100000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.318}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67800000000000005}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8784,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363056,"statfs":{"total":96636764160,"available":96627769344,"internally_reserved":0,"allocated":335872,"data_stored":137495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.378}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":134326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.437},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:37:56.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:37:57.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.059+0000 7f4066064700 1 Processor -- start 2022-08-10T17:37:57.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.059+0000 7f4066064700 1 -- start start 2022-08-10T17:37:57.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f4066064700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f40600c7220 0x7f40600c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f4066064700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40600c25c0 0x7f406006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f4066064700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40600c2a60 con 0x7f40600c4d90 2022-08-10T17:37:57.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f4066064700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600c5e10 con 0x7f40600c25c0 2022-08-10T17:37:57.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f4066064700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600c1c30 con 0x7f40600c7220 2022-08-10T17:37:57.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40600c25c0 0x7f406006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40600c25c0 0x7f406006fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57974/0 (socket says 172.21.15.150:57974) 2022-08-10T17:37:57.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 -- 172.21.15.150:0/3620081417 learned_addr learned my addr 172.21.15.150:0/3620081417 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:57.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405f7fe700 1 --1- 172.21.15.150:0/3620081417 >> v1:172.21.15.150:6789/0 conn(0x7f40600c4d90 0x7f40600c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42418/0 (socket says 172.21.15.150:42418) 2022-08-10T17:37:57.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 -- 172.21.15.150:0/3620081417 >> v2:172.21.15.197:3300/0 conn(0x7f40600c7220 msgr2=0x7f40600c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:57.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 --2- 172.21.15.150:0/3620081417 >> v2:172.21.15.197:3300/0 conn(0x7f40600c7220 0x7f40600c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 -- 172.21.15.150:0/3620081417 >> v1:172.21.15.150:6789/0 conn(0x7f40600c4d90 legacy=0x7f40600c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 -- 172.21.15.150:0/3620081417 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600699c0 con 0x7f40600c25c0 2022-08-10T17:37:57.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405e7fc700 1 -- 172.21.15.150:0/3620081417 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662580661 0 0) 0x7f40600c2a60 con 0x7f40600c4d90 2022-08-10T17:37:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405ffff700 1 --2- 172.21.15.150:0/3620081417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c25c0 0x7f406006fca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40600afcf0 tx=0x7f4050009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b92e18ac214538 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405e7fc700 1 -- 172.21.15.150:0/3620081417 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050004230 con 0x7f40600c25c0 2022-08-10T17:37:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405e7fc700 1 -- 172.21.15.150:0/3620081417 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050004390 con 0x7f40600c25c0 2022-08-10T17:37:57.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.060+0000 7f405e7fc700 1 -- 172.21.15.150:0/3620081417 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011830 con 0x7f40600c25c0 2022-08-10T17:37:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 -- 172.21.15.150:0/3620081417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c25c0 msgr2=0x7f406006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 --2- 172.21.15.150:0/3620081417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c25c0 0x7f406006fca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40600afcf0 tx=0x7f4050009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 -- 172.21.15.150:0/3620081417 shutdown_connections 2022-08-10T17:37:57.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 --2- 172.21.15.150:0/3620081417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c25c0 0x7f406006fca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 --2- 172.21.15.150:0/3620081417 >> v2:172.21.15.197:3300/0 conn(0x7f40600c7220 0x7f40600c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 -- 172.21.15.150:0/3620081417 >> 172.21.15.150:0/3620081417 conn(0x7f406006d0d0 msgr2=0x7f40600c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:57.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 -- 172.21.15.150:0/3620081417 shutdown_connections 2022-08-10T17:37:57.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.061+0000 7f4066064700 1 -- 172.21.15.150:0/3620081417 wait complete. 2022-08-10T17:37:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.063+0000 7f4066064700 1 Processor -- start 2022-08-10T17:37:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.063+0000 7f4066064700 1 -- start start 2022-08-10T17:37:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 0x7f406014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40600c7220 0x7f40601dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601dd210 con 0x7f40600c4d90 2022-08-10T17:37:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601eccc0 con 0x7f40600c25c0 2022-08-10T17:37:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40601d9e80 con 0x7f40600c7220 2022-08-10T17:37:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57978/0 (socket says 172.21.15.150:57978) 2022-08-10T17:37:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 -- 172.21.15.150:0/2475788576 learned_addr learned my addr 172.21.15.150:0/2475788576 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405f7fe700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 0x7f406014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405ffff700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40600c7220 0x7f40601dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 -- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40600c7220 msgr2=0x7f40601dbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40600c7220 0x7f40601dbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 -- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 msgr2=0x7f406014ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 0x7f406014ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 -- 172.21.15.150:0/2475788576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500093e0 con 0x7f40600c4d90 2022-08-10T17:37:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405f7fe700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 0x7f406014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f405effd700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f404800b410 tx=0x7f404800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048011830 con 0x7f40600c4d90 2022-08-10T17:37:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4048011990 con 0x7f40600c4d90 2022-08-10T17:37:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601db470 con 0x7f40600c4d90 2022-08-10T17:37:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048011d40 con 0x7f40600c4d90 2022-08-10T17:37:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.064+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601d98c0 con 0x7f40600c4d90 2022-08-10T17:37:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.065+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406006df80 con 0x7f40600c4d90 2022-08-10T17:37:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.066+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4048021070 con 0x7f40600c4d90 2022-08-10T17:37:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.066+0000 7f4057fff700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 0x7f4044067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.066+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f40480820a0 con 0x7f40600c4d90 2022-08-10T17:37:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.066+0000 7f405f7fe700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 0x7f4044067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.067+0000 7f405f7fe700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 0x7f4044067560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.070+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4048050020 con 0x7f40600c4d90 2022-08-10T17:37:57.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.244+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4060072890 con 0x7f40440650b0 2022-08-10T17:37:57.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.255+0000 7f4057fff700 1 -- 172.21.15.150:0/2475788576 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392417 (secure 0 0 0) 0x7f4060072890 con 0x7f40440650b0 2022-08-10T17:37:57.264 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:57.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 msgr2=0x7f4044067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 0x7f4044067560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007ea0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 msgr2=0x7f406014f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f404800b410 tx=0x7f404800b7d0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 shutdown_connections 2022-08-10T17:37:57.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40440650b0 0x7f4044067560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40600c7220 0x7f40601dbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f40600c25c0 0x7f406014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 --2- 172.21.15.150:0/2475788576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40600c4d90 0x7f406014f2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 >> 172.21.15.150:0/2475788576 conn(0x7f406006d0d0 msgr2=0x7f40600bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:57.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 shutdown_connections 2022-08-10T17:37:57.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.259+0000 7f4066064700 1 -- 172.21.15.150:0/2475788576 wait complete. 2022-08-10T17:37:57.270 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:37:57.274 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2022-08-10T17:37:55.247042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594899,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70688,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754904032,"statfs":{"total":773094113280,"available":773021728768,"internally_reserved":0,"allocated":2719744,"data_stored":2259318,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2201,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674245+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:36:17.674245+0000","last_peered":"2022-08-10T17:36:17.674245+0000","last_clean":"2022-08-10T17:36:17.674245+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:36:17.674245+0000","last_undegraded":"2022-08-10T17:36:17.674245+0000","last_fullsized":"2022-08-10T17:36:17.674245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680953+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:36:17.680953+0000","last_peered":"2022-08-10T17:36:17.680953+0000","last_clean":"2022-08-10T17:36:17.680953+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:36:17.680953+0000","last_undegraded":"2022-08-10T17:36:17.680953+0000","last_fullsized":"2022-08-10T17:36:17.680953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675981+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:17.675981+0000","last_peered":"2022-08-10T17:36:17.675981+0000","last_clean":"2022-08-10T17:36:17.675981+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:17.675981+0000","last_undegraded":"2022-08-10T17:36:17.675981+0000","last_fullsized":"2022-08-10T17:36:17.675981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690304+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:36:17.690304+0000","last_peered":"2022-08-10T17:36:17.690304+0000","last_clean":"2022-08-10T17:36:17.690304+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:36:17.690304+0000","last_undegraded":"2022-08-10T17:36:17.690304+0000","last_fullsized":"2022-08-10T17:36:17.690304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673965+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:36:17.673965+0000","last_peered":"2022-08-10T17:36:17.673965+0000","last_clean":"2022-08-10T17:36:17.673965+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:36:17.673965+0000","last_undegraded":"2022-08-10T17:36:17.673965+0000","last_fullsized":"2022-08-10T17:36:17.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'3","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690924+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:17.690924+0000","last_peered":"2022-08-10T17:36:17.690924+0000","last_clean":"2022-08-10T17:36:17.690924+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:17.690924+0000","last_undegraded":"2022-08-10T17:36:17.690924+0000","last_fullsized":"2022-08-10T17:36:17.690924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:50.505566+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:50.505566+0000","last_peered":"2022-08-10T17:37:50.505566+0000","last_clean":"2022-08-10T17:37:50.505566+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:50.505566+0000","last_undegraded":"2022-08-10T17:37:50.505566+0000","last_fullsized":"2022-08-10T17:37:50.505566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690616+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:36:17.690616+0000","last_peered":"2022-08-10T17:36:17.690616+0000","last_clean":"2022-08-10T17:36:17.690616+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:36:17.690616+0000","last_undegraded":"2022-08-10T17:36:17.690616+0000","last_fullsized":"2022-08-10T17:36:17.690616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689763+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:36:17.689763+0000","last_peered":"2022-08-10T17:36:17.689763+0000","last_clean":"2022-08-10T17:36:17.689763+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:36:17.689763+0000","last_undegraded":"2022-08-10T17:36:17.689763+0000","last_fullsized":"2022-08-10T17:36:17.689763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690205+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:36:17.690205+0000","last_peered":"2022-08-10T17:36:17.690205+0000","last_clean":"2022-08-10T17:36:17.690205+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:36:17.690205+0000","last_undegraded":"2022-08-10T17:36:17.690205+0000","last_fullsized":"2022-08-10T17:36:17.690205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'8","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689854+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:36:17.689854+0000","last_peered":"2022-08-10T17:36:17.689854+0000","last_clean":"2022-08-10T17:36:17.689854+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:36:17.689854+0000","last_undegraded":"2022-08-10T17:36:17.689854+0000","last_fullsized":"2022-08-10T17:36:17.689854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690766+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:17.690766+0000","last_peered":"2022-08-10T17:36:17.690766+0000","last_clean":"2022-08-10T17:36:17.690766+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:17.690766+0000","last_undegraded":"2022-08-10T17:36:17.690766+0000","last_fullsized":"2022-08-10T17:36:17.690766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674011+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:36:17.674011+0000","last_peered":"2022-08-10T17:36:17.674011+0000","last_clean":"2022-08-10T17:36:17.674011+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:36:17.674011+0000","last_undegraded":"2022-08-10T17:36:17.674011+0000","last_fullsized":"2022-08-10T17:36:17.674011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675758+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:36:17.675758+0000","last_peered":"2022-08-10T17:36:17.675758+0000","last_clean":"2022-08-10T17:36:17.675758+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:36:17.675758+0000","last_undegraded":"2022-08-10T17:36:17.675758+0000","last_fullsized":"2022-08-10T17:36:17.675758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690719+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:17.690719+0000","last_peered":"2022-08-10T17:36:17.690719+0000","last_clean":"2022-08-10T17:36:17.690719+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:17.690719+0000","last_undegraded":"2022-08-10T17:36:17.690719+0000","last_fullsized":"2022-08-10T17:36:17.690719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673450+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:36:17.673450+0000","last_peered":"2022-08-10T17:36:17.673450+0000","last_clean":"2022-08-10T17:36:17.673450+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:36:17.673450+0000","last_undegraded":"2022-08-10T17:36:17.673450+0000","last_fullsized":"2022-08-10T17:36:17.673450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675875+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:36:17.675875+0000","last_peered":"2022-08-10T17:36:17.675875+0000","last_clean":"2022-08-10T17:36:17.675875+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:36:17.675875+0000","last_undegraded":"2022-08-10T17:36:17.675875+0000","last_fullsized":"2022-08-10T17:36:17.675875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673917+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:17.673917+0000","last_peered":"2022-08-10T17:36:17.673917+0000","last_clean":"2022-08-10T17:36:17.673917+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:17.673917+0000","last_undegraded":"2022-08-10T17:36:17.673917+0000","last_fullsized":"2022-08-10T17:36:17.673917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674586+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:36:17.674586+0000","last_peered":"2022-08-10T17:36:17.674586+0000","last_clean":"2022-08-10T17:36:17.674586+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:36:17.674586+0000","last_undegraded":"2022-08-10T17:36:17.674586+0000","last_fullsized":"2022-08-10T17:36:17.674586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680912+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:36:17.680912+0000","last_peered":"2022-08-10T17:36:17.680912+0000","last_clean":"2022-08-10T17:36:17.680912+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:36:17.680912+0000","last_undegraded":"2022-08-10T17:36:17.680912+0000","last_fullsized":"2022-08-10T17:36:17.680912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675709+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:17.675709+0000","last_peered":"2022-08-10T17:36:17.675709+0000","last_clean":"2022-08-10T17:36:17.675709+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:17.675709+0000","last_undegraded":"2022-08-10T17:36:17.675709+0000","last_fullsized":"2022-08-10T17:36:17.675709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689677+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:36:17.689677+0000","last_peered":"2022-08-10T17:36:17.689677+0000","last_clean":"2022-08-10T17:36:17.689677+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:36:17.689677+0000","last_undegraded":"2022-08-10T17:36:17.689677+0000","last_fullsized":"2022-08-10T17:36:17.689677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676402+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:36:17.676402+0000","last_peered":"2022-08-10T17:36:17.676402+0000","last_clean":"2022-08-10T17:36:17.676402+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:36:17.676402+0000","last_undegraded":"2022-08-10T17:36:17.676402+0000","last_fullsized":"2022-08-10T17:36:17.676402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690229+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:36:17.690229+0000","last_peered":"2022-08-10T17:36:17.690229+0000","last_clean":"2022-08-10T17:36:17.690229+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:36:17.690229+0000","last_undegraded":"2022-08-10T17:36:17.690229+0000","last_fullsized":"2022-08-10T17:36:17.690229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690057+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:36:17.690057+0000","last_peered":"2022-08-10T17:36:17.690057+0000","last_clean":"2022-08-10T17:36:17.690057+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:36:17.690057+0000","last_undegraded":"2022-08-10T17:36:17.690057+0000","last_fullsized":"2022-08-10T17:36:17.690057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673777+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:36:17.673777+0000","last_peered":"2022-08-10T17:36:17.673777+0000","last_clean":"2022-08-10T17:36:17.673777+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:36:17.673777+0000","last_undegraded":"2022-08-10T17:36:17.673777+0000","last_fullsized":"2022-08-10T17:36:17.673777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676303+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:17.676303+0000","last_peered":"2022-08-10T17:36:17.676303+0000","last_clean":"2022-08-10T17:36:17.676303+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:17.676303+0000","last_undegraded":"2022-08-10T17:36:17.676303+0000","last_fullsized":"2022-08-10T17:36:17.676303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690394+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:36:17.690394+0000","last_peered":"2022-08-10T17:36:17.690394+0000","last_clean":"2022-08-10T17:36:17.690394+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:36:17.690394+0000","last_undegraded":"2022-08-10T17:36:17.690394+0000","last_fullsized":"2022-08-10T17:36:17.690394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4531,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9304,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362536,"statfs":{"total":96636764160,"available":96627236864,"internally_reserved":0,"allocated":409600,"data_stored":728023,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.371}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.501},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.436},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.502}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.374}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.247},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35499999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76300000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":385024,"data_stored":724624,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.307}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.435},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.5}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.376},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42499999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.497},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8704,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363136,"statfs":{"total":96636764160,"available":96627851264,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.23100000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.318}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67800000000000005}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8784,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363056,"statfs":{"total":96636764160,"available":96627769344,"internally_reserved":0,"allocated":335872,"data_stored":137495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.378}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":134326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.437},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:37:57.283 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-08-10T17:37:57.283 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-08-10T17:37:57.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-08-10T17:37:57.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-08-10T17:37:57.285 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-08-10T17:37:57.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.430+0000 7fb059949700 1 Processor -- start 2022-08-10T17:37:57.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.430+0000 7fb059949700 1 -- start start 2022-08-10T17:37:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb059949700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 0x7fb05415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb059949700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05415b060 con 0x7fb0540c5860 2022-08-10T17:37:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb059949700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054156c00 con 0x7fb0540c1250 2022-08-10T17:37:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb059949700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb054157b00 con 0x7fb0540c0e80 2022-08-10T17:37:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb0537fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb0540c5860 0x7fb0540c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42432/0 (socket says 172.21.15.150:42432) 2022-08-10T17:37:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb0537fe700 1 -- 172.21.15.150:0/1454476525 learned_addr learned my addr 172.21.15.150:0/1454476525 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb052ffd700 1 --2- 172.21.15.150:0/1454476525 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 0x7fb05415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.431+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263553996 0 0) 0x7fb05415b060 con 0x7fb0540c5860 2022-08-10T17:37:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb040003430 con 0x7fb0540c5860 2022-08-10T17:37:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938521961 0 0) 0x7fb054156c00 con 0x7fb0540c1250 2022-08-10T17:37:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb05415b060 con 0x7fb0540c1250 2022-08-10T17:37:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb052ffd700 1 -- 172.21.15.150:0/1454476525 >> v1:172.21.15.197:6789/0 conn(0x7fb0540c1250 legacy=0x7fb0540c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb052ffd700 1 -- 172.21.15.150:0/1454476525 >> v1:172.21.15.150:6789/0 conn(0x7fb0540c5860 legacy=0x7fb0540c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2069596485 0 0) 0x7fb040003430 con 0x7fb0540c5860 2022-08-10T17:37:57.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb052ffd700 1 -- 172.21.15.150:0/1454476525 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054156e80 con 0x7fb0540c0e80 2022-08-10T17:37:57.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb052ffd700 1 --2- 172.21.15.150:0/1454476525 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 0x7fb05415ab20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0480096e0 tx=0x7fb0480099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7648a2dd5c8f923 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0019f0 con 0x7fb0540c0e80 2022-08-10T17:37:57.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048004030 con 0x7fb0540c0e80 2022-08-10T17:37:57.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.432+0000 7fb051ffb700 1 -- 172.21.15.150:0/1454476525 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480043a0 con 0x7fb0540c0e80 2022-08-10T17:37:57.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 -- 172.21.15.150:0/1454476525 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 msgr2=0x7fb05415ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 --2- 172.21.15.150:0/1454476525 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 0x7fb05415ab20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0480096e0 tx=0x7fb0480099f0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 -- 172.21.15.150:0/1454476525 shutdown_connections 2022-08-10T17:37:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 --2- 172.21.15.150:0/1454476525 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c0e80 0x7fb05415ab20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 -- 172.21.15.150:0/1454476525 >> 172.21.15.150:0/1454476525 conn(0x7fb05406fae0 msgr2=0x7fb05406fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 -- 172.21.15.150:0/1454476525 shutdown_connections 2022-08-10T17:37:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.433+0000 7fb059949700 1 -- 172.21.15.150:0/1454476525 wait complete. 2022-08-10T17:37:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.434+0000 7fb059949700 1 Processor -- start 2022-08-10T17:37:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.434+0000 7fb059949700 1 -- start start 2022-08-10T17:37:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 0x7fb0540add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 0x7fb054154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540ad340 con 0x7fb05406b160 2022-08-10T17:37:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054154a90 con 0x7fb0540c0e80 2022-08-10T17:37:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb059949700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541ec0d0 con 0x7fb0540c5860 2022-08-10T17:37:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb0537fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.435+0000 7fb0537fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57992/0 (socket says 172.21.15.150:57992) 2022-08-10T17:37:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 0x7fb0540add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb0537fe700 1 -- 172.21.15.150:0/3376562937 learned_addr learned my addr 172.21.15.150:0/3376562937 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb0527fc700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 0x7fb054154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 -- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 msgr2=0x7fb054154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 0x7fb054154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 -- 172.21.15.150:0/3376562937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 msgr2=0x7fb0541ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 -- 172.21.15.150:0/3376562937 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048009310 con 0x7fb0540c0e80 2022-08-10T17:37:57.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb0527fc700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 0x7fb054154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:57.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb0537fe700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:37:57.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb052ffd700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 0x7fb0540add30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb05406e360 tx=0x7fb0480045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048003520 con 0x7fb0540c0e80 2022-08-10T17:37:57.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048003680 con 0x7fb0540c0e80 2022-08-10T17:37:57.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05406acd0 con 0x7fb0540c0e80 2022-08-10T17:37:57.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.436+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048003a30 con 0x7fb0540c0e80 2022-08-10T17:37:57.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.437+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05406a3a0 con 0x7fb0540c0e80 2022-08-10T17:37:57.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.437+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05406b6f0 con 0x7fb0540c0e80 2022-08-10T17:37:57.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.438+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb04802c070 con 0x7fb0540c0e80 2022-08-10T17:37:57.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.438+0000 7fb03bfff700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 0x7fb034067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.439+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb048083380 con 0x7fb0540c0e80 2022-08-10T17:37:57.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.439+0000 7fb0527fc700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 0x7fb034067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.440+0000 7fb0527fc700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 0x7fb034067560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0440011e0 tx=0x7fb044009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.444+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb048051360 con 0x7fb0540c0e80 2022-08-10T17:37:57.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.677+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb054072890 con 0x7fb0540c0e80 2022-08-10T17:37:57.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.680+0000 7fb03bfff700 1 -- 172.21.15.150:0/3376562937 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+160923 (secure 0 0 0) 0x7fb04802a090 con 0x7fb0540c0e80 2022-08-10T17:37:57.686 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:57.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 msgr2=0x7fb034067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 0x7fb034067560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0440011e0 tx=0x7fb044009040 comp rx=0 tx=0).stop 2022-08-10T17:37:57.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 msgr2=0x7fb0540add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 0x7fb0540add30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb05406e360 tx=0x7fb0480045d0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 shutdown_connections 2022-08-10T17:37:57.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb05406b160 0x7fb0541ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb0540c0e80 0x7fb0540add30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb0340650b0 0x7fb034067560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 --2- 172.21.15.150:0/3376562937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb0540c5860 0x7fb054154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.682+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 >> 172.21.15.150:0/3376562937 conn(0x7fb05406fae0 msgr2=0x7fb0541e07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:57.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.683+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 shutdown_connections 2022-08-10T17:37:57.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.683+0000 7fb059949700 1 -- 172.21.15.150:0/3376562937 wait complete. 2022-08-10T17:37:57.698 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6832","nonce":97455},{"type":"v1","addr":"172.21.15.197:6833","nonce":97455}]},"active_addr":"172.21.15.197:6833/97455","active_change":"2022-08-10T17:35:17.196891+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":1064726455}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":3086192973}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":3355813744}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":2102441768}]}]}} 2022-08-10T17:37:57.784 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-08-10T17:37:57.785 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-08-10T17:37:57.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:37:57.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.904+0000 7f5a4d0a9700 1 Processor -- start 2022-08-10T17:37:57.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.904+0000 7f5a4d0a9700 1 -- start start 2022-08-10T17:37:57.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4d0a9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f5a4815a570 0x7f5a480c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4d0a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480c4dc0 con 0x7f5a4806c860 2022-08-10T17:37:57.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4d0a9700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480c5940 con 0x7f5a48150af0 2022-08-10T17:37:57.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4d0a9700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480c9fc0 con 0x7f5a4815a570 2022-08-10T17:37:57.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4659c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5a4806c860 0x7f5a480c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42448/0 (socket says 172.21.15.150:42448) 2022-08-10T17:37:57.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4659c700 1 -- 172.21.15.150:0/28965431 learned_addr learned my addr 172.21.15.150:0/28965431 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:57.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a4759e700 1 --2- 172.21.15.150:0/28965431 >> v2:172.21.15.197:3300/0 conn(0x7f5a4815a570 0x7f5a480c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.905+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843360524 0 0) 0x7f5a480c4dc0 con 0x7f5a4806c860 2022-08-10T17:37:57.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a34003430 con 0x7f5a4806c860 2022-08-10T17:37:57.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481125403 0 0) 0x7f5a34003430 con 0x7f5a4806c860 2022-08-10T17:37:57.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 >> v2:172.21.15.197:3300/0 conn(0x7f5a4815a570 msgr2=0x7f5a480c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:57.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 --2- 172.21.15.150:0/28965431 >> v2:172.21.15.197:3300/0 conn(0x7f5a4815a570 0x7f5a480c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 >> v1:172.21.15.197:6789/0 conn(0x7f5a48150af0 legacy=0x7f5a48159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4806f9a0 con 0x7f5a4806c860 2022-08-10T17:37:57.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5a38001670 con 0x7f5a4806c860 2022-08-10T17:37:57.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 >> v1:172.21.15.150:6789/0 conn(0x7f5a4806c860 legacy=0x7f5a480c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 0x7f5a34003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a340046d0 0x7f5a34004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34005080 0x7f5a3400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c9fc0 con 0x7f5a34003880 2022-08-10T17:37:57.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3400bf90 con 0x7f5a340046d0 2022-08-10T17:37:57.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3400c150 con 0x7f5a34005080 2022-08-10T17:37:57.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 0x7f5a34003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a4659c700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a340046d0 0x7f5a34004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a4759e700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34005080 0x7f5a3400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 -- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34005080 msgr2=0x7f5a3400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:57.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34005080 0x7f5a3400b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 -- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a340046d0 msgr2=0x7f5a34004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:57.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a340046d0 0x7f5a34004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 -- 172.21.15.150:0/28965431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34003430 con 0x7f5a34003880 2022-08-10T17:37:57.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a4759e700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34005080 0x7f5a3400b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a4759e700 1 -- 172.21.15.150:0/28965431 reap_dead start 2022-08-10T17:37:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.906+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 0x7f5a34003c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c001640 tx=0x7f5a34005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a854494249dcacee server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0052d0 con 0x7f5a34003880 2022-08-10T17:37:57.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c003500 con 0x7f5a34003880 2022-08-10T17:37:57.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a45d9b700 1 -- 172.21.15.150:0/28965431 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0038b0 con 0x7f5a34003880 2022-08-10T17:37:57.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 msgr2=0x7f5a34003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 0x7f5a34003c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c001640 tx=0x7f5a34005700 comp rx=0 tx=0).stop 2022-08-10T17:37:57.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/28965431 shutdown_connections 2022-08-10T17:37:57.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/28965431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a34003880 0x7f5a34003c90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/28965431 >> 172.21.15.150:0/28965431 conn(0x7f5a480c92f0 msgr2=0x7f5a480c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:57.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/28965431 shutdown_connections 2022-08-10T17:37:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.907+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/28965431 wait complete. 2022-08-10T17:37:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 Processor -- start 2022-08-10T17:37:57.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 -- start start 2022-08-10T17:37:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 0x7f5a481f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 0x7f5a48154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481efc60 con 0x7f5a48154580 2022-08-10T17:37:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480bfae0 con 0x7f5a481556c0 2022-08-10T17:37:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4d0a9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481f05c0 con 0x7f5a34003880 2022-08-10T17:37:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58012/0 (socket says 172.21.15.150:58012) 2022-08-10T17:37:57.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.909+0000 7f5a4659c700 1 -- 172.21.15.150:0/2292798897 learned_addr learned my addr 172.21.15.150:0/2292798897 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:57.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 0x7f5a481f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4759e700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 0x7f5a48154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 -- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 msgr2=0x7f5a481f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 0x7f5a481f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 -- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 msgr2=0x7f5a48154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:57.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 0x7f5a48154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:57.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 -- 172.21.15.150:0/2292798897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a481ef630 con 0x7f5a48154580 2022-08-10T17:37:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 0x7f5a481f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4759e700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 0x7f5a48154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4659c700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5a380049b0 tx=0x7f5a38004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380015d0 con 0x7f5a48154580 2022-08-10T17:37:57.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38004e90 con 0x7f5a48154580 2022-08-10T17:37:57.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a481ed050 con 0x7f5a48154580 2022-08-10T17:37:57.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800fa90 con 0x7f5a48154580 2022-08-10T17:37:57.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.910+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a48159e10 con 0x7f5a48154580 2022-08-10T17:37:57.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.911+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480c39a0 con 0x7f5a48154580 2022-08-10T17:37:57.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.911+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5a3800fbf0 con 0x7f5a48154580 2022-08-10T17:37:57.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.912+0000 7f5a2f7fe700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 0x7f5a28067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:57.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.912+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5a380818c0 con 0x7f5a48154580 2022-08-10T17:37:57.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.912+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 0x7f5a28067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.912+0000 7f5a46d9d700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 0x7f5a28067590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c014040 tx=0x7f5a3c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:57.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:57.916+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5a3804f840 con 0x7f5a48154580 2022-08-10T17:37:58.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.095+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a48072890 con 0x7f5a48154580 2022-08-10T17:37:58.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.096+0000 7f5a2f7fe700 1 -- 172.21.15.150:0/2292798897 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7f5a38052e60 con 0x7f5a48154580 2022-08-10T17:37:58.100 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:58.101 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:37:58.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 msgr2=0x7f5a28067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 0x7f5a28067590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c014040 tx=0x7f5a3c009030 comp rx=0 tx=0).stop 2022-08-10T17:37:58.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 msgr2=0x7f5a481ecb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5a380049b0 tx=0x7f5a38004d70 comp rx=0 tx=0).stop 2022-08-10T17:37:58.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 shutdown_connections 2022-08-10T17:37:58.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a481556c0 0x7f5a48154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5a280650e0 0x7f5a28067590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a34003880 0x7f5a481f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 --2- 172.21.15.150:0/2292798897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a48154580 0x7f5a481ecb10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 >> 172.21.15.150:0/2292798897 conn(0x7f5a480c92f0 msgr2=0x7f5a48064000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 shutdown_connections 2022-08-10T17:37:58.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.098+0000 7f5a4d0a9700 1 -- 172.21.15.150:0/2292798897 wait complete. 2022-08-10T17:37:58.114 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-08-10T17:37:58.115 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:37:58.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.231+0000 7f7cfc77a700 1 Processor -- start 2022-08-10T17:37:58.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.231+0000 7f7cfc77a700 1 -- start start 2022-08-10T17:37:58.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfc77a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cf4068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfc77a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40c6100 con 0x7f7cf41540f0 2022-08-10T17:37:58.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfc77a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40c5e00 con 0x7f7cf40bd4b0 2022-08-10T17:37:58.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfc77a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c5270 con 0x7f7cf41544c0 2022-08-10T17:37:58.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfa516700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7cf41540f0 0x7f7cf4071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42466/0 (socket says 172.21.15.150:42466) 2022-08-10T17:37:58.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfa516700 1 -- 172.21.15.150:0/2093865817 learned_addr learned my addr 172.21.15.150:0/2093865817 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:58.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9d15700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cf4068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999795471 0 0) 0x7f7cf40c6100 con 0x7f7cf41540f0 2022-08-10T17:37:58.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cdc003430 con 0x7f7cf41540f0 2022-08-10T17:37:58.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734078415 0 0) 0x7f7cdc003430 con 0x7f7cf41540f0 2022-08-10T17:37:58.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 msgr2=0x7f7cf4068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cf4068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 >> v1:172.21.15.197:6789/0 conn(0x7f7cf40bd4b0 legacy=0x7f7cf4161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf406eb00 con 0x7f7cf41540f0 2022-08-10T17:37:58.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f7ce4001670 con 0x7f7cf41540f0 2022-08-10T17:37:58.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 >> v1:172.21.15.150:6789/0 conn(0x7f7cf41540f0 legacy=0x7f7cf4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc0038b0 0x7f7cdc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cdc0046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc004c10 0x7f7cdc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c5270 con 0x7f7cdc0038b0 2022-08-10T17:37:58.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc00b9a0 con 0x7f7cdc004c10 2022-08-10T17:37:58.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc00bb60 con 0x7f7cf41544c0 2022-08-10T17:37:58.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.232+0000 7f7cfa516700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc0038b0 0x7f7cdc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cf9d15700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cdc0046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfad17700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc004c10 0x7f7cdc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 -- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 msgr2=0x7f7cdc0046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41544c0 0x7f7cdc0046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 -- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc004c10 msgr2=0x7f7cdc005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc004c10 0x7f7cdc005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 -- 172.21.15.150:0/2093865817 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc003430 con 0x7f7cdc0038b0 2022-08-10T17:37:58.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfa516700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc0038b0 0x7f7cdc003cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4007fd0 tx=0x7f7cdc005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f66bae4059353f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4007a90 con 0x7f7cdc0038b0 2022-08-10T17:37:58.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400cc70 con 0x7f7cdc0038b0 2022-08-10T17:37:58.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cf9514700 1 -- 172.21.15.150:0/2093865817 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40070d0 con 0x7f7cdc0038b0 2022-08-10T17:37:58.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfc77a700 1 -- 172.21.15.150:0/2093865817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc0038b0 msgr2=0x7f7cdc003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.233+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/2093865817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc0038b0 0x7f7cdc003cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4007fd0 tx=0x7f7cdc005700 comp rx=0 tx=0).stop 2022-08-10T17:37:58.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.234+0000 7f7cfad17700 1 -- 172.21.15.150:0/2093865817 reap_dead start 2022-08-10T17:37:58.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.234+0000 7f7cfc77a700 1 -- 172.21.15.150:0/2093865817 shutdown_connections 2022-08-10T17:37:58.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.234+0000 7f7cfc77a700 1 -- 172.21.15.150:0/2093865817 >> 172.21.15.150:0/2093865817 conn(0x7f7cf406d0d0 msgr2=0x7f7cf40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.234+0000 7f7cfc77a700 1 -- 172.21.15.150:0/2093865817 shutdown_connections 2022-08-10T17:37:58.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.234+0000 7f7cfc77a700 1 -- 172.21.15.150:0/2093865817 wait complete. 2022-08-10T17:37:58.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.235+0000 7f7cfc77a700 1 Processor -- start 2022-08-10T17:37:58.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.235+0000 7f7cfc77a700 1 -- start start 2022-08-10T17:37:58.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.235+0000 7f7cfc77a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc0038b0 0x7f7cf40c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.235+0000 7f7cfc77a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 0x7f7cf414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c8490 con 0x7f7cf415aaf0 2022-08-10T17:37:58.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c9f90 con 0x7f7cdc0038b0 2022-08-10T17:37:58.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf415a480 con 0x7f7cf41e1040 2022-08-10T17:37:58.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58030/0 (socket says 172.21.15.150:58030) 2022-08-10T17:37:58.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 -- 172.21.15.150:0/3766298811 learned_addr learned my addr 172.21.15.150:0/3766298811 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfa516700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc0038b0 0x7f7cf40c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfad17700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 0x7f7cf414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 -- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 msgr2=0x7f7cf414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 0x7f7cf414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 -- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc0038b0 msgr2=0x7f7cf40c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc0038b0 0x7f7cf40c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 -- 172.21.15.150:0/3766298811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40c7a70 con 0x7f7cf415aaf0 2022-08-10T17:37:58.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfad17700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 0x7f7cf414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:58.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cf9d15700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0011960 tx=0x7f7cf0011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011e50 con 0x7f7cf415aaf0 2022-08-10T17:37:58.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000f940 con 0x7f7cf415aaf0 2022-08-10T17:37:58.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000fcd0 con 0x7f7cf415aaf0 2022-08-10T17:37:58.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf40c7d50 con 0x7f7cf415aaf0 2022-08-10T17:37:58.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.236+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40c8150 con 0x7f7cf415aaf0 2022-08-10T17:37:58.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.237+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4072890 con 0x7f7cf415aaf0 2022-08-10T17:37:58.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.238+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7cf0014440 con 0x7f7cf415aaf0 2022-08-10T17:37:58.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.238+0000 7f7ce2ffd700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 0x7f7cd4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.238+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7cf0082910 con 0x7f7cf415aaf0 2022-08-10T17:37:58.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.238+0000 7f7cfa516700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 0x7f7cd4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.239+0000 7f7cfa516700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 0x7f7cd4067590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4000c00 tx=0x7f7ce4007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.242+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7cf0050950 con 0x7f7cf415aaf0 2022-08-10T17:37:58.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.419+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cf40c2a30 con 0x7f7cf415aaf0 2022-08-10T17:37:58.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.420+0000 7f7ce2ffd700 1 -- 172.21.15.150:0/3766298811 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7f7cf0053f70 con 0x7f7cf415aaf0 2022-08-10T17:37:58.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:37:58.425 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:37:58.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 msgr2=0x7f7cd4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 0x7f7cd4067590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4000c00 tx=0x7f7ce4007000 comp rx=0 tx=0).stop 2022-08-10T17:37:58.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 msgr2=0x7f7cf4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0011960 tx=0x7f7cf0011c70 comp rx=0 tx=0).stop 2022-08-10T17:37:58.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 shutdown_connections 2022-08-10T17:37:58.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7cd40650e0 0x7f7cd4067590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7cf41e1040 0x7f7cf414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7cdc0038b0 0x7f7cf40c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 --2- 172.21.15.150:0/3766298811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cf415aaf0 0x7f7cf4159b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 >> 172.21.15.150:0/3766298811 conn(0x7f7cf406d0d0 msgr2=0x7f7cf40c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 shutdown_connections 2022-08-10T17:37:58.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.422+0000 7f7cfc77a700 1 -- 172.21.15.150:0/3766298811 wait complete. 2022-08-10T17:37:58.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-08-10T17:37:58.439 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-08-10T17:37:58.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-08-10T17:37:58.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-08-10T17:37:58.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-08-10T17:37:58.442 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-08-10T17:37:58.442 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-08-10T17:37:58.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-08-10T17:37:58.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.645+0000 7f5120e7c700 1 Processor -- start 2022-08-10T17:37:58.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.645+0000 7f5120e7c700 1 -- start start 2022-08-10T17:37:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7f5120e7c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7f5120e7c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c070810 con 0x7f511c071550 2022-08-10T17:37:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7f5120e7c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0c7510 con 0x7f511c0c4420 2022-08-10T17:37:58.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7f5120e7c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c15e290 con 0x7f511c071920 2022-08-10T17:37:58.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7fd4f815d700 1 Processor -- start 2022-08-10T17:37:58.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7fd4f815d700 1 -- start start 2022-08-10T17:37:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44028/0 (socket says 172.21.15.150:44028) 2022-08-10T17:37:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 -- 172.21.15.150:0/1461956563 learned_addr learned my addr 172.21.15.150:0/1461956563 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.647+0000 7fd10fc8c700 1 Processor -- start 2022-08-10T17:37:58.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd10fc8c700 1 -- start start 2022-08-10T17:37:58.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 -- 172.21.15.150:0/1461956563 >> v1:172.21.15.197:6789/0 conn(0x7f511c0c4420 legacy=0x7f511c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 -- 172.21.15.150:0/1461956563 >> v1:172.21.15.150:6789/0 conn(0x7f511c071550 legacy=0x7f511c15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 -- 172.21.15.150:0/1461956563 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c15e570 con 0x7f511c071920 2022-08-10T17:37:58.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd4f815d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4f0070290 0x7fd4f006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd4f815d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd4f00c8990 0x7fd4f00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd4f815d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f00c9990 con 0x7fd4f00c26c0 2022-08-10T17:37:58.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd4f815d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f015b830 con 0x7fd4f0070290 2022-08-10T17:37:58.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7fd4f815d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f015af60 con 0x7fd4f00c8990 2022-08-10T17:37:58.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.648+0000 7f511ad9d700 1 --2- 172.21.15.150:0/1461956563 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f510c009780 tx=0x7f510c009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa1a7308b48d48c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10fc8c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10fc8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd10806a760 0x7fd1080c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10fc8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080c98f0 con 0x7fd10806dc90 2022-08-10T17:37:58.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10fc8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080c4880 con 0x7fd10806a760 2022-08-10T17:37:58.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10fc8c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080c4e20 con 0x7fd10814ce90 2022-08-10T17:37:58.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7f511959a700 1 -- 172.21.15.150:0/1461956563 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011830 con 0x7f511c071920 2022-08-10T17:37:58.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7f511959a700 1 -- 172.21.15.150:0/1461956563 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c011990 con 0x7f511c071920 2022-08-10T17:37:58.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7f511959a700 1 -- 172.21.15.150:0/1461956563 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011d20 con 0x7f511c071920 2022-08-10T17:37:58.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44038/0 (socket says 172.21.15.150:44038) 2022-08-10T17:37:58.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 -- 172.21.15.150:0/4232756631 learned_addr learned my addr 172.21.15.150:0/4232756631 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 -- 172.21.15.150:0/4232756631 >> v2:172.21.15.150:3300/0 conn(0x7fd10806a760 msgr2=0x7fd1080c3620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:58.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 --2- 172.21.15.150:0/4232756631 >> v2:172.21.15.150:3300/0 conn(0x7fd10806a760 0x7fd1080c3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.649+0000 7fd10da28700 1 -- 172.21.15.150:0/4232756631 >> v1:172.21.15.150:6789/0 conn(0x7fd10806dc90 legacy=0x7fd108069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7fd10da28700 1 -- 172.21.15.150:0/4232756631 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080c4b40 con 0x7fd10814ce90 2022-08-10T17:37:58.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7f5120e7c700 1 -- 172.21.15.150:0/1461956563 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 msgr2=0x7f511c0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7f5120e7c700 1 --2- 172.21.15.150:0/1461956563 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f510c009780 tx=0x7f510c009a90 comp rx=0 tx=0).stop 2022-08-10T17:37:58.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7fd4f66fa700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd4f00c8990 0x7fd4f00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7fd4f66fa700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd4f00c8990 0x7fd4f00c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40406/0 (socket says 172.21.15.150:40406) 2022-08-10T17:37:58.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.650+0000 7fd4f66fa700 1 -- 172.21.15.150:0/2399865289 learned_addr learned my addr 172.21.15.150:0/2399865289 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7f5120e7c700 1 -- 172.21.15.150:0/1461956563 shutdown_connections 2022-08-10T17:37:58.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7f5120e7c700 1 --2- 172.21.15.150:0/1461956563 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071920 0x7f511c0c6fd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7f5120e7c700 1 -- 172.21.15.150:0/1461956563 >> 172.21.15.150:0/1461956563 conn(0x7f511c06d0d0 msgr2=0x7f511c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7fd4f56f8700 1 --2- 172.21.15.150:0/2399865289 >> v2:172.21.15.150:3300/0 conn(0x7fd4f0070290 0x7fd4f006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd4f66fa700 1 -- 172.21.15.150:0/2399865289 >> v2:172.21.15.150:3300/0 conn(0x7fd4f0070290 msgr2=0x7fd4f006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd4f66fa700 1 --2- 172.21.15.150:0/2399865289 >> v2:172.21.15.150:3300/0 conn(0x7fd4f0070290 0x7fd4f006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd4f66fa700 1 -- 172.21.15.150:0/2399865289 >> v1:172.21.15.150:6789/0 conn(0x7fd4f00c26c0 legacy=0x7fd4f00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd4f66fa700 1 -- 172.21.15.150:0/2399865289 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00706f0 con 0x7fd4f00c8990 2022-08-10T17:37:58.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd4f66fa700 1 --2- 172.21.15.150:0/2399865289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f00c8990 0x7fd4f00c8dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00b9460 tx=0x7fd4e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45fd9f5383d91707 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7f5120e7c700 1 -- 172.21.15.150:0/1461956563 shutdown_connections 2022-08-10T17:37:58.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.651+0000 7f5120e7c700 1 -- 172.21.15.150:0/1461956563 wait complete. 2022-08-10T17:37:58.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5120e7c700 1 Processor -- start 2022-08-10T17:37:58.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fd10da28700 1 --2- 172.21.15.150:0/4232756631 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd10000d150 tx=0x7fd10000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7985da059f43dca2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7f5265ce5700 1 Processor -- start 2022-08-10T17:37:58.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7f5265ce5700 1 -- start start 2022-08-10T17:37:58.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5265ce5700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f52600c8af0 0x7f52600c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5265ce5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526006e070 con 0x7f52600c3340 2022-08-10T17:37:58.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5265ce5700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600701c0 con 0x7f52600c96b0 2022-08-10T17:37:58.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5265ce5700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526006ec10 con 0x7f52600c8af0 2022-08-10T17:37:58.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.652+0000 7fca31abc700 1 Processor -- start 2022-08-10T17:37:58.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7fca31abc700 1 -- start start 2022-08-10T17:37:58.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f525f7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f52600c8af0 0x7f52600c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f525effd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f52600c96b0 0x7f526006e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57086/0 (socket says 172.21.15.150:57086) 2022-08-10T17:37:58.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f525effd700 1 -- 172.21.15.150:0/2417031134 learned_addr learned my addr 172.21.15.150:0/2417031134 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:58.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fd10ca26700 1 -- 172.21.15.150:0/4232756631 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100010070 con 0x7fd10814ce90 2022-08-10T17:37:58.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fd10ca26700 1 -- 172.21.15.150:0/4232756631 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10000db70 con 0x7fd10814ce90 2022-08-10T17:37:58.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fd10ca26700 1 -- 172.21.15.150:0/4232756631 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000038a0 con 0x7fd10814ce90 2022-08-10T17:37:58.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca31abc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fca2c0c1d10 0x7fca2c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca31abc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0c7f80 con 0x7fca2c15f140 2022-08-10T17:37:58.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca31abc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0c1170 con 0x7fca2c15ed70 2022-08-10T17:37:58.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca31abc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0c3060 con 0x7fca2c0c1d10 2022-08-10T17:37:58.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f525f7fe700 1 -- 172.21.15.150:0/2417031134 >> v1:172.21.15.197:6789/0 conn(0x7f52600c96b0 legacy=0x7f526006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f525f7fe700 1 -- 172.21.15.150:0/2417031134 >> v1:172.21.15.150:6789/0 conn(0x7f52600c3340 legacy=0x7f5260167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f525f7fe700 1 -- 172.21.15.150:0/2417031134 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526006da60 con 0x7f52600c8af0 2022-08-10T17:37:58.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca2b7fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fca2c15ed70 0x7fca2c0c8ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57090/0 (socket says 172.21.15.150:57090) 2022-08-10T17:37:58.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fca2b7fe700 1 -- 172.21.15.150:0/3736735833 learned_addr learned my addr 172.21.15.150:0/3736735833 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:58.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.653+0000 7f5120e7c700 1 -- start start 2022-08-10T17:37:58.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071550 0x7f511c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f511c071920 0x7f511c0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f511c0c4420 0x7f511c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1f4070 con 0x7f511c0c4420 2022-08-10T17:37:58.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0c8480 con 0x7f511c071920 2022-08-10T17:37:58.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7f5120e7c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1f3460 con 0x7f511c071550 2022-08-10T17:37:58.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f5119d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f511c071920 0x7f511c0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.654+0000 7fd4f4ef7700 1 -- 172.21.15.150:0/2399865289 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e800e070 con 0x7fd4f00c8990 2022-08-10T17:37:58.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fd4f4ef7700 1 -- 172.21.15.150:0/2399865289 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e80038a0 con 0x7fd4f00c8990 2022-08-10T17:37:58.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fd4f4ef7700 1 -- 172.21.15.150:0/2399865289 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8003c50 con 0x7fd4f00c8990 2022-08-10T17:37:58.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fd10fc8c700 1 -- 172.21.15.150:0/4232756631 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 msgr2=0x7fd108156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/4232756631 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd10000d150 tx=0x7fd10000d460 comp rx=0 tx=0).stop 2022-08-10T17:37:58.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947819141 0 0) 0x7fca2c0c7f80 con 0x7fca2c15f140 2022-08-10T17:37:58.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca18003430 con 0x7fca2c15f140 2022-08-10T17:37:58.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174488831 0 0) 0x7fca2c0c1170 con 0x7fca2c15ed70 2022-08-10T17:37:58.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c0c7f80 con 0x7fca2c15ed70 2022-08-10T17:37:58.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f5119d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f511c071920 0x7f511c0c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40422/0 (socket says 172.21.15.150:40422) 2022-08-10T17:37:58.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f5119d9b700 1 -- 172.21.15.150:0/2287398811 learned_addr learned my addr 172.21.15.150:0/2287398811 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511ad9d700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f511c0c4420 0x7f511c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071550 0x7f511c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f90509d1700 1 Processor -- start 2022-08-10T17:37:58.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2bfff700 1 --2- 172.21.15.150:0/3736735833 >> v2:172.21.15.150:3300/0 conn(0x7fca2c0c1d10 0x7fca2c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 -- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f511c071920 msgr2=0x7f511c0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f511c071920 0x7f511c0c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 -- 172.21.15.150:0/2287398811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f511c0c4420 msgr2=0x7f511c14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f511c0c4420 0x7f511c14ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 -- 172.21.15.150:0/2287398811 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0093e0 con 0x7f511c071550 2022-08-10T17:37:58.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f511a59c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071550 0x7f511c1597c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511400b7b0 tx=0x7f511400bac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 -- 172.21.15.150:0/2399865289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f00c8990 msgr2=0x7fd4f00c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 --2- 172.21.15.150:0/2399865289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f00c8990 0x7fd4f00c8dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00b9460 tx=0x7fd4e800b330 comp rx=0 tx=0).stop 2022-08-10T17:37:58.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 -- 172.21.15.150:0/2399865289 shutdown_connections 2022-08-10T17:37:58.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 --2- 172.21.15.150:0/2399865289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f00c8990 0x7fd4f00c8dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 --2- 172.21.15.150:0/2399865289 >> v2:172.21.15.150:3300/0 conn(0x7fd4f0070290 0x7fd4f006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 -- 172.21.15.150:0/2399865289 >> 172.21.15.150:0/2399865289 conn(0x7fd4f006b500 msgr2=0x7fd4f006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3247602375 0 0) 0x7fca2c0c7f80 con 0x7fca2c15ed70 2022-08-10T17:37:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 >> v2:172.21.15.150:3300/0 conn(0x7fca2c0c1d10 msgr2=0x7fca2c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 --2- 172.21.15.150:0/3736735833 >> v2:172.21.15.150:3300/0 conn(0x7fca2c0c1d10 0x7fca2c0c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 >> v1:172.21.15.150:6789/0 conn(0x7fca2c15f140 legacy=0x7fca2c0c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0c8a50 con 0x7fca2c15ed70 2022-08-10T17:37:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fca24001920 con 0x7fca2c15ed70 2022-08-10T17:37:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 >> v1:172.21.15.197:6789/0 conn(0x7fca2c15ed70 legacy=0x7fca2c0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 0x7fca18004e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca18003670 0x7fca18003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004020 0x7fca1800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c001230 con 0x7fca18003670 2022-08-10T17:37:58.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800c010 con 0x7fca18004020 2022-08-10T17:37:58.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800c1d0 con 0x7fca18004ac0 2022-08-10T17:37:58.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 0x7fca18004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114011830 con 0x7f511c071550 2022-08-10T17:37:58.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140119b0 con 0x7f511c071550 2022-08-10T17:37:58.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114011d60 con 0x7f511c071550 2022-08-10T17:37:58.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 -- 172.21.15.150:0/2399865289 shutdown_connections 2022-08-10T17:37:58.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7f525f7fe700 1 --2- 172.21.15.150:0/2417031134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c8af0 0x7f52600c8ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5250005cc0 tx=0x7f525000bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc184d440e9393e8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 -- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004020 msgr2=0x7fca1800b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:58.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004020 0x7fca1800b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 -- 172.21.15.150:0/3736735833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca18003670 msgr2=0x7fca18003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca18003670 0x7fca18003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 -- 172.21.15.150:0/3736735833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0c7f80 con 0x7fca18004ac0 2022-08-10T17:37:58.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fd4f815d700 1 -- 172.21.15.150:0/2399865289 wait complete. 2022-08-10T17:37:58.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f525e7fc700 1 -- 172.21.15.150:0/2417031134 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000dd30 con 0x7f52600c8af0 2022-08-10T17:37:58.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2bfff700 1 -- 172.21.15.150:0/3736735833 reap_dead start 2022-08-10T17:37:58.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.656+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 0x7fca18004e90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca2401d2f0 tx=0x7fca18005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a4c3e28fdf3a8e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2401dc30 con 0x7fca18004ac0 2022-08-10T17:37:58.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2401dd90 con 0x7fca18004ac0 2022-08-10T17:37:58.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fca2a7fc700 1 -- 172.21.15.150:0/3736735833 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24005da0 con 0x7fca18004ac0 2022-08-10T17:37:58.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.655+0000 7f90509d1700 1 -- start start 2022-08-10T17:37:58.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f90509d1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c15e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f90509d1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f904c0bc8e0 0x7f904c15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f90509d1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c15bc10 con 0x7f904c06f7e0 2022-08-10T17:37:58.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f90509d1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0bc770 con 0x7f904c0bc8e0 2022-08-10T17:37:58.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f90509d1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15b680 con 0x7f904c154ee0 2022-08-10T17:37:58.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f9049d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f904c0bc8e0 0x7f904c15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f9049d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f904c0bc8e0 0x7f904c15ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58076/0 (socket says 172.21.15.150:58076) 2022-08-10T17:37:58.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f9049d9b700 1 -- 172.21.15.150:0/3993633182 learned_addr learned my addr 172.21.15.150:0/3993633182 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 -- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 msgr2=0x7fca18004e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 0x7fca18004e90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca2401d2f0 tx=0x7fca18005700 comp rx=0 tx=0).stop 2022-08-10T17:37:58.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f9049d9b700 1 -- 172.21.15.150:0/3993633182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 msgr2=0x7f904c15e810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:37:58.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f9049d9b700 1 --2- 172.21.15.150:0/3993633182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c15e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f9049d9b700 1 -- 172.21.15.150:0/3993633182 >> v1:172.21.15.197:6789/0 conn(0x7f904c06f7e0 legacy=0x7f904c06fc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:58.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f9049d9b700 1 -- 172.21.15.150:0/3993633182 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c064650 con 0x7f904c0bc8e0 2022-08-10T17:37:58.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 -- 172.21.15.150:0/4232756631 shutdown_connections 2022-08-10T17:37:58.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/4232756631 >> v2:172.21.15.150:3300/0 conn(0x7fd10806a760 0x7fd1080c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/4232756631 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10814ce90 0x7fd108156b60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 -- 172.21.15.150:0/4232756631 >> 172.21.15.150:0/4232756631 conn(0x7fd10806b500 msgr2=0x7fd10806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 -- 172.21.15.150:0/4232756631 shutdown_connections 2022-08-10T17:37:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 -- 172.21.15.150:0/3736735833 shutdown_connections 2022-08-10T17:37:58.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 --2- 172.21.15.150:0/3736735833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca18004ac0 0x7fca18004e90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 -- 172.21.15.150:0/3736735833 >> 172.21.15.150:0/3736735833 conn(0x7fca2c0cce30 msgr2=0x7fca2c0cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7fd10fc8c700 1 -- 172.21.15.150:0/4232756631 wait complete. 2022-08-10T17:37:58.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f525e7fc700 1 -- 172.21.15.150:0/2417031134 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000de90 con 0x7f52600c8af0 2022-08-10T17:37:58.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f525e7fc700 1 -- 172.21.15.150:0/2417031134 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250004250 con 0x7f52600c8af0 2022-08-10T17:37:58.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f5265ce5700 1 -- 172.21.15.150:0/2417031134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c8af0 msgr2=0x7f52600c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f5265ce5700 1 --2- 172.21.15.150:0/2417031134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c8af0 0x7f52600c8ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5250005cc0 tx=0x7f525000bec0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fd4f815d700 1 Processor -- start 2022-08-10T17:37:58.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c1f3740 con 0x7f511c071550 2022-08-10T17:37:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.657+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c1f3d00 con 0x7f511c071550 2022-08-10T17:37:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f5265ce5700 1 -- 172.21.15.150:0/2417031134 shutdown_connections 2022-08-10T17:37:58.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f5265ce5700 1 --2- 172.21.15.150:0/2417031134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c8af0 0x7f52600c8ec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f5265ce5700 1 -- 172.21.15.150:0/2417031134 >> 172.21.15.150:0/2417031134 conn(0x7f526006b500 msgr2=0x7f526006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 -- 172.21.15.150:0/3736735833 shutdown_connections 2022-08-10T17:37:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f9049d9b700 1 --2- 172.21.15.150:0/3993633182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0bc8e0 0x7f904c15ed50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853fa1e2143dc58d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fca31abc700 1 -- 172.21.15.150:0/3736735833 wait complete. 2022-08-10T17:37:58.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f904959a700 1 -- 172.21.15.150:0/3993633182 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c011830 con 0x7f904c0bc8e0 2022-08-10T17:37:58.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f904959a700 1 -- 172.21.15.150:0/3993633182 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c011990 con 0x7f904c0bc8e0 2022-08-10T17:37:58.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7f904959a700 1 -- 172.21.15.150:0/3993633182 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c011d40 con 0x7f904c0bc8e0 2022-08-10T17:37:58.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7f90509d1700 1 -- 172.21.15.150:0/3993633182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0bc8e0 msgr2=0x7f904c15ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7f90509d1700 1 --2- 172.21.15.150:0/3993633182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0bc8e0 0x7f904c15ed50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:58.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.658+0000 7fd4f815d700 1 -- start start 2022-08-10T17:37:58.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 0x7fd4f01511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f00c26c0 0x7fd4f01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4f00c8990 0x7fd4f00c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f01f3290 con 0x7fd4f00c26c0 2022-08-10T17:37:58.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f01f3570 con 0x7fd4f0070290 2022-08-10T17:37:58.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f815d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f01f3850 con 0x7fd4f00c8990 2022-08-10T17:37:58.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7fd4f5ef9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 0x7fd4f01511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 0x7fd4f01511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40438/0 (socket says 172.21.15.150:40438) 2022-08-10T17:37:58.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 -- 172.21.15.150:0/3024324608 learned_addr learned my addr 172.21.15.150:0/3024324608 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f56f8700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f00c26c0 0x7fd4f01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f66fa700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4f00c8990 0x7fd4f00c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fca31abc700 1 Processor -- start 2022-08-10T17:37:58.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.659+0000 7f5265ce5700 1 -- 172.21.15.150:0/2417031134 shutdown_connections 2022-08-10T17:37:58.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 -- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4f00c8990 msgr2=0x7fd4f00c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4f00c8990 0x7fd4f00c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 -- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f00c26c0 msgr2=0x7fd4f01543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f00c26c0 0x7fd4f01543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8009b30 con 0x7fd4f0070290 2022-08-10T17:37:58.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f5ef9700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 0x7fd4f01511f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c780 tx=0x7fd4ec00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7f90509d1700 1 -- 172.21.15.150:0/3993633182 shutdown_connections 2022-08-10T17:37:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7f90509d1700 1 --2- 172.21.15.150:0/3993633182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c15e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7f90509d1700 1 --2- 172.21.15.150:0/3993633182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0bc8e0 0x7f904c15ed50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7f90509d1700 1 -- 172.21.15.150:0/3993633182 >> 172.21.15.150:0/3993633182 conn(0x7f904c0c92f0 msgr2=0x7f904c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f90509d1700 1 -- 172.21.15.150:0/3993633182 shutdown_connections 2022-08-10T17:37:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f90509d1700 1 -- 172.21.15.150:0/3993633182 wait complete. 2022-08-10T17:37:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7f90509d1700 1 Processor -- start 2022-08-10T17:37:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec003500 con 0x7fd4f0070290 2022-08-10T17:37:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec003680 con 0x7fd4f0070290 2022-08-10T17:37:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f01f3b30 con 0x7fd4f0070290 2022-08-10T17:37:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f0151730 con 0x7fd4f0070290 2022-08-10T17:37:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0039f0 con 0x7fd4f0070290 2022-08-10T17:37:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4cc000fc0 con 0x7fd4f0070290 2022-08-10T17:37:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5114021070 con 0x7f511c071550 2022-08-10T17:37:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f510affd700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50f80651b0 0x7f50f8067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5114082170 con 0x7f511c071550 2022-08-10T17:37:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f5120e7c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f511c0c8730 0x7f511c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 --> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f511c154ba0 con 0x7f511c0c8730 2022-08-10T17:37:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7f511ad9d700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f511c0c8730 0x7f511c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7f5265ce5700 1 -- 172.21.15.150:0/2417031134 wait complete. 2022-08-10T17:37:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7f5265ce5700 1 Processor -- start 2022-08-10T17:37:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fca31abc700 1 -- start start 2022-08-10T17:37:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004ac0 0x7fca2c06a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 0x7fca2c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c1eab70 0x7fca2c1eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c06cb20 con 0x7fca2c1eab70 2022-08-10T17:37:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c6fa0 con 0x7fca18004ac0 2022-08-10T17:37:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca31abc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c1eb520 con 0x7fca2c151a00 2022-08-10T17:37:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca2affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 0x7fca2c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fca2b7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004ac0 0x7fca2c06a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 0x7fca2c1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44078/0 (socket says 172.21.15.150:44078) 2022-08-10T17:37:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 -- 172.21.15.150:0/1637356685 learned_addr learned my addr 172.21.15.150:0/1637356685 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 -- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004ac0 msgr2=0x7fca2c06a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004ac0 0x7fca2c06a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 -- 172.21.15.150:0/1637356685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c1eab70 msgr2=0x7fca2c1eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c1eab70 0x7fca2c1eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 -- 172.21.15.150:0/1637356685 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c15e0c0 con 0x7fca2c151a00 2022-08-10T17:37:58.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fca18004ac0 0x7fca2c06a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:37:58.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fca2affd700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 0x7fca2c1545d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007f80 tx=0x7fca1c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd10fc8c700 1 Processor -- start 2022-08-10T17:37:58.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.660+0000 7fd10fc8c700 1 -- start start 2022-08-10T17:37:58.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd10806a760 0x7fd1080b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 0x7fd1080b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd10814ce90 0x7fd1080c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080bb060 con 0x7fd10806a760 2022-08-10T17:37:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b6030 con 0x7fd10814ce90 2022-08-10T17:37:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.661+0000 7fd10fc8c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b8e50 con 0x7fd10806dc90 2022-08-10T17:37:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10e229700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd10814ce90 0x7fd1080c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 0x7fd1080b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10e229700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd10814ce90 0x7fd1080c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40454/0 (socket says 172.21.15.150:40454) 2022-08-10T17:37:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 0x7fd1080b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44086/0 (socket says 172.21.15.150:44086) 2022-08-10T17:37:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10e229700 1 -- 172.21.15.150:0/1825861923 learned_addr learned my addr 172.21.15.150:0/1825861923 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 -- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd10814ce90 msgr2=0x7fd1080c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd10814ce90 0x7fd1080c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 -- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd10806a760 msgr2=0x7fd1080b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd10806a760 0x7fd1080b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 -- 172.21.15.150:0/1825861923 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10000bd40 con 0x7fd10806dc90 2022-08-10T17:37:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.662+0000 7fd10d227700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 0x7fd1080b94d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c410 tx=0x7fd10400c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7f5119d9b700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50f80651b0 0x7f50f8067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7f5265ce5700 1 -- start start 2022-08-10T17:37:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd4ec010070 con 0x7fd4f0070290 2022-08-10T17:37:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f3269891700 1 Processor -- start 2022-08-10T17:37:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c3340 0x7f52600bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52600c8af0 0x7f5260161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52600c96b0 0x7f52600bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260162310 con 0x7f52600c96b0 2022-08-10T17:37:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52602016b0 con 0x7f52600c3340 2022-08-10T17:37:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5265ce5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52602024d0 con 0x7f52600c8af0 2022-08-10T17:37:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f5119d9b700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50f80651b0 0x7f50f8067660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f511c159200 tx=0x7f5110009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f525f7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c3340 0x7f52600bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f525f7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c3340 0x7f52600bd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40460/0 (socket says 172.21.15.150:40460) 2022-08-10T17:37:58.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f525f7fe700 1 -- 172.21.15.150:0/2540520444 learned_addr learned my addr 172.21.15.150:0/2540520444 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f525effd700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52600c8af0 0x7f5260161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.663+0000 7f90509d1700 1 -- start start 2022-08-10T17:37:58.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c06f7e0 0x7f904c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 0x7f904c140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0c8dd0 con 0x7f904c06f7e0 2022-08-10T17:37:58.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0bdbe0 con 0x7f904c0bc8e0 2022-08-10T17:37:58.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f90509d1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c13a870 con 0x7f904c154ee0 2022-08-10T17:37:58.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f904a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c06f7e0 0x7f904c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f9049d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 0x7f904c140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f904a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c06f7e0 0x7f904c150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58106/0 (socket says 172.21.15.150:58106) 2022-08-10T17:37:58.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f9049d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 0x7f904c140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40468/0 (socket says 172.21.15.150:40468) 2022-08-10T17:37:58.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f904a59c700 1 -- 172.21.15.150:0/1613342624 learned_addr learned my addr 172.21.15.150:0/1613342624 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f904ad9d700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 -- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 msgr2=0x7f904c142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 -- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c06f7e0 msgr2=0x7f904c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c06f7e0 0x7f904c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0093e0 con 0x7f904c0bc8e0 2022-08-10T17:37:58.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f904ad9d700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f904c154ee0 0x7f904c142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:58.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f9049d9b700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 0x7f904c140330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f904c0c6e10 tx=0x7f903c0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4e67fc700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4d8065130 0x7fd4d80675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd4ec0817b0 con 0x7fd4f0070290 2022-08-10T17:37:58.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4e67fc700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7fd4d806ef00 0x7fd4d8071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d8071a20 con 0x7fd4d806ef00 2022-08-10T17:37:58.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4ec081c10 con 0x7fd4f0070290 2022-08-10T17:37:58.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7fd4f66fa700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7fd4d806ef00 0x7fd4d8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd4f56f8700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4d8065130 0x7fd4d80675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd4f66fa700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7fd4d806ef00 0x7fd4d8071350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f3269891700 1 -- start start 2022-08-10T17:37:58.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3269891700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f32640c1730 0x7f32640cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3269891700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f32640cda80 0x7f32640691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3269891700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640c3020 con 0x7f3264070240 2022-08-10T17:37:58.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3269891700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640c1b60 con 0x7f32640c1730 2022-08-10T17:37:58.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3269891700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264156930 con 0x7f32640cda80 2022-08-10T17:37:58.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f32637fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f32640cda80 0x7f32640691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040052d0 con 0x7fd10806dc90 2022-08-10T17:37:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104003500 con 0x7fd10806dc90 2022-08-10T17:37:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1080b9a10 con 0x7fd10806dc90 2022-08-10T17:37:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1080b7830 con 0x7fd10806dc90 2022-08-10T17:37:58.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040038b0 con 0x7fd10806dc90 2022-08-10T17:37:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0052e0 con 0x7fca2c151a00 2022-08-10T17:37:58.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f511ad9d700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f511c0c8730 0x7f511c14f390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== osd.5 v2:172.21.15.197:6808/98110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f511c154ba0 con 0x7f511c0c8730 2022-08-10T17:37:58.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.664+0000 7f525ffff700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52600c96b0 0x7f52600bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 -- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c3340 msgr2=0x7f52600bd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52600c3340 0x7f52600bd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 -- 172.21.15.150:0/2540520444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52600c96b0 msgr2=0x7f52600bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52600c96b0 0x7f52600bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525000b840 con 0x7f52600c8af0 2022-08-10T17:37:58.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f525effd700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52600c8af0 0x7f5260161dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f52600c9b00 tx=0x7f525400b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3262ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3264070240 0x7f3264157060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42566/0 (socket says 172.21.15.150:42566) 2022-08-10T17:37:58.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7f3262ffd700 1 -- 172.21.15.150:0/2861229150 learned_addr learned my addr 172.21.15.150:0/2861229150 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:58.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c15dde0 con 0x7fca2c151a00 2022-08-10T17:37:58.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c0c6950 con 0x7fca2c151a00 2022-08-10T17:37:58.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254011600 con 0x7f52600c8af0 2022-08-10T17:37:58.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254011760 con 0x7f52600c8af0 2022-08-10T17:37:58.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254011ad0 con 0x7f52600c8af0 2022-08-10T17:37:58.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c01a830 con 0x7f904c0bc8e0 2022-08-10T17:37:58.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c01a9b0 con 0x7f904c0bc8e0 2022-08-10T17:37:58.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c01ad60 con 0x7f904c0bc8e0 2022-08-10T17:37:58.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c15c2d0 con 0x7f904c0bc8e0 2022-08-10T17:37:58.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.666+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0bd590 con 0x7f904c0bc8e0 2022-08-10T17:37:58.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.667+0000 7f325a7fc700 1 --2- 172.21.15.150:0/2861229150 >> v2:172.21.15.197:3300/0 conn(0x7f32640c1730 0x7f32640cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.667+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f902c000fc0 con 0x7f904c0bc8e0 2022-08-10T17:37:58.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.667+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52602018c0 con 0x7f52600c8af0 2022-08-10T17:37:58.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.667+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5260201e80 con 0x7f52600c8af0 2022-08-10T17:37:58.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5260072890 con 0x7f52600c8af0 2022-08-10T17:37:58.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f903c00f050 con 0x7f904c0bc8e0 2022-08-10T17:37:58.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790925425 0 0) 0x7f32640c3020 con 0x7f3264070240 2022-08-10T17:37:58.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3244003430 con 0x7f3264070240 2022-08-10T17:37:58.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd104019030 con 0x7fd10806dc90 2022-08-10T17:37:58.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7fd0fe7fc700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd0f00651b0 0x7fd0f0067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd1040812c0 con 0x7fd10806dc90 2022-08-10T17:37:58.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.665+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c003500 con 0x7fca2c151a00 2022-08-10T17:37:58.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0038b0 con 0x7fca2c151a00 2022-08-10T17:37:58.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fca1c03b030 con 0x7fca2c151a00 2022-08-10T17:37:58.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537610518 0 0) 0x7f3244003430 con 0x7f3264070240 2022-08-10T17:37:58.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f32640cda80 msgr2=0x7f32640691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.668+0000 7f32627fc700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f32640cda80 0x7f32640691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 >> v2:172.21.15.197:3300/0 conn(0x7f32640c1730 msgr2=0x7f32640cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 --2- 172.21.15.150:0/2861229150 >> v2:172.21.15.197:3300/0 conn(0x7f32640c1730 0x7f32640cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264156bd0 con 0x7f3264070240 2022-08-10T17:37:58.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f324c001670 con 0x7f3264070240 2022-08-10T17:37:58.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 >> v1:172.21.15.150:6789/0 conn(0x7f3264070240 legacy=0x7f3264157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f3244003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32440046d0 0x7f3244004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3244005080 0x7f324400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c1b60 con 0x7f32440046d0 2022-08-10T17:37:58.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264156930 con 0x7f3244005080 2022-08-10T17:37:58.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324400bf60 con 0x7f3244003880 2022-08-10T17:37:58.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fd10da28700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd0f00651b0 0x7fd0f0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7fd0e40015e0 0x7fd0e4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 --> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0e4006a40 con 0x7fd0e40015e0 2022-08-10T17:37:58.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fd4f56f8700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4d8065130 0x7fd4d80675e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0154350 tx=0x7fd4e00090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fd10e229700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7fd0e40015e0 0x7fd0e4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f903affd700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90280651b0 0x7f9028067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f903c083570 con 0x7f904c0bc8e0 2022-08-10T17:37:58.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f903affd700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f902806f000 0x7f9028071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9028071b20 con 0x7f902806f000 2022-08-10T17:37:58.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f903c083920 con 0x7f904c0bc8e0 2022-08-10T17:37:58.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f904a59c700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90280651b0 0x7f9028067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f904a59c700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90280651b0 0x7f9028067660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9044009c20 tx=0x7f9044009360 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f3244003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7fd10da28700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd0f00651b0 0x7fd0f0067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd100000f80 tx=0x7fd100014000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fca13fff700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fca0c065200 0x7fca0c0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fca1c0a3520 con 0x7fca2c151a00 2022-08-10T17:37:58.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.669+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5254018030 con 0x7f52600c8af0 2022-08-10T17:37:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f5247fff700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5240065130 0x7f52400675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5254081bd0 con 0x7f52600c8af0 2022-08-10T17:37:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f525f7fe700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5240065130 0x7f52400675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f5247fff700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f524006ef80 0x7f52400713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5240071aa0 con 0x7f524006ef80 2022-08-10T17:37:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5254082050 con 0x7f52600c8af0 2022-08-10T17:37:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fca0c065200 0x7fca0c0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f525ffff700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f524006ef80 0x7f52400713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== osd.1 v2:172.21.15.150:6816/98006 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fd4d8071a20 con 0x7fd4d806ef00 2022-08-10T17:37:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f525f7fe700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5240065130 0x7f52400675e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f525000bf00 tx=0x7f5250012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fd10e229700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7fd0e40015e0 0x7fd0e4003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fca31abc700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fca080015e0 0x7fca08003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 --> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca08006a40 con 0x7fca080015e0 2022-08-10T17:37:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f525ffff700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f524006ef80 0x7f52400713d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f32637fe700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3244005080 0x7f324400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f325a7fc700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32440046d0 0x7f3244004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 -- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3244005080 msgr2=0x7f324400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3244005080 0x7f324400b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 -- 172.21.15.150:0/2861229150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32440046d0 msgr2=0x7f3244004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32440046d0 0x7f3244004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.670+0000 7f3262ffd700 1 -- 172.21.15.150:0/2861229150 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264156bd0 con 0x7f3244003880 2022-08-10T17:37:58.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f3244003c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c160 tx=0x7f3244005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffdb8fafd0027175 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f904ad9d700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f902806f000 0x7f9028071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fca2bfff700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fca080015e0 0x7fca08003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7fca2b7fe700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fca0c065200 0x7fca0c0676b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f80 tx=0x7fca24021000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00cbc0 con 0x7f3244003880 2022-08-10T17:37:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00cd40 con 0x7f3244003880 2022-08-10T17:37:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.671+0000 7f32627fc700 1 -- 172.21.15.150:0/2861229150 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c007310 con 0x7f3244003880 2022-08-10T17:37:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f904ad9d700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f902806f000 0x7f9028071450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== osd.6 v2:172.21.15.197:6824/98136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f5240071aa0 con 0x7f524006ef80 2022-08-10T17:37:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f3269891700 1 -- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 msgr2=0x7f3244003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f3269891700 1 --2- 172.21.15.150:0/2861229150 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f3244003c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c160 tx=0x7f3244005700 comp rx=0 tx=0).stop 2022-08-10T17:37:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== osd.3 v2:172.21.15.150:6824/98020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fd0e4006a40 con 0x7fd0e40015e0 2022-08-10T17:37:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f32637fe700 1 -- 172.21.15.150:0/2861229150 reap_dead start 2022-08-10T17:37:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f3269891700 1 -- 172.21.15.150:0/2861229150 shutdown_connections 2022-08-10T17:37:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7f3269891700 1 -- 172.21.15.150:0/2861229150 >> 172.21.15.150:0/2861229150 conn(0x7f3264071e40 msgr2=0x7f32640cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.672+0000 7fca2bfff700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fca080015e0 0x7fca08003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.673+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== osd.0 v2:172.21.15.150:6800/97995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f9028071b20 con 0x7f902806f000 2022-08-10T17:37:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.673+0000 7f3269891700 1 -- 172.21.15.150:0/2861229150 shutdown_connections 2022-08-10T17:37:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.673+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== osd.4 v2:172.21.15.197:6800/98109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fca08006a40 con 0x7fca080015e0 2022-08-10T17:37:58.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.673+0000 7f3269891700 1 -- 172.21.15.150:0/2861229150 wait complete. 2022-08-10T17:37:58.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.675+0000 7f3269891700 1 Processor -- start 2022-08-10T17:37:58.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.675+0000 7f3269891700 1 -- start start 2022-08-10T17:37:58.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f32641ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 0x7f32640bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32640b2ab0 0x7f32640c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32641ecc30 con 0x7f32640c12e0 2022-08-10T17:37:58.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32641ec8a0 con 0x7f32640b2ab0 2022-08-10T17:37:58.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.676+0000 7f3269891700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264152770 con 0x7f3244003880 2022-08-10T17:37:58.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 0x7f32640bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 0x7f32640bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58146/0 (socket says 172.21.15.150:58146) 2022-08-10T17:37:58.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 -- 172.21.15.150:0/2685143604 learned_addr learned my addr 172.21.15.150:0/2685143604 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 -- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 msgr2=0x7f32641ea210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:37:58.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3244003880 0x7f32641ea210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 -- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32640b2ab0 msgr2=0x7f32640c02b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:37:58.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32640b2ab0 0x7f32640c02b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 -- 172.21.15.150:0/2685143604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264152a50 con 0x7f32640c12e0 2022-08-10T17:37:58.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.677+0000 7f325a7fc700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 0x7f32640bfd70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f325400fde0 tx=0x7f325400d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.678+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254007e50 con 0x7f32640c12e0 2022-08-10T17:37:58.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.678+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400de20 con 0x7f32640c12e0 2022-08-10T17:37:58.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.678+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254017630 con 0x7f32640c12e0 2022-08-10T17:37:58.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.678+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3264155ea0 con 0x7f32640c12e0 2022-08-10T17:37:58.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.678+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32641563e0 con 0x7f32640c12e0 2022-08-10T17:37:58.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.681+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f325401e030 con 0x7f32640c12e0 2022-08-10T17:37:58.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.681+0000 7f3260ff9700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3248065100 0x7f32480675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.681+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3254082980 con 0x7f32640c12e0 2022-08-10T17:37:58.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.682+0000 7f3269891700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f323c0015e0 0x7f323c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.682+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 --> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f323c006a40 con 0x7f323c0015e0 2022-08-10T17:37:58.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.684+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3248065100 0x7f32480675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.684+0000 7f3262ffd700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3248065100 0x7f32480675b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f324c000fb0 tx=0x7f324c00a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.688+0000 7f32637fe700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f323c0015e0 0x7f323c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.689+0000 7f32637fe700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f323c0015e0 0x7f323c003a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.690+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== osd.2 v2:172.21.15.150:6808/98004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f323c006a40 con 0x7f323c0015e0 2022-08-10T17:37:58.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.696+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 --> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f511c0648b0 con 0x7f511c0c8730 2022-08-10T17:37:58.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.697+0000 7f510affd700 1 -- 172.21.15.150:0/2287398811 <== osd.5 v2:172.21.15.197:6808/98110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f511c0648b0 con 0x7f511c0c8730 2022-08-10T17:37:58.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f511c0c8730 msgr2=0x7f511c14f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f511c0c8730 0x7f511c14f390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 --> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5260202610 con 0x7f524006ef80 2022-08-10T17:37:58.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50f80651b0 msgr2=0x7f50f8067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50f80651b0 0x7f50f8067660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f511c159200 tx=0x7f5110009040 comp rx=0 tx=0).stop 2022-08-10T17:37:58.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071550 msgr2=0x7f511c1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.698+0000 7f5120e7c700 1 --2- 172.21.15.150:0/2287398811 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f511c071550 0x7f511c1597c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511400b7b0 tx=0x7f511400bac0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f511ad9d700 1 -- 172.21.15.150:0/2287398811 reap_dead start 2022-08-10T17:37:58.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 shutdown_connections 2022-08-10T17:37:58.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 >> 172.21.15.150:0/2287398811 conn(0x7f511c06d0d0 msgr2=0x7f511c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 shutdown_connections 2022-08-10T17:37:58.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f5120e7c700 1 -- 172.21.15.150:0/2287398811 wait complete. 2022-08-10T17:37:58.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.699+0000 7f5247fff700 1 -- 172.21.15.150:0/2540520444 <== osd.6 v2:172.21.15.197:6824/98136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5260202610 con 0x7f524006ef80 2022-08-10T17:37:58.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.701+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 --> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f902c002bc0 con 0x7f902806f000 2022-08-10T17:37:58.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.701+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f524006ef80 msgr2=0x7f52400713d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.701+0000 7f5265ce5700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f524006ef80 0x7f52400713d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.701+0000 7f903affd700 1 -- 172.21.15.150:0/1613342624 <== osd.0 v2:172.21.15.150:6800/97995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f902c002bc0 con 0x7f902806f000 2022-08-10T17:37:58.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.701+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5240065130 msgr2=0x7f52400675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f5265ce5700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5240065130 0x7f52400675e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f525000bf00 tx=0x7f5250012000 comp rx=0 tx=0).stop 2022-08-10T17:37:58.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52600c8af0 msgr2=0x7f5260161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f5265ce5700 1 --2- 172.21.15.150:0/2540520444 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52600c8af0 0x7f5260161dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f52600c9b00 tx=0x7f525400b670 comp rx=0 tx=0).stop 2022-08-10T17:37:58.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f525ffff700 1 -- 172.21.15.150:0/2540520444 reap_dead start 2022-08-10T17:37:58.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 shutdown_connections 2022-08-10T17:37:58.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 >> 172.21.15.150:0/2540520444 conn(0x7f526006b500 msgr2=0x7f52600c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f902806f000 msgr2=0x7f9028071450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f902806f000 0x7f9028071450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90280651b0 msgr2=0x7f9028067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90280651b0 0x7f9028067660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9044009c20 tx=0x7f9044009360 comp rx=0 tx=0).stop 2022-08-10T17:37:58.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 msgr2=0x7f904c140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 --2- 172.21.15.150:0/1613342624 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f904c0bc8e0 0x7f904c140330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f904c0c6e10 tx=0x7f903c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f904ad9d700 1 -- 172.21.15.150:0/1613342624 reap_dead start 2022-08-10T17:37:58.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 shutdown_connections 2022-08-10T17:37:58.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 >> 172.21.15.150:0/1613342624 conn(0x7f904c0c92f0 msgr2=0x7f904c1517b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.702+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 --> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4cc002bc0 con 0x7fd4d806ef00 2022-08-10T17:37:58.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.703+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 shutdown_connections 2022-08-10T17:37:58.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.703+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 --> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0e4005b20 con 0x7fd0e40015e0 2022-08-10T17:37:58.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.703+0000 7fd4e67fc700 1 -- 172.21.15.150:0/3024324608 <== osd.1 v2:172.21.15.150:6816/98006 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4cc002bc0 con 0x7fd4d806ef00 2022-08-10T17:37:58.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 shutdown_connections 2022-08-10T17:37:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7f90509d1700 1 -- 172.21.15.150:0/1613342624 wait complete. 2022-08-10T17:37:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7fd0fe7fc700 1 -- 172.21.15.150:0/1825861923 <== osd.3 v2:172.21.15.150:6824/98020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0e4005b20 con 0x7fd0e40015e0 2022-08-10T17:37:58.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7f5265ce5700 1 -- 172.21.15.150:0/2540520444 wait complete. 2022-08-10T17:37:58.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.703+0000 7ff056210700 1 Processor -- start 2022-08-10T17:37:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.703+0000 7ff056210700 1 -- start start 2022-08-10T17:37:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff056210700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff050070290 0x7ff05006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff056210700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff0500c8990 0x7ff0500c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff056210700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500c9990 con 0x7ff0500c26c0 2022-08-10T17:37:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff056210700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05015b830 con 0x7ff050070290 2022-08-10T17:37:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff056210700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05015af60 con 0x7ff0500c8990 2022-08-10T17:37:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7fd4d806ef00 msgr2=0x7fd4d8071350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7fd4f815d700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7fd4d806ef00 0x7fd4d8071350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.704+0000 7ff04effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff050070290 0x7ff05006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff050070290 0x7ff05006dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58156/0 (socket says 172.21.15.150:58156) 2022-08-10T17:37:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 -- 172.21.15.150:0/4134664468 learned_addr learned my addr 172.21.15.150:0/4134664468 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04ffff700 1 --2- 172.21.15.150:0/4134664468 >> v2:172.21.15.197:3300/0 conn(0x7ff0500c8990 0x7ff0500c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 -- 172.21.15.150:0/4134664468 >> v2:172.21.15.197:3300/0 conn(0x7ff0500c8990 msgr2=0x7ff0500c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 --2- 172.21.15.150:0/4134664468 >> v2:172.21.15.197:3300/0 conn(0x7ff0500c8990 0x7ff0500c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 -- 172.21.15.150:0/4134664468 >> v1:172.21.15.197:6789/0 conn(0x7ff0500c26c0 legacy=0x7ff0500c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 -- 172.21.15.150:0/4134664468 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500706f0 con 0x7ff050070290 2022-08-10T17:37:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.705+0000 7ff04effd700 1 --2- 172.21.15.150:0/4134664468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05006dcf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0500b9460 tx=0x7ff040009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82398c969795f820 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7fd0e40015e0 msgr2=0x7fd0e4003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7fd0e40015e0 0x7fd0e4003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4d8065130 msgr2=0x7fd4d80675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4d8065130 0x7fd4d80675e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0154350 tx=0x7fd4e00090e0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 msgr2=0x7fd4f01511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 --2- 172.21.15.150:0/3024324608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4f0070290 0x7fd4f01511f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c780 tx=0x7fd4ec00ca90 comp rx=0 tx=0).stop 2022-08-10T17:37:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f66fa700 1 -- 172.21.15.150:0/3024324608 reap_dead start 2022-08-10T17:37:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 shutdown_connections 2022-08-10T17:37:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 >> 172.21.15.150:0/3024324608 conn(0x7fd4f006b500 msgr2=0x7fd4f00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd0f00651b0 msgr2=0x7fd0f0067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd0f00651b0 0x7fd0f0067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd100000f80 tx=0x7fd100014000 comp rx=0 tx=0).stop 2022-08-10T17:37:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 msgr2=0x7fd1080b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10fc8c700 1 --2- 172.21.15.150:0/1825861923 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd10806dc90 0x7fd1080b94d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c410 tx=0x7fd10400c720 comp rx=0 tx=0).stop 2022-08-10T17:37:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.706+0000 7fd10e229700 1 -- 172.21.15.150:0/1825861923 reap_dead start 2022-08-10T17:37:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.708+0000 7ff04e7fc700 1 -- 172.21.15.150:0/4134664468 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400107b0 con 0x7ff050070290 2022-08-10T17:37:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.708+0000 7ff04e7fc700 1 -- 172.21.15.150:0/4134664468 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040010910 con 0x7ff050070290 2022-08-10T17:37:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.708+0000 7ff04e7fc700 1 -- 172.21.15.150:0/4134664468 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040010ca0 con 0x7ff050070290 2022-08-10T17:37:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.708+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 --> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca08005ac0 con 0x7fca080015e0 2022-08-10T17:37:58.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.708+0000 7fca13fff700 1 -- 172.21.15.150:0/1637356685 <== osd.4 v2:172.21.15.197:6800/98109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca08005ac0 con 0x7fca080015e0 2022-08-10T17:37:58.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 -- 172.21.15.150:0/4134664468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 msgr2=0x7ff05006dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 --2- 172.21.15.150:0/4134664468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05006dcf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0500b9460 tx=0x7ff040009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:58.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fca080015e0 msgr2=0x7fca08003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fca080015e0 0x7fca08003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 -- 172.21.15.150:0/4134664468 shutdown_connections 2022-08-10T17:37:58.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 --2- 172.21.15.150:0/4134664468 >> v2:172.21.15.197:3300/0 conn(0x7ff0500c8990 0x7ff0500c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 --2- 172.21.15.150:0/4134664468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05006dcf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 -- 172.21.15.150:0/4134664468 >> 172.21.15.150:0/4134664468 conn(0x7ff05006b500 msgr2=0x7ff05006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fca0c065200 msgr2=0x7fca0c0676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fca0c065200 0x7fca0c0676b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f80 tx=0x7fca24021000 comp rx=0 tx=0).stop 2022-08-10T17:37:58.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 msgr2=0x7fca2c1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 --2- 172.21.15.150:0/1637356685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fca2c151a00 0x7fca2c1545d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007f80 tx=0x7fca1c00ca40 comp rx=0 tx=0).stop 2022-08-10T17:37:58.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca2bfff700 1 -- 172.21.15.150:0/1637356685 reap_dead start 2022-08-10T17:37:58.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 shutdown_connections 2022-08-10T17:37:58.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 >> 172.21.15.150:0/1637356685 conn(0x7fca2c0cce30 msgr2=0x7fca2c0c9870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 -- 172.21.15.150:0/4134664468 shutdown_connections 2022-08-10T17:37:58.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 shutdown_connections 2022-08-10T17:37:58.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.710+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 shutdown_connections 2022-08-10T17:37:58.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.710+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 >> 172.21.15.150:0/1825861923 conn(0x7fd10806b500 msgr2=0x7fd1080c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.711+0000 7fca31abc700 1 -- 172.21.15.150:0/1637356685 wait complete. 2022-08-10T17:37:58.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.709+0000 7ff056210700 1 -- 172.21.15.150:0/4134664468 wait complete. 2022-08-10T17:37:58.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.711+0000 7ff056210700 1 Processor -- start 2022-08-10T17:37:58.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 shutdown_connections 2022-08-10T17:37:58.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7fd10fc8c700 1 -- 172.21.15.150:0/1825861923 wait complete. 2022-08-10T17:37:58.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.711+0000 7ff056210700 1 -- start start 2022-08-10T17:37:58.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0500c26c0 0x7ff05013b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0500c8990 0x7ff05015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05013c8d0 con 0x7ff050070290 2022-08-10T17:37:58.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05013bef0 con 0x7ff0500c8990 2022-08-10T17:37:58.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.712+0000 7ff056210700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05013aef0 con 0x7ff0500c26c0 2022-08-10T17:37:58.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05013c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58160/0 (socket says 172.21.15.150:58160) 2022-08-10T17:37:58.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 -- 172.21.15.150:0/380997577 learned_addr learned my addr 172.21.15.150:0/380997577 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:58.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04ffff700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0500c8990 0x7ff05015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04effd700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0500c26c0 0x7ff05013b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 -- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0500c26c0 msgr2=0x7ff05013b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0500c26c0 0x7ff05013b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 -- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0500c8990 msgr2=0x7ff05015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0500c8990 0x7ff05015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.713+0000 7ff04f7fe700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400093e0 con 0x7ff050070290 2022-08-10T17:37:58.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.714+0000 7ff04f7fe700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05013c390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c440 tx=0x7ff04400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.714+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 shutdown_connections 2022-08-10T17:37:58.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.714+0000 7fd4f815d700 1 -- 172.21.15.150:0/3024324608 wait complete. 2022-08-10T17:37:58.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.718+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 --> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f323c005ac0 con 0x7f323c0015e0 2022-08-10T17:37:58.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.717+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440052d0 con 0x7ff050070290 2022-08-10T17:37:58.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.718+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044003500 con 0x7ff050070290 2022-08-10T17:37:58.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.718+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440038b0 con 0x7ff050070290 2022-08-10T17:37:58.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.718+0000 7f3260ff9700 1 -- 172.21.15.150:0/2685143604 <== osd.2 v2:172.21.15.150:6808/98004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f323c005ac0 con 0x7f323c0015e0 2022-08-10T17:37:58.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.719+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05013caf0 con 0x7ff050070290 2022-08-10T17:37:58.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.719+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05013d0b0 con 0x7ff050070290 2022-08-10T17:37:58.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.720+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff050072890 con 0x7ff050070290 2022-08-10T17:37:58.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.722+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff044019030 con 0x7ff050070290 2022-08-10T17:37:58.858 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:37:58.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff037fff700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff030065130 0x7ff0300675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-08-10T17:37:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff044081a60 con 0x7ff050070290 2022-08-10T17:37:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff037fff700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7ff03006ef80 0x7ff0300713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff04effd700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff030065130 0x7ff0300675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff030071aa0 con 0x7ff03006ef80 2022-08-10T17:37:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.723+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff044081ee0 con 0x7ff050070290 2022-08-10T17:37:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.724+0000 7ff04effd700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff030065130 0x7ff0300675e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff040013040 tx=0x7ff040008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.863 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:58.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-08-10T17:37:58.864 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:58.865 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-08-10T17:37:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.728+0000 7ff04ffff700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7ff03006ef80 0x7ff0300713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.728+0000 7ff04ffff700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7ff03006ef80 0x7ff0300713d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:58.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f323c0015e0 msgr2=0x7f323c003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f323c0015e0 0x7f323c003a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3248065100 msgr2=0x7f32480675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3248065100 0x7f32480675b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f324c000fb0 tx=0x7f324c00a000 comp rx=0 tx=0).stop 2022-08-10T17:37:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 msgr2=0x7f32640bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 --2- 172.21.15.150:0/2685143604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32640c12e0 0x7f32640bfd70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f325400fde0 tx=0x7f325400d660 comp rx=0 tx=0).stop 2022-08-10T17:37:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f32637fe700 1 -- 172.21.15.150:0/2685143604 reap_dead start 2022-08-10T17:37:58.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 shutdown_connections 2022-08-10T17:37:58.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 >> 172.21.15.150:0/2685143604 conn(0x7f3264071e40 msgr2=0x7f32640ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== osd.7 v2:172.21.15.197:6816/98111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7ff030071aa0 con 0x7ff03006ef80 2022-08-10T17:37:58.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 shutdown_connections 2022-08-10T17:37:58.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.729+0000 7f3269891700 1 -- 172.21.15.150:0/2685143604 wait complete. 2022-08-10T17:37:58.874 INFO:teuthology.orchestra.run.smithi150.stdout:55834574882 2022-08-10T17:37:58.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-08-10T17:37:58.876 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:37:58.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-08-10T17:37:58.878 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:58.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-08-10T17:37:58.880 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:37:58.881 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-08-10T17:37:58.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.753+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 --> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff05006c140 con 0x7ff03006ef80 2022-08-10T17:37:58.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.754+0000 7ff037fff700 1 -- 172.21.15.150:0/380997577 <== osd.7 v2:172.21.15.197:6816/98111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff05006c140 con 0x7ff03006ef80 2022-08-10T17:37:58.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.754+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7ff03006ef80 msgr2=0x7ff0300713d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.754+0000 7ff056210700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7ff03006ef80 0x7ff0300713d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:58.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff030065130 msgr2=0x7ff0300675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff030065130 0x7ff0300675e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff040013040 tx=0x7ff040008030 comp rx=0 tx=0).stop 2022-08-10T17:37:58.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 msgr2=0x7ff05013c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:58.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 --2- 172.21.15.150:0/380997577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff050070290 0x7ff05013c390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c440 tx=0x7ff04400c750 comp rx=0 tx=0).stop 2022-08-10T17:37:58.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff04ffff700 1 -- 172.21.15.150:0/380997577 reap_dead start 2022-08-10T17:37:58.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 shutdown_connections 2022-08-10T17:37:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 >> 172.21.15.150:0/380997577 conn(0x7ff05006b500 msgr2=0x7ff0500c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 shutdown_connections 2022-08-10T17:37:58.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:58.755+0000 7ff056210700 1 -- 172.21.15.150:0/380997577 wait complete. 2022-08-10T17:37:58.890 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:37:58.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-08-10T17:37:59.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.102+0000 7f1b58b05700 1 Processor -- start 2022-08-10T17:37:59.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.103+0000 7f1b58b05700 1 -- start start 2022-08-10T17:37:59.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.104+0000 7f1b58b05700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.104+0000 7f1b58b05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b540c3340 0x7f1b54161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.104+0000 7f1b58b05700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b541574c0 con 0x7f1b540c8d60 2022-08-10T17:37:59.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.104+0000 7f1b58b05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b541569a0 con 0x7f1b540c3340 2022-08-10T17:37:59.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.104+0000 7f1b58b05700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54157950 con 0x7f1b540c8990 2022-08-10T17:37:59.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44160/0 (socket says 172.21.15.150:44160) 2022-08-10T17:37:59.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 -- 172.21.15.150:0/841868546 learned_addr learned my addr 172.21.15.150:0/841868546 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 -- 172.21.15.150:0/841868546 >> v2:172.21.15.150:3300/0 conn(0x7f1b540c3340 msgr2=0x7f1b54161210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:59.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 --2- 172.21.15.150:0/841868546 >> v2:172.21.15.150:3300/0 conn(0x7f1b540c3340 0x7f1b54161210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 -- 172.21.15.150:0/841868546 >> v1:172.21.15.197:6789/0 conn(0x7f1b540c8d60 legacy=0x7f1b54069910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:59.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.105+0000 7f1b5259c700 1 -- 172.21.15.150:0/841868546 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54154460 con 0x7f1b540c8990 2022-08-10T17:37:59.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.106+0000 7f1b5259c700 1 --2- 172.21.15.150:0/841868546 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed3ce3d0bc3da06 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.106+0000 7f1b5159a700 1 -- 172.21.15.150:0/841868546 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44011830 con 0x7f1b540c8990 2022-08-10T17:37:59.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.106+0000 7f1b5159a700 1 -- 172.21.15.150:0/841868546 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44011990 con 0x7f1b540c8990 2022-08-10T17:37:59.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.106+0000 7f1b5159a700 1 -- 172.21.15.150:0/841868546 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44011d40 con 0x7f1b540c8990 2022-08-10T17:37:59.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.107+0000 7f1b58b05700 1 -- 172.21.15.150:0/841868546 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 msgr2=0x7f1b540c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.107+0000 7f1b58b05700 1 --2- 172.21.15.150:0/841868546 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:59.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.111+0000 7f1b58b05700 1 -- 172.21.15.150:0/841868546 shutdown_connections 2022-08-10T17:37:59.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.111+0000 7f1b58b05700 1 --2- 172.21.15.150:0/841868546 >> v2:172.21.15.150:3300/0 conn(0x7f1b540c3340 0x7f1b54161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.111+0000 7f1b58b05700 1 --2- 172.21.15.150:0/841868546 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8990 0x7f1b540c4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.111+0000 7f1b58b05700 1 -- 172.21.15.150:0/841868546 >> 172.21.15.150:0/841868546 conn(0x7f1b5406b500 msgr2=0x7f1b5406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.112+0000 7f1b58b05700 1 -- 172.21.15.150:0/841868546 shutdown_connections 2022-08-10T17:37:59.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.112+0000 7f1b58b05700 1 -- 172.21.15.150:0/841868546 wait complete. 2022-08-10T17:37:59.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.112+0000 7f9f1d345700 1 Processor -- start 2022-08-10T17:37:59.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.112+0000 7f9f1d345700 1 -- start start 2022-08-10T17:37:59.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f1d345700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f18068930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f1d345700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 0x7f9f181556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f1d345700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f18158220 con 0x7f9f1806d340 2022-08-10T17:37:59.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f1d345700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f18158500 con 0x7f9f18155210 2022-08-10T17:37:59.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f1d345700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181587e0 con 0x7f9f1806cf70 2022-08-10T17:37:59.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f167fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9f1806d340 0x7f9f180af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42622/0 (socket says 172.21.15.150:42622) 2022-08-10T17:37:59.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f167fc700 1 -- 172.21.15.150:0/3269975042 learned_addr learned my addr 172.21.15.150:0/3269975042 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:59.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f16ffd700 1 --2- 172.21.15.150:0/3269975042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f1b58b05700 1 Processor -- start 2022-08-10T17:37:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.113+0000 7f9f177fe700 1 --2- 172.21.15.150:0/3269975042 >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 0x7f9f181556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f16ffd700 1 -- 172.21.15.150:0/3269975042 >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 msgr2=0x7f9f181556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f16ffd700 1 --2- 172.21.15.150:0/3269975042 >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 0x7f9f181556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f16ffd700 1 -- 172.21.15.150:0/3269975042 >> v1:172.21.15.150:6789/0 conn(0x7f9f1806d340 legacy=0x7f9f180af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f16ffd700 1 -- 172.21.15.150:0/3269975042 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18158ac0 con 0x7f9f1806cf70 2022-08-10T17:37:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f177fe700 1 --2- 172.21.15.150:0/3269975042 >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 0x7f9f181556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.111+0000 7f669f8f3700 1 Processor -- start 2022-08-10T17:37:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f669f8f3700 1 -- start start 2022-08-10T17:37:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f16ffd700 1 --2- 172.21.15.150:0/3269975042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f18068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f080096b0 tx=0x7f9f080099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46bc56fad32dd2b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f15ffb700 1 -- 172.21.15.150:0/3269975042 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004230 con 0x7f9f1806cf70 2022-08-10T17:37:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f15ffb700 1 -- 172.21.15.150:0/3269975042 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08004390 con 0x7f9f1806cf70 2022-08-10T17:37:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.114+0000 7f9f15ffb700 1 -- 172.21.15.150:0/3269975042 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011870 con 0x7f9f1806cf70 2022-08-10T17:37:59.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f1b58b05700 1 -- start start 2022-08-10T17:37:59.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7fea9eca6700 1 Processor -- start 2022-08-10T17:37:59.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 -- 172.21.15.150:0/3269975042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 msgr2=0x7f9f18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 --2- 172.21.15.150:0/3269975042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f18068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f080096b0 tx=0x7f9f080099c0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 -- 172.21.15.150:0/3269975042 shutdown_connections 2022-08-10T17:37:59.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 --2- 172.21.15.150:0/3269975042 >> v2:172.21.15.197:3300/0 conn(0x7f9f18155210 0x7f9f181556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 --2- 172.21.15.150:0/3269975042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f18068930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f9f1d345700 1 -- 172.21.15.150:0/3269975042 >> 172.21.15.150:0/3269975042 conn(0x7f9f180c72d0 msgr2=0x7f9f1806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7fea9eca6700 1 -- start start 2022-08-10T17:37:59.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b540c3340 0x7f1b540bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1b540c8990 0x7f1b5414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9eca6700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fea980c4100 0x7fea98069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9eca6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980707d0 con 0x7fea980c91d0 2022-08-10T17:37:59.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9eca6700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9814d250 con 0x7fea980c45b0 2022-08-10T17:37:59.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9eca6700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea98153980 con 0x7fea980c4100 2022-08-10T17:37:59.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54159240 con 0x7f1b540c3340 2022-08-10T17:37:59.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541f0330 con 0x7f1b540c8990 2022-08-10T17:37:59.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b58b05700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541ef440 con 0x7f1b540c8d60 2022-08-10T17:37:59.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9ca42700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fea980c91d0 0x7fea980c3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42628/0 (socket says 172.21.15.150:42628) 2022-08-10T17:37:59.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7fea9ca42700 1 -- 172.21.15.150:0/2818378504 learned_addr learned my addr 172.21.15.150:0/2818378504 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:59.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f669f8f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f669806c860 0x7f66980c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f669f8f3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980c4dc0 con 0x7f6698150af0 2022-08-10T17:37:59.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f669f8f3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980c5940 con 0x7f669815a570 2022-08-10T17:37:59.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.115+0000 7f669f8f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66980c9fc0 con 0x7f669806c860 2022-08-10T17:37:59.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f669de90700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f669815a570 0x7f66980c4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57214/0 (socket says 172.21.15.150:57214) 2022-08-10T17:37:59.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f669de90700 1 -- 172.21.15.150:0/92269747 learned_addr learned my addr 172.21.15.150:0/92269747 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:59.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f669ce8e700 1 --2- 172.21.15.150:0/92269747 >> v2:172.21.15.150:3300/0 conn(0x7f669806c860 0x7f66980c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b51d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1b540c8990 0x7f1b5414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7ff16d21d700 1 Processor -- start 2022-08-10T17:37:59.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b52d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b52d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44182/0 (socket says 172.21.15.150:44182) 2022-08-10T17:37:59.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f1b52d9d700 1 -- 172.21.15.150:0/2508620701 learned_addr learned my addr 172.21.15.150:0/2508620701 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f668ffff700 1 -- 172.21.15.150:0/92269747 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499993295 0 0) 0x7f66980c5940 con 0x7f669815a570 2022-08-10T17:37:59.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f668ffff700 1 -- 172.21.15.150:0/92269747 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f667c003430 con 0x7f669815a570 2022-08-10T17:37:59.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f669ce8e700 1 -- 172.21.15.150:0/92269747 >> v1:172.21.15.197:6789/0 conn(0x7f669815a570 legacy=0x7f66980c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f669ce8e700 1 -- 172.21.15.150:0/92269747 >> v1:172.21.15.150:6789/0 conn(0x7f6698150af0 legacy=0x7f6698159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f669ce8e700 1 -- 172.21.15.150:0/92269747 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669806f9a0 con 0x7f669806c860 2022-08-10T17:37:59.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 -- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1b540c8990 msgr2=0x7f1b5414c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1b540c8990 0x7f1b5414c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 -- 172.21.15.150:0/2508620701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b540c3340 msgr2=0x7f1b540bd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b540c3340 0x7f1b540bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 -- 172.21.15.150:0/2508620701 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b440093e0 con 0x7f1b540c8d60 2022-08-10T17:37:59.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7fea97fff700 1 --2- 172.21.15.150:0/2818378504 >> v2:172.21.15.197:3300/0 conn(0x7fea980c4100 0x7fea98069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b52d9d700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00b970 tx=0x7f1b4c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f669ce8e700 1 --2- 172.21.15.150:0/92269747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f669806c860 0x7f66980c3ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66940096b0 tx=0x7f66940099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e509ac4828cbf2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7fea97fff700 1 -- 172.21.15.150:0/2818378504 >> v1:172.21.15.197:6789/0 conn(0x7fea980c45b0 legacy=0x7fea9815d2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:37:59.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7fea97fff700 1 -- 172.21.15.150:0/2818378504 >> v1:172.21.15.150:6789/0 conn(0x7fea980c91d0 legacy=0x7fea980c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7fea97fff700 1 -- 172.21.15.150:0/2818378504 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98152b40 con 0x7fea980c4100 2022-08-10T17:37:59.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00c930 con 0x7f1b540c8d60 2022-08-10T17:37:59.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c00cab0 con 0x7f1b540c8d60 2022-08-10T17:37:59.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00cea0 con 0x7f1b540c8d60 2022-08-10T17:37:59.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b541ef720 con 0x7f1b540c8d60 2022-08-10T17:37:59.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b541efce0 con 0x7f1b540c8d60 2022-08-10T17:37:59.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7fea97fff700 1 --2- 172.21.15.150:0/2818378504 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c4100 0x7fea98069c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea88009f40 tx=0x7fea88009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da542bd7aec7a4e1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f668ffff700 1 -- 172.21.15.150:0/92269747 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694004230 con 0x7f669806c860 2022-08-10T17:37:59.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f71f3a6a700 1 Processor -- start 2022-08-10T17:37:59.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.116+0000 7f71f3a6a700 1 -- start start 2022-08-10T17:37:59.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f71ec0c26c0 0x7f71ec070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71ec0c3340 0x7f71ec06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c8990 0x7f71ec0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec0c9990 con 0x7f71ec0c3340 2022-08-10T17:37:59.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec15b830 con 0x7f71ec0c26c0 2022-08-10T17:37:59.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f3a6a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec15af60 con 0x7f71ec0c8990 2022-08-10T17:37:59.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f1806700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f71ec0c26c0 0x7f71ec070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f1806700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f71ec0c26c0 0x7f71ec070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40556/0 (socket says 172.21.15.150:40556) 2022-08-10T17:37:59.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.117+0000 7f71f1806700 1 -- 172.21.15.150:0/1195712348 learned_addr learned my addr 172.21.15.150:0/1195712348 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f2007700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c8990 0x7f71ec0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f1806700 1 -- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c8990 msgr2=0x7f71ec0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f1806700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c8990 0x7f71ec0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f1806700 1 -- 172.21.15.150:0/1195712348 >> v2:172.21.15.150:3300/0 conn(0x7f71ec0c3340 msgr2=0x7f71ec06dcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:37:59.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f1806700 1 --2- 172.21.15.150:0/1195712348 >> v2:172.21.15.150:3300/0 conn(0x7f71ec0c3340 0x7f71ec06dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f71f1806700 1 -- 172.21.15.150:0/1195712348 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0c4e80 con 0x7f71ec0c26c0 2022-08-10T17:37:59.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7fea977fe700 1 -- 172.21.15.150:0/2818378504 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88004230 con 0x7fea980c4100 2022-08-10T17:37:59.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7fea977fe700 1 -- 172.21.15.150:0/2818378504 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88004390 con 0x7fea980c4100 2022-08-10T17:37:59.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7fea977fe700 1 -- 172.21.15.150:0/2818378504 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800f980 con 0x7fea980c4100 2022-08-10T17:37:59.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7fea9eca6700 1 -- 172.21.15.150:0/2818378504 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c4100 msgr2=0x7fea98069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2818378504 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c4100 0x7fea98069c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea88009f40 tx=0x7fea88009340 comp rx=0 tx=0).stop 2022-08-10T17:37:59.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f668ffff700 1 -- 172.21.15.150:0/92269747 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694004390 con 0x7f669806c860 2022-08-10T17:37:59.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.118+0000 7f668ffff700 1 -- 172.21.15.150:0/92269747 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940107b0 con 0x7f669806c860 2022-08-10T17:37:59.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f669f8f3700 1 -- 172.21.15.150:0/92269747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f669806c860 msgr2=0x7f66980c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f669f8f3700 1 --2- 172.21.15.150:0/92269747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f669806c860 0x7f66980c3ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66940096b0 tx=0x7f66940099c0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f9f1d345700 1 -- 172.21.15.150:0/3269975042 shutdown_connections 2022-08-10T17:37:59.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f71f1806700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c26c0 0x7f71ec070290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0c6580 tx=0x7f71e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a8c84f154a6c1aa server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f9f1d345700 1 -- 172.21.15.150:0/3269975042 wait complete. 2022-08-10T17:37:59.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7ff16d21d700 1 -- start start 2022-08-10T17:37:59.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7fea9eca6700 1 -- 172.21.15.150:0/2818378504 shutdown_connections 2022-08-10T17:37:59.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2818378504 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c4100 0x7fea98069c80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7fea9eca6700 1 -- 172.21.15.150:0/2818378504 >> 172.21.15.150:0/2818378504 conn(0x7fea9806b500 msgr2=0x7fea9806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1b4c01b030 con 0x7f1b540c8d60 2022-08-10T17:37:59.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.119+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b54072890 con 0x7f1b540c8d60 2022-08-10T17:37:59.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f1b42ffd700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 0x7f1b30067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1b4c081db0 con 0x7f1b540c8d60 2022-08-10T17:37:59.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7fea9eca6700 1 -- 172.21.15.150:0/2818378504 shutdown_connections 2022-08-10T17:37:59.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f669f8f3700 1 -- 172.21.15.150:0/92269747 shutdown_connections 2022-08-10T17:37:59.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f669f8f3700 1 --2- 172.21.15.150:0/92269747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f669806c860 0x7f66980c3ec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f669f8f3700 1 -- 172.21.15.150:0/92269747 >> 172.21.15.150:0/92269747 conn(0x7f66980c92f0 msgr2=0x7f66980c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 0x7ff1680c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1680c3340 0x7ff16815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff16806a890 0x7ff1680c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680c5110 con 0x7ff1680c3340 2022-08-10T17:37:59.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680c4180 con 0x7ff16806a4c0 2022-08-10T17:37:59.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7ff16d21d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815be10 con 0x7ff16806a890 2022-08-10T17:37:59.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.120+0000 7f1b5259c700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 0x7f1b30067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1680c3340 0x7ff16815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1680c3340 0x7ff16815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58202/0 (socket says 172.21.15.150:58202) 2022-08-10T17:37:59.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 -- 172.21.15.150:0/2333129015 learned_addr learned my addr 172.21.15.150:0/2333129015 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16759e700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff16806a890 0x7ff1680c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7fea9eca6700 1 -- 172.21.15.150:0/2818378504 wait complete. 2022-08-10T17:37:59.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f669f8f3700 1 -- 172.21.15.150:0/92269747 shutdown_connections 2022-08-10T17:37:59.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f669f8f3700 1 -- 172.21.15.150:0/92269747 wait complete. 2022-08-10T17:37:59.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f9f1d345700 1 Processor -- start 2022-08-10T17:37:59.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f71f0804700 1 -- 172.21.15.150:0/1195712348 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400e070 con 0x7f71ec0c26c0 2022-08-10T17:37:59.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f71f0804700 1 -- 172.21.15.150:0/1195712348 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400b9c0 con 0x7f71ec0c26c0 2022-08-10T17:37:59.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f71f0804700 1 -- 172.21.15.150:0/1195712348 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400bd70 con 0x7f71ec0c26c0 2022-08-10T17:37:59.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 -- 172.21.15.150:0/2333129015 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff16806a890 msgr2=0x7ff1680c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff16806a890 0x7ff1680c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff16659c700 1 -- 172.21.15.150:0/2333129015 >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 msgr2=0x7ff1680c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7ff166d9d700 1 --2- 172.21.15.150:0/2333129015 >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 0x7ff1680c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff16659c700 1 --2- 172.21.15.150:0/2333129015 >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 0x7ff1680c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff16659c700 1 -- 172.21.15.150:0/2333129015 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680c37d0 con 0x7ff1680c3340 2022-08-10T17:37:59.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff166d9d700 1 --2- 172.21.15.150:0/2333129015 >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 0x7ff1680c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:59.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 -- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c26c0 msgr2=0x7f71ec070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c26c0 0x7f71ec070290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0c6580 tx=0x7f71e400b330 comp rx=0 tx=0).stop 2022-08-10T17:37:59.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 -- 172.21.15.150:0/1195712348 shutdown_connections 2022-08-10T17:37:59.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c8990 0x7f71ec0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/1195712348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c26c0 0x7f71ec070290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/1195712348 >> v2:172.21.15.150:3300/0 conn(0x7f71ec0c3340 0x7f71ec06dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 -- 172.21.15.150:0/1195712348 >> 172.21.15.150:0/1195712348 conn(0x7f71ec06b500 msgr2=0x7f71ec06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff16659c700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1680c3340 0x7ff16815b8d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff16806c920 tx=0x7ff158009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896a3c529595ffd8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff165d9b700 1 -- 172.21.15.150:0/2333129015 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158004230 con 0x7ff1680c3340 2022-08-10T17:37:59.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff165d9b700 1 -- 172.21.15.150:0/2333129015 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158004390 con 0x7ff1680c3340 2022-08-10T17:37:59.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7ff165d9b700 1 -- 172.21.15.150:0/2333129015 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011850 con 0x7ff1680c3340 2022-08-10T17:37:59.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 -- 172.21.15.150:0/2333129015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1680c3340 msgr2=0x7ff16815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1680c3340 0x7ff16815b8d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff16806c920 tx=0x7ff158009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:59.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 -- 172.21.15.150:0/2333129015 shutdown_connections 2022-08-10T17:37:59.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff16806a890 0x7ff1680c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 --2- 172.21.15.150:0/2333129015 >> v2:172.21.15.197:3300/0 conn(0x7ff16806a4c0 0x7ff1680c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 --2- 172.21.15.150:0/2333129015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1680c3340 0x7ff16815b8d0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff16806c920 tx=0x7ff158009a60 comp rx=0 tx=0).stop 2022-08-10T17:37:59.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7ff16d21d700 1 -- 172.21.15.150:0/2333129015 >> 172.21.15.150:0/2333129015 conn(0x7ff16806b500 msgr2=0x7ff16806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7fea9eca6700 1 Processor -- start 2022-08-10T17:37:59.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7fea9eca6700 1 -- start start 2022-08-10T17:37:59.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f669f8f3700 1 Processor -- start 2022-08-10T17:37:59.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.121+0000 7f9f1d345700 1 -- start start 2022-08-10T17:37:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f1814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9f18155210 0x7f9f18146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18145c00 con 0x7f9f1806d340 2022-08-10T17:37:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1814ac90 con 0x7f9f18155210 2022-08-10T17:37:59.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f1d345700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1814af20 con 0x7f9f1806cf70 2022-08-10T17:37:59.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f167fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f167fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58210/0 (socket says 172.21.15.150:58210) 2022-08-10T17:37:59.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f167fc700 1 -- 172.21.15.150:0/2870065931 learned_addr learned my addr 172.21.15.150:0/2870065931 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f9f177fe700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9f18155210 0x7f9f18146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 -- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 msgr2=0x7f9f1814a750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:37:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f1814a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 -- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9f18155210 msgr2=0x7f9f18146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9f18155210 0x7f9f18146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 -- 172.21.15.150:0/2870065931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08009310 con 0x7f9f1806d340 2022-08-10T17:37:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f167fc700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c490 tx=0x7f9f0c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0074e0 con 0x7f9f1806d340 2022-08-10T17:37:59.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c007640 con 0x7f9f1806d340 2022-08-10T17:37:59.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f18145e50 con 0x7f9f1806d340 2022-08-10T17:37:59.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.122+0000 7f71f3a6a700 1 -- 172.21.15.150:0/1195712348 shutdown_connections 2022-08-10T17:37:59.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 0x7fea981dc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea980c45b0 0x7fea980bd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980bdbf0 con 0x7fea980c4100 2022-08-10T17:37:59.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980bd890 con 0x7fea980c91d0 2022-08-10T17:37:59.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fea9eca6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9814d400 con 0x7fea980c45b0 2022-08-10T17:37:59.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f71f3a6a700 1 -- 172.21.15.150:0/1195712348 wait complete. 2022-08-10T17:37:59.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f669f8f3700 1 -- start start 2022-08-10T17:37:59.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 0x7f66980be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6698150af0 0x7f669806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 0x7f669813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669814bf20 con 0x7f6698150af0 2022-08-10T17:37:59.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669814cd00 con 0x7f669815a570 2022-08-10T17:37:59.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669f8f3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669814ba40 con 0x7f669806c860 2022-08-10T17:37:59.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669d68f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 0x7f66980be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669d68f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 0x7f66980be7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44206/0 (socket says 172.21.15.150:44206) 2022-08-10T17:37:59.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669d68f700 1 -- 172.21.15.150:0/1164094209 learned_addr learned my addr 172.21.15.150:0/1164094209 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7f669de90700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 0x7f669813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.124+0000 7fdd7356b700 1 Processor -- start 2022-08-10T17:37:59.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0059d0 con 0x7f9f1806d340 2022-08-10T17:37:59.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.123+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f18146410 con 0x7f9f1806d340 2022-08-10T17:37:59.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40582/0 (socket says 172.21.15.150:40582) 2022-08-10T17:37:59.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 -- 172.21.15.150:0/2729059168 learned_addr learned my addr 172.21.15.150:0/2729059168 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea97fff700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea980c45b0 0x7fea980bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9ca42700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 0x7fea981dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669ce8e700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6698150af0 0x7f669806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669de90700 1 -- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 msgr2=0x7f66980be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669de90700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 0x7f66980be7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669de90700 1 -- 172.21.15.150:0/1164094209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6698150af0 msgr2=0x7f669806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669de90700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6698150af0 0x7f669806b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f669de90700 1 -- 172.21.15.150:0/1164094209 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009310 con 0x7f669815a570 2022-08-10T17:37:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f18072890 con 0x7f9f1806d340 2022-08-10T17:37:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 -- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea980c45b0 msgr2=0x7fea980bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea980c45b0 0x7fea980bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 -- 172.21.15.150:0/2729059168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 msgr2=0x7fea981dc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 0x7fea981dc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 -- 172.21.15.150:0/2729059168 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88009ba0 con 0x7fea980c91d0 2022-08-10T17:37:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9ca42700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 0x7fea981dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:37:59.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7ff16d21d700 1 -- 172.21.15.150:0/2333129015 shutdown_connections 2022-08-10T17:37:59.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fea9d243700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b440 tx=0x7fea8c00b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1b4c04c6b0 con 0x7f1b540c8d60 2022-08-10T17:37:59.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7f1b5259c700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 0x7f1b30067560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7f669de90700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 0x7f669813f1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f669000c730 tx=0x7f669000caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.125+0000 7fdd7356b700 1 -- start start 2022-08-10T17:37:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd7356b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd6c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd7356b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0c18f0 con 0x7fdd6c156e00 2022-08-10T17:37:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd7356b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0c6fd0 con 0x7fdd6c0c2d50 2022-08-10T17:37:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd7356b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0c2220 con 0x7fdd6c0701f0 2022-08-10T17:37:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd70b06700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdd6c156e00 0x7fdd6c0c2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42674/0 (socket says 172.21.15.150:42674) 2022-08-10T17:37:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fdd70b06700 1 -- 172.21.15.150:0/1120578278 learned_addr learned my addr 172.21.15.150:0/1120578278 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:37:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7f71f3a6a700 1 Processor -- start 2022-08-10T17:37:59.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c011830 con 0x7fea980c91d0 2022-08-10T17:37:59.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c0119b0 con 0x7fea980c91d0 2022-08-10T17:37:59.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c011d60 con 0x7fea980c91d0 2022-08-10T17:37:59.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9814df80 con 0x7fea980c91d0 2022-08-10T17:37:59.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9814d650 con 0x7fea980c91d0 2022-08-10T17:37:59.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.127+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9f0c019030 con 0x7f9f1806d340 2022-08-10T17:37:59.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.127+0000 7f9eff7fe700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 0x7f9ef8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.127+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9f0c081910 con 0x7f9f1806d340 2022-08-10T17:37:59.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f9f16ffd700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 0x7f9ef8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.126+0000 7ff16d21d700 1 -- 172.21.15.150:0/2333129015 wait complete. 2022-08-10T17:37:59.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7ff16d21d700 1 Processor -- start 2022-08-10T17:37:59.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.127+0000 7f71f3a6a700 1 -- start start 2022-08-10T17:37:59.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 0x7f71ec146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c8990 0x7f71ec141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec14a260 con 0x7f71ec0c3340 2022-08-10T17:37:59.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec14a540 con 0x7f71ec0c8990 2022-08-10T17:37:59.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f3a6a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec14a820 con 0x7f71ec0c26c0 2022-08-10T17:37:59.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7ff16d21d700 1 -- start start 2022-08-10T17:37:59.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f1005700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 0x7f71ec146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f1806700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f1005700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 0x7f71ec146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58236/0 (socket says 172.21.15.150:58236) 2022-08-10T17:37:59.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f1806700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44224/0 (socket says 172.21.15.150:44224) 2022-08-10T17:37:59.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f1005700 1 -- 172.21.15.150:0/3498336466 learned_addr learned my addr 172.21.15.150:0/3498336466 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.128+0000 7f71f2007700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c8990 0x7f71ec141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 -- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c8990 msgr2=0x7f71ec141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c8990 0x7f71ec141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 -- 172.21.15.150:0/3498336466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 msgr2=0x7f71ec146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 0x7f71ec146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 -- 172.21.15.150:0/3498336466 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009b30 con 0x7f71ec0c26c0 2022-08-10T17:37:59.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f1806700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71e4015000 tx=0x7f71e4004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff16806a4c0 0x7ff168153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff16806a890 0x7ff1681e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681e3e00 con 0x7ff16806a4c0 2022-08-10T17:37:59.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680bf8b0 con 0x7ff16806a890 2022-08-10T17:37:59.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7ff16d21d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680c8370 con 0x7ff168152fa0 2022-08-10T17:37:59.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004450 con 0x7f71ec0c26c0 2022-08-10T17:37:59.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40045b0 con 0x7f71ec0c26c0 2022-08-10T17:37:59.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40092e0 con 0x7f71ec0c26c0 2022-08-10T17:37:59.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fea8c021070 con 0x7fea980c91d0 2022-08-10T17:37:59.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec14ab00 con 0x7f71ec0c26c0 2022-08-10T17:37:59.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec142c10 con 0x7f71ec0c26c0 2022-08-10T17:37:59.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7fea957fa700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 0x7fea78067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fea8c0820c0 con 0x7fea980c91d0 2022-08-10T17:37:59.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7ff16759e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7ff16759e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44230/0 (socket says 172.21.15.150:44230) 2022-08-10T17:37:59.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7ff16759e700 1 -- 172.21.15.150:0/1171672007 learned_addr learned my addr 172.21.15.150:0/1171672007 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.130+0000 7ff166d9d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff16806a4c0 0x7ff168153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 -- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff16806a890 msgr2=0x7ff1681e4820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:37:59.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff16806a890 0x7ff1681e4820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 -- 172.21.15.150:0/1171672007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff16806a4c0 msgr2=0x7ff168153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff16806a4c0 0x7ff168153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 -- 172.21.15.150:0/1171672007 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580093e0 con 0x7ff168152fa0 2022-08-10T17:37:59.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c8005170 con 0x7f71ec0c26c0 2022-08-10T17:37:59.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7fea9ca42700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 0x7fea78067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900070d0 con 0x7f669815a570 2022-08-10T17:37:59.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690007230 con 0x7f669815a570 2022-08-10T17:37:59.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.129+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900075a0 con 0x7f669815a570 2022-08-10T17:37:59.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7ff16759e700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff160009cb0 tx=0x7ff16000c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980bed30 con 0x7f669815a570 2022-08-10T17:37:59.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669814cef0 con 0x7f669815a570 2022-08-10T17:37:59.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.131+0000 7fea9ca42700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 0x7fea78067660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea900012e0 tx=0x7fea90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.132+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f71e401c440 con 0x7f71ec0c26c0 2022-08-10T17:37:59.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.132+0000 7f71e27fc700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 0x7f71d40675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.132+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f71e4083b30 con 0x7f71ec0c26c0 2022-08-10T17:37:59.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.132+0000 7f71f1005700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 0x7f71d40675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7f71f1005700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 0x7f71d40675b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71ec1478f0 tx=0x7f71dc0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6690019030 con 0x7f669815a570 2022-08-10T17:37:59.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793030886 0 0) 0x7fdd6c0c18f0 con 0x7fdd6c156e00 2022-08-10T17:37:59.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd54003430 con 0x7fdd6c156e00 2022-08-10T17:37:59.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7fdd71307700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd6c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7f668dffb700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 0x7f66800675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135715182 0 0) 0x7fdd54003430 con 0x7fdd6c156e00 2022-08-10T17:37:59.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 msgr2=0x7fdd6c0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd6c0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 >> v1:172.21.15.197:6789/0 conn(0x7fdd6c0c2d50 legacy=0x7fdd6c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0c72b0 con 0x7fdd6c156e00 2022-08-10T17:37:59.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fdd640019f0 con 0x7fdd6c156e00 2022-08-10T17:37:59.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 >> v1:172.21.15.150:6789/0 conn(0x7fdd6c156e00 legacy=0x7fdd6c0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f66900815b0 con 0x7f669815a570 2022-08-10T17:37:59.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540038b0 0x7fdd54003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd540046d0 0x7fdd54004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd54005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0c2220 con 0x7fdd540046d0 2022-08-10T17:37:59.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5400fe10 con 0x7fdd540038b0 2022-08-10T17:37:59.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5400ffd0 con 0x7fdd6c0701f0 2022-08-10T17:37:59.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7f9f16ffd700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 0x7f9ef8067590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f080045a0 tx=0x7f9f08008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.133+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f9f0c04f880 con 0x7f9f1806d340 2022-08-10T17:37:59.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74005170 con 0x7fea980c91d0 2022-08-10T17:37:59.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd540046d0 0x7fdd54004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd71b08700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd54005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd71307700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540038b0 0x7fdd54003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669806e290 con 0x7f669815a570 2022-08-10T17:37:59.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7f669d68f700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 0x7f66800675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 -- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 msgr2=0x7fdd54005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd54005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 -- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540038b0 msgr2=0x7fdd54003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540038b0 0x7fdd54003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd70b06700 1 -- 172.21.15.150:0/1120578278 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54003430 con 0x7fdd540046d0 2022-08-10T17:37:59.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.134+0000 7fdd71b08700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c0701f0 0x7fdd54005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:37:59.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.135+0000 7fdd70b06700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd540046d0 0x7fdd54004b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c490 tx=0x7fdd54005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202d86991909d788 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.135+0000 7f669d68f700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 0x7f66800675b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66880016d0 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.135+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64005b60 con 0x7fdd540046d0 2022-08-10T17:37:59.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.135+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64005cc0 con 0x7fdd540046d0 2022-08-10T17:37:59.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.135+0000 7fdd5bfff700 1 -- 172.21.15.150:0/1120578278 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640072f0 con 0x7fdd540046d0 2022-08-10T17:37:59.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 -- 172.21.15.150:0/1120578278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd540046d0 msgr2=0x7fdd54004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 --2- 172.21.15.150:0/1120578278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd540046d0 0x7fdd54004b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c490 tx=0x7fdd54005700 comp rx=0 tx=0).stop 2022-08-10T17:37:59.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd71b08700 1 -- 172.21.15.150:0/1120578278 reap_dead start 2022-08-10T17:37:59.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 -- 172.21.15.150:0/1120578278 shutdown_connections 2022-08-10T17:37:59.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 -- 172.21.15.150:0/1120578278 >> 172.21.15.150:0/1120578278 conn(0x7fdd6c06c5d0 msgr2=0x7fdd6c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 -- 172.21.15.150:0/1120578278 shutdown_connections 2022-08-10T17:37:59.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7fdd7356b700 1 -- 172.21.15.150:0/1120578278 wait complete. 2022-08-10T17:37:59.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16000cb80 con 0x7ff168152fa0 2022-08-10T17:37:59.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16000f040 con 0x7ff168152fa0 2022-08-10T17:37:59.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680bf610 con 0x7ff168152fa0 2022-08-10T17:37:59.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f71e4051b50 con 0x7f71ec0c26c0 2022-08-10T17:37:59.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1680c6aa0 con 0x7ff168152fa0 2022-08-10T17:37:59.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.136+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160014480 con 0x7ff168152fa0 2022-08-10T17:37:59.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.137+0000 7fdd7356b700 1 Processor -- start 2022-08-10T17:37:59.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.137+0000 7fdd7356b700 1 -- start start 2022-08-10T17:37:59.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540046d0 0x7fdd6c1e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 0x7fdd6c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1e8bd0 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0bddc0 con 0x7fdd540046d0 2022-08-10T17:37:59.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd7356b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0bd7d0 con 0x7fdd6c1549b0 2022-08-10T17:37:59.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff144005170 con 0x7ff168152fa0 2022-08-10T17:37:59.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd71b08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd71307700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540046d0 0x7fdd6c1e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd71b08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58260/0 (socket says 172.21.15.150:58260) 2022-08-10T17:37:59.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd71b08700 1 -- 172.21.15.150:0/596017639 learned_addr learned my addr 172.21.15.150:0/596017639 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7fdd70b06700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 0x7fdd6c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.138+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff1600145e0 con 0x7ff168152fa0 2022-08-10T17:37:59.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7ff14f7fe700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 0x7ff148067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff160082f70 con 0x7ff168152fa0 2022-08-10T17:37:59.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7ff166d9d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 0x7ff148067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 -- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 msgr2=0x7fdd6c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 0x7fdd6c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 -- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540046d0 msgr2=0x7fdd6c1e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540046d0 0x7fdd6c1e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 -- 172.21.15.150:0/596017639 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c1e7d30 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd70b06700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 0x7fdd6c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:37:59.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fea8c015070 con 0x7fea980c91d0 2022-08-10T17:37:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.139+0000 7fdd71b08700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd68000c00 tx=0x7fdd6800fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68005340 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7ff166d9d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 0x7ff148067560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00aa60 tx=0x7ff15c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c1e8010 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68007030 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680073e0 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.140+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c1e85d0 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.141+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c06dfa0 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.142+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdd6801c030 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.142+0000 7fdd59ffb700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 0x7fdd4c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.142+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdd68081230 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.143+0000 7fdd71307700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 0x7fdd4c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.143+0000 7fdd71307700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 0x7fdd4c067590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c003520 tx=0x7fdd5c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.143+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff160050f50 con 0x7ff168152fa0 2022-08-10T17:37:59.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.147+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fdd68086060 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.148+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f669004a6b0 con 0x7f669815a570 2022-08-10T17:37:59.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.148+0000 7fccf7077700 1 Processor -- start 2022-08-10T17:37:59.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.154+0000 7fccf7077700 1 -- start start 2022-08-10T17:37:59.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.155+0000 7fccf7077700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.155+0000 7fccf7077700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf006e0e0 con 0x7fccf015ba60 2022-08-10T17:37:59.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.155+0000 7fccf7077700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf006ddb0 con 0x7fccf015b690 2022-08-10T17:37:59.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.155+0000 7fccf7077700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00c46e0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44258/0 (socket says 172.21.15.150:44258) 2022-08-10T17:37:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 -- 172.21.15.150:0/3982330610 learned_addr learned my addr 172.21.15.150:0/3982330610 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 -- 172.21.15.150:0/3982330610 >> v1:172.21.15.197:6789/0 conn(0x7fccf015b690 legacy=0x7fccf006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 -- 172.21.15.150:0/3982330610 >> v1:172.21.15.150:6789/0 conn(0x7fccf015ba60 legacy=0x7fccf0165580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:37:59.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.163+0000 7fcceffff700 1 -- 172.21.15.150:0/3982330610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00aedf0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.164+0000 7fcceffff700 1 --2- 172.21.15.150:0/3982330610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009780 tx=0x7fcce4009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33f3c50ac2765d2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.170+0000 7fccef7fe700 1 -- 172.21.15.150:0/3982330610 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011830 con 0x7fccf00c9bb0 2022-08-10T17:37:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.170+0000 7fccef7fe700 1 -- 172.21.15.150:0/3982330610 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4011990 con 0x7fccf00c9bb0 2022-08-10T17:37:59.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.170+0000 7fccef7fe700 1 -- 172.21.15.150:0/3982330610 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011d40 con 0x7fccf00c9bb0 2022-08-10T17:37:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.171+0000 7fccf7077700 1 -- 172.21.15.150:0/3982330610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 msgr2=0x7fccf015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.171+0000 7fccf7077700 1 --2- 172.21.15.150:0/3982330610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009780 tx=0x7fcce4009a90 comp rx=0 tx=0).stop 2022-08-10T17:37:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.172+0000 7fccf7077700 1 -- 172.21.15.150:0/3982330610 shutdown_connections 2022-08-10T17:37:59.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.172+0000 7fccf7077700 1 --2- 172.21.15.150:0/3982330610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015e2e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.172+0000 7fccf7077700 1 -- 172.21.15.150:0/3982330610 >> 172.21.15.150:0/3982330610 conn(0x7fccf00c8f10 msgr2=0x7fccf00c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.172+0000 7fccf7077700 1 -- 172.21.15.150:0/3982330610 shutdown_connections 2022-08-10T17:37:59.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.172+0000 7fccf7077700 1 -- 172.21.15.150:0/3982330610 wait complete. 2022-08-10T17:37:59.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.174+0000 7fccf7077700 1 Processor -- start 2022-08-10T17:37:59.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.175+0000 7fccf7077700 1 -- start start 2022-08-10T17:37:59.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fccf015b690 0x7fccf0152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf015ba60 0x7fccf006b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf015cef0 con 0x7fccf015ba60 2022-08-10T17:37:59.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0152ed0 con 0x7fccf015b690 2022-08-10T17:37:59.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.176+0000 7fccf7077700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf015bff0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.177+0000 7fccf4e13700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.177+0000 7fccf4e13700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44264/0 (socket says 172.21.15.150:44264) 2022-08-10T17:37:59.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.177+0000 7fccf4e13700 1 -- 172.21.15.150:0/2839216868 learned_addr learned my addr 172.21.15.150:0/2839216868 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:37:59.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.177+0000 7fcceffff700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fccf015b690 0x7fccf0152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf5614700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf015ba60 0x7fccf006b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 -- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fccf015b690 msgr2=0x7fccf0152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fccf015b690 0x7fccf0152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 -- 172.21.15.150:0/2839216868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf015ba60 msgr2=0x7fccf006b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf015ba60 0x7fccf006b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 -- 172.21.15.150:0/2839216868 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40093e0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.178+0000 7fccf4e13700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c3c0 tx=0x7fcce000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.180+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00052d0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.180+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0003500 con 0x7fccf00c9bb0 2022-08-10T17:37:59.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.180+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00038b0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.180+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf015c290 con 0x7fccf00c9bb0 2022-08-10T17:37:59.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.180+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf015c830 con 0x7fccf00c9bb0 2022-08-10T17:37:59.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.182+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc005170 con 0x7fccf00c9bb0 2022-08-10T17:37:59.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.183+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcce0019030 con 0x7fccf00c9bb0 2022-08-10T17:37:59.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.184+0000 7fcced7fa700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 0x7fccd0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:37:59.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.184+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcce00814c0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.184+0000 7fcceffff700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 0x7fccd0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:37:59.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.185+0000 7fcceffff700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 0x7fccd0067560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fccf00c9f80 tx=0x7fcce401d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:37:59.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.188+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcce004f3b0 con 0x7fccf00c9bb0 2022-08-10T17:37:59.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.501+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1b540bf800 con 0x7f1b540c8d60 2022-08-10T17:37:59.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.502+0000 7f1b42ffd700 1 -- 172.21.15.150:0/2508620701 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b4c019070 con 0x7f1b540c8d60 2022-08-10T17:37:59.508 INFO:teuthology.orchestra.run.smithi150.stdout:55834574879 2022-08-10T17:37:59.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 msgr2=0x7f1b30067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 0x7f1b30067560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44010000 comp rx=0 tx=0).stop 2022-08-10T17:37:59.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 msgr2=0x7f1b5406a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00b970 tx=0x7f1b4c00bc80 comp rx=0 tx=0).stop 2022-08-10T17:37:59.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 shutdown_connections 2022-08-10T17:37:59.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1b300650b0 0x7f1b30067560 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44010000 comp rx=0 tx=0).stop 2022-08-10T17:37:59.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1b540c8d60 0x7f1b5406a0e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b540c3340 0x7f1b540bd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 --2- 172.21.15.150:0/2508620701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1b540c8990 0x7f1b5414c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 >> 172.21.15.150:0/2508620701 conn(0x7f1b5406b500 msgr2=0x7f1b540c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.506+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6698072890 con 0x7f669815a570 2022-08-10T17:37:59.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.507+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f18158da0 con 0x7f9f1806d340 2022-08-10T17:37:59.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.507+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 shutdown_connections 2022-08-10T17:37:59.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.507+0000 7f1b58b05700 1 -- 172.21.15.150:0/2508620701 wait complete. 2022-08-10T17:37:59.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.507+0000 7f668dffb700 1 -- 172.21.15.150:0/1164094209 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6690017080 con 0x7f669815a570 2022-08-10T17:37:59.515 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:37:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 msgr2=0x7f66800675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 0x7f66800675b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66880016d0 tx=0x7f6688009040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 msgr2=0x7f669813f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 0x7f669813f1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f669000c730 tx=0x7f669000caf0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 shutdown_connections 2022-08-10T17:37:59.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f669815a570 0x7f669813f1c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6680065100 0x7f66800675b0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66880016d0 tx=0x7f6688009040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f669806c860 0x7f66980be7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 --2- 172.21.15.150:0/1164094209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6698150af0 0x7f669806b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.510+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 >> 172.21.15.150:0/1164094209 conn(0x7f66980c92f0 msgr2=0x7f669814f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.511+0000 7f9eff7fe700 1 -- 172.21.15.150:0/2870065931 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f0c017020 con 0x7f9f1806d340 2022-08-10T17:37:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:55834574879 2022-08-10T17:37:59.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.518+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff144005420 con 0x7ff168152fa0 2022-08-10T17:37:59.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.519+0000 7ff14f7fe700 1 -- 172.21.15.150:0/1171672007 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff160018070 con 0x7ff168152fa0 2022-08-10T17:37:59.523 INFO:teuthology.orchestra.run.smithi150.stdout:55834574879 2022-08-10T17:37:59.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.519+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 msgr2=0x7f9ef8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.519+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 0x7f9ef8067590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f080045a0 tx=0x7f9f08008030 comp rx=0 tx=0).stop 2022-08-10T17:37:59.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.519+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 msgr2=0x7f9f1814ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.519+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c490 tx=0x7f9f0c00c7a0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 shutdown_connections 2022-08-10T17:37:59.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9f18155210 0x7f9f18146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9ef80650e0 0x7f9ef8067590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9f1806cf70 0x7f9f1814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 --2- 172.21.15.150:0/2870065931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1806d340 0x7f9f1814ef40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.520+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 >> 172.21.15.150:0/2870065931 conn(0x7f9f180c72d0 msgr2=0x7f9f1806b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 shutdown_connections 2022-08-10T17:37:59.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7f9f1d345700 1 -- 172.21.15.150:0/2870065931 wait complete. 2022-08-10T17:37:59.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea74005420 con 0x7fea980c91d0 2022-08-10T17:37:59.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 msgr2=0x7ff148067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 0x7ff148067560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00aa60 tx=0x7ff15c008040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 msgr2=0x7ff1681533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff160009cb0 tx=0x7ff16000c0c0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 shutdown_connections 2022-08-10T17:37:59.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1480650b0 0x7ff148067560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff168152fa0 0x7ff1681533f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.521+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff16806a4c0 0x7ff168153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7ff16d21d700 1 --2- 172.21.15.150:0/1171672007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff16806a890 0x7ff1681e4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 >> 172.21.15.150:0/1171672007 conn(0x7ff16806b500 msgr2=0x7ff16806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 shutdown_connections 2022-08-10T17:37:59.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7ff16d21d700 1 -- 172.21.15.150:0/1171672007 wait complete. 2022-08-10T17:37:59.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71c80056f0 con 0x7f71ec0c26c0 2022-08-10T17:37:59.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.522+0000 7f71e27fc700 1 -- 172.21.15.150:0/3498336466 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71e4055170 con 0x7f71ec0c26c0 2022-08-10T17:37:59.533 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:59.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.525+0000 7fea957fa700 1 -- 172.21.15.150:0/2729059168 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea8c050030 con 0x7fea980c91d0 2022-08-10T17:37:59.534 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:59.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574879 for osd.6 2022-08-10T17:37:59.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 msgr2=0x7f71d40675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 0x7f71d40675b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71ec1478f0 tx=0x7f71dc0090e0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 msgr2=0x7f71ec1426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71e4015000 tx=0x7f71e4004950 comp rx=0 tx=0).stop 2022-08-10T17:37:59.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 shutdown_connections 2022-08-10T17:37:59.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71ec0c8990 0x7f71ec141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f71d4065100 0x7f71d40675b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71ec0c26c0 0x7f71ec1426d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 --2- 172.21.15.150:0/3498336466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71ec0c3340 0x7f71ec146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 >> 172.21.15.150:0/3498336466 conn(0x7f71ec06b500 msgr2=0x7f71ec06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 shutdown_connections 2022-08-10T17:37:59.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.527+0000 7f71f3a6a700 1 -- 172.21.15.150:0/3498336466 wait complete. 2022-08-10T17:37:59.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.529+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 msgr2=0x7fea78067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.529+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 0x7fea78067660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea900012e0 tx=0x7fea90009040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.529+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 msgr2=0x7fea9814ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.529+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b440 tx=0x7fea8c00b800 comp rx=0 tx=0).stop 2022-08-10T17:37:59.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.525+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 shutdown_connections 2022-08-10T17:37:59.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.525+0000 7f669f8f3700 1 -- 172.21.15.150:0/1164094209 wait complete. 2022-08-10T17:37:59.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 shutdown_connections 2022-08-10T17:37:59.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea980c91d0 0x7fea9814ee20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea980c4100 0x7fea981dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea780651b0 0x7fea78067660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fea9eca6700 1 --2- 172.21.15.150:0/2729059168 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea980c45b0 0x7fea980bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.531+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 >> 172.21.15.150:0/2729059168 conn(0x7fea9806b500 msgr2=0x7fea980c6900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.530+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdd6c0bdf30 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.531+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 shutdown_connections 2022-08-10T17:37:59.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.531+0000 7fea9eca6700 1 -- 172.21.15.150:0/2729059168 wait complete. 2022-08-10T17:37:59.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.531+0000 7fdd59ffb700 1 -- 172.21.15.150:0/596017639 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd68086090 con 0x7fdd6c0c03b0 2022-08-10T17:37:59.546 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:59.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 msgr2=0x7fdd4c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 0x7fdd4c067590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c003520 tx=0x7fdd5c008040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 msgr2=0x7fdd6c0be250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd68000c00 tx=0x7fdd6800fa50 comp rx=0 tx=0).stop 2022-08-10T17:37:59.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 shutdown_connections 2022-08-10T17:37:59.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd6c0c03b0 0x7fdd6c0be250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdd540046d0 0x7fdd6c1e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdd4c0650e0 0x7fdd4c067590 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 --2- 172.21.15.150:0/596017639 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdd6c1549b0 0x7fdd6c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 >> 172.21.15.150:0/596017639 conn(0x7fdd6c06c5d0 msgr2=0x7fdd6c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 shutdown_connections 2022-08-10T17:37:59.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.534+0000 7fdd7356b700 1 -- 172.21.15.150:0/596017639 wait complete. 2022-08-10T17:37:59.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574879 for osd.1 2022-08-10T17:37:59.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574879 for osd.0 2022-08-10T17:37:59.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.4 2022-08-10T17:37:59.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574880 for osd.3 2022-08-10T17:37:59.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.554+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcccc005420 con 0x7fccf00c9bb0 2022-08-10T17:37:59.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.555+0000 7fcced7fa700 1 -- 172.21.15.150:0/2839216868 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcce0017090 con 0x7fccf00c9bb0 2022-08-10T17:37:59.559 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:37:59.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574880 for osd.5 2022-08-10T17:37:59.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 msgr2=0x7fccd0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 0x7fccd0067560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fccf00c9f80 tx=0x7fcce401d040 comp rx=0 tx=0).stop 2022-08-10T17:37:59.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 msgr2=0x7fccf015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:37:59.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c3c0 tx=0x7fcce000c6d0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 shutdown_connections 2022-08-10T17:37:59.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf015ba60 0x7fccf006b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fccd00650b0 0x7fccd0067560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fccf00c9bb0 0x7fccf015d310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 --2- 172.21.15.150:0/2839216868 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fccf015b690 0x7fccf0152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:37:59.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 >> 172.21.15.150:0/2839216868 conn(0x7fccf00c8f10 msgr2=0x7fccf0157410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:37:59.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 shutdown_connections 2022-08-10T17:37:59.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:37:59.558+0000 7fccf7077700 1 -- 172.21.15.150:0/2839216868 wait complete. 2022-08-10T17:37:59.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574880 for osd.2 2022-08-10T17:37:59.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574880 for osd.7 2022-08-10T17:38:00.537 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-08-10T17:38:00.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-08-10T17:38:00.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-08-10T17:38:00.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-08-10T17:38:00.557 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-08-10T17:38:00.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-08-10T17:38:00.566 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-08-10T17:38:00.575 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-08-10T17:38:00.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.739+0000 7fb5b9228700 1 Processor -- start 2022-08-10T17:38:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.739+0000 7fb5b9228700 1 -- start start 2022-08-10T17:38:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 0x7fb5b40c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c4100 0x7fb5b40c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb5b40c45b0 0x7fb5b4069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40707d0 con 0x7fb5b40c91d0 2022-08-10T17:38:00.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b414d250 con 0x7fb5b40c45b0 2022-08-10T17:38:00.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.740+0000 7fb5b9228700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4153980 con 0x7fb5b40c4100 2022-08-10T17:38:00.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.741+0000 7fb5b359e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb5b40c45b0 0x7fb5b4069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.741+0000 7fb5b359e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb5b40c45b0 0x7fb5b4069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40644/0 (socket says 172.21.15.150:40644) 2022-08-10T17:38:00.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.741+0000 7fb5b359e700 1 -- 172.21.15.150:0/1603438787 learned_addr learned my addr 172.21.15.150:0/1603438787 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b2d9d700 1 --2- 172.21.15.150:0/1603438787 >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 0x7fb5b40c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b259c700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c4100 0x7fb5b40c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b359e700 1 -- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c4100 msgr2=0x7fb5b40c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b359e700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c4100 0x7fb5b40c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b359e700 1 -- 172.21.15.150:0/1603438787 >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 msgr2=0x7fb5b40c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b359e700 1 --2- 172.21.15.150:0/1603438787 >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 0x7fb5b40c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.742+0000 7fb5b359e700 1 -- 172.21.15.150:0/1603438787 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4152b40 con 0x7fb5b40c45b0 2022-08-10T17:38:00.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.743+0000 7fb5b2d9d700 1 --2- 172.21.15.150:0/1603438787 >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 0x7fb5b40c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:00.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.743+0000 7fb5b359e700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c45b0 0x7fb5b4069c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4150660 tx=0x7fb5a4009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd39fe76fffdd666 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.743+0000 7fb5b1d9b700 1 -- 172.21.15.150:0/1603438787 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4004230 con 0x7fb5b40c45b0 2022-08-10T17:38:00.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.743+0000 7fb5b1d9b700 1 -- 172.21.15.150:0/1603438787 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a4004390 con 0x7fb5b40c45b0 2022-08-10T17:38:00.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.743+0000 7fb5b1d9b700 1 -- 172.21.15.150:0/1603438787 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4010ad0 con 0x7fb5b40c45b0 2022-08-10T17:38:00.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.744+0000 7fb5b9228700 1 -- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c45b0 msgr2=0x7fb5b4069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.744+0000 7fb5b9228700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c45b0 0x7fb5b4069c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4150660 tx=0x7fb5a4009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:00.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 -- 172.21.15.150:0/1603438787 shutdown_connections 2022-08-10T17:38:00.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c45b0 0x7fb5b4069c80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 --2- 172.21.15.150:0/1603438787 >> v2:172.21.15.150:3300/0 conn(0x7fb5b40c91d0 0x7fb5b40c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 --2- 172.21.15.150:0/1603438787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c4100 0x7fb5b40c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 -- 172.21.15.150:0/1603438787 >> 172.21.15.150:0/1603438787 conn(0x7fb5b406b500 msgr2=0x7fb5b406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 -- 172.21.15.150:0/1603438787 shutdown_connections 2022-08-10T17:38:00.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.745+0000 7fb5b9228700 1 -- 172.21.15.150:0/1603438787 wait complete. 2022-08-10T17:38:00.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.747+0000 7fb5b9228700 1 Processor -- start 2022-08-10T17:38:00.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.747+0000 7fb5b9228700 1 -- start start 2022-08-10T17:38:00.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c4100 0x7fb5b41f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c91d0 0x7fb5b40c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b406da60 con 0x7fb5b40c45b0 2022-08-10T17:38:00.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b414a710 con 0x7fb5b40c4100 2022-08-10T17:38:00.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.748+0000 7fb5b9228700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b41d9480 con 0x7fb5b40c91d0 2022-08-10T17:38:00.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58290/0 (socket says 172.21.15.150:58290) 2022-08-10T17:38:00.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 -- 172.21.15.150:0/2060488466 learned_addr learned my addr 172.21.15.150:0/2060488466 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 -- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c91d0 msgr2=0x7fb5b40c1920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:38:00.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c91d0 0x7fb5b40c1920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 -- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c4100 msgr2=0x7fb5b41f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c4100 0x7fb5b41f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.749+0000 7fb5b259c700 1 -- 172.21.15.150:0/2060488466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40093e0 con 0x7fb5b40c45b0 2022-08-10T17:38:00.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb5b259c700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800fa90 tx=0x7fb5a800fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800dd00 con 0x7fb5b40c45b0 2022-08-10T17:38:00.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a800de60 con 0x7fb5b40c45b0 2022-08-10T17:38:00.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8010650 con 0x7fb5b40c45b0 2022-08-10T17:38:00.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b414c180 con 0x7fb5b40c45b0 2022-08-10T17:38:00.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.750+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b41d96d0 con 0x7fb5b40c45b0 2022-08-10T17:38:00.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.754+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb5a801e020 con 0x7fb5b40c45b0 2022-08-10T17:38:00.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.754+0000 7fb59b7fe700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 0x7fb5a0067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.754+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb5a8082ca0 con 0x7fb5b40c45b0 2022-08-10T17:38:00.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.754+0000 7fb5b2d9d700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 0x7fb5a0067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.755+0000 7fb5b2d9d700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 0x7fb5a0067710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00bfb0 tx=0x7fb5ac00b6f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.758+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590005170 con 0x7fb5b40c45b0 2022-08-10T17:38:00.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.768+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb5a8050c50 con 0x7fb5b40c45b0 2022-08-10T17:38:00.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.795+0000 7fa5d502c700 1 Processor -- start 2022-08-10T17:38:00.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.795+0000 7fa5d502c700 1 -- start start 2022-08-10T17:38:00.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.796+0000 7fa5d502c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.796+0000 7fa5d502c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5d00c45b0 0x7fa5d006a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.796+0000 7fa5d502c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00707d0 con 0x7fa5d00c91d0 2022-08-10T17:38:00.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.796+0000 7fa5d502c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d014d250 con 0x7fa5d00c45b0 2022-08-10T17:38:00.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.796+0000 7fa5d502c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0153980 con 0x7fa5d00c4100 2022-08-10T17:38:00.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44284/0 (socket says 172.21.15.150:44284) 2022-08-10T17:38:00.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 -- 172.21.15.150:0/1239099420 learned_addr learned my addr 172.21.15.150:0/1239099420 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7f4fa6234700 1 Processor -- start 2022-08-10T17:38:00.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7f4fa6234700 1 -- start start 2022-08-10T17:38:00.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 -- 172.21.15.150:0/1239099420 >> v2:172.21.15.150:3300/0 conn(0x7fa5d00c45b0 msgr2=0x7fa5d006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 --2- 172.21.15.150:0/1239099420 >> v2:172.21.15.150:3300/0 conn(0x7fa5d00c45b0 0x7fa5d006a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 -- 172.21.15.150:0/1239099420 >> v1:172.21.15.150:6789/0 conn(0x7fa5d00c91d0 legacy=0x7fa5d00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.797+0000 7fa5ce59c700 1 -- 172.21.15.150:0/1239099420 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0152b40 con 0x7fa5d00c4100 2022-08-10T17:38:00.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7fa5ce59c700 1 --2- 172.21.15.150:0/1239099420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0006fd0 tx=0x7fa5c000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b86f89f66597c2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4fa6234700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa00c3340 0x7f4fa00c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4fa6234700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4fa00bfee0 0x7f4fa006e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4fa6234700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa006e0b0 con 0x7f4fa00c9620 2022-08-10T17:38:00.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4fa6234700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa006da60 con 0x7f4fa00c3340 2022-08-10T17:38:00.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4fa6234700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa006dd40 con 0x7f4fa00bfee0 2022-08-10T17:38:00.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7fa5cdd9b700 1 -- 172.21.15.150:0/1239099420 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0010070 con 0x7fa5d00c4100 2022-08-10T17:38:00.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7fa5cdd9b700 1 -- 172.21.15.150:0/1239099420 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000d980 con 0x7fa5d00c4100 2022-08-10T17:38:00.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7fa5cdd9b700 1 -- 172.21.15.150:0/1239099420 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000dd10 con 0x7fa5d00c4100 2022-08-10T17:38:00.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4f9effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa00c3340 0x7f4fa00c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4f9effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa00c3340 0x7f4fa00c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58302/0 (socket says 172.21.15.150:58302) 2022-08-10T17:38:00.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.798+0000 7f4f9effd700 1 -- 172.21.15.150:0/3174440085 learned_addr learned my addr 172.21.15.150:0/3174440085 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fe42a2f0700 1 Processor -- start 2022-08-10T17:38:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7f4f9effd700 1 -- 172.21.15.150:0/3174440085 >> v2:172.21.15.197:3300/0 conn(0x7f4fa00bfee0 msgr2=0x7f4fa006e540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:38:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7f4f9effd700 1 --2- 172.21.15.150:0/3174440085 >> v2:172.21.15.197:3300/0 conn(0x7f4fa00bfee0 0x7f4fa006e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7f4f9effd700 1 -- 172.21.15.150:0/3174440085 >> v1:172.21.15.197:6789/0 conn(0x7f4fa00c9620 legacy=0x7f4fa0167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7f4f9effd700 1 -- 172.21.15.150:0/3174440085 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0070660 con 0x7f4fa00c3340 2022-08-10T17:38:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7f4f9effd700 1 --2- 172.21.15.150:0/3174440085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c3340 0x7f4fa00c4f10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00c3c80 tx=0x7f4f90009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551284b31143529a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7f4f9e7fc700 1 -- 172.21.15.150:0/3174440085 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011830 con 0x7f4fa00c3340 2022-08-10T17:38:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7f4f9e7fc700 1 -- 172.21.15.150:0/3174440085 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90011990 con 0x7f4fa00c3340 2022-08-10T17:38:00.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7f4f9e7fc700 1 -- 172.21.15.150:0/3174440085 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011d40 con 0x7f4fa00c3340 2022-08-10T17:38:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fe42a2f0700 1 -- start start 2022-08-10T17:38:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fe42a2f0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe42406a4c0 0x7fe4240c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fe42a2f0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fe42a2f0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4240c4180 con 0x7fe42406a890 2022-08-10T17:38:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fe42a2f0700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240c5110 con 0x7fe42406a4c0 2022-08-10T17:38:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fe42a2f0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42415be10 con 0x7fe4240c3340 2022-08-10T17:38:00.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44296/0 (socket says 172.21.15.150:44296) 2022-08-10T17:38:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 -- 172.21.15.150:0/3349970864 learned_addr learned my addr 172.21.15.150:0/3349970864 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe423fff700 1 --2- 172.21.15.150:0/3349970864 >> v2:172.21.15.197:3300/0 conn(0x7fe42406a4c0 0x7fe4240c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7f4fa6234700 1 -- 172.21.15.150:0/3174440085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c3340 msgr2=0x7f4fa00c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3174440085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c3340 0x7f4fa00c4f10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00c3c80 tx=0x7f4f90009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 -- 172.21.15.150:0/3349970864 >> v2:172.21.15.197:3300/0 conn(0x7fe42406a4c0 msgr2=0x7fe4240c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 --2- 172.21.15.150:0/3349970864 >> v2:172.21.15.197:3300/0 conn(0x7fe42406a4c0 0x7fe4240c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 -- 172.21.15.150:0/3349970864 >> v1:172.21.15.150:6789/0 conn(0x7fe42406a890 legacy=0x7fe4240c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 -- 172.21.15.150:0/3349970864 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240c37d0 con 0x7fe4240c3340 2022-08-10T17:38:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe4237fe700 1 --2- 172.21.15.150:0/3349970864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009e50 tx=0x7fe41c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eef3b811c9c4262 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe2427a1700 1 Processor -- start 2022-08-10T17:38:00.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe422ffd700 1 -- 172.21.15.150:0/3349970864 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00e070 con 0x7fe4240c3340 2022-08-10T17:38:00.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe422ffd700 1 -- 172.21.15.150:0/3349970864 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c00b8d0 con 0x7fe4240c3340 2022-08-10T17:38:00.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe422ffd700 1 -- 172.21.15.150:0/3349970864 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00bc80 con 0x7fe4240c3340 2022-08-10T17:38:00.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 -- 172.21.15.150:0/3349970864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 msgr2=0x7fe42415b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/3349970864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009e50 tx=0x7fe41c00b330 comp rx=0 tx=0).stop 2022-08-10T17:38:00.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 -- 172.21.15.150:0/3174440085 shutdown_connections 2022-08-10T17:38:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3174440085 >> v2:172.21.15.197:3300/0 conn(0x7f4fa00bfee0 0x7f4fa006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3174440085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c3340 0x7f4fa00c4f10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 -- 172.21.15.150:0/3174440085 >> 172.21.15.150:0/3174440085 conn(0x7f4fa006b500 msgr2=0x7f4fa006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 -- 172.21.15.150:0/3349970864 shutdown_connections 2022-08-10T17:38:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/3349970864 >> v2:172.21.15.197:3300/0 conn(0x7fe42406a4c0 0x7fe4240c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/3349970864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4240c3340 0x7fe42415b8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 -- 172.21.15.150:0/3349970864 >> 172.21.15.150:0/3349970864 conn(0x7fe42406b500 msgr2=0x7fe42406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 -- 172.21.15.150:0/3174440085 shutdown_connections 2022-08-10T17:38:00.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7f4fa6234700 1 -- 172.21.15.150:0/3174440085 wait complete. 2022-08-10T17:38:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 -- 172.21.15.150:0/3349970864 shutdown_connections 2022-08-10T17:38:00.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.801+0000 7fe2427a1700 1 -- start start 2022-08-10T17:38:00.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe2427a1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe2427a1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe23c06a390 0x7fe23c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe2427a1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0707d0 con 0x7fe23c0c4100 2022-08-10T17:38:00.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe2427a1700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c14d250 con 0x7fe23c06a390 2022-08-10T17:38:00.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fe2427a1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c153980 con 0x7fe23c0c91d0 2022-08-10T17:38:00.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44302/0 (socket says 172.21.15.150:44302) 2022-08-10T17:38:00.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 -- 172.21.15.150:0/1354327532 learned_addr learned my addr 172.21.15.150:0/1354327532 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 -- 172.21.15.150:0/1354327532 >> v2:172.21.15.197:3300/0 conn(0x7fe23c06a390 msgr2=0x7fe23c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 --2- 172.21.15.150:0/1354327532 >> v2:172.21.15.197:3300/0 conn(0x7fe23c06a390 0x7fe23c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 -- 172.21.15.150:0/1354327532 >> v1:172.21.15.197:6789/0 conn(0x7fe23c0c4100 legacy=0x7fe23c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe23bfff700 1 -- 172.21.15.150:0/1354327532 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c152b40 con 0x7fe23c0c91d0 2022-08-10T17:38:00.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fe23bfff700 1 --2- 172.21.15.150:0/1354327532 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe22c006fd0 tx=0x7fe22c009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=417b00d6defd4b44 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 -- 172.21.15.150:0/1239099420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 msgr2=0x7fa5d0069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 --2- 172.21.15.150:0/1239099420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0006fd0 tx=0x7fa5c000d330 comp rx=0 tx=0).stop 2022-08-10T17:38:00.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 -- 172.21.15.150:0/1239099420 shutdown_connections 2022-08-10T17:38:00.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 --2- 172.21.15.150:0/1239099420 >> v2:172.21.15.150:3300/0 conn(0x7fa5d00c45b0 0x7fa5d006a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 --2- 172.21.15.150:0/1239099420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c4100 0x7fa5d0069c80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.799+0000 7fa5d502c700 1 -- 172.21.15.150:0/1239099420 >> 172.21.15.150:0/1239099420 conn(0x7fa5d006b500 msgr2=0x7fa5d006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fa5d502c700 1 -- 172.21.15.150:0/1239099420 shutdown_connections 2022-08-10T17:38:00.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.800+0000 7fa5d502c700 1 -- 172.21.15.150:0/1239099420 wait complete. 2022-08-10T17:38:00.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fa5d502c700 1 Processor -- start 2022-08-10T17:38:00.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.802+0000 7fa5d502c700 1 -- start start 2022-08-10T17:38:00.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5d00c45b0 0x7fa5d00be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c91d0 0x7fa5d020da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d014be80 con 0x7fa5d00c45b0 2022-08-10T17:38:00.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c1150 con 0x7fa5d00c4100 2022-08-10T17:38:00.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5d502c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00b8270 con 0x7fa5d00c91d0 2022-08-10T17:38:00.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5cf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c91d0 0x7fa5d020da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5ced9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5ced9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40678/0 (socket says 172.21.15.150:40678) 2022-08-10T17:38:00.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5ced9d700 1 -- 172.21.15.150:0/2876884954 learned_addr learned my addr 172.21.15.150:0/2876884954 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fa5ce59c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5d00c45b0 0x7fa5d00be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 -- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c91d0 msgr2=0x7fa5d020da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c91d0 0x7fa5d020da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 -- 172.21.15.150:0/2876884954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5d00c45b0 msgr2=0x7fa5d00be660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5d00c45b0 0x7fa5d00be660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 -- 172.21.15.150:0/2876884954 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0008460 con 0x7fa5d00c4100 2022-08-10T17:38:00.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.804+0000 7fa5ced9d700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c7b0 tx=0x7fa5c800cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7f4fa6234700 1 Processor -- start 2022-08-10T17:38:00.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.803+0000 7fe42a2f0700 1 -- 172.21.15.150:0/3349970864 wait complete. 2022-08-10T17:38:00.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fe42a2f0700 1 Processor -- start 2022-08-10T17:38:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7f4fa6234700 1 -- start start 2022-08-10T17:38:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa00bfee0 0x7f4fa0155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 0x7f4fa015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa02050d0 con 0x7f4fa00c7e00 2022-08-10T17:38:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00b9570 con 0x7f4fa00bfee0 2022-08-10T17:38:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7f4fa6234700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa02052d0 con 0x7f4fa00c3340 2022-08-10T17:38:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fe23affd700 1 -- 172.21.15.150:0/1354327532 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00f940 con 0x7fe23c0c91d0 2022-08-10T17:38:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fe23affd700 1 -- 172.21.15.150:0/1354327532 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c00faa0 con 0x7fe23c0c91d0 2022-08-10T17:38:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fe23affd700 1 -- 172.21.15.150:0/1354327532 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00fe50 con 0x7fe23c0c91d0 2022-08-10T17:38:00.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 -- 172.21.15.150:0/1354327532 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 msgr2=0x7fe23c0c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 --2- 172.21.15.150:0/1354327532 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe22c006fd0 tx=0x7fe22c009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:00.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 -- 172.21.15.150:0/1354327532 shutdown_connections 2022-08-10T17:38:00.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 --2- 172.21.15.150:0/1354327532 >> v2:172.21.15.197:3300/0 conn(0x7fe23c06a390 0x7fe23c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 --2- 172.21.15.150:0/1354327532 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c0c91d0 0x7fe23c0c3340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe2427a1700 1 -- 172.21.15.150:0/1354327532 >> 172.21.15.150:0/1354327532 conn(0x7fe23c06b500 msgr2=0x7fe23c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8003c90 con 0x7fa5d00c4100 2022-08-10T17:38:00.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8003df0 con 0x7fa5d00c4100 2022-08-10T17:38:00.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8005310 con 0x7fa5d00c4100 2022-08-10T17:38:00.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d020df70 con 0x7fa5d00c4100 2022-08-10T17:38:00.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.805+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00c1380 con 0x7fa5d00c4100 2022-08-10T17:38:00.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44318/0 (socket says 172.21.15.150:44318) 2022-08-10T17:38:00.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 -- 172.21.15.150:0/3514956470 learned_addr learned my addr 172.21.15.150:0/3514956470 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.806+0000 7fe42a2f0700 1 -- start start 2022-08-10T17:38:00.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe42406a4c0 0x7fe424137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4240c3340 0x7fe42413d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424122cf0 con 0x7fe42406a890 2022-08-10T17:38:00.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4241fc9a0 con 0x7fe4240c3340 2022-08-10T17:38:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe42a2f0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c1d70 con 0x7fe42406a4c0 2022-08-10T17:38:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fe423fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe42406a4c0 0x7fe424137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fe42888d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4240c3340 0x7fe42413d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58332/0 (socket says 172.21.15.150:58332) 2022-08-10T17:38:00.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fe4237fe700 1 -- 172.21.15.150:0/2232263457 learned_addr learned my addr 172.21.15.150:0/2232263457 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9ffff700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 0x7f4fa015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 -- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa00bfee0 msgr2=0x7f4fa0155220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:38:00.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa00bfee0 0x7f4fa0155220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 -- 172.21.15.150:0/3514956470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 msgr2=0x7f4fa015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 0x7f4fa015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7f4f9effd700 1 -- 172.21.15.150:0/3514956470 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900093e0 con 0x7f4fa00c3340 2022-08-10T17:38:00.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7f4f9ffff700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 0x7f4fa015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:00.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe2427a1700 1 -- 172.21.15.150:0/1354327532 shutdown_connections 2022-08-10T17:38:00.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fe2427a1700 1 -- 172.21.15.150:0/1354327532 wait complete. 2022-08-10T17:38:00.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d006f8c0 con 0x7fa5d00c4100 2022-08-10T17:38:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.807+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa5c8019030 con 0x7fa5d00c4100 2022-08-10T17:38:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fa5b77fe700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 0x7fa5b0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa5c8081830 con 0x7fa5d00c4100 2022-08-10T17:38:00.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7fa5ce59c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 0x7fa5b0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7f4f9effd700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006c950 tx=0x7f4f900045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7faf66711700 1 Processor -- start 2022-08-10T17:38:00.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7faf66711700 1 -- start start 2022-08-10T17:38:00.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.808+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9001a6e0 con 0x7f4fa00c3340 2022-08-10T17:38:00.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9001a860 con 0x7f4fa00c3340 2022-08-10T17:38:00.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9001ac10 con 0x7f4fa00c3340 2022-08-10T17:38:00.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe2427a1700 1 Processor -- start 2022-08-10T17:38:00.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00b9810 con 0x7f4fa00c3340 2022-08-10T17:38:00.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 -- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe42406a4c0 msgr2=0x7fe424137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe42406a4c0 0x7fe424137820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 -- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4240c3340 msgr2=0x7fe42413d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4240c3340 0x7fe42413d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 -- 172.21.15.150:0/2232263457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009b30 con 0x7fe42406a890 2022-08-10T17:38:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00b9bf0 con 0x7f4fa00c3340 2022-08-10T17:38:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fa5ce59c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 0x7fa5b0067630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000d370 tx=0x7fa5c000a040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe4237fe700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe41c015040 tx=0x7fe41c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf66711700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf600c4f80 0x7faf600c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf66711700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf66711700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf601574c0 con 0x7faf600c8990 2022-08-10T17:38:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf66711700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf601569a0 con 0x7faf600c4f80 2022-08-10T17:38:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf66711700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60157950 con 0x7faf600c3340 2022-08-10T17:38:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf64cae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf64cae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44332/0 (socket says 172.21.15.150:44332) 2022-08-10T17:38:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7faf64cae700 1 -- 172.21.15.150:0/3656705378 learned_addr learned my addr 172.21.15.150:0/3656705378 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c005170 con 0x7f4fa00c3340 2022-08-10T17:38:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.809+0000 7fe2427a1700 1 -- start start 2022-08-10T17:38:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 0x7fe23c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 0x7fe23c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 0x7fe23c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0c7e20 con 0x7fe23c150190 2022-08-10T17:38:00.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0c7990 con 0x7fe23c0c91d0 2022-08-10T17:38:00.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe2427a1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0c6aa0 con 0x7fe23c06a390 2022-08-10T17:38:00.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe23bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 0x7fe23c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe23bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 0x7fe23c14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44336/0 (socket says 172.21.15.150:44336) 2022-08-10T17:38:00.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe23bfff700 1 -- 172.21.15.150:0/4000344632 learned_addr learned my addr 172.21.15.150:0/4000344632 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe97737b700 1 Processor -- start 2022-08-10T17:38:00.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf5f7fe700 1 --2- 172.21.15.150:0/3656705378 >> v2:172.21.15.150:3300/0 conn(0x7faf600c4f80 0x7faf600c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 0x7fe23c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.810+0000 7fe97737b700 1 -- start start 2022-08-10T17:38:00.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf64cae700 1 -- 172.21.15.150:0/3656705378 >> v2:172.21.15.150:3300/0 conn(0x7faf600c4f80 msgr2=0x7faf600c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf64cae700 1 --2- 172.21.15.150:0/3656705378 >> v2:172.21.15.150:3300/0 conn(0x7faf600c4f80 0x7faf600c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf64cae700 1 -- 172.21.15.150:0/3656705378 >> v1:172.21.15.150:6789/0 conn(0x7faf600c8990 legacy=0x7faf60069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf64cae700 1 -- 172.21.15.150:0/3656705378 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60154460 con 0x7faf600c3340 2022-08-10T17:38:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe23b7fe700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 0x7fe23c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4f9002b030 con 0x7f4fa00c3340 2022-08-10T17:38:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7f4f87fff700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 0x7f4f80067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7faf64cae700 1 --2- 172.21.15.150:0/3656705378 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf54006fd0 tx=0x7faf54009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb78a9440f821adb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 -- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 msgr2=0x7fe23c14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 0x7fe23c14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 -- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 msgr2=0x7fe23c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 0x7fe23c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe240d3e700 1 -- 172.21.15.150:0/4000344632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0093e0 con 0x7fe23c150190 2022-08-10T17:38:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe23b7fe700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 0x7fe23c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:00.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0092e0 con 0x7fe42406a890 2022-08-10T17:38:00.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c00be30 con 0x7fe42406a890 2022-08-10T17:38:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c004460 con 0x7fe42406a890 2022-08-10T17:38:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240c1a90 con 0x7fe42406a890 2022-08-10T17:38:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4f90083520 con 0x7f4fa00c3340 2022-08-10T17:38:00.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.811+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4241fc5c0 con 0x7fe42406a890 2022-08-10T17:38:00.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.812+0000 7f4f9f7fe700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 0x7f4f80067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.812+0000 7f4f9f7fe700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 0x7f4f80067660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0070930 tx=0x7f4f98007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.812+0000 7fe240d3e700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 0x7fe23c0c81b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe23400bdf0 tx=0x7fe234009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.812+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa5c804f7a0 con 0x7fa5d00c4100 2022-08-10T17:38:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4241fc420 con 0x7fe42406a890 2022-08-10T17:38:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.814+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe41c0045c0 con 0x7fe42406a890 2022-08-10T17:38:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.814+0000 7fe420ff9700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 0x7fe404067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.814+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe41c0834f0 con 0x7fe42406a890 2022-08-10T17:38:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400cbb0 con 0x7fe23c150190 2022-08-10T17:38:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400cd10 con 0x7fe23c150190 2022-08-10T17:38:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe97737b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe97006a4c0 0x7fe9700c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe97737b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe97006a890 0x7fe9700c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe97737b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9700c4180 con 0x7fe9700c3340 2022-08-10T17:38:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe97737b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700c5110 con 0x7fe97006a890 2022-08-10T17:38:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe97737b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c37d0 con 0x7fe97006a4c0 2022-08-10T17:38:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe974916700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe9700c3340 0x7fe97015b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42802/0 (socket says 172.21.15.150:42802) 2022-08-10T17:38:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe974916700 1 -- 172.21.15.150:0/1995265682 learned_addr learned my addr 172.21.15.150:0/1995265682 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.814+0000 7fe975918700 1 --2- 172.21.15.150:0/1995265682 >> v2:172.21.15.197:3300/0 conn(0x7fe97006a890 0x7fe9700c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c0c6d80 con 0x7fe23c150190 2022-08-10T17:38:00.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c0c7340 con 0x7fe23c150190 2022-08-10T17:38:00.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.813+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234014680 con 0x7fe23c150190 2022-08-10T17:38:00.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe218005170 con 0x7fe23c150190 2022-08-10T17:38:00.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe975918700 1 -- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe97006a4c0 msgr2=0x7fe9700c4bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:38:00.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe975918700 1 --2- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe97006a4c0 0x7fe9700c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe975918700 1 -- 172.21.15.150:0/1995265682 >> v1:172.21.15.150:6789/0 conn(0x7fe9700c3340 legacy=0x7fe97015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe975918700 1 -- 172.21.15.150:0/1995265682 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970070280 con 0x7fe97006a890 2022-08-10T17:38:00.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe975918700 1 --2- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe97006a890 0x7fe9700c8910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0096b0 tx=0x7fe96c0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4ca6ed6793f27da server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe95ffff700 1 -- 172.21.15.150:0/1995265682 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c011830 con 0x7fe97006a890 2022-08-10T17:38:00.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe95ffff700 1 -- 172.21.15.150:0/1995265682 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c011990 con 0x7fe97006a890 2022-08-10T17:38:00.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe95ffff700 1 -- 172.21.15.150:0/1995265682 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c011d20 con 0x7fe97006a890 2022-08-10T17:38:00.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.815+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe23401c360 con 0x7fe23c150190 2022-08-10T17:38:00.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe238ff9700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 0x7fe21c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe234082140 con 0x7fe23c150190 2022-08-10T17:38:00.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe23bfff700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 0x7fe21c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 -- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe97006a890 msgr2=0x7fe9700c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 --2- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe97006a890 0x7fe9700c8910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0096b0 tx=0x7fe96c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 -- 172.21.15.150:0/1995265682 shutdown_connections 2022-08-10T17:38:00.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 --2- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe97006a890 0x7fe9700c8910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 --2- 172.21.15.150:0/1995265682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe97006a4c0 0x7fe9700c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.816+0000 7fe97737b700 1 -- 172.21.15.150:0/1995265682 >> 172.21.15.150:0/1995265682 conn(0x7fe97006b500 msgr2=0x7fe97006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.817+0000 7faf5effd700 1 -- 172.21.15.150:0/3656705378 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54004230 con 0x7faf600c3340 2022-08-10T17:38:00.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.817+0000 7faf5effd700 1 -- 172.21.15.150:0/3656705378 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54004390 con 0x7faf600c3340 2022-08-10T17:38:00.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.817+0000 7faf5effd700 1 -- 172.21.15.150:0/3656705378 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54011830 con 0x7faf600c3340 2022-08-10T17:38:00.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.817+0000 7fe23bfff700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 0x7fe21c067660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.818+0000 7fe97737b700 1 -- 172.21.15.150:0/1995265682 shutdown_connections 2022-08-10T17:38:00.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.818+0000 7fe97737b700 1 -- 172.21.15.150:0/1995265682 wait complete. 2022-08-10T17:38:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.818+0000 7faf66711700 1 -- 172.21.15.150:0/3656705378 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 msgr2=0x7faf60161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.818+0000 7faf66711700 1 --2- 172.21.15.150:0/3656705378 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf54006fd0 tx=0x7faf54009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.818+0000 7faf66711700 1 -- 172.21.15.150:0/3656705378 shutdown_connections 2022-08-10T17:38:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.819+0000 7faf66711700 1 --2- 172.21.15.150:0/3656705378 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c3340 0x7faf60161210 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.819+0000 7faf66711700 1 --2- 172.21.15.150:0/3656705378 >> v2:172.21.15.150:3300/0 conn(0x7faf600c4f80 0x7faf600c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.819+0000 7faf66711700 1 -- 172.21.15.150:0/3656705378 >> 172.21.15.150:0/3656705378 conn(0x7faf6006b500 msgr2=0x7faf6006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.819+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe4241fc420 con 0x7fe42406a890 2022-08-10T17:38:00.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.820+0000 7faf66711700 1 -- 172.21.15.150:0/3656705378 shutdown_connections 2022-08-10T17:38:00.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.820+0000 7faf66711700 1 -- 172.21.15.150:0/3656705378 wait complete. 2022-08-10T17:38:00.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.820+0000 7fe97737b700 1 Processor -- start 2022-08-10T17:38:00.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.820+0000 7fe97737b700 1 -- start start 2022-08-10T17:38:00.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe9700c3340 0x7fe9700c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe9701259e0 0x7fe9701eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.822+0000 7faf66711700 1 Processor -- start 2022-08-10T17:38:00.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970124740 con 0x7fe97006a890 2022-08-10T17:38:00.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701ea620 con 0x7fe9700c3340 2022-08-10T17:38:00.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe97737b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c86a0 con 0x7fe9701259e0 2022-08-10T17:38:00.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe975117700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe975117700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58362/0 (socket says 172.21.15.150:58362) 2022-08-10T17:38:00.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.821+0000 7fe975117700 1 -- 172.21.15.150:0/4249163149 learned_addr learned my addr 172.21.15.150:0/4249163149 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.822+0000 7fe975918700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe9701259e0 0x7fe9701eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.822+0000 7fe974916700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe9700c3340 0x7fe9700c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 -- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe9701259e0 msgr2=0x7fe9701eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe9701259e0 0x7fe9701eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 -- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe9700c3340 msgr2=0x7fe9700c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe9700c3340 0x7fe9700c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 -- 172.21.15.150:0/4249163149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009310 con 0x7fe97006a890 2022-08-10T17:38:00.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7fe975117700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe96800b990 tx=0x7fe96800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.822+0000 7faf66711700 1 -- start start 2022-08-10T17:38:00.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 0x7faf6014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faf600c8990 0x7faf600c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf601e22b0 con 0x7faf600c3340 2022-08-10T17:38:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600bff10 con 0x7faf600c8990 2022-08-10T17:38:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf66711700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600c1c30 con 0x7faf600c4f80 2022-08-10T17:38:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf5ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf5ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58368/0 (socket says 172.21.15.150:58368) 2022-08-10T17:38:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf5ffff700 1 -- 172.21.15.150:0/57474217 learned_addr learned my addr 172.21.15.150:0/57474217 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.823+0000 7faf5f7fe700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 0x7faf6014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf64cae700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faf600c8990 0x7faf600c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4f90051490 con 0x7f4fa00c3340 2022-08-10T17:38:00.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 -- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 msgr2=0x7faf6014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 0x7faf6014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 -- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faf600c8990 msgr2=0x7faf600c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faf600c8990 0x7faf600c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 -- 172.21.15.150:0/57474217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540093e0 con 0x7faf600c3340 2022-08-10T17:38:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5f7fe700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 0x7faf6014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:00.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.824+0000 7faf5ffff700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c3f0 tx=0x7faf5000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.825+0000 7fe423fff700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 0x7fe404067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.825+0000 7fe423fff700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 0x7fe404067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe414009a50 tx=0x7fe4140090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800c950 con 0x7fe97006a890 2022-08-10T17:38:00.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe234050050 con 0x7fe23c150190 2022-08-10T17:38:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe970150690 con 0x7fe97006a890 2022-08-10T17:38:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800cab0 con 0x7fe97006a890 2022-08-10T17:38:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ce20 con 0x7fe97006a890 2022-08-10T17:38:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.826+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe970150c50 con 0x7fe97006a890 2022-08-10T17:38:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.827+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500052d0 con 0x7faf600c3340 2022-08-10T17:38:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.827+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000ce10 con 0x7faf600c3340 2022-08-10T17:38:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.828+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500117d0 con 0x7faf600c3340 2022-08-10T17:38:00.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.828+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf601e2520 con 0x7faf600c3340 2022-08-10T17:38:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.828+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf600c01b0 con 0x7faf600c3340 2022-08-10T17:38:00.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.828+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe96801b030 con 0x7fe97006a890 2022-08-10T17:38:00.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.829+0000 7fe95dffb700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 0x7fe950067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.830+0000 7fe974916700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 0x7fe950067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.831+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe96805a940 con 0x7fe97006a890 2022-08-10T17:38:00.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.832+0000 7fe974916700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 0x7fe950067590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9700bfc80 tx=0x7fe960009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.832+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7faf50019030 con 0x7faf600c3340 2022-08-10T17:38:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.833+0000 7faf5cff9700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 0x7faf4c067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.833+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7faf50081430 con 0x7faf600c3340 2022-08-10T17:38:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.833+0000 7faf5f7fe700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 0x7faf4c067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.834+0000 7faf5f7fe700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 0x7faf4c067710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf6014d490 tx=0x7faf5800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.839+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9701ea890 con 0x7fe97006a890 2022-08-10T17:38:00.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.848+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe96804c6b0 con 0x7fe97006a890 2022-08-10T17:38:00.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.849+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c005170 con 0x7faf600c3340 2022-08-10T17:38:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.851+0000 7f75d2a03700 1 Processor -- start 2022-08-10T17:38:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.851+0000 7f75d2a03700 1 -- start start 2022-08-10T17:38:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.852+0000 7f75d2a03700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f75cc0afc60 0x7f75cc071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.852+0000 7f75d2a03700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75cc06ea90 0x7f75cc0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.852+0000 7f75d2a03700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc06aa80 con 0x7f75cc158460 2022-08-10T17:38:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.852+0000 7f75d2a03700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0c49e0 con 0x7f75cc06ea90 2022-08-10T17:38:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.852+0000 7f75d2a03700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc06ae40 con 0x7f75cc0afc60 2022-08-10T17:38:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f75cc0afc60 0x7f75cc071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f75cc0afc60 0x7f75cc071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40742/0 (socket says 172.21.15.150:40742) 2022-08-10T17:38:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 -- 172.21.15.150:0/1332805202 learned_addr learned my addr 172.21.15.150:0/1332805202 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 -- 172.21.15.150:0/1332805202 >> v2:172.21.15.150:3300/0 conn(0x7f75cc06ea90 msgr2=0x7f75cc0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 --2- 172.21.15.150:0/1332805202 >> v2:172.21.15.150:3300/0 conn(0x7f75cc06ea90 0x7f75cc0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 -- 172.21.15.150:0/1332805202 >> v1:172.21.15.150:6789/0 conn(0x7f75cc158460 legacy=0x7f75cc06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7f75c37fe700 1 -- 172.21.15.150:0/1332805202 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0c4550 con 0x7f75cc0afc60 2022-08-10T17:38:00.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.857+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7faf5004f340 con 0x7faf600c3340 2022-08-10T17:38:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.858+0000 7f75c37fe700 1 --2- 172.21.15.150:0/1332805202 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc071370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0c4160 tx=0x7f75b4009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cecfc4c899c4e015 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.862+0000 7f75cb7fe700 1 -- 172.21.15.150:0/1332805202 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011830 con 0x7f75cc0afc60 2022-08-10T17:38:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.862+0000 7f75cb7fe700 1 -- 172.21.15.150:0/1332805202 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4011990 con 0x7f75cc0afc60 2022-08-10T17:38:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.862+0000 7f75cb7fe700 1 -- 172.21.15.150:0/1332805202 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011d20 con 0x7f75cc0afc60 2022-08-10T17:38:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 -- 172.21.15.150:0/1332805202 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 msgr2=0x7f75cc071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 --2- 172.21.15.150:0/1332805202 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc071370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0c4160 tx=0x7f75b4009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 -- 172.21.15.150:0/1332805202 shutdown_connections 2022-08-10T17:38:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 --2- 172.21.15.150:0/1332805202 >> v2:172.21.15.150:3300/0 conn(0x7f75cc06ea90 0x7f75cc0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 --2- 172.21.15.150:0/1332805202 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc071370 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 -- 172.21.15.150:0/1332805202 >> 172.21.15.150:0/1332805202 conn(0x7f75cc068110 msgr2=0x7f75cc068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:00.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.864+0000 7f75d2a03700 1 -- 172.21.15.150:0/1332805202 shutdown_connections 2022-08-10T17:38:00.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.865+0000 7f75d2a03700 1 -- 172.21.15.150:0/1332805202 wait complete. 2022-08-10T17:38:00.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.866+0000 7f75d2a03700 1 Processor -- start 2022-08-10T17:38:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.867+0000 7f75d2a03700 1 -- start start 2022-08-10T17:38:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 0x7f75cc140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc0c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 0x7f75cc15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc141270 con 0x7f75cc06ea90 2022-08-10T17:38:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0bfbe0 con 0x7f75cc0afc60 2022-08-10T17:38:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.868+0000 7f75d2a03700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0c8ea0 con 0x7f75cc158460 2022-08-10T17:38:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.869+0000 7f75c37fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc0c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.869+0000 7f75d0fa0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 0x7f75cc15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.869+0000 7f75cbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 0x7f75cc140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.869+0000 7f75cbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 0x7f75cc140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58384/0 (socket says 172.21.15.150:58384) 2022-08-10T17:38:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.869+0000 7f75cbfff700 1 -- 172.21.15.150:0/3846549287 learned_addr learned my addr 172.21.15.150:0/3846549287 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.870+0000 7f75d0fa0700 1 -- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 msgr2=0x7f75cc0c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.870+0000 7f75d0fa0700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc0c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.870+0000 7f75d0fa0700 1 -- 172.21.15.150:0/3846549287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 msgr2=0x7f75cc140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.870+0000 7f75d0fa0700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 0x7f75cc140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.870+0000 7f75d0fa0700 1 -- 172.21.15.150:0/3846549287 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b40093e0 con 0x7f75cc158460 2022-08-10T17:38:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.871+0000 7f75d0fa0700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 0x7f75cc15e000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75c400bdf0 tx=0x7f75c4009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.871+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400cb30 con 0x7f75cc158460 2022-08-10T17:38:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.872+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400cc90 con 0x7f75cc158460 2022-08-10T17:38:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.872+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4014440 con 0x7f75cc158460 2022-08-10T17:38:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.872+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0c9140 con 0x7f75cc158460 2022-08-10T17:38:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.872+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc144fd0 con 0x7f75cc158460 2022-08-10T17:38:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.875+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f75c401b030 con 0x7f75cc158460 2022-08-10T17:38:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.875+0000 7f75c97fa700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 0x7f75ac0677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.875+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f75c4082080 con 0x7f75cc158460 2022-08-10T17:38:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.876+0000 7f75cbfff700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 0x7f75ac0677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.877+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b00051a0 con 0x7f75cc158460 2022-08-10T17:38:00.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.878+0000 7f75cbfff700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 0x7f75ac0677c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0068c0 tx=0x7f75bc006850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:00.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:00.883+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f75c4019080 con 0x7f75cc158460 2022-08-10T17:38:01.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.113+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb590005420 con 0x7fb5b40c45b0 2022-08-10T17:38:01.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.113+0000 7fb59b7fe700 1 -- 172.21.15.150:0/2060488466 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5a8054270 con 0x7fb5b40c45b0 2022-08-10T17:38:01.120 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:38:01.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 msgr2=0x7fb5a0067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 0x7fb5a0067710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00bfb0 tx=0x7fb5ac00b6f0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 msgr2=0x7fb5b40c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800fa90 tx=0x7fb5a800fe50 comp rx=0 tx=0).stop 2022-08-10T17:38:01.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 shutdown_connections 2022-08-10T17:38:01.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5a0065260 0x7fb5a0067710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5b40c91d0 0x7fb5b40c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5b40c4100 0x7fb5b41f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 --2- 172.21.15.150:0/2060488466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b40c45b0 0x7fb5b40c13e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.117+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 >> 172.21.15.150:0/2060488466 conn(0x7fb5b406b500 msgr2=0x7fb5b414c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.118+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 shutdown_connections 2022-08-10T17:38:01.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.118+0000 7fb5b9228700 1 -- 172.21.15.150:0/2060488466 wait complete. 2022-08-10T17:38:01.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574880 for osd.6 2022-08-10T17:38:01.140 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.172+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa5d0072890 con 0x7fa5d00c4100 2022-08-10T17:38:01.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.173+0000 7fa5b77fe700 1 -- 172.21.15.150:0/2876884954 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5c8017090 con 0x7fa5d00c4100 2022-08-10T17:38:01.177 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:38:01.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.176+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 msgr2=0x7fa5b0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.176+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 0x7fa5b0067630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000d370 tx=0x7fa5c000a040 comp rx=0 tx=0).stop 2022-08-10T17:38:01.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.176+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 msgr2=0x7fa5d00b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.176+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c7b0 tx=0x7fa5c800cac0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 shutdown_connections 2022-08-10T17:38:01.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5b0065180 0x7fa5b0067630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa5d00c91d0 0x7fa5d020da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5d00c4100 0x7fa5d00b5f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 --2- 172.21.15.150:0/2876884954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5d00c45b0 0x7fa5d00be660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.178+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 >> 172.21.15.150:0/2876884954 conn(0x7fa5d006b500 msgr2=0x7fa5d006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.180+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 shutdown_connections 2022-08-10T17:38:01.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.180+0000 7fa5d502c700 1 -- 172.21.15.150:0/2876884954 wait complete. 2022-08-10T17:38:01.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.187+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf3c005420 con 0x7faf600c3340 2022-08-10T17:38:01.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.188+0000 7faf5cff9700 1 -- 172.21.15.150:0/57474217 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf50017070 con 0x7faf600c3340 2022-08-10T17:38:01.192 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:38:01.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.190+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 msgr2=0x7faf4c067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.190+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 0x7faf4c067710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf6014d490 tx=0x7faf5800b040 comp rx=0 tx=0).stop 2022-08-10T17:38:01.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.190+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 msgr2=0x7faf6014f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.190+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf5000c3f0 tx=0x7faf5000c700 comp rx=0 tx=0).stop 2022-08-10T17:38:01.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 shutdown_connections 2022-08-10T17:38:01.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faf600c8990 0x7faf600c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf600c3340 0x7faf6014f1b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faf4c065260 0x7faf4c067710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 --2- 172.21.15.150:0/57474217 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faf600c4f80 0x7faf6014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 >> 172.21.15.150:0/57474217 conn(0x7faf6006b500 msgr2=0x7faf600c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 shutdown_connections 2022-08-10T17:38:01.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.191+0000 7faf66711700 1 -- 172.21.15.150:0/57474217 wait complete. 2022-08-10T17:38:01.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.194+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4f7c005420 con 0x7f4fa00c3340 2022-08-10T17:38:01.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.195+0000 7f4f87fff700 1 -- 172.21.15.150:0/3514956470 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f90029090 con 0x7f4fa00c3340 2022-08-10T17:38:01.199 INFO:teuthology.orchestra.run.smithi150.stdout:55834574882 2022-08-10T17:38:01.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 msgr2=0x7f4f80067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 0x7f4f80067660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0070930 tx=0x7f4f98007c40 comp rx=0 tx=0).stop 2022-08-10T17:38:01.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 msgr2=0x7f4fa00c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006c950 tx=0x7f4f900045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 shutdown_connections 2022-08-10T17:38:01.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa00c7e00 0x7f4fa015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa00bfee0 0x7f4fa0155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f800651b0 0x7f4f80067660 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 --2- 172.21.15.150:0/3514956470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa00c3340 0x7f4fa00c8f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.199+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 >> 172.21.15.150:0/3514956470 conn(0x7f4fa006b500 msgr2=0x7f4fa00c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.200+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 shutdown_connections 2022-08-10T17:38:01.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.200+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4241fc420 con 0x7fe42406a890 2022-08-10T17:38:01.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.200+0000 7fe420ff9700 1 -- 172.21.15.150:0/2232263457 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4241fc420 con 0x7fe42406a890 2022-08-10T17:38:01.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574881 for osd.7 2022-08-10T17:38:01.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.201+0000 7f4fa6234700 1 -- 172.21.15.150:0/3514956470 wait complete. 2022-08-10T17:38:01.213 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.214 INFO:teuthology.orchestra.run.smithi150.stdout:55834574880 2022-08-10T17:38:01.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.203+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe218005420 con 0x7fe23c150190 2022-08-10T17:38:01.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.203+0000 7fe238ff9700 1 -- 172.21.15.150:0/4000344632 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe234053670 con 0x7fe23c150190 2022-08-10T17:38:01.215 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:38:01.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 msgr2=0x7fe404067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 0x7fe404067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe414009a50 tx=0x7fe4140090e0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 msgr2=0x7fe4241fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe41c015040 tx=0x7fe41c004950 comp rx=0 tx=0).stop 2022-08-10T17:38:01.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574880 for osd.1 2022-08-10T17:38:01.218 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 msgr2=0x7fe21c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 0x7fe21c067660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe22c000c00 tx=0x7fe22c008030 comp rx=0 tx=0).stop 2022-08-10T17:38:01.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 msgr2=0x7fe23c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.206+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 0x7fe23c0c81b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe23400bdf0 tx=0x7fe234009ed0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 shutdown_connections 2022-08-10T17:38:01.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe23c150190 0x7fe23c0c81b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe21c0651b0 0x7fe21c067660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe23c06a390 0x7fe23c14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 --2- 172.21.15.150:0/4000344632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe23c0c91d0 0x7fe23c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 >> 172.21.15.150:0/4000344632 conn(0x7fe23c06b500 msgr2=0x7fe23c150880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 shutdown_connections 2022-08-10T17:38:01.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.207+0000 7fe2427a1700 1 -- 172.21.15.150:0/4000344632 wait complete. 2022-08-10T17:38:01.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 shutdown_connections 2022-08-10T17:38:01.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4240c3340 0x7fe42413d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe404065180 0x7fe404067630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe42406a4c0 0x7fe424137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 --2- 172.21.15.150:0/2232263457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe42406a890 0x7fe4241fcdc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.208+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 >> 172.21.15.150:0/2232263457 conn(0x7fe42406b500 msgr2=0x7fe424063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.215+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 shutdown_connections 2022-08-10T17:38:01.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.215+0000 7fe42a2f0700 1 -- 172.21.15.150:0/2232263457 wait complete. 2022-08-10T17:38:01.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.215+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe9700c3130 con 0x7fe97006a890 2022-08-10T17:38:01.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.216+0000 7fe95dffb700 1 -- 172.21.15.150:0/4249163149 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe968019070 con 0x7fe97006a890 2022-08-10T17:38:01.227 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:38:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.219+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 msgr2=0x7fe950067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.219+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 0x7fe950067590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9700bfc80 tx=0x7fe960009040 comp rx=0 tx=0).stop 2022-08-10T17:38:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.219+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 msgr2=0x7fe970150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.219+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe96800b990 tx=0x7fe96800bd50 comp rx=0 tx=0).stop 2022-08-10T17:38:01.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.4 2022-08-10T17:38:01.230 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574881 for osd.3 2022-08-10T17:38:01.232 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 shutdown_connections 2022-08-10T17:38:01.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe9500650e0 0x7fe950067590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe9701259e0 0x7fe9701eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe97006a890 0x7fe970150050 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 --2- 172.21.15.150:0/4249163149 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe9700c3340 0x7fe9700c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 >> 172.21.15.150:0/4249163149 conn(0x7fe97006b500 msgr2=0x7fe9700c0430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 shutdown_connections 2022-08-10T17:38:01.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.223+0000 7fe97737b700 1 -- 172.21.15.150:0/4249163149 wait complete. 2022-08-10T17:38:01.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574880 got 55834574880 for osd.0 2022-08-10T17:38:01.239 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574881 for osd.5 2022-08-10T17:38:01.240 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.239+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75b0005450 con 0x7f75cc158460 2022-08-10T17:38:01.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.240+0000 7f75c97fa700 1 -- 172.21.15.150:0/3846549287 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75c4053a20 con 0x7f75cc158460 2022-08-10T17:38:01.244 INFO:teuthology.orchestra.run.smithi150.stdout:55834574881 2022-08-10T17:38:01.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 msgr2=0x7f75ac0677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 0x7f75ac0677c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0068c0 tx=0x7f75bc006850 comp rx=0 tx=0).stop 2022-08-10T17:38:01.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 msgr2=0x7f75cc15e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 0x7f75cc15e000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75c400bdf0 tx=0x7f75c4009ed0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 shutdown_connections 2022-08-10T17:38:01.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f75ac065310 0x7f75ac0677c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f75cc158460 0x7f75cc15e000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc06ea90 0x7f75cc140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 --2- 172.21.15.150:0/3846549287 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f75cc0afc60 0x7f75cc0c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 >> 172.21.15.150:0/3846549287 conn(0x7f75cc068110 msgr2=0x7f75cc070150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 shutdown_connections 2022-08-10T17:38:01.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.242+0000 7f75d2a03700 1 -- 172.21.15.150:0/3846549287 wait complete. 2022-08-10T17:38:01.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574881 got 55834574881 for osd.2 2022-08-10T17:38:01.258 DEBUG:teuthology.parallel:result is None 2022-08-10T17:38:01.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-08-10T17:38:01.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:38:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.415+0000 7fa9d9be4700 1 Processor -- start 2022-08-10T17:38:01.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.415+0000 7fa9d9be4700 1 -- start start 2022-08-10T17:38:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d9be4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa9d41564d0 0x7fa9d40699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d9be4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 0x7fa9d406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d9be4700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4156c30 con 0x7fa9d40b0cb0 2022-08-10T17:38:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d9be4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d41578b0 con 0x7fa9d41564d0 2022-08-10T17:38:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d9be4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4156f10 con 0x7fa9d4068110 2022-08-10T17:38:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d2ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 0x7fa9d406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d3fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fa9d40b0cb0 0x7fa9d4157ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57424/0 (socket says 172.21.15.150:57424) 2022-08-10T17:38:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.416+0000 7fa9d3fff700 1 -- 172.21.15.150:0/1929900939 learned_addr learned my addr 172.21.15.150:0/1929900939 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d37fe700 1 --2- 172.21.15.150:0/1929900939 >> v2:172.21.15.150:3300/0 conn(0x7fa9d41564d0 0x7fa9d40699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d27fc700 1 -- 172.21.15.150:0/1929900939 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979470359 0 0) 0x7fa9d4156c30 con 0x7fa9d40b0cb0 2022-08-10T17:38:01.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d2ffd700 1 -- 172.21.15.150:0/1929900939 >> v2:172.21.15.150:3300/0 conn(0x7fa9d41564d0 msgr2=0x7fa9d40699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d2ffd700 1 --2- 172.21.15.150:0/1929900939 >> v2:172.21.15.150:3300/0 conn(0x7fa9d41564d0 0x7fa9d40699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d2ffd700 1 -- 172.21.15.150:0/1929900939 >> v1:172.21.15.197:6789/0 conn(0x7fa9d40b0cb0 legacy=0x7fa9d4157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d2ffd700 1 -- 172.21.15.150:0/1929900939 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d41571f0 con 0x7fa9d4068110 2022-08-10T17:38:01.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d2ffd700 1 --2- 172.21.15.150:0/1929900939 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 0x7fa9d406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80096b0 tx=0x7fa9c80099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6dc59463d6793d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d27fc700 1 -- 172.21.15.150:0/1929900939 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80107b0 con 0x7fa9d4068110 2022-08-10T17:38:01.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d27fc700 1 -- 172.21.15.150:0/1929900939 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8010910 con 0x7fa9d4068110 2022-08-10T17:38:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.417+0000 7fa9d27fc700 1 -- 172.21.15.150:0/1929900939 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8010cc0 con 0x7fa9d4068110 2022-08-10T17:38:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 -- 172.21.15.150:0/1929900939 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 msgr2=0x7fa9d406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/1929900939 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 0x7fa9d406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80096b0 tx=0x7fa9c80099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 -- 172.21.15.150:0/1929900939 shutdown_connections 2022-08-10T17:38:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/1929900939 >> v2:172.21.15.150:3300/0 conn(0x7fa9d41564d0 0x7fa9d40699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/1929900939 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d4068110 0x7fa9d406d2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 -- 172.21.15.150:0/1929900939 >> 172.21.15.150:0/1929900939 conn(0x7fa9d406b3b0 msgr2=0x7fa9d406fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 -- 172.21.15.150:0/1929900939 shutdown_connections 2022-08-10T17:38:01.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.418+0000 7fa9d9be4700 1 -- 172.21.15.150:0/1929900939 wait complete. 2022-08-10T17:38:01.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.419+0000 7fa9d9be4700 1 Processor -- start 2022-08-10T17:38:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.419+0000 7fa9d9be4700 1 -- start start 2022-08-10T17:38:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9d4068110 0x7fa9d415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d40b0cb0 0x7fa9d4157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40c7fe0 con 0x7fa9d41564d0 2022-08-10T17:38:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d414e290 con 0x7fa9d4068110 2022-08-10T17:38:01.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d9be4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415a6b0 con 0x7fa9d40b0cb0 2022-08-10T17:38:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.420+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d2ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d40b0cb0 0x7fa9d4157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58402/0 (socket says 172.21.15.150:58402) 2022-08-10T17:38:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 -- 172.21.15.150:0/2660984917 learned_addr learned my addr 172.21.15.150:0/2660984917 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d37fe700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9d4068110 0x7fa9d415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 -- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d40b0cb0 msgr2=0x7fa9d4157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d40b0cb0 0x7fa9d4157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 -- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9d4068110 msgr2=0x7fa9d415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9d4068110 0x7fa9d415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 -- 172.21.15.150:0/2660984917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8009310 con 0x7fa9d41564d0 2022-08-10T17:38:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d3fff700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c7b0 tx=0x7fa9cc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc004e80 con 0x7fa9d41564d0 2022-08-10T17:38:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0070d0 con 0x7fa9d41564d0 2022-08-10T17:38:01.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d414f2a0 con 0x7fa9d41564d0 2022-08-10T17:38:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc007480 con 0x7fa9d41564d0 2022-08-10T17:38:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.421+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d414e4e0 con 0x7fa9d41564d0 2022-08-10T17:38:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.422+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d414d1c0 con 0x7fa9d41564d0 2022-08-10T17:38:01.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.422+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa9cc01a020 con 0x7fa9d41564d0 2022-08-10T17:38:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.423+0000 7fa9bbfff700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 0x7fa9b4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.423+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa9cc081e80 con 0x7fa9d41564d0 2022-08-10T17:38:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.423+0000 7fa9d37fe700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 0x7fa9b4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.423+0000 7fa9d37fe700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 0x7fa9b4067590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009a50 tx=0x7fa9c40090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.427+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa9d414d1c0 con 0x7fa9d41564d0 2022-08-10T17:38:01.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.603+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9d40686c0 con 0x7fa9b40650e0 2022-08-10T17:38:01.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.614+0000 7fa9bbfff700 1 -- 172.21.15.150:0/2660984917 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392430 (secure 0 0 0) 0x7fa9d40686c0 con 0x7fa9b40650e0 2022-08-10T17:38:01.623 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:01.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.617+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 msgr2=0x7fa9b4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.617+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 0x7fa9b4067590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009a50 tx=0x7fa9c40090e0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 msgr2=0x7fa9d414bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c7b0 tx=0x7fa9cc00cac0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 shutdown_connections 2022-08-10T17:38:01.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d41564d0 0x7fa9d414bf90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa9d4068110 0x7fa9d415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa9b40650e0 0x7fa9b4067590 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 --2- 172.21.15.150:0/2660984917 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa9d40b0cb0 0x7fa9d4157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 >> 172.21.15.150:0/2660984917 conn(0x7fa9d406b3b0 msgr2=0x7fa9d40c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 shutdown_connections 2022-08-10T17:38:01.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.618+0000 7fa9d9be4700 1 -- 172.21.15.150:0/2660984917 wait complete. 2022-08-10T17:38:01.630 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:38:01.634 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2022-08-10T17:38:01.257294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594899,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70688,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754904032,"statfs":{"total":773094113280,"available":773021728768,"internally_reserved":0,"allocated":2719744,"data_stored":2259318,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2201,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.012105"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674245+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:36:17.674245+0000","last_peered":"2022-08-10T17:36:17.674245+0000","last_clean":"2022-08-10T17:36:17.674245+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:36:17.674245+0000","last_undegraded":"2022-08-10T17:36:17.674245+0000","last_fullsized":"2022-08-10T17:36:17.674245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680953+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:36:17.680953+0000","last_peered":"2022-08-10T17:36:17.680953+0000","last_clean":"2022-08-10T17:36:17.680953+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:36:17.680953+0000","last_undegraded":"2022-08-10T17:36:17.680953+0000","last_fullsized":"2022-08-10T17:36:17.680953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675981+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:17.675981+0000","last_peered":"2022-08-10T17:36:17.675981+0000","last_clean":"2022-08-10T17:36:17.675981+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:17.675981+0000","last_undegraded":"2022-08-10T17:36:17.675981+0000","last_fullsized":"2022-08-10T17:36:17.675981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690304+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:36:17.690304+0000","last_peered":"2022-08-10T17:36:17.690304+0000","last_clean":"2022-08-10T17:36:17.690304+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:36:17.690304+0000","last_undegraded":"2022-08-10T17:36:17.690304+0000","last_fullsized":"2022-08-10T17:36:17.690304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673965+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:36:17.673965+0000","last_peered":"2022-08-10T17:36:17.673965+0000","last_clean":"2022-08-10T17:36:17.673965+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:36:17.673965+0000","last_undegraded":"2022-08-10T17:36:17.673965+0000","last_fullsized":"2022-08-10T17:36:17.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'3","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690924+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:17.690924+0000","last_peered":"2022-08-10T17:36:17.690924+0000","last_clean":"2022-08-10T17:36:17.690924+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:17.690924+0000","last_undegraded":"2022-08-10T17:36:17.690924+0000","last_fullsized":"2022-08-10T17:36:17.690924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:50.505566+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:50.505566+0000","last_peered":"2022-08-10T17:37:50.505566+0000","last_clean":"2022-08-10T17:37:50.505566+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:50.505566+0000","last_undegraded":"2022-08-10T17:37:50.505566+0000","last_fullsized":"2022-08-10T17:37:50.505566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690616+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:36:17.690616+0000","last_peered":"2022-08-10T17:36:17.690616+0000","last_clean":"2022-08-10T17:36:17.690616+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:36:17.690616+0000","last_undegraded":"2022-08-10T17:36:17.690616+0000","last_fullsized":"2022-08-10T17:36:17.690616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689763+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:36:17.689763+0000","last_peered":"2022-08-10T17:36:17.689763+0000","last_clean":"2022-08-10T17:36:17.689763+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:36:17.689763+0000","last_undegraded":"2022-08-10T17:36:17.689763+0000","last_fullsized":"2022-08-10T17:36:17.689763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690205+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:36:17.690205+0000","last_peered":"2022-08-10T17:36:17.690205+0000","last_clean":"2022-08-10T17:36:17.690205+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:36:17.690205+0000","last_undegraded":"2022-08-10T17:36:17.690205+0000","last_fullsized":"2022-08-10T17:36:17.690205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'8","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689854+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:36:17.689854+0000","last_peered":"2022-08-10T17:36:17.689854+0000","last_clean":"2022-08-10T17:36:17.689854+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:36:17.689854+0000","last_undegraded":"2022-08-10T17:36:17.689854+0000","last_fullsized":"2022-08-10T17:36:17.689854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690766+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:17.690766+0000","last_peered":"2022-08-10T17:36:17.690766+0000","last_clean":"2022-08-10T17:36:17.690766+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:17.690766+0000","last_undegraded":"2022-08-10T17:36:17.690766+0000","last_fullsized":"2022-08-10T17:36:17.690766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674011+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:36:17.674011+0000","last_peered":"2022-08-10T17:36:17.674011+0000","last_clean":"2022-08-10T17:36:17.674011+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:36:17.674011+0000","last_undegraded":"2022-08-10T17:36:17.674011+0000","last_fullsized":"2022-08-10T17:36:17.674011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675758+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:36:17.675758+0000","last_peered":"2022-08-10T17:36:17.675758+0000","last_clean":"2022-08-10T17:36:17.675758+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:36:17.675758+0000","last_undegraded":"2022-08-10T17:36:17.675758+0000","last_fullsized":"2022-08-10T17:36:17.675758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690719+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:17.690719+0000","last_peered":"2022-08-10T17:36:17.690719+0000","last_clean":"2022-08-10T17:36:17.690719+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:17.690719+0000","last_undegraded":"2022-08-10T17:36:17.690719+0000","last_fullsized":"2022-08-10T17:36:17.690719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673450+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:36:17.673450+0000","last_peered":"2022-08-10T17:36:17.673450+0000","last_clean":"2022-08-10T17:36:17.673450+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:36:17.673450+0000","last_undegraded":"2022-08-10T17:36:17.673450+0000","last_fullsized":"2022-08-10T17:36:17.673450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675875+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:36:17.675875+0000","last_peered":"2022-08-10T17:36:17.675875+0000","last_clean":"2022-08-10T17:36:17.675875+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:36:17.675875+0000","last_undegraded":"2022-08-10T17:36:17.675875+0000","last_fullsized":"2022-08-10T17:36:17.675875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673917+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:17.673917+0000","last_peered":"2022-08-10T17:36:17.673917+0000","last_clean":"2022-08-10T17:36:17.673917+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:17.673917+0000","last_undegraded":"2022-08-10T17:36:17.673917+0000","last_fullsized":"2022-08-10T17:36:17.673917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674586+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:36:17.674586+0000","last_peered":"2022-08-10T17:36:17.674586+0000","last_clean":"2022-08-10T17:36:17.674586+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:36:17.674586+0000","last_undegraded":"2022-08-10T17:36:17.674586+0000","last_fullsized":"2022-08-10T17:36:17.674586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680912+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:36:17.680912+0000","last_peered":"2022-08-10T17:36:17.680912+0000","last_clean":"2022-08-10T17:36:17.680912+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:36:17.680912+0000","last_undegraded":"2022-08-10T17:36:17.680912+0000","last_fullsized":"2022-08-10T17:36:17.680912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675709+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:17.675709+0000","last_peered":"2022-08-10T17:36:17.675709+0000","last_clean":"2022-08-10T17:36:17.675709+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:17.675709+0000","last_undegraded":"2022-08-10T17:36:17.675709+0000","last_fullsized":"2022-08-10T17:36:17.675709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689677+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:36:17.689677+0000","last_peered":"2022-08-10T17:36:17.689677+0000","last_clean":"2022-08-10T17:36:17.689677+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:36:17.689677+0000","last_undegraded":"2022-08-10T17:36:17.689677+0000","last_fullsized":"2022-08-10T17:36:17.689677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676402+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:36:17.676402+0000","last_peered":"2022-08-10T17:36:17.676402+0000","last_clean":"2022-08-10T17:36:17.676402+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:36:17.676402+0000","last_undegraded":"2022-08-10T17:36:17.676402+0000","last_fullsized":"2022-08-10T17:36:17.676402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690229+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:36:17.690229+0000","last_peered":"2022-08-10T17:36:17.690229+0000","last_clean":"2022-08-10T17:36:17.690229+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:36:17.690229+0000","last_undegraded":"2022-08-10T17:36:17.690229+0000","last_fullsized":"2022-08-10T17:36:17.690229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690057+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:36:17.690057+0000","last_peered":"2022-08-10T17:36:17.690057+0000","last_clean":"2022-08-10T17:36:17.690057+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:36:17.690057+0000","last_undegraded":"2022-08-10T17:36:17.690057+0000","last_fullsized":"2022-08-10T17:36:17.690057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673777+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:36:17.673777+0000","last_peered":"2022-08-10T17:36:17.673777+0000","last_clean":"2022-08-10T17:36:17.673777+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:36:17.673777+0000","last_undegraded":"2022-08-10T17:36:17.673777+0000","last_fullsized":"2022-08-10T17:36:17.673777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676303+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:17.676303+0000","last_peered":"2022-08-10T17:36:17.676303+0000","last_clean":"2022-08-10T17:36:17.676303+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:17.676303+0000","last_undegraded":"2022-08-10T17:36:17.676303+0000","last_fullsized":"2022-08-10T17:36:17.676303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690394+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:36:17.690394+0000","last_peered":"2022-08-10T17:36:17.690394+0000","last_clean":"2022-08-10T17:36:17.690394+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:36:17.690394+0000","last_undegraded":"2022-08-10T17:36:17.690394+0000","last_fullsized":"2022-08-10T17:36:17.690394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4531,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9304,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362536,"statfs":{"total":96636764160,"available":96627236864,"internally_reserved":0,"allocated":409600,"data_stored":728023,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.439},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.5},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.504},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68600000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73299999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":385024,"data_stored":724624,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.313}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.495},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.38400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.441},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.39300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.24099999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.28999999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8704,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363136,"statfs":{"total":96636764160,"available":96627851264,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8784,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363056,"statfs":{"total":96636764160,"available":96627769344,"internally_reserved":0,"allocated":335872,"data_stored":137495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":1.018}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.98199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":1.036},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.93300000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.443}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.501},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":134326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.53300000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.439},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.435}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55200000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:38:01.643 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:38:01.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.790+0000 7f76a4aa2700 1 Processor -- start 2022-08-10T17:38:01.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.790+0000 7f76a4aa2700 1 -- start start 2022-08-10T17:38:01.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f76a4aa2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76a00c2790 0x7f76a006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f76a4aa2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00699c0 con 0x7f76a00c7220 2022-08-10T17:38:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f76a4aa2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a0068e40 con 0x7f76a00c4d90 2022-08-10T17:38:01.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f76a4aa2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a00c5e10 con 0x7f76a00c2790 2022-08-10T17:38:01.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f769ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76a00c2790 0x7f76a006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f769dd9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f76a00c7220 0x7f76a00c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42858/0 (socket says 172.21.15.150:42858) 2022-08-10T17:38:01.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.791+0000 7f769dd9b700 1 -- 172.21.15.150:0/2721440982 learned_addr learned my addr 172.21.15.150:0/2721440982 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:01.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769ed9d700 1 -- 172.21.15.150:0/2721440982 >> v1:172.21.15.197:6789/0 conn(0x7f76a00c4d90 legacy=0x7f76a00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:01.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769ed9d700 1 -- 172.21.15.150:0/2721440982 >> v1:172.21.15.150:6789/0 conn(0x7f76a00c7220 legacy=0x7f76a00c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769ed9d700 1 -- 172.21.15.150:0/2721440982 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0069120 con 0x7f76a00c2790 2022-08-10T17:38:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769d59a700 1 -- 172.21.15.150:0/2721440982 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363076784 0 0) 0x7f76a00699c0 con 0x7f76a00c7220 2022-08-10T17:38:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769ed9d700 1 --2- 172.21.15.150:0/2721440982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c2790 0x7f76a006fca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f769800bfa0 tx=0x7f769800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f113233c7a9808d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769d59a700 1 -- 172.21.15.150:0/2721440982 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698010070 con 0x7f76a00c2790 2022-08-10T17:38:01.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769d59a700 1 -- 172.21.15.150:0/2721440982 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800b2e0 con 0x7f76a00c2790 2022-08-10T17:38:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.792+0000 7f769d59a700 1 -- 172.21.15.150:0/2721440982 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800dcb0 con 0x7f76a00c2790 2022-08-10T17:38:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 -- 172.21.15.150:0/2721440982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c2790 msgr2=0x7f76a006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/2721440982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c2790 0x7f76a006fca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f769800bfa0 tx=0x7f769800d330 comp rx=0 tx=0).stop 2022-08-10T17:38:01.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 -- 172.21.15.150:0/2721440982 shutdown_connections 2022-08-10T17:38:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/2721440982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c2790 0x7f76a006fca0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 -- 172.21.15.150:0/2721440982 >> 172.21.15.150:0/2721440982 conn(0x7f76a006d0d0 msgr2=0x7f76a00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 -- 172.21.15.150:0/2721440982 shutdown_connections 2022-08-10T17:38:01.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.793+0000 7f76a4aa2700 1 -- 172.21.15.150:0/2721440982 wait complete. 2022-08-10T17:38:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.794+0000 7f76a4aa2700 1 Processor -- start 2022-08-10T17:38:01.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.794+0000 7f76a4aa2700 1 -- start start 2022-08-10T17:38:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 0x7f76a00bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76a00c4d90 0x7f76a014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0150ef0 con 0x7f76a00c7220 2022-08-10T17:38:01.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0151800 con 0x7f76a00c4d90 2022-08-10T17:38:01.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f76a4aa2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0152ab0 con 0x7f76a00c2790 2022-08-10T17:38:01.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.795+0000 7f769ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58420/0 (socket says 172.21.15.150:58420) 2022-08-10T17:38:01.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 -- 172.21.15.150:0/66637029 learned_addr learned my addr 172.21.15.150:0/66637029 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:01.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769dd9b700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76a00c4d90 0x7f76a014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769e59c700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 0x7f76a00bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 -- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 msgr2=0x7f76a00bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 0x7f76a00bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 -- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76a00c4d90 msgr2=0x7f76a014f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76a00c4d90 0x7f76a014f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:01.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 -- 172.21.15.150:0/66637029 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769800bc80 con 0x7f76a00c7220 2022-08-10T17:38:01.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769e59c700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 0x7f76a00bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:01.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f769ed9d700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7698004000 tx=0x7f7698004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698004240 con 0x7f76a00c7220 2022-08-10T17:38:01.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76980043c0 con 0x7f76a00c7220 2022-08-10T17:38:01.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00c05c0 con 0x7f76a00c7220 2022-08-10T17:38:01.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698004770 con 0x7f76a00c7220 2022-08-10T17:38:01.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.796+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a0152460 con 0x7f76a00c7220 2022-08-10T17:38:01.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.797+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0072890 con 0x7f76a00c7220 2022-08-10T17:38:01.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.797+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7698009460 con 0x7f76a00c7220 2022-08-10T17:38:01.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.798+0000 7f768effd700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 0x7f767c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:01.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.798+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f76980858a0 con 0x7f76a00c7220 2022-08-10T17:38:01.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.798+0000 7f769e59c700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 0x7f767c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:01.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.799+0000 7f769e59c700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 0x7f767c067590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7694003c40 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:01.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.802+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7698053820 con 0x7f76a00c7220 2022-08-10T17:38:01.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.976+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76a01e7120 con 0x7f767c0650e0 2022-08-10T17:38:01.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.987+0000 7f768effd700 1 -- 172.21.15.150:0/66637029 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392430 (secure 0 0 0) 0x7f76a01e7120 con 0x7f767c0650e0 2022-08-10T17:38:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 msgr2=0x7f767c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 0x7f767c067590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7694003c40 tx=0x7f7694009040 comp rx=0 tx=0).stop 2022-08-10T17:38:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 msgr2=0x7f76a00c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7698004000 tx=0x7f7698004950 comp rx=0 tx=0).stop 2022-08-10T17:38:02.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 shutdown_connections 2022-08-10T17:38:02.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a00c7220 0x7f76a00c98f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f767c0650e0 0x7f767c067590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76a00c2790 0x7f76a00bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 --2- 172.21.15.150:0/66637029 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76a00c4d90 0x7f76a014f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 >> 172.21.15.150:0/66637029 conn(0x7f76a006d0d0 msgr2=0x7f76a00c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 shutdown_connections 2022-08-10T17:38:02.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:01.991+0000 7f76a4aa2700 1 -- 172.21.15.150:0/66637029 wait complete. 2022-08-10T17:38:02.002 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:38:02.006 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2022-08-10T17:38:01.257294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594899,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70688,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754904032,"statfs":{"total":773094113280,"available":773021728768,"internally_reserved":0,"allocated":2719744,"data_stored":2259318,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2201,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.012105"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674245+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:36:17.674245+0000","last_peered":"2022-08-10T17:36:17.674245+0000","last_clean":"2022-08-10T17:36:17.674245+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:36:17.674245+0000","last_undegraded":"2022-08-10T17:36:17.674245+0000","last_fullsized":"2022-08-10T17:36:17.674245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680953+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:36:17.680953+0000","last_peered":"2022-08-10T17:36:17.680953+0000","last_clean":"2022-08-10T17:36:17.680953+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:36:17.680953+0000","last_undegraded":"2022-08-10T17:36:17.680953+0000","last_fullsized":"2022-08-10T17:36:17.680953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675981+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:17.675981+0000","last_peered":"2022-08-10T17:36:17.675981+0000","last_clean":"2022-08-10T17:36:17.675981+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:17.675981+0000","last_undegraded":"2022-08-10T17:36:17.675981+0000","last_fullsized":"2022-08-10T17:36:17.675981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690304+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:36:17.690304+0000","last_peered":"2022-08-10T17:36:17.690304+0000","last_clean":"2022-08-10T17:36:17.690304+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:36:17.690304+0000","last_undegraded":"2022-08-10T17:36:17.690304+0000","last_fullsized":"2022-08-10T17:36:17.690304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673965+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:36:17.673965+0000","last_peered":"2022-08-10T17:36:17.673965+0000","last_clean":"2022-08-10T17:36:17.673965+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:36:17.673965+0000","last_undegraded":"2022-08-10T17:36:17.673965+0000","last_fullsized":"2022-08-10T17:36:17.673965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'3","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690924+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:17.690924+0000","last_peered":"2022-08-10T17:36:17.690924+0000","last_clean":"2022-08-10T17:36:17.690924+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:17.690924+0000","last_undegraded":"2022-08-10T17:36:17.690924+0000","last_fullsized":"2022-08-10T17:36:17.690924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:50.505566+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:50.505566+0000","last_peered":"2022-08-10T17:37:50.505566+0000","last_clean":"2022-08-10T17:37:50.505566+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:50.505566+0000","last_undegraded":"2022-08-10T17:37:50.505566+0000","last_fullsized":"2022-08-10T17:37:50.505566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690616+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:36:17.690616+0000","last_peered":"2022-08-10T17:36:17.690616+0000","last_clean":"2022-08-10T17:36:17.690616+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:36:17.690616+0000","last_undegraded":"2022-08-10T17:36:17.690616+0000","last_fullsized":"2022-08-10T17:36:17.690616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689763+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:36:17.689763+0000","last_peered":"2022-08-10T17:36:17.689763+0000","last_clean":"2022-08-10T17:36:17.689763+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:36:17.689763+0000","last_undegraded":"2022-08-10T17:36:17.689763+0000","last_fullsized":"2022-08-10T17:36:17.689763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690205+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:36:17.690205+0000","last_peered":"2022-08-10T17:36:17.690205+0000","last_clean":"2022-08-10T17:36:17.690205+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:36:17.690205+0000","last_undegraded":"2022-08-10T17:36:17.690205+0000","last_fullsized":"2022-08-10T17:36:17.690205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'8","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689854+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:36:17.689854+0000","last_peered":"2022-08-10T17:36:17.689854+0000","last_clean":"2022-08-10T17:36:17.689854+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:36:17.689854+0000","last_undegraded":"2022-08-10T17:36:17.689854+0000","last_fullsized":"2022-08-10T17:36:17.689854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690766+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:17.690766+0000","last_peered":"2022-08-10T17:36:17.690766+0000","last_clean":"2022-08-10T17:36:17.690766+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:17.690766+0000","last_undegraded":"2022-08-10T17:36:17.690766+0000","last_fullsized":"2022-08-10T17:36:17.690766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674011+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:36:17.674011+0000","last_peered":"2022-08-10T17:36:17.674011+0000","last_clean":"2022-08-10T17:36:17.674011+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:36:17.674011+0000","last_undegraded":"2022-08-10T17:36:17.674011+0000","last_fullsized":"2022-08-10T17:36:17.674011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675758+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:36:17.675758+0000","last_peered":"2022-08-10T17:36:17.675758+0000","last_clean":"2022-08-10T17:36:17.675758+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:36:17.675758+0000","last_undegraded":"2022-08-10T17:36:17.675758+0000","last_fullsized":"2022-08-10T17:36:17.675758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690719+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:17.690719+0000","last_peered":"2022-08-10T17:36:17.690719+0000","last_clean":"2022-08-10T17:36:17.690719+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:17.690719+0000","last_undegraded":"2022-08-10T17:36:17.690719+0000","last_fullsized":"2022-08-10T17:36:17.690719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673450+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:36:17.673450+0000","last_peered":"2022-08-10T17:36:17.673450+0000","last_clean":"2022-08-10T17:36:17.673450+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:36:17.673450+0000","last_undegraded":"2022-08-10T17:36:17.673450+0000","last_fullsized":"2022-08-10T17:36:17.673450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675875+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:36:17.675875+0000","last_peered":"2022-08-10T17:36:17.675875+0000","last_clean":"2022-08-10T17:36:17.675875+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:36:17.675875+0000","last_undegraded":"2022-08-10T17:36:17.675875+0000","last_fullsized":"2022-08-10T17:36:17.675875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673917+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:17.673917+0000","last_peered":"2022-08-10T17:36:17.673917+0000","last_clean":"2022-08-10T17:36:17.673917+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:17.673917+0000","last_undegraded":"2022-08-10T17:36:17.673917+0000","last_fullsized":"2022-08-10T17:36:17.673917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674586+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:36:17.674586+0000","last_peered":"2022-08-10T17:36:17.674586+0000","last_clean":"2022-08-10T17:36:17.674586+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:36:17.674586+0000","last_undegraded":"2022-08-10T17:36:17.674586+0000","last_fullsized":"2022-08-10T17:36:17.674586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.680912+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:36:17.680912+0000","last_peered":"2022-08-10T17:36:17.680912+0000","last_clean":"2022-08-10T17:36:17.680912+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:36:17.680912+0000","last_undegraded":"2022-08-10T17:36:17.680912+0000","last_fullsized":"2022-08-10T17:36:17.680912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675709+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:17.675709+0000","last_peered":"2022-08-10T17:36:17.675709+0000","last_clean":"2022-08-10T17:36:17.675709+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:17.675709+0000","last_undegraded":"2022-08-10T17:36:17.675709+0000","last_fullsized":"2022-08-10T17:36:17.675709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689677+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:36:17.689677+0000","last_peered":"2022-08-10T17:36:17.689677+0000","last_clean":"2022-08-10T17:36:17.689677+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:36:17.689677+0000","last_undegraded":"2022-08-10T17:36:17.689677+0000","last_fullsized":"2022-08-10T17:36:17.689677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676402+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:36:17.676402+0000","last_peered":"2022-08-10T17:36:17.676402+0000","last_clean":"2022-08-10T17:36:17.676402+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:36:17.676402+0000","last_undegraded":"2022-08-10T17:36:17.676402+0000","last_fullsized":"2022-08-10T17:36:17.676402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690229+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:36:17.690229+0000","last_peered":"2022-08-10T17:36:17.690229+0000","last_clean":"2022-08-10T17:36:17.690229+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:36:17.690229+0000","last_undegraded":"2022-08-10T17:36:17.690229+0000","last_fullsized":"2022-08-10T17:36:17.690229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690057+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:36:17.690057+0000","last_peered":"2022-08-10T17:36:17.690057+0000","last_clean":"2022-08-10T17:36:17.690057+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:36:17.690057+0000","last_undegraded":"2022-08-10T17:36:17.690057+0000","last_fullsized":"2022-08-10T17:36:17.690057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673777+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:36:17.673777+0000","last_peered":"2022-08-10T17:36:17.673777+0000","last_clean":"2022-08-10T17:36:17.673777+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:36:17.673777+0000","last_undegraded":"2022-08-10T17:36:17.673777+0000","last_fullsized":"2022-08-10T17:36:17.673777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676303+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:17.676303+0000","last_peered":"2022-08-10T17:36:17.676303+0000","last_clean":"2022-08-10T17:36:17.676303+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:17.676303+0000","last_undegraded":"2022-08-10T17:36:17.676303+0000","last_fullsized":"2022-08-10T17:36:17.676303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690394+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:36:17.690394+0000","last_peered":"2022-08-10T17:36:17.690394+0000","last_clean":"2022-08-10T17:36:17.690394+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:36:17.690394+0000","last_undegraded":"2022-08-10T17:36:17.690394+0000","last_fullsized":"2022-08-10T17:36:17.690394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4531,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9304,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362536,"statfs":{"total":96636764160,"available":96627236864,"internally_reserved":0,"allocated":409600,"data_stored":728023,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.439},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.5},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.504},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68600000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73299999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":385024,"data_stored":724624,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.313}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.495},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.38400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.441},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.39300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8636,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363204,"statfs":{"total":96636764160,"available":96627920896,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.24099999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.28999999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8704,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363136,"statfs":{"total":96636764160,"available":96627851264,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8784,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363056,"statfs":{"total":96636764160,"available":96627769344,"internally_reserved":0,"allocated":335872,"data_stored":137495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":1.018}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.98199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":1.036},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.93300000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.443}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.501},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":134326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.53300000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.439},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.435}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55200000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:38:02.015 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-08-10T17:38:02.019 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-08-10T17:38:02.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-08-10T17:38:02.020 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-08-10T17:38:02.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.162+0000 7f1113471700 1 Processor -- start 2022-08-10T17:38:02.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.162+0000 7f1113471700 1 -- start start 2022-08-10T17:38:02.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1113471700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f110c150aa0 0x7f110c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1113471700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 0x7f110c070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1113471700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c06f8b0 con 0x7f110c150e70 2022-08-10T17:38:02.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1113471700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c06f050 con 0x7f110c150aa0 2022-08-10T17:38:02.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1113471700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c15a990 con 0x7f110c069f30 2022-08-10T17:38:02.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f110c150aa0 0x7f110c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1111a0e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f110c150e70 0x7f110c071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42874/0 (socket says 172.21.15.150:42874) 2022-08-10T17:38:02.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f110c150aa0 0x7f110c06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58424/0 (socket says 172.21.15.150:58424) 2022-08-10T17:38:02.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1111a0e700 1 -- 172.21.15.150:0/1104580973 learned_addr learned my addr 172.21.15.150:0/1104580973 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:02.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1110a0c700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 0x7f110c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 -- 172.21.15.150:0/1104580973 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 msgr2=0x7f110c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:02.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 0x7f110c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 -- 172.21.15.150:0/1104580973 >> v1:172.21.15.150:6789/0 conn(0x7f110c150e70 legacy=0x7f110c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f111120d700 1 -- 172.21.15.150:0/1104580973 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c15ac70 con 0x7f110c150aa0 2022-08-10T17:38:02.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f10fbfff700 1 -- 172.21.15.150:0/1104580973 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073690154 0 0) 0x7f110c06f8b0 con 0x7f110c150e70 2022-08-10T17:38:02.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.163+0000 7f1110a0c700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 0x7f110c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:02.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f111120d700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c06fd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0096b0 tx=0x7f10fc0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3939f35732831f3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f10fbfff700 1 -- 172.21.15.150:0/1104580973 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc011830 con 0x7f110c150aa0 2022-08-10T17:38:02.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f10fbfff700 1 -- 172.21.15.150:0/1104580973 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc011990 con 0x7f110c150aa0 2022-08-10T17:38:02.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f10fbfff700 1 -- 172.21.15.150:0/1104580973 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc011d40 con 0x7f110c150aa0 2022-08-10T17:38:02.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 -- 172.21.15.150:0/1104580973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 msgr2=0x7f110c06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c06fd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0096b0 tx=0x7f10fc0099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 -- 172.21.15.150:0/1104580973 shutdown_connections 2022-08-10T17:38:02.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c06fd40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 --2- 172.21.15.150:0/1104580973 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c069f30 0x7f110c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 -- 172.21.15.150:0/1104580973 >> 172.21.15.150:0/1104580973 conn(0x7f110c06c570 msgr2=0x7f110c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 -- 172.21.15.150:0/1104580973 shutdown_connections 2022-08-10T17:38:02.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.164+0000 7f1113471700 1 -- 172.21.15.150:0/1104580973 wait complete. 2022-08-10T17:38:02.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.165+0000 7f1113471700 1 Processor -- start 2022-08-10T17:38:02.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 -- start start 2022-08-10T17:38:02.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 0x7f110c1ec530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 0x7f110c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1552e0 con 0x7f110c150aa0 2022-08-10T17:38:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0bf500 con 0x7f110c069f30 2022-08-10T17:38:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1113471700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1ecb20 con 0x7f110c150e70 2022-08-10T17:38:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1110a0c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1110a0c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58430/0 (socket says 172.21.15.150:58430) 2022-08-10T17:38:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1110a0c700 1 -- 172.21.15.150:0/3709460900 learned_addr learned my addr 172.21.15.150:0/3709460900 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f1111a0e700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 0x7f110c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.166+0000 7f111120d700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 0x7f110c1ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 -- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 msgr2=0x7f110c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 0x7f110c071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 -- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 msgr2=0x7f110c1ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 0x7f110c1ec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 -- 172.21.15.150:0/3709460900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc009310 con 0x7f110c150aa0 2022-08-10T17:38:02.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f111120d700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 0x7f110c1ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:02.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1111a0e700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 0x7f110c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:02.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1110a0c700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f110800c7f0 tx=0x7f110800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011800 con 0x7f110c150aa0 2022-08-10T17:38:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1108011960 con 0x7f110c150aa0 2022-08-10T17:38:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0c0930 con 0x7f110c150aa0 2022-08-10T17:38:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011cf0 con 0x7f110c150aa0 2022-08-10T17:38:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.167+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0bf9f0 con 0x7f110c150aa0 2022-08-10T17:38:02.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.168+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c06f280 con 0x7f110c150aa0 2022-08-10T17:38:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.168+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1108021070 con 0x7f110c150aa0 2022-08-10T17:38:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.169+0000 7f10f9ffb700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 0x7f10ec067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.169+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1108082040 con 0x7f110c150aa0 2022-08-10T17:38:02.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.169+0000 7f111120d700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 0x7f10ec067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.169+0000 7f111120d700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 0x7f10ec067560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.173+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f110804ffc0 con 0x7f110c150aa0 2022-08-10T17:38:02.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.389+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f110c14d6b0 con 0x7f110c150aa0 2022-08-10T17:38:02.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.390+0000 7f10f9ffb700 1 -- 172.21.15.150:0/3709460900 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f11080535e0 con 0x7f110c150aa0 2022-08-10T17:38:02.394 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:02.394 INFO:teuthology.orchestra.run.smithi150.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-08-10T17:38:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 msgr2=0x7f10ec067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 0x7f10ec067560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc008030 comp rx=0 tx=0).stop 2022-08-10T17:38:02.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 msgr2=0x7f110c156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f110800c7f0 tx=0x7f110800cbb0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 shutdown_connections 2022-08-10T17:38:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10ec0650b0 0x7f10ec067560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f110c150e70 0x7f110c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f110c069f30 0x7f110c1ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 --2- 172.21.15.150:0/3709460900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f110c150aa0 0x7f110c156f40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 >> 172.21.15.150:0/3709460900 conn(0x7f110c06c570 msgr2=0x7f110c0c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 shutdown_connections 2022-08-10T17:38:02.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.392+0000 7f1113471700 1 -- 172.21.15.150:0/3709460900 wait complete. 2022-08-10T17:38:02.408 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-08-10T17:38:02.408 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:38:02.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.525+0000 7f3077be0700 1 Processor -- start 2022-08-10T17:38:02.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.525+0000 7f3077be0700 1 -- start start 2022-08-10T17:38:02.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f3077be0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f30700c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f3077be0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c36f0 con 0x7f307014ed30 2022-08-10T17:38:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f3077be0700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307006ca30 con 0x7f307006b640 2022-08-10T17:38:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f3077be0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307014f100 con 0x7f30701564f0 2022-08-10T17:38:02.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f307597c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f307014ed30 0x7f30700c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42884/0 (socket says 172.21.15.150:42884) 2022-08-10T17:38:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f307597c700 1 -- 172.21.15.150:0/2072252851 learned_addr learned my addr 172.21.15.150:0/2072252851 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.526+0000 7f307617d700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f30700c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492002933 0 0) 0x7f3060001110 con 0x7f307014ed30 2022-08-10T17:38:02.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003430 con 0x7f307014ed30 2022-08-10T17:38:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404310838 0 0) 0x7f3058003430 con 0x7f307014ed30 2022-08-10T17:38:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 msgr2=0x7f30700c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f30700c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 >> v1:172.21.15.197:6789/0 conn(0x7f307006b640 legacy=0x7f3070155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307006a450 con 0x7f307014ed30 2022-08-10T17:38:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f3060001800 con 0x7f307014ed30 2022-08-10T17:38:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 >> v1:172.21.15.150:6789/0 conn(0x7f307014ed30 legacy=0x7f30700c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30580038b0 0x7f3058003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3058004710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f3058005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307014f100 con 0x7f3058004250 2022-08-10T17:38:02.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305800b940 con 0x7f30580038b0 2022-08-10T17:38:02.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800bad0 con 0x7f30701564f0 2022-08-10T17:38:02.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3058004710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307597c700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30580038b0 0x7f3058003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307617d700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f3058005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 -- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 msgr2=0x7f3058005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:02.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701564f0 0x7f3058005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 -- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30580038b0 msgr2=0x7f3058003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:02.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30580038b0 0x7f3058003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 -- 172.21.15.150:0/2072252851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003430 con 0x7f3058004250 2022-08-10T17:38:02.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.527+0000 7f307517b700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3058004710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f306c0017e0 tx=0x7f3058005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d4f91ecb0b3802 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c007230 con 0x7f3058004250 2022-08-10T17:38:02.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c007390 con 0x7f3058004250 2022-08-10T17:38:02.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f307497a700 1 -- 172.21.15.150:0/2072252851 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0066e0 con 0x7f3058004250 2022-08-10T17:38:02.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 -- 172.21.15.150:0/2072252851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 msgr2=0x7f3058004710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 --2- 172.21.15.150:0/2072252851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3058004710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f306c0017e0 tx=0x7f3058005700 comp rx=0 tx=0).stop 2022-08-10T17:38:02.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f307617d700 1 -- 172.21.15.150:0/2072252851 reap_dead start 2022-08-10T17:38:02.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 -- 172.21.15.150:0/2072252851 shutdown_connections 2022-08-10T17:38:02.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 -- 172.21.15.150:0/2072252851 >> 172.21.15.150:0/2072252851 conn(0x7f307006e1f0 msgr2=0x7f307006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 -- 172.21.15.150:0/2072252851 shutdown_connections 2022-08-10T17:38:02.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.528+0000 7f3077be0700 1 -- 172.21.15.150:0/2072252851 wait complete. 2022-08-10T17:38:02.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.529+0000 7f3077be0700 1 Processor -- start 2022-08-10T17:38:02.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 -- start start 2022-08-10T17:38:02.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701f0160 0x7f30701ec010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30700beab0 0x7f3070142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307006a170 con 0x7f3058004250 2022-08-10T17:38:02.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070069780 con 0x7f30700beab0 2022-08-10T17:38:02.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f3077be0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3070069bb0 con 0x7f30701f0160 2022-08-10T17:38:02.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f307597c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f307597c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58448/0 (socket says 172.21.15.150:58448) 2022-08-10T17:38:02.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f307597c700 1 -- 172.21.15.150:0/1274269470 learned_addr learned my addr 172.21.15.150:0/1274269470 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:02.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f307597c700 1 -- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701f0160 msgr2=0x7f30701ec010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.530+0000 7f307597c700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701f0160 0x7f30701ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f307617d700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30700beab0 0x7f3070142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f307597c700 1 -- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30700beab0 msgr2=0x7f3070142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f307597c700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30700beab0 0x7f3070142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f307597c700 1 -- 172.21.15.150:0/1274269470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070069e90 con 0x7f3058004250 2022-08-10T17:38:02.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f307597c700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30600076a0 tx=0x7f30600049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600017e0 con 0x7f3058004250 2022-08-10T17:38:02.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060011580 con 0x7f3058004250 2022-08-10T17:38:02.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30701ef680 con 0x7f3058004250 2022-08-10T17:38:02.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011930 con 0x7f3058004250 2022-08-10T17:38:02.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.531+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30701efc40 con 0x7f3058004250 2022-08-10T17:38:02.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.532+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3070072890 con 0x7f3058004250 2022-08-10T17:38:02.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.532+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f306001b030 con 0x7f3058004250 2022-08-10T17:38:02.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.533+0000 7f305e7fc700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 0x7f3050067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.533+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3060081a20 con 0x7f3058004250 2022-08-10T17:38:02.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.533+0000 7f307517b700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 0x7f3050067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.534+0000 7f307517b700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 0x7f3050067560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306c0017e0 tx=0x7f306c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.537+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f306004fa00 con 0x7f3058004250 2022-08-10T17:38:02.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.713+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30700c36f0 con 0x7f3058004250 2022-08-10T17:38:02.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.714+0000 7f305e7fc700 1 -- 172.21.15.150:0/1274269470 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7f30700c36f0 con 0x7f3058004250 2022-08-10T17:38:02.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:02.718 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:38:02.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 msgr2=0x7f3050067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 0x7f3050067560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306c0017e0 tx=0x7f306c009030 comp rx=0 tx=0).stop 2022-08-10T17:38:02.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 msgr2=0x7f3070069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30600076a0 tx=0x7f30600049d0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 shutdown_connections 2022-08-10T17:38:02.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30700beab0 0x7f3070142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058004250 0x7f3070069240 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f30500650b0 0x7f3050067560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 --2- 172.21.15.150:0/1274269470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30701f0160 0x7f30701ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 >> 172.21.15.150:0/1274269470 conn(0x7f307006e1f0 msgr2=0x7f30701568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 shutdown_connections 2022-08-10T17:38:02.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.716+0000 7f3077be0700 1 -- 172.21.15.150:0/1274269470 wait complete. 2022-08-10T17:38:02.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-08-10T17:35:27.251819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-08-10T17:35:30.366555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-08-10T17:35:35.008984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-08-10T17:35:36.359965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-08-10T17:35:39.420480+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-08-10T17:38:02.733 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-08-10T17:38:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.853+0000 7f18c4f08700 1 Processor -- start 2022-08-10T17:38:02.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.853+0000 7f18c4f08700 1 -- start start 2022-08-10T17:38:02.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18c4f08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18c0068110 0x7f18c00699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18c4f08700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c0156c30 con 0x7f18c01564d0 2022-08-10T17:38:02.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18c4f08700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c0156f10 con 0x7f18c00b0cb0 2022-08-10T17:38:02.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18c4f08700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c01578b0 con 0x7f18c0068110 2022-08-10T17:38:02.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18bdd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18c0068110 0x7f18c00699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18be59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f18c01564d0 0x7f18c006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42904/0 (socket says 172.21.15.150:42904) 2022-08-10T17:38:02.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.854+0000 7f18be59c700 1 -- 172.21.15.150:0/3431817951 learned_addr learned my addr 172.21.15.150:0/3431817951 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:02.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bdd9b700 1 -- 172.21.15.150:0/3431817951 >> v1:172.21.15.197:6789/0 conn(0x7f18c00b0cb0 legacy=0x7f18c0157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bdd9b700 1 -- 172.21.15.150:0/3431817951 >> v1:172.21.15.150:6789/0 conn(0x7f18c01564d0 legacy=0x7f18c006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bdd9b700 1 -- 172.21.15.150:0/3431817951 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c01571f0 con 0x7f18c0068110 2022-08-10T17:38:02.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bd59a700 1 -- 172.21.15.150:0/3431817951 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191687329 0 0) 0x7f18c0156c30 con 0x7f18c01564d0 2022-08-10T17:38:02.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bdd9b700 1 --2- 172.21.15.150:0/3431817951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c0068110 0x7f18c00699b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18b00096b0 tx=0x7f18b00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce281eba1f55f71 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bd59a700 1 -- 172.21.15.150:0/3431817951 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0011830 con 0x7f18c0068110 2022-08-10T17:38:02.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bd59a700 1 -- 172.21.15.150:0/3431817951 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0011990 con 0x7f18c0068110 2022-08-10T17:38:02.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.855+0000 7f18bd59a700 1 -- 172.21.15.150:0/3431817951 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0011d40 con 0x7f18c0068110 2022-08-10T17:38:02.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 -- 172.21.15.150:0/3431817951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c0068110 msgr2=0x7f18c00699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 --2- 172.21.15.150:0/3431817951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c0068110 0x7f18c00699b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18b00096b0 tx=0x7f18b00099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 -- 172.21.15.150:0/3431817951 shutdown_connections 2022-08-10T17:38:02.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 --2- 172.21.15.150:0/3431817951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c0068110 0x7f18c00699b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 -- 172.21.15.150:0/3431817951 >> 172.21.15.150:0/3431817951 conn(0x7f18c006b3b0 msgr2=0x7f18c006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:02.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 -- 172.21.15.150:0/3431817951 shutdown_connections 2022-08-10T17:38:02.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.856+0000 7f18c4f08700 1 -- 172.21.15.150:0/3431817951 wait complete. 2022-08-10T17:38:02.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.857+0000 7f18c4f08700 1 Processor -- start 2022-08-10T17:38:02.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.857+0000 7f18c4f08700 1 -- start start 2022-08-10T17:38:02.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18c0068110 0x7f18c01eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18c00b0cb0 0x7f18c01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01ecf70 con 0x7f18c01564d0 2022-08-10T17:38:02.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c00bf7f0 con 0x7f18c00b0cb0 2022-08-10T17:38:02.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01e0a60 con 0x7f18c0068110 2022-08-10T17:38:02.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58464/0 (socket says 172.21.15.150:58464) 2022-08-10T17:38:02.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 -- 172.21.15.150:0/1895543483 learned_addr learned my addr 172.21.15.150:0/1895543483 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:02.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bdd9b700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18c00b0cb0 0x7f18c01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18be59c700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18c0068110 0x7f18c01eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 -- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18c0068110 msgr2=0x7f18c01eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18c0068110 0x7f18c01eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 -- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18c00b0cb0 msgr2=0x7f18c01510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:02.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18c00b0cb0 0x7f18c01510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:02.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 -- 172.21.15.150:0/1895543483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0009310 con 0x7f18c01564d0 2022-08-10T17:38:02.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18bed9d700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c730 tx=0x7f18b800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8003a80 con 0x7f18c01564d0 2022-08-10T17:38:02.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b8003c00 con 0x7f18c01564d0 2022-08-10T17:38:02.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c01e0d40 con 0x7f18c01564d0 2022-08-10T17:38:02.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.858+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b80050d0 con 0x7f18c01564d0 2022-08-10T17:38:02.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.859+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c01df210 con 0x7f18c01564d0 2022-08-10T17:38:02.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.859+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c006a080 con 0x7f18c01564d0 2022-08-10T17:38:02.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.860+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f18b8019030 con 0x7f18c01564d0 2022-08-10T17:38:02.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.860+0000 7f18aeffd700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 0x7f189c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:02.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.860+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f18b8081620 con 0x7f18c01564d0 2022-08-10T17:38:02.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.860+0000 7f18be59c700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 0x7f189c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:02.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.861+0000 7f18be59c700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 0x7f189c067560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007e80 tx=0x7f18b4007e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:02.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:02.864+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f18b804f600 con 0x7f18c01564d0 2022-08-10T17:38:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.041+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18c0068970 con 0x7f18c01564d0 2022-08-10T17:38:03.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.042+0000 7f18aeffd700 1 -- 172.21.15.150:0/1895543483 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18b80170a0 con 0x7f18c01564d0 2022-08-10T17:38:03.046 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2022-08-10T17:38:03.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 msgr2=0x7f189c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 0x7f189c067560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007e80 tx=0x7f18b4007e10 comp rx=0 tx=0).stop 2022-08-10T17:38:03.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 msgr2=0x7f18c01dfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c730 tx=0x7f18b800ca40 comp rx=0 tx=0).stop 2022-08-10T17:38:03.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 shutdown_connections 2022-08-10T17:38:03.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18c01564d0 0x7f18c01dfcf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f189c0650b0 0x7f189c067560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18c0068110 0x7f18c01eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 --2- 172.21.15.150:0/1895543483 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18c00b0cb0 0x7f18c01510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 >> 172.21.15.150:0/1895543483 conn(0x7f18c006b3b0 msgr2=0x7f18c00c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 shutdown_connections 2022-08-10T17:38:03.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.044+0000 7f18c4f08700 1 -- 172.21.15.150:0/1895543483 wait complete. 2022-08-10T17:38:03.059 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-08-10T17:38:03.123 INFO:tasks.ceph.mds.d.smithi197.stderr:2022-08-10T17:38:03.119+0000 7f88c6672700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2022-08-10T17:38:03.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.179+0000 7fb2dd4c0700 1 Processor -- start 2022-08-10T17:38:03.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.179+0000 7fb2dd4c0700 1 -- start start 2022-08-10T17:38:03.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2dd4c0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb2d8151290 0x7fb2d80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2dd4c0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c1f40 con 0x7fb2d8068bf0 2022-08-10T17:38:03.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2dd4c0700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c2220 con 0x7fb2d8158170 2022-08-10T17:38:03.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2dd4c0700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80c7d90 con 0x7fb2d8151290 2022-08-10T17:38:03.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2d77fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb2d8068bf0 0x7fb2d80c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42920/0 (socket says 172.21.15.150:42920) 2022-08-10T17:38:03.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2d77fe700 1 -- 172.21.15.150:0/427737146 learned_addr learned my addr 172.21.15.150:0/427737146 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:03.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/427737146 >> v2:172.21.15.197:3300/0 conn(0x7fb2d8151290 0x7fb2d80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652195401 0 0) 0x7fb2d80c1f40 con 0x7fb2d8068bf0 2022-08-10T17:38:03.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.180+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003430 con 0x7fb2d8068bf0 2022-08-10T17:38:03.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519694878 0 0) 0x7fb2c4003430 con 0x7fb2d8068bf0 2022-08-10T17:38:03.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 >> v2:172.21.15.197:3300/0 conn(0x7fb2d8151290 msgr2=0x7fb2d80c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:03.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 --2- 172.21.15.150:0/427737146 >> v2:172.21.15.197:3300/0 conn(0x7fb2d8151290 0x7fb2d80c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 >> v1:172.21.15.197:6789/0 conn(0x7fb2d8158170 legacy=0x7fb2d8157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c2500 con 0x7fb2d8068bf0 2022-08-10T17:38:03.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fb2d00019f0 con 0x7fb2d8068bf0 2022-08-10T17:38:03.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/427737146 >> v2:172.21.15.197:3300/0 conn(0x7fb2d8151290 0x7fb2d80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:03.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 >> v1:172.21.15.150:6789/0 conn(0x7fb2d8068bf0 legacy=0x7fb2d80c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2c4003880 0x7fb2c4003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2c4004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2c4005080 0x7fb2c400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c7d90 con 0x7fb2c40046d0 2022-08-10T17:38:03.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400bf00 con 0x7fb2c4003880 2022-08-10T17:38:03.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400c0c0 con 0x7fb2c4005080 2022-08-10T17:38:03.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2c4004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2c4003880 0x7fb2c4003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d77fe700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2c4005080 0x7fb2c400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 -- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2c4005080 msgr2=0x7fb2c400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:03.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2c4005080 0x7fb2c400b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 -- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2c4003880 msgr2=0x7fb2c4003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:03.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2c4003880 0x7fb2c4003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 -- 172.21.15.150:0/427737146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4003430 con 0x7fb2c40046d0 2022-08-10T17:38:03.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d77fe700 1 -- 172.21.15.150:0/427737146 reap_dead start 2022-08-10T17:38:03.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2c4004b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8001640 tx=0x7fb2c4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c542f2904785e08 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80052d0 con 0x7fb2c40046d0 2022-08-10T17:38:03.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8003500 con 0x7fb2c40046d0 2022-08-10T17:38:03.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.181+0000 7fb2d5ffb700 1 -- 172.21.15.150:0/427737146 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80038b0 con 0x7fb2c40046d0 2022-08-10T17:38:03.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 msgr2=0x7fb2c4004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2c4004b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8001640 tx=0x7fb2c4005700 comp rx=0 tx=0).stop 2022-08-10T17:38:03.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/427737146 shutdown_connections 2022-08-10T17:38:03.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/427737146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2c4004b40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/427737146 >> 172.21.15.150:0/427737146 conn(0x7fb2d806f880 msgr2=0x7fb2d806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/427737146 shutdown_connections 2022-08-10T17:38:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.182+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/427737146 wait complete. 2022-08-10T17:38:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.183+0000 7fb2dd4c0700 1 Processor -- start 2022-08-10T17:38:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.183+0000 7fb2dd4c0700 1 -- start start 2022-08-10T17:38:03.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2d8143960 0x7fb2d80c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 0x7fb2d80c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8143220 con 0x7fb2c40046d0 2022-08-10T17:38:03.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81f0340 con 0x7fb2d80c4b30 2022-08-10T17:38:03.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2dd4c0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81f05e0 con 0x7fb2d8143960 2022-08-10T17:38:03.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58482/0 (socket says 172.21.15.150:58482) 2022-08-10T17:38:03.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d6ffd700 1 -- 172.21.15.150:0/3323126178 learned_addr learned my addr 172.21.15.150:0/3323126178 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:03.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d77fe700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 0x7fb2d80c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d6ffd700 1 -- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2d8143960 msgr2=0x7fb2d80c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.184+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2d8143960 0x7fb2d80c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2d8143960 0x7fb2d80c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d6ffd700 1 -- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 msgr2=0x7fb2d80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 0x7fb2d80c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d6ffd700 1 -- 172.21.15.150:0/3323126178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d81f08c0 con 0x7fb2c40046d0 2022-08-10T17:38:03.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d77fe700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 0x7fb2d80c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:03.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2d6ffd700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc011a90 tx=0x7fb2cc011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004020 con 0x7fb2c40046d0 2022-08-10T17:38:03.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc004180 con 0x7fb2c40046d0 2022-08-10T17:38:03.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d81f0ba0 con 0x7fb2c40046d0 2022-08-10T17:38:03.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00fa00 con 0x7fb2c40046d0 2022-08-10T17:38:03.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.185+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d8157b40 con 0x7fb2c40046d0 2022-08-10T17:38:03.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.186+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d81f10c0 con 0x7fb2c40046d0 2022-08-10T17:38:03.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.186+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb2cc024070 con 0x7fb2c40046d0 2022-08-10T17:38:03.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.187+0000 7fb2bf7fe700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 0x7fb2b8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.187+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb2cc0826e0 con 0x7fb2c40046d0 2022-08-10T17:38:03.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.187+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 0x7fb2b8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.188+0000 7fb2d67fc700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 0x7fb2b8067560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2d81491b0 tx=0x7fb2c8009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.191+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb2d81f10c0 con 0x7fb2c40046d0 2022-08-10T17:38:03.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.367+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb2d81f10c0 con 0x7fb2c40046d0 2022-08-10T17:38:03.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.367+0000 7fb2bf7fe700 1 -- 172.21.15.150:0/3323126178 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb2d81f10c0 con 0x7fb2c40046d0 2022-08-10T17:38:03.372 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 8 2022-08-10T17:38:03.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 msgr2=0x7fb2b8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 0x7fb2b8067560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2d81491b0 tx=0x7fb2c8009030 comp rx=0 tx=0).stop 2022-08-10T17:38:03.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 msgr2=0x7fb2d8157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc011a90 tx=0x7fb2cc011e50 comp rx=0 tx=0).stop 2022-08-10T17:38:03.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 shutdown_connections 2022-08-10T17:38:03.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb2d80c4b30 0x7fb2d80c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2c40046d0 0x7fb2d8157600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb2b80650b0 0x7fb2b8067560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 --2- 172.21.15.150:0/3323126178 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb2d8143960 0x7fb2d80c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 >> 172.21.15.150:0/3323126178 conn(0x7fb2d806f880 msgr2=0x7fb2d80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 shutdown_connections 2022-08-10T17:38:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.369+0000 7fb2dd4c0700 1 -- 172.21.15.150:0/3323126178 wait complete. 2022-08-10T17:38:03.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-08-10T17:38:03.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.504+0000 7f8751436700 1 Processor -- start 2022-08-10T17:38:03.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.504+0000 7f8751436700 1 -- start start 2022-08-10T17:38:03.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.504+0000 7f8751436700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.504+0000 7f8751436700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f8751436700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c157bd0 con 0x7f874c0c6950 2022-08-10T17:38:03.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f8751436700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c157150 con 0x7f874c150e20 2022-08-10T17:38:03.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f8751436700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c15b040 con 0x7f874c1511f0 2022-08-10T17:38:03.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874affd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:44480/0 (socket says 172.21.15.150:44480) 2022-08-10T17:38:03.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874affd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:40848/0 (socket says 172.21.15.150:40848) 2022-08-10T17:38:03.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 -- 172.21.15.150:0/108441522 learned_addr learned my addr 172.21.15.150:0/108441522 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:03.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 -- 172.21.15.150:0/108441522 >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 msgr2=0x7f874c156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:03.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 --2- 172.21.15.150:0/108441522 >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 -- 172.21.15.150:0/108441522 >> v1:172.21.15.197:6789/0 conn(0x7f874c0c6950 legacy=0x7f874c1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 -- 172.21.15.150:0/108441522 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c157330 con 0x7f874c1511f0 2022-08-10T17:38:03.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874affd700 1 --2- 172.21.15.150:0/108441522 >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:03.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f874a7fc700 1 --2- 172.21.15.150:0/108441522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f873c006fd0 tx=0x7f873c009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c40edfd248e44e2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.505+0000 7f8749ffb700 1 -- 172.21.15.150:0/108441522 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c004230 con 0x7f874c1511f0 2022-08-10T17:38:03.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8749ffb700 1 -- 172.21.15.150:0/108441522 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c004390 con 0x7f874c1511f0 2022-08-10T17:38:03.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8749ffb700 1 -- 172.21.15.150:0/108441522 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c011830 con 0x7f874c1511f0 2022-08-10T17:38:03.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 -- 172.21.15.150:0/108441522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 msgr2=0x7f874c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 --2- 172.21.15.150:0/108441522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f873c006fd0 tx=0x7f873c009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:03.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 -- 172.21.15.150:0/108441522 shutdown_connections 2022-08-10T17:38:03.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 --2- 172.21.15.150:0/108441522 >> v2:172.21.15.197:3300/0 conn(0x7f874c150e20 0x7f874c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 --2- 172.21.15.150:0/108441522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c1511f0 0x7f874c15ab00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 -- 172.21.15.150:0/108441522 >> 172.21.15.150:0/108441522 conn(0x7f874c071370 msgr2=0x7f874c071770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 -- 172.21.15.150:0/108441522 shutdown_connections 2022-08-10T17:38:03.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.506+0000 7f8751436700 1 -- 172.21.15.150:0/108441522 wait complete. 2022-08-10T17:38:03.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.507+0000 7f8751436700 1 Processor -- start 2022-08-10T17:38:03.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.507+0000 7f8751436700 1 -- start start 2022-08-10T17:38:03.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 0x7f874c149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 0x7f874c1ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c144d10 con 0x7f874c0c6950 2022-08-10T17:38:03.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c149070 con 0x7f874c1511f0 2022-08-10T17:38:03.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f8751436700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0cd4b0 con 0x7f874c150e20 2022-08-10T17:38:03.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f874affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f874affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58496/0 (socket says 172.21.15.150:58496) 2022-08-10T17:38:03.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f874affd700 1 -- 172.21.15.150:0/1211059953 learned_addr learned my addr 172.21.15.150:0/1211059953 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f874b7fe700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 0x7f874c1ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.508+0000 7f874a7fc700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 0x7f874c149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 -- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 msgr2=0x7f874c149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 0x7f874c149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 -- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 msgr2=0x7f874c1ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 0x7f874c1ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 -- 172.21.15.150:0/1211059953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009310 con 0x7f874c0c6950 2022-08-10T17:38:03.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874b7fe700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 0x7f874c1ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:03.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874a7fc700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 0x7f874c149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:03.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f874affd700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f874000e9b0 tx=0x7f874000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740009670 con 0x7f874c0c6950 2022-08-10T17:38:03.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874000c7f0 con 0x7f874c0c6950 2022-08-10T17:38:03.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874000cb80 con 0x7f874c0c6950 2022-08-10T17:38:03.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c0093e0 con 0x7f874c0c6950 2022-08-10T17:38:03.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.509+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c14b540 con 0x7f874c0c6950 2022-08-10T17:38:03.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.510+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c1492e0 con 0x7f874c0c6950 2022-08-10T17:38:03.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.510+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8740023070 con 0x7f874c0c6950 2022-08-10T17:38:03.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.511+0000 7f87337fe700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 0x7f872c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.511+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f87400824b0 con 0x7f874c0c6950 2022-08-10T17:38:03.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.511+0000 7f874a7fc700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 0x7f872c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.511+0000 7f874a7fc700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 0x7f872c067560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f873c009aa0 tx=0x7f873c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.515+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8740050430 con 0x7f874c0c6950 2022-08-10T17:38:03.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.690+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f874c072890 con 0x7f874c0c6950 2022-08-10T17:38:03.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.691+0000 7f87337fe700 1 -- 172.21.15.150:0/1211059953 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8740053a50 con 0x7f874c0c6950 2022-08-10T17:38:03.696 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:03.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.692+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 msgr2=0x7f872c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.692+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 0x7f872c067560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f873c009aa0 tx=0x7f873c008030 comp rx=0 tx=0).stop 2022-08-10T17:38:03.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.692+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 msgr2=0x7f874c1ee8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.692+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f874000e9b0 tx=0x7f874000ed70 comp rx=0 tx=0).stop 2022-08-10T17:38:03.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 shutdown_connections 2022-08-10T17:38:03.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f874c1511f0 0x7f874c1ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c6950 0x7f874c1ee8e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f872c0650b0 0x7f872c067560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 --2- 172.21.15.150:0/1211059953 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f874c150e20 0x7f874c149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 >> 172.21.15.150:0/1211059953 conn(0x7f874c071370 msgr2=0x7f874c1564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 shutdown_connections 2022-08-10T17:38:03.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.693+0000 7f8751436700 1 -- 172.21.15.150:0/1211059953 wait complete. 2022-08-10T17:38:03.708 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-08-10T17:38:03.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.827+0000 7f2aba450700 1 Processor -- start 2022-08-10T17:38:03.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.827+0000 7f2aba450700 1 -- start start 2022-08-10T17:38:03.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2aba450700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 0x7f2ab4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2aba450700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ab40647d0 0x7f2ab415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2aba450700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40c4dc0 con 0x7f2ab406c860 2022-08-10T17:38:03.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2aba450700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40c5940 con 0x7f2ab40647d0 2022-08-10T17:38:03.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2aba450700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40c9fc0 con 0x7f2ab4150af0 2022-08-10T17:38:03.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2ab89ed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ab40647d0 0x7f2ab415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.828+0000 7f2ab37fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2ab406c860 0x7f2ab40c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42950/0 (socket says 172.21.15.150:42950) 2022-08-10T17:38:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab37fe700 1 -- 172.21.15.150:0/955010890 learned_addr learned my addr 172.21.15.150:0/955010890 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab3fff700 1 --2- 172.21.15.150:0/955010890 >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 0x7f2ab4159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab89ed700 1 -- 172.21.15.150:0/955010890 >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 msgr2=0x7f2ab4159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:03.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab89ed700 1 --2- 172.21.15.150:0/955010890 >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 0x7f2ab4159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab89ed700 1 -- 172.21.15.150:0/955010890 >> v1:172.21.15.150:6789/0 conn(0x7f2ab406c860 legacy=0x7f2ab40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab89ed700 1 -- 172.21.15.150:0/955010890 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab406f9a0 con 0x7f2ab40647d0 2022-08-10T17:38:03.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab3fff700 1 --2- 172.21.15.150:0/955010890 >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 0x7f2ab4159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:03.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab89ed700 1 --2- 172.21.15.150:0/955010890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab40647d0 0x7f2ab415a3a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40707d0 tx=0x7f2aac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cf68ef30a9ab6a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab2ffd700 1 -- 172.21.15.150:0/955010890 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00e070 con 0x7f2ab40647d0 2022-08-10T17:38:03.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab2ffd700 1 -- 172.21.15.150:0/955010890 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00bad0 con 0x7f2ab40647d0 2022-08-10T17:38:03.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.829+0000 7f2ab2ffd700 1 -- 172.21.15.150:0/955010890 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00be80 con 0x7f2ab40647d0 2022-08-10T17:38:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 -- 172.21.15.150:0/955010890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab40647d0 msgr2=0x7f2ab415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 --2- 172.21.15.150:0/955010890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab40647d0 0x7f2ab415a3a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40707d0 tx=0x7f2aac00b330 comp rx=0 tx=0).stop 2022-08-10T17:38:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 -- 172.21.15.150:0/955010890 shutdown_connections 2022-08-10T17:38:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 --2- 172.21.15.150:0/955010890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab40647d0 0x7f2ab415a3a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 --2- 172.21.15.150:0/955010890 >> v2:172.21.15.197:3300/0 conn(0x7f2ab4150af0 0x7f2ab4159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 -- 172.21.15.150:0/955010890 >> 172.21.15.150:0/955010890 conn(0x7f2ab40c92f0 msgr2=0x7f2ab40c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 -- 172.21.15.150:0/955010890 shutdown_connections 2022-08-10T17:38:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.830+0000 7f2aba450700 1 -- 172.21.15.150:0/955010890 wait complete. 2022-08-10T17:38:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.831+0000 7f2aba450700 1 Processor -- start 2022-08-10T17:38:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.831+0000 7f2aba450700 1 -- start start 2022-08-10T17:38:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ab40647d0 0x7f2ab40c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 0x7f2ab40c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c3140 con 0x7f2ab4150af0 2022-08-10T17:38:03.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c2000 con 0x7f2ab40647d0 2022-08-10T17:38:03.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2aba450700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c13f0 con 0x7f2ab406c860 2022-08-10T17:38:03.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58510/0 (socket says 172.21.15.150:58510) 2022-08-10T17:38:03.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 -- 172.21.15.150:0/3660565213 learned_addr learned my addr 172.21.15.150:0/3660565213 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:03.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab3fff700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ab40647d0 0x7f2ab40c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab37fe700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 0x7f2ab40c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 -- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 msgr2=0x7f2ab40c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 0x7f2ab40c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 -- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ab40647d0 msgr2=0x7f2ab40c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ab40647d0 0x7f2ab40c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 -- 172.21.15.150:0/3660565213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac009a70 con 0x7f2ab4150af0 2022-08-10T17:38:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab37fe700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 0x7f2ab40c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.832+0000 7f2ab89ed700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00b370 tx=0x7f2aac004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.833+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac012430 con 0x7f2ab4150af0 2022-08-10T17:38:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.833+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac0125b0 con 0x7f2ab4150af0 2022-08-10T17:38:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.833+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40c16d0 con 0x7f2ab4150af0 2022-08-10T17:38:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.833+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac012960 con 0x7f2ab4150af0 2022-08-10T17:38:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.833+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab40c1c90 con 0x7f2ab4150af0 2022-08-10T17:38:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.834+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab40c1e20 con 0x7f2ab4150af0 2022-08-10T17:38:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.834+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2aac02c070 con 0x7f2ab4150af0 2022-08-10T17:38:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.834+0000 7f2ab0ff9700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 0x7f2a94067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.834+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2aac0842b0 con 0x7f2ab4150af0 2022-08-10T17:38:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.835+0000 7f2ab3fff700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 0x7f2a94067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.835+0000 7f2ab3fff700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 0x7f2a94067590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8006e10 tx=0x7f2aa8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:03.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:03.838+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2aac052290 con 0x7f2ab4150af0 2022-08-10T17:38:04.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.019+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ab4072890 con 0x7f2ab4150af0 2022-08-10T17:38:04.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.019+0000 7f2ab0ff9700 1 -- 172.21.15.150:0/3660565213 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2aac02a070 con 0x7f2ab4150af0 2022-08-10T17:38:04.023 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 64 2022-08-10T17:38:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 msgr2=0x7f2a94067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 0x7f2a94067590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8006e10 tx=0x7f2aa8008040 comp rx=0 tx=0).stop 2022-08-10T17:38:04.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 msgr2=0x7f2ab40beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00b370 tx=0x7f2aac004950 comp rx=0 tx=0).stop 2022-08-10T17:38:04.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 shutdown_connections 2022-08-10T17:38:04.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ab4150af0 0x7f2ab40beab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ab40647d0 0x7f2ab40c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a940650e0 0x7f2a94067590 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 --2- 172.21.15.150:0/3660565213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ab406c860 0x7f2ab40c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 >> 172.21.15.150:0/3660565213 conn(0x7f2ab40c92f0 msgr2=0x7f2ab40c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:04.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 shutdown_connections 2022-08-10T17:38:04.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.021+0000 7f2aba450700 1 -- 172.21.15.150:0/3660565213 wait complete. 2022-08-10T17:38:04.037 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-08-10T17:38:04.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.156+0000 7f5ba8a89700 1 Processor -- start 2022-08-10T17:38:04.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.156+0000 7f5ba8a89700 1 -- start start 2022-08-10T17:38:04.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba8a89700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 0x7f5ba4068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba8a89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40c6100 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba8a89700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40c5e00 con 0x7f5ba41540f0 2022-08-10T17:38:04.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba8a89700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c5270 con 0x7f5ba41544c0 2022-08-10T17:38:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba2d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5ba40bd4b0 0x7f5ba4161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42966/0 (socket says 172.21.15.150:42966) 2022-08-10T17:38:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba2d9d700 1 -- 172.21.15.150:0/2971652314 learned_addr learned my addr 172.21.15.150:0/2971652314 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.157+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/2971652314 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 0x7f5ba4068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696465857 0 0) 0x7f5ba40c6100 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b88003430 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963791771 0 0) 0x7f5ba40c5e00 con 0x7f5ba41540f0 2022-08-10T17:38:04.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba40c6100 con 0x7f5ba41540f0 2022-08-10T17:38:04.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba1d9b700 1 -- 172.21.15.150:0/2971652314 >> v1:172.21.15.197:6789/0 conn(0x7f5ba41540f0 legacy=0x7f5ba4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba1d9b700 1 -- 172.21.15.150:0/2971652314 >> v1:172.21.15.150:6789/0 conn(0x7f5ba40bd4b0 legacy=0x7f5ba4161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba1d9b700 1 -- 172.21.15.150:0/2971652314 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba406eb00 con 0x7f5ba41544c0 2022-08-10T17:38:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/2971652314 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 0x7f5ba4068110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b940096e0 tx=0x7f5b940099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c51d6dbd0f888 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940107b0 con 0x7f5ba41544c0 2022-08-10T17:38:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94010910 con 0x7f5ba41544c0 2022-08-10T17:38:04.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.158+0000 7f5ba159a700 1 -- 172.21.15.150:0/2971652314 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94010c80 con 0x7f5ba41544c0 2022-08-10T17:38:04.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 -- 172.21.15.150:0/2971652314 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 msgr2=0x7f5ba4068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/2971652314 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 0x7f5ba4068110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b940096e0 tx=0x7f5b940099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 -- 172.21.15.150:0/2971652314 shutdown_connections 2022-08-10T17:38:04.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/2971652314 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41544c0 0x7f5ba4068110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 -- 172.21.15.150:0/2971652314 >> 172.21.15.150:0/2971652314 conn(0x7f5ba406d0d0 msgr2=0x7f5ba40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:04.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 -- 172.21.15.150:0/2971652314 shutdown_connections 2022-08-10T17:38:04.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.159+0000 7f5ba8a89700 1 -- 172.21.15.150:0/2971652314 wait complete. 2022-08-10T17:38:04.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.160+0000 7f5ba8a89700 1 Processor -- start 2022-08-10T17:38:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.160+0000 7f5ba8a89700 1 -- start start 2022-08-10T17:38:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 0x7f5ba41ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 0x7f5ba41eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41ed400 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41ec830 con 0x7f5ba41544c0 2022-08-10T17:38:04.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba8a89700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41ecb10 con 0x7f5ba41540f0 2022-08-10T17:38:04.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58520/0 (socket says 172.21.15.150:58520) 2022-08-10T17:38:04.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 -- 172.21.15.150:0/1418145384 learned_addr learned my addr 172.21.15.150:0/1418145384 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:04.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 0x7f5ba41ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba2d9d700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 0x7f5ba41eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 -- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 msgr2=0x7f5ba41ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 0x7f5ba41ed890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 -- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 msgr2=0x7f5ba41eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 0x7f5ba41eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 -- 172.21.15.150:0/1418145384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009310 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 0x7f5ba41ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:04.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba2d9d700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 0x7f5ba41eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:04.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.161+0000 7f5ba259c700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c3c0 tx=0x7f5b9800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.162+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980052d0 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.162+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98011590 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.162+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba40c9350 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.162+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98011940 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.162+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba41e17a0 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.163+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba41ed6e0 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.163+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5b98019030 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.163+0000 7f5b92ffd700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 0x7f5b80067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.164+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5b98081550 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.164+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 0x7f5b80067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.164+0000 7f5ba1d9b700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 0x7f5b80067590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b940090b0 tx=0x7f5b94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.168+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5b9804f530 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.345+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ba4072890 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.346+0000 7f5b92ffd700 1 -- 172.21.15.150:0/1418145384 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b980170a0 con 0x7f5ba40bd4b0 2022-08-10T17:38:04.350 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:04.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.347+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 msgr2=0x7f5b80067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.347+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 0x7f5b80067590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b940090b0 tx=0x7f5b94008030 comp rx=0 tx=0).stop 2022-08-10T17:38:04.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.347+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 msgr2=0x7f5ba41eec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.347+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c3c0 tx=0x7f5b9800c780 comp rx=0 tx=0).stop 2022-08-10T17:38:04.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 shutdown_connections 2022-08-10T17:38:04.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5ba41544c0 0x7f5ba41eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ba40bd4b0 0x7f5ba41eec20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b800650e0 0x7f5b80067590 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 --2- 172.21.15.150:0/1418145384 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5ba41540f0 0x7f5ba41ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 >> 172.21.15.150:0/1418145384 conn(0x7f5ba406d0d0 msgr2=0x7f5ba406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:04.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 shutdown_connections 2022-08-10T17:38:04.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.348+0000 7f5ba8a89700 1 -- 172.21.15.150:0/1418145384 wait complete. 2022-08-10T17:38:04.364 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:38:04.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.480+0000 7f428463a700 1 Processor -- start 2022-08-10T17:38:04.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.480+0000 7f428463a700 1 -- start start 2022-08-10T17:38:04.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f428463a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f427c06c5b0 0x7f427c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f428463a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f427c0c76b0 0x7f427c0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f428463a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0c8220 con 0x7f427c06c980 2022-08-10T17:38:04.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f428463a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0c2190 con 0x7f427c0c76b0 2022-08-10T17:38:04.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f428463a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c2470 con 0x7f427c06c5b0 2022-08-10T17:38:04.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f4281bd5700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f427c06c980 0x7f427c0c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:42976/0 (socket says 172.21.15.150:42976) 2022-08-10T17:38:04.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.481+0000 7f4281bd5700 1 -- 172.21.15.150:0/4133167716 learned_addr learned my addr 172.21.15.150:0/4133167716 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:04.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42823d6700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f427c06c5b0 0x7f427c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4282bd7700 1 --2- 172.21.15.150:0/4133167716 >> v2:172.21.15.197:3300/0 conn(0x7f427c0c76b0 0x7f427c0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584837329 0 0) 0x7f427c0c8220 con 0x7f427c06c980 2022-08-10T17:38:04.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4264003430 con 0x7f427c06c980 2022-08-10T17:38:04.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781449240 0 0) 0x7f4264003430 con 0x7f427c06c980 2022-08-10T17:38:04.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f427c06c5b0 msgr2=0x7f427c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:04.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f427c06c5b0 0x7f427c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 >> v2:172.21.15.197:3300/0 conn(0x7f427c0c76b0 msgr2=0x7f427c0c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:04.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 --2- 172.21.15.150:0/4133167716 >> v2:172.21.15.197:3300/0 conn(0x7f427c0c76b0 0x7f427c0c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0c2750 con 0x7f427c06c980 2022-08-10T17:38:04.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f4278001670 con 0x7f427c06c980 2022-08-10T17:38:04.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 >> v1:172.21.15.150:6789/0 conn(0x7f427c06c980 legacy=0x7f427c0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264003880 0x7f4264003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4264004260 0x7f4264004730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4264004da0 0x7f426400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c2190 con 0x7f4264004260 2022-08-10T17:38:04.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c2470 con 0x7f4264004da0 2022-08-10T17:38:04.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426400bdd0 con 0x7f4264003880 2022-08-10T17:38:04.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4282bd7700 1 --2- 172.21.15.150:0/4133167716 >> v2:172.21.15.197:3300/0 conn(0x7f427c0c76b0 0x7f427c0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:04.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42823d6700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f427c06c5b0 0x7f427c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:04.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4264004260 0x7f4264004730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4282bd7700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4264004da0 0x7f426400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f42823d6700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264003880 0x7f4264003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 -- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264003880 msgr2=0x7f4264003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:04.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264003880 0x7f4264003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 -- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4264004da0 msgr2=0x7f426400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:04.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4264004da0 0x7f426400b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 -- 172.21.15.150:0/4133167716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264003430 con 0x7f4264004260 2022-08-10T17:38:04.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4282bd7700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4264004da0 0x7f426400b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:04.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.482+0000 7f4281bd5700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4264004260 0x7f4264004730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f427c06ef50 tx=0x7f4264005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637641f8c3f2e999 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800cc20 con 0x7f4264004260 2022-08-10T17:38:04.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800cd80 con 0x7f4264004260 2022-08-10T17:38:04.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f42813d4700 1 -- 172.21.15.150:0/4133167716 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278007310 con 0x7f4264004260 2022-08-10T17:38:04.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 -- 172.21.15.150:0/4133167716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4264004260 msgr2=0x7f4264004730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 --2- 172.21.15.150:0/4133167716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4264004260 0x7f4264004730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f427c06ef50 tx=0x7f4264005700 comp rx=0 tx=0).stop 2022-08-10T17:38:04.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f4282bd7700 1 -- 172.21.15.150:0/4133167716 reap_dead start 2022-08-10T17:38:04.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 -- 172.21.15.150:0/4133167716 shutdown_connections 2022-08-10T17:38:04.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 -- 172.21.15.150:0/4133167716 >> 172.21.15.150:0/4133167716 conn(0x7f427c06e1f0 msgr2=0x7f427c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:04.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 -- 172.21.15.150:0/4133167716 shutdown_connections 2022-08-10T17:38:04.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.483+0000 7f428463a700 1 -- 172.21.15.150:0/4133167716 wait complete. 2022-08-10T17:38:04.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.484+0000 7f428463a700 1 Processor -- start 2022-08-10T17:38:04.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 -- start start 2022-08-10T17:38:04.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264004260 0x7f427c1e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f427c068110 0x7f427c1ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1f00e0 con 0x7f427c0c9310 2022-08-10T17:38:04.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1ebec0 con 0x7f427c068110 2022-08-10T17:38:04.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f428463a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1ef580 con 0x7f4264004260 2022-08-10T17:38:04.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f4282bd7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f4282bd7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58542/0 (socket says 172.21.15.150:58542) 2022-08-10T17:38:04.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f4282bd7700 1 -- 172.21.15.150:0/1384277493 learned_addr learned my addr 172.21.15.150:0/1384277493 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:04.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f42823d6700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264004260 0x7f427c1e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.485+0000 7f4281bd5700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f427c068110 0x7f427c1ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 -- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264004260 msgr2=0x7f427c1e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264004260 0x7f427c1e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 -- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f427c068110 msgr2=0x7f427c1ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f427c068110 0x7f427c1ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 -- 172.21.15.150:0/1384277493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c1ef840 con 0x7f427c0c9310 2022-08-10T17:38:04.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f4282bd7700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f427c0c7640 tx=0x7f42740114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400e070 con 0x7f427c0c9310 2022-08-10T17:38:04.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011c20 con 0x7f427c0c9310 2022-08-10T17:38:04.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c1efb20 con 0x7f427c0c9310 2022-08-10T17:38:04.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011df0 con 0x7f427c0c9310 2022-08-10T17:38:04.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.486+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c1ef1d0 con 0x7f427c0c9310 2022-08-10T17:38:04.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.487+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c072890 con 0x7f427c0c9310 2022-08-10T17:38:04.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.487+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f42740038a0 con 0x7f427c0c9310 2022-08-10T17:38:04.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.487+0000 7f426affd700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 0x7f425c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:04.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.488+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4274082ab0 con 0x7f427c0c9310 2022-08-10T17:38:04.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.488+0000 7f42823d6700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 0x7f425c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:04.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.488+0000 7f42823d6700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 0x7f425c067590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f427c0725a0 tx=0x7f426c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:04.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.492+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4274050a90 con 0x7f427c0c9310 2022-08-10T17:38:04.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.710+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f427c1ebc90 con 0x7f427c0c9310 2022-08-10T17:38:04.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.710+0000 7f426affd700 1 -- 172.21.15.150:0/1384277493 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6153 (secure 0 0 0) 0x7f42740540b0 con 0x7f427c0c9310 2022-08-10T17:38:04.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:04.715 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:37:59.874679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:38:04.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 msgr2=0x7f425c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 0x7f425c067590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f427c0725a0 tx=0x7f426c008040 comp rx=0 tx=0).stop 2022-08-10T17:38:04.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 msgr2=0x7f427c1ec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:04.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f427c0c7640 tx=0x7f42740114b0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 shutdown_connections 2022-08-10T17:38:04.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f427c0c9310 0x7f427c1ec890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f425c0650e0 0x7f425c067590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4264004260 0x7f427c1e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 --2- 172.21.15.150:0/1384277493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f427c068110 0x7f427c1ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:04.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 >> 172.21.15.150:0/1384277493 conn(0x7f427c06e1f0 msgr2=0x7f427c0beab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:04.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 shutdown_connections 2022-08-10T17:38:04.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:04.712+0000 7f428463a700 1 -- 172.21.15.150:0/1384277493 wait complete. 2022-08-10T17:38:04.719 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 14 2022-08-10T17:38:05.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-08-10T17:35:37.393269+0000', 'modified': '2022-08-10T17:37:59.874679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4317, 'mds_1': 4297, 'mds_2': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 2, 'incarnation': 14, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.150:6833/903670715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6832', 'nonce': 903670715}, {'type': 'v1', 'addr': '172.21.15.150:6833', 'nonce': 903670715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 38, 'addr': '172.21.15.197:6839/4060491020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6837', 'nonce': 4060491020}, {'type': 'v1', 'addr': '172.21.15.197:6839', 'nonce': 4060491020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4317': {'gid': 4317, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.197:6835/1505577177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6834', 'nonce': 1505577177}, {'type': 'v1', 'addr': '172.21.15.197:6835', 'nonce': 1505577177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-08-10T17:38:05.334 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4296:up:creating 2022-08-10T17:38:06.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:38:06.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.464+0000 7fd309fcc700 1 Processor -- start 2022-08-10T17:38:06.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.464+0000 7fd309fcc700 1 -- start start 2022-08-10T17:38:06.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd309fcc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd30406c860 0x7fd304068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd309fcc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3041563c0 con 0x7fd3040bc830 2022-08-10T17:38:06.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd309fcc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304150940 con 0x7fd304070040 2022-08-10T17:38:06.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd309fcc700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304153590 con 0x7fd30406c860 2022-08-10T17:38:06.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3037fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd3040bc830 0x7fd304152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43022/0 (socket says 172.21.15.150:43022) 2022-08-10T17:38:06.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3037fe700 1 -- 172.21.15.150:0/3476194711 learned_addr learned my addr 172.21.15.150:0/3476194711 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:06.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd302ffd700 1 --2- 172.21.15.150:0/3476194711 >> v2:172.21.15.197:3300/0 conn(0x7fd30406c860 0x7fd304068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728163990 0 0) 0x7fd3041563c0 con 0x7fd3040bc830 2022-08-10T17:38:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e4003430 con 0x7fd3040bc830 2022-08-10T17:38:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533018807 0 0) 0x7fd2e4003430 con 0x7fd3040bc830 2022-08-10T17:38:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 >> v2:172.21.15.197:3300/0 conn(0x7fd30406c860 msgr2=0x7fd304068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 --2- 172.21.15.150:0/3476194711 >> v2:172.21.15.197:3300/0 conn(0x7fd30406c860 0x7fd304068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 >> v1:172.21.15.197:6789/0 conn(0x7fd304070040 legacy=0x7fd3040c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304068870 con 0x7fd3040bc830 2022-08-10T17:38:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.465+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fd2ec001670 con 0x7fd3040bc830 2022-08-10T17:38:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 >> v1:172.21.15.150:6789/0 conn(0x7fd3040bc830 legacy=0x7fd304152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2e4003880 0x7fd2e4003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e40046d0 0x7fd2e4004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 0x7fd2e400c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400cfe0 con 0x7fd2e4005080 2022-08-10T17:38:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400d150 con 0x7fd2e4003880 2022-08-10T17:38:06.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400d310 con 0x7fd2e40046d0 2022-08-10T17:38:06.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 0x7fd2e400c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3037fe700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2e4003880 0x7fd2e4003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd302ffd700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e40046d0 0x7fd2e4004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 -- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e40046d0 msgr2=0x7fd2e4004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e40046d0 0x7fd2e4004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 -- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2e4003880 msgr2=0x7fd2e4003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2e4003880 0x7fd2e4003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 -- 172.21.15.150:0/3476194711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4003430 con 0x7fd2e4005080 2022-08-10T17:38:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 -- 172.21.15.150:0/3476194711 reap_dead start 2022-08-10T17:38:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd303fff700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 0x7fd2e400c9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001d60 tx=0x7fd2e4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59acc2bf53cf450 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc003a80 con 0x7fd2e4005080 2022-08-10T17:38:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc003be0 con 0x7fd2e4005080 2022-08-10T17:38:06.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.466+0000 7fd3027fc700 1 -- 172.21.15.150:0/3476194711 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0017a0 con 0x7fd2e4005080 2022-08-10T17:38:06.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 -- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 msgr2=0x7fd2e400c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 0x7fd2e400c9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001d60 tx=0x7fd2e4005700 comp rx=0 tx=0).stop 2022-08-10T17:38:06.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 -- 172.21.15.150:0/3476194711 shutdown_connections 2022-08-10T17:38:06.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 --2- 172.21.15.150:0/3476194711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e4005080 0x7fd2e400c9a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 -- 172.21.15.150:0/3476194711 >> 172.21.15.150:0/3476194711 conn(0x7fd3040c92f0 msgr2=0x7fd3040c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:06.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 -- 172.21.15.150:0/3476194711 shutdown_connections 2022-08-10T17:38:06.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.467+0000 7fd309fcc700 1 -- 172.21.15.150:0/3476194711 wait complete. 2022-08-10T17:38:06.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.468+0000 7fd309fcc700 1 Processor -- start 2022-08-10T17:38:06.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.468+0000 7fd309fcc700 1 -- start start 2022-08-10T17:38:06.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e4005080 0x7fd3040bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 0x7fd3040c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040ba320 con 0x7fd30414f7e0 2022-08-10T17:38:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040bc010 con 0x7fd3040c12f0 2022-08-10T17:38:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd309fcc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040bb370 con 0x7fd2e4005080 2022-08-10T17:38:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58590/0 (socket says 172.21.15.150:58590) 2022-08-10T17:38:06.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 -- 172.21.15.150:0/2804972007 learned_addr learned my addr 172.21.15.150:0/2804972007 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:06.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd302ffd700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 0x7fd3040c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd3037fe700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e4005080 0x7fd3040bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 -- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e4005080 msgr2=0x7fd3040bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e4005080 0x7fd3040bbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 -- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 msgr2=0x7fd3040c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 0x7fd3040c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd303fff700 1 -- 172.21.15.150:0/2804972007 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040bb650 con 0x7fd30414f7e0 2022-08-10T17:38:06.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.469+0000 7fd302ffd700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 0x7fd3040c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:06.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd303fff700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3040c46f0 tx=0x7fd2fc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:06.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc020070 con 0x7fd30414f7e0 2022-08-10T17:38:06.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc006a60 con 0x7fd30414f7e0 2022-08-10T17:38:06.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3040ba530 con 0x7fd30414f7e0 2022-08-10T17:38:06.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc001820 con 0x7fd30414f7e0 2022-08-10T17:38:06.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.470+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3040c1820 con 0x7fd30414f7e0 2022-08-10T17:38:06.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.471+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3040bb7e0 con 0x7fd30414f7e0 2022-08-10T17:38:06.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.471+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd2fc010050 con 0x7fd30414f7e0 2022-08-10T17:38:06.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.472+0000 7fd2fbfff700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 0x7fd2e8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:06.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.472+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd2fc081fb0 con 0x7fd30414f7e0 2022-08-10T17:38:06.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.472+0000 7fd3037fe700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 0x7fd2e8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:06.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.472+0000 7fd3037fe700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 0x7fd2e8067590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001050 tx=0x7fd2ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:06.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.476+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd2fc04ff90 con 0x7fd30414f7e0 2022-08-10T17:38:06.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.697+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd304072890 con 0x7fd30414f7e0 2022-08-10T17:38:06.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.698+0000 7fd2fbfff700 1 -- 172.21.15.150:0/2804972007 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6152 (secure 0 0 0) 0x7fd2fc016030 con 0x7fd30414f7e0 2022-08-10T17:38:06.702 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:06.702 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:38:04.920762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":40,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:38:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 msgr2=0x7fd2e8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 0x7fd2e8067590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001050 tx=0x7fd2ec009040 comp rx=0 tx=0).stop 2022-08-10T17:38:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 msgr2=0x7fd30414c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3040c46f0 tx=0x7fd2fc0014a0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 shutdown_connections 2022-08-10T17:38:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd30414f7e0 0x7fd30414c9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2e80650e0 0x7fd2e8067590 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2e4005080 0x7fd3040bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 --2- 172.21.15.150:0/2804972007 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd3040c12f0 0x7fd3040c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 >> 172.21.15.150:0/2804972007 conn(0x7fd3040c92f0 msgr2=0x7fd3040c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 shutdown_connections 2022-08-10T17:38:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:06.700+0000 7fd309fcc700 1 -- 172.21.15.150:0/2804972007 wait complete. 2022-08-10T17:38:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 15 2022-08-10T17:38:06.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:38:06.854 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:38:07.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-08-10T17:35:37.393269+0000', 'modified': '2022-08-10T17:38:04.920762+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4317, 'mds_1': 4297, 'mds_2': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 40, 'addr': '172.21.15.150:6833/903670715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6832', 'nonce': 903670715}, {'type': 'v1', 'addr': '172.21.15.150:6833', 'nonce': 903670715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 38, 'addr': '172.21.15.197:6839/4060491020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6837', 'nonce': 4060491020}, {'type': 'v1', 'addr': '172.21.15.197:6839', 'nonce': 4060491020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4317': {'gid': 4317, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.197:6835/1505577177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.197:6834', 'nonce': 1505577177}, {'type': 'v1', 'addr': '172.21.15.197:6835', 'nonce': 1505577177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-08-10T17:38:07.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-08-10T17:38:07.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2022-08-10T17:38:07.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.439+0000 7f764eb62700 1 Processor -- start 2022-08-10T17:38:07.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.439+0000 7f764eb62700 1 -- start start 2022-08-10T17:38:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764eb62700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 0x7f76480c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764eb62700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76480c25c0 0x7f764806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764eb62700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480c2a60 con 0x7f76480c4d90 2022-08-10T17:38:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764eb62700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480c5e10 con 0x7f76480c25c0 2022-08-10T17:38:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764eb62700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480c1c30 con 0x7f76480c7220 2022-08-10T17:38:07.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.440+0000 7f764d0ff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76480c25c0 0x7f764806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76480c25c0 0x7f764806fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58598/0 (socket says 172.21.15.150:58598) 2022-08-10T17:38:07.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 -- 172.21.15.150:0/1797264512 learned_addr learned my addr 172.21.15.150:0/1797264512 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:07.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f7647fff700 1 --2- 172.21.15.150:0/1797264512 >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 0x7f76480c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 -- 172.21.15.150:0/1797264512 >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 msgr2=0x7f76480c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1797264512 >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 0x7f76480c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 -- 172.21.15.150:0/1797264512 >> v1:172.21.15.197:6789/0 conn(0x7f76480c4d90 legacy=0x7f76480c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 -- 172.21.15.150:0/1797264512 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480699c0 con 0x7f76480c25c0 2022-08-10T17:38:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f7647fff700 1 --2- 172.21.15.150:0/1797264512 >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 0x7f76480c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1797264512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c25c0 0x7f764806fca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76480afcf0 tx=0x7f764000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77abbdac79b5dc5c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f76477fe700 1 -- 172.21.15.150:0/1797264512 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000e070 con 0x7f76480c25c0 2022-08-10T17:38:07.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f76477fe700 1 -- 172.21.15.150:0/1797264512 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764000b980 con 0x7f76480c25c0 2022-08-10T17:38:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.441+0000 7f76477fe700 1 -- 172.21.15.150:0/1797264512 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000bd30 con 0x7f76480c25c0 2022-08-10T17:38:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 -- 172.21.15.150:0/1797264512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c25c0 msgr2=0x7f764806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 --2- 172.21.15.150:0/1797264512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c25c0 0x7f764806fca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76480afcf0 tx=0x7f764000b330 comp rx=0 tx=0).stop 2022-08-10T17:38:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 -- 172.21.15.150:0/1797264512 shutdown_connections 2022-08-10T17:38:07.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 --2- 172.21.15.150:0/1797264512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c25c0 0x7f764806fca0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 --2- 172.21.15.150:0/1797264512 >> v2:172.21.15.197:3300/0 conn(0x7f76480c7220 0x7f76480c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 -- 172.21.15.150:0/1797264512 >> 172.21.15.150:0/1797264512 conn(0x7f764806d0d0 msgr2=0x7f76480c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 -- 172.21.15.150:0/1797264512 shutdown_connections 2022-08-10T17:38:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.442+0000 7f764eb62700 1 -- 172.21.15.150:0/1797264512 wait complete. 2022-08-10T17:38:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.443+0000 7f764eb62700 1 Processor -- start 2022-08-10T17:38:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.443+0000 7f764eb62700 1 -- start start 2022-08-10T17:38:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76480c25c0 0x7f76480c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 0x7f7648151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76481dbcf0 con 0x7f76480c4d90 2022-08-10T17:38:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76481ec5d0 con 0x7f76480c25c0 2022-08-10T17:38:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76481ec8b0 con 0x7f76480c7220 2022-08-10T17:38:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58602/0 (socket says 172.21.15.150:58602) 2022-08-10T17:38:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 -- 172.21.15.150:0/1941011353 learned_addr learned my addr 172.21.15.150:0/1941011353 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76480c25c0 0x7f76480c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 0x7f7648151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 -- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 msgr2=0x7f7648151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 0x7f7648151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 -- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76480c25c0 msgr2=0x7f76480c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76480c25c0 0x7f76480c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 -- 172.21.15.150:0/1941011353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640009b30 con 0x7f76480c4d90 2022-08-10T17:38:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 0x7f7648151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f7647fff700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f763400c5c0 tx=0x7f763400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f76457fa700 1 -- 172.21.15.150:0/1941011353 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634011800 con 0x7f76480c4d90 2022-08-10T17:38:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f76457fa700 1 -- 172.21.15.150:0/1941011353 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634011960 con 0x7f76480c4d90 2022-08-10T17:38:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.444+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76481ecb90 con 0x7f76480c4d90 2022-08-10T17:38:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.445+0000 7f76457fa700 1 -- 172.21.15.150:0/1941011353 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634011d30 con 0x7f76480c4d90 2022-08-10T17:38:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.445+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76481ed150 con 0x7f76480c4d90 2022-08-10T17:38:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.446+0000 7f76457fa700 1 -- 172.21.15.150:0/1941011353 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7634021070 con 0x7f76480c4d90 2022-08-10T17:38:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.446+0000 7f76457fa700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 0x7f7630067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.446+0000 7f76457fa700 1 -- 172.21.15.150:0/1941011353 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7634081f50 con 0x7f76480c4d90 2022-08-10T17:38:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.447+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 0x7f7630067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.447+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 0x7f7630067560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f763c007fd0 tx=0x7f763c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.448+0000 7f765aab8b80 1 Processor -- start 2022-08-10T17:38:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.448+0000 7f765aab8b80 1 -- start start 2022-08-10T17:38:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 0x564506ca1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 0x564506c58060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506b48c10 con 0x564506c5e4a0 2022-08-10T17:38:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506bb2c40 con 0x564506c9cb60 2022-08-10T17:38:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x564506bac440 con 0x564506c9cf30 2022-08-10T17:38:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58610/0 (socket says 172.21.15.150:58610) 2022-08-10T17:38:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 -- 172.21.15.150:0/1149359103 learned_addr learned my addr 172.21.15.150:0/1149359103 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 0x564506ca1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 0x564506c58060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 -- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 msgr2=0x564506c58060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 0x564506c58060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 -- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 msgr2=0x564506ca1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 0x564506ca1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 -- 172.21.15.150:0/1149359103 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564506a355e0 con 0x564506c5e4a0 2022-08-10T17:38:07.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 0x564506ca1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:07.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 0x564506c58060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:07.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.449+0000 7f7647fff700 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f76340535a0 tx=0x7f76340535d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e8376f2b7f1e50 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:07.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f762a7fc700 1 -- 172.21.15.150:0/1149359103 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634057170 con 0x564506c5e4a0 2022-08-10T17:38:07.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f762a7fc700 1 -- 172.21.15.150:0/1149359103 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634053060 con 0x564506c5e4a0 2022-08-10T17:38:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f762a7fc700 1 -- 172.21.15.150:0/1149359103 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763405a630 con 0x564506c5e4a0 2022-08-10T17:38:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 -- 172.21.15.150:0/1149359103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 msgr2=0x564506c97d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f76340535a0 tx=0x7f76340535d0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 -- 172.21.15.150:0/1149359103 shutdown_connections 2022-08-10T17:38:07.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cf30 0x564506c58060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c9cb60 0x564506ca1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1149359103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c5e4a0 0x564506c97d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 -- 172.21.15.150:0/1149359103 >> 172.21.15.150:0/1149359103 conn(0x564506c52db0 msgr2=0x564506c5b780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:07.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 -- 172.21.15.150:0/1149359103 shutdown_connections 2022-08-10T17:38:07.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.450+0000 7f765aab8b80 1 -- 172.21.15.150:0/1149359103 wait complete. 2022-08-10T17:38:07.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.451+0000 7f765aab8b80 1 -- start start 2022-08-10T17:38:07.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.451+0000 7f765aab8b80 1 Processor -- start 2022-08-10T17:38:07.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c5e4a0 0x564506cb15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cb60 0x564506c90070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506a9b0c0 con 0x564506c9cf30 2022-08-10T17:38:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506c944a0 con 0x564506c5e4a0 2022-08-10T17:38:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x564506ca07a0 con 0x564506c9cb60 2022-08-10T17:38:07.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 10 client.0 _ll_register_callbacks cb 0x564506a59240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:07.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58618/0 (socket says 172.21.15.150:58618) 2022-08-10T17:38:07.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 -- 172.21.15.150:0/3524230117 learned_addr learned my addr 172.21.15.150:0/3524230117 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:07.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764c8fe700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c5e4a0 0x564506cb15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f7647fff700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cb60 0x564506c90070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 -- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cb60 msgr2=0x564506c90070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cb60 0x564506c90070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 -- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c5e4a0 msgr2=0x564506cb15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c5e4a0 0x564506cb15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 -- 172.21.15.150:0/3524230117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76481ed150 con 0x564506c9cf30 2022-08-10T17:38:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f764d0ff700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f764806deb0 tx=0x7f76400049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0130cb6851f668 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:07.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f76237fe700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640004440 con 0x564506c9cf30 2022-08-10T17:38:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7640003e30 con 0x564506c9cf30 2022-08-10T17:38:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.452+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564506c50570 con 0x564506c9cf30 2022-08-10T17:38:07.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76400045a0 con 0x564506c9cf30 2022-08-10T17:38:07.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 10 client.4791 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:07.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5645069e1d90 con 0x564506c9cf30 2022-08-10T17:38:07.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564506c50570 con 0x564506c9cf30 2022-08-10T17:38:07.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7f7640012430 con 0x564506c9cf30 2022-08-10T17:38:07.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 10 client.4791 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:07.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 10 client.4791 resolve_mds: resolved name 'a' to daemon mds.a 2022-08-10T17:38:07.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 20 client.4791 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:07.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c96b00 0x564506c57f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:07.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 4 client.4791 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2022-08-10T17:38:07.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 --> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564506b4ece0 con 0x564506c96b00 2022-08-10T17:38:07.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f764c8fe700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c96b00 0x564506c57f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:07.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f76237fe700 10 client.4791 ms_handle_connect on v2:172.21.15.150:6832/903670715 2022-08-10T17:38:07.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:07.453+0000 7f764c8fe700 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c96b00 0x564506c57f70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d38adbcab49fd329 server_cookie=360d26275a53f8a9 in_seq=0 out_seq=0 2022-08-10T17:38:08.123 INFO:tasks.ceph.mds.d.smithi197.stderr:2022-08-10T17:38:08.120+0000 7f88c6672700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2022-08-10T17:38:09.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f76237fe700 1 -- 172.21.15.150:0/3524230117 <== mds.2 v2:172.21.15.150:6832/903670715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x564506b4ece0 con 0x564506c96b00 2022-08-10T17:38:09.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f76237fe700 10 client.4791 handle_command_reply: tid=0 2022-08-10T17:38:09.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 client.4791 shutdown 2022-08-10T17:38:09.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 msgr2=0x564506c94970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:09.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f764806deb0 tx=0x7f76400049c0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 shutdown_connections 2022-08-10T17:38:09.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c96b00 0x564506c57f70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cf30 0x564506c94970 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c5e4a0 0x564506cb15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f76237fe700 0 client.4791 ms_handle_reset on v2:172.21.15.150:6832/903670715 2022-08-10T17:38:09.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 --2- 172.21.15.150:0/3524230117 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c9cb60 0x564506c90070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 >> 172.21.15.150:0/3524230117 conn(0x564506c52db0 msgr2=0x564506c970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:09.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 shutdown_connections 2022-08-10T17:38:09.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.923+0000 7f765aab8b80 1 -- 172.21.15.150:0/3524230117 wait complete. 2022-08-10T17:38:09.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.924+0000 7f765aab8b80 20 client.4791 trim_cache size 0 max 16384 2022-08-10T17:38:09.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.942+0000 7f765aab8b80 1 Processor -- start 2022-08-10T17:38:09.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.942+0000 7f765aab8b80 1 -- start start 2022-08-10T17:38:09.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c8d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506c93ab0 con 0x564506c9cb60 2022-08-10T17:38:09.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506c8d680 con 0x564506c96b00 2022-08-10T17:38:09.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x564506c98b10 con 0x564506c5e4a0 2022-08-10T17:38:09.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58626/0 (socket says 172.21.15.150:58626) 2022-08-10T17:38:09.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 -- 172.21.15.150:0/1146786345 learned_addr learned my addr 172.21.15.150:0/1146786345 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:09.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f7647fff700 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764c8fe700 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c8d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 -- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 msgr2=0x564506c8d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:09.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c8d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 -- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 msgr2=0x564506c5a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:09.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 -- 172.21.15.150:0/1146786345 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645069e0260 con 0x564506c9cb60 2022-08-10T17:38:09.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.943+0000 7f764d0ff700 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7640015040 tx=0x7f764001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3967b3afa8edbf0f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:09.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f762affd700 1 -- 172.21.15.150:0/1146786345 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000e040 con 0x564506c9cb60 2022-08-10T17:38:09.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f762affd700 1 -- 172.21.15.150:0/1146786345 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400038a0 con 0x564506c9cb60 2022-08-10T17:38:09.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f762affd700 1 -- 172.21.15.150:0/1146786345 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000bea0 con 0x564506c9cb60 2022-08-10T17:38:09.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 -- 172.21.15.150:0/1146786345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 msgr2=0x564506c5a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:09.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7640015040 tx=0x7f764001d000 comp rx=0 tx=0).stop 2022-08-10T17:38:09.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 -- 172.21.15.150:0/1146786345 shutdown_connections 2022-08-10T17:38:09.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506c5a850 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c8d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 --2- 172.21.15.150:0/1146786345 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.944+0000 7f765aab8b80 1 -- 172.21.15.150:0/1146786345 >> 172.21.15.150:0/1146786345 conn(0x564506c52db0 msgr2=0x564506c95360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:09.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.945+0000 7f765aab8b80 1 -- 172.21.15.150:0/1146786345 shutdown_connections 2022-08-10T17:38:09.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.945+0000 7f765aab8b80 1 -- 172.21.15.150:0/1146786345 wait complete. 2022-08-10T17:38:09.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.945+0000 7f765aab8b80 1 -- start start 2022-08-10T17:38:09.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 Processor -- start 2022-08-10T17:38:09.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c5a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506c8bf40 con 0x564506c9cb60 2022-08-10T17:38:09.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506c5ac50 con 0x564506c96b00 2022-08-10T17:38:09.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x564506c5e2f0 con 0x564506c5e4a0 2022-08-10T17:38:09.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f765aab8b80 10 client.0 _ll_register_callbacks cb 0x7f7640009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:09.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.946+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58632/0 (socket says 172.21.15.150:58632) 2022-08-10T17:38:09.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 -- 172.21.15.150:0/887667256 learned_addr learned my addr 172.21.15.150:0/887667256 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:09.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f7647fff700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764c8fe700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c5a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 -- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 msgr2=0x564506c5a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:09.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c5a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 -- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 msgr2=0x564506c5ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:09.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 -- 172.21.15.150:0/887667256 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645069e1d90 con 0x564506c9cb60 2022-08-10T17:38:09.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f764d0ff700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7640015040 tx=0x7f7640009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c0de8f25a4d182 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:09.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f76237fe700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:09.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000e070 con 0x564506c9cb60 2022-08-10T17:38:09.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7640012b40 con 0x564506c9cb60 2022-08-10T17:38:09.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7634053060 con 0x564506c9cb60 2022-08-10T17:38:09.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7640012d20 con 0x564506c9cb60 2022-08-10T17:38:09.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f765aab8b80 10 client.4797 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:09.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.947+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564506aaea30 con 0x564506c9cb60 2022-08-10T17:38:09.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634053060 con 0x564506c9cb60 2022-08-10T17:38:09.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7f7640004240 con 0x564506c9cb60 2022-08-10T17:38:09.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 10 client.4797 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:09.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2022-08-10T17:38:09.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 20 client.4797 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:09.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c9cf30 0x564506c96ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:09.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 4 client.4797 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2022-08-10T17:38:09.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 --> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564506b4ea00 con 0x564506c9cf30 2022-08-10T17:38:09.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f764c8fe700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c9cf30 0x564506c96ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:09.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f764c8fe700 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c9cf30 0x564506c96ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d32d86eb5736ebae server_cookie=46937abade703866 in_seq=0 out_seq=0 2022-08-10T17:38:09.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.948+0000 7f76237fe700 10 client.4797 ms_handle_connect on v2:172.21.15.150:6832/903670715 2022-08-10T17:38:09.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f76237fe700 1 -- 172.21.15.150:0/887667256 <== mds.2 v2:172.21.15.150:6832/903670715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x564506b4ea00 con 0x564506c9cf30 2022-08-10T17:38:09.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f76237fe700 10 client.4797 handle_command_reply: tid=0 2022-08-10T17:38:09.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 client.4797 shutdown 2022-08-10T17:38:09.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 msgr2=0x564506cfc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:09.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7640015040 tx=0x7f7640009810 comp rx=0 tx=0).stop 2022-08-10T17:38:09.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 shutdown_connections 2022-08-10T17:38:09.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:6832/903670715,v1:172.21.15.150:6833/903670715] conn(0x564506c9cf30 0x564506c96ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564506c9cb60 0x564506cfc600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x564506c5e4a0 0x564506c5a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f76237fe700 0 client.4797 ms_handle_reset on v2:172.21.15.150:6832/903670715 2022-08-10T17:38:09.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 --2- 172.21.15.150:0/887667256 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x564506c96b00 0x564506c5ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 >> 172.21.15.150:0/887667256 conn(0x564506c52db0 msgr2=0x564506c57c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:09.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 shutdown_connections 2022-08-10T17:38:09.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 1 -- 172.21.15.150:0/887667256 wait complete. 2022-08-10T17:38:09.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.949+0000 7f765aab8b80 20 client.4797 trim_cache size 0 max 16384 2022-08-10T17:38:09.975 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:09.975 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:09.975 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 2, 2022-08-10T17:38:09.975 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4296, 2022-08-10T17:38:09.976 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2022-08-10T17:38:09.976 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2022-08-10T17:38:09.977 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2022-08-10T17:38:09.977 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 10.070891624, 2022-08-10T17:38:09.978 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 15, 2022-08-10T17:38:09.978 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 29, 2022-08-10T17:38:09.978 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 29, 2022-08-10T17:38:09.978 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 157.857347189 2022-08-10T17:38:09.979 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 msgr2=0x7f7630067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:09.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 0x7f7630067560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f763c007fd0 tx=0x7f763c009040 comp rx=0 tx=0).stop 2022-08-10T17:38:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 msgr2=0x7f7648151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f763400c5c0 tx=0x7f763400c8d0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 shutdown_connections 2022-08-10T17:38:09.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f76300650b0 0x7f7630067560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f76480c7220 0x7f7648151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f76480c25c0 0x7f76480c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 --2- 172.21.15.150:0/1941011353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76480c4d90 0x7f7648151870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:09.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 >> 172.21.15.150:0/1941011353 conn(0x7f764806d0d0 msgr2=0x7f7648154220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:09.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 shutdown_connections 2022-08-10T17:38:09.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:09.950+0000 7f764eb62700 1 -- 172.21.15.150:0/1941011353 wait complete. 2022-08-10T17:38:09.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-08-10T17:38:10.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.108+0000 7f2a625b3700 1 Processor -- start 2022-08-10T17:38:10.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.108+0000 7f2a625b3700 1 -- start start 2022-08-10T17:38:10.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a625b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 0x7f2a5c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a625b3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0c4dc0 con 0x7f2a5c15a570 2022-08-10T17:38:10.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a625b3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0c5940 con 0x7f2a5c150af0 2022-08-10T17:38:10.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a625b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0c9fc0 con 0x7f2a5c06c860 2022-08-10T17:38:10.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a60b50700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2a5c15a570 0x7f2a5c0c4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43088/0 (socket says 172.21.15.150:43088) 2022-08-10T17:38:10.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a60b50700 1 -- 172.21.15.150:0/3463915758 learned_addr learned my addr 172.21.15.150:0/3463915758 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:10.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.109+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/3463915758 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 0x7f2a5c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182469558 0 0) 0x7f2a5c0c4dc0 con 0x7f2a5c15a570 2022-08-10T17:38:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c003430 con 0x7f2a5c15a570 2022-08-10T17:38:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866125162 0 0) 0x7f2a5c0c5940 con 0x7f2a5c150af0 2022-08-10T17:38:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a5c0c4dc0 con 0x7f2a5c150af0 2022-08-10T17:38:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 514975756 0 0) 0x7f2a3c003430 con 0x7f2a5c15a570 2022-08-10T17:38:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/3463915758 >> v1:172.21.15.197:6789/0 conn(0x7f2a5c150af0 legacy=0x7f2a5c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/3463915758 >> v1:172.21.15.150:6789/0 conn(0x7f2a5c15a570 legacy=0x7f2a5c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/3463915758 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c06f9a0 con 0x7f2a5c06c860 2022-08-10T17:38:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/3463915758 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 0x7f2a5c0c3ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a440096e0 tx=0x7f2a440099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d7519b8101749c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540019f0 con 0x7f2a5c06c860 2022-08-10T17:38:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44004030 con 0x7f2a5c06c860 2022-08-10T17:38:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.110+0000 7f2a5affd700 1 -- 172.21.15.150:0/3463915758 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440043c0 con 0x7f2a5c06c860 2022-08-10T17:38:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 -- 172.21.15.150:0/3463915758 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 msgr2=0x7f2a5c0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 --2- 172.21.15.150:0/3463915758 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 0x7f2a5c0c3ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a440096e0 tx=0x7f2a440099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 -- 172.21.15.150:0/3463915758 shutdown_connections 2022-08-10T17:38:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 --2- 172.21.15.150:0/3463915758 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c06c860 0x7f2a5c0c3ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 -- 172.21.15.150:0/3463915758 >> 172.21.15.150:0/3463915758 conn(0x7f2a5c0c92f0 msgr2=0x7f2a5c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 -- 172.21.15.150:0/3463915758 shutdown_connections 2022-08-10T17:38:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.111+0000 7f2a625b3700 1 -- 172.21.15.150:0/3463915758 wait complete. 2022-08-10T17:38:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.112+0000 7f2a625b3700 1 Processor -- start 2022-08-10T17:38:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.112+0000 7f2a625b3700 1 -- start start 2022-08-10T17:38:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 0x7f2a5c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 0x7f2a5c146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0bad60 con 0x7f2a5c150af0 2022-08-10T17:38:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c14b450 con 0x7f2a5c06c860 2022-08-10T17:38:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a625b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1579d0 con 0x7f2a5c15a570 2022-08-10T17:38:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58644/0 (socket says 172.21.15.150:58644) 2022-08-10T17:38:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/2915469890 learned_addr learned my addr 172.21.15.150:0/2915469890 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 0x7f2a5c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a60b50700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 0x7f2a5c146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 msgr2=0x7f2a5c146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 0x7f2a5c146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 msgr2=0x7f2a5c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 0x7f2a5c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/2915469890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009310 con 0x7f2a5c150af0 2022-08-10T17:38:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 0x7f2a5c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a60b50700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 0x7f2a5c146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.113+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a44014040 tx=0x7f2a440045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.114+0000 7f2a58ff9700 1 -- 172.21.15.150:0/2915469890 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44010e90 con 0x7f2a5c150af0 2022-08-10T17:38:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.114+0000 7f2a58ff9700 1 -- 172.21.15.150:0/2915469890 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44003730 con 0x7f2a5c150af0 2022-08-10T17:38:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.114+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c14cd20 con 0x7f2a5c150af0 2022-08-10T17:38:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.114+0000 7f2a58ff9700 1 -- 172.21.15.150:0/2915469890 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003ae0 con 0x7f2a5c150af0 2022-08-10T17:38:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.114+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c159780 con 0x7f2a5c150af0 2022-08-10T17:38:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.115+0000 7f2a58ff9700 1 -- 172.21.15.150:0/2915469890 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2a4402c070 con 0x7f2a5c150af0 2022-08-10T17:38:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.115+0000 7f2a58ff9700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 0x7f2a40067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.115+0000 7f2a58ff9700 1 -- 172.21.15.150:0/2915469890 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2a440831b0 con 0x7f2a5c150af0 2022-08-10T17:38:10.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.115+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 0x7f2a40067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.116+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 0x7f2a40067590 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0011e0 tx=0x7f2a4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.117+0000 7f2a6e509b80 1 Processor -- start 2022-08-10T17:38:10.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.117+0000 7f2a6e509b80 1 -- start start 2022-08-10T17:38:10.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22c14d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22bd5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22ac5c10 con 0x556c22c19b60 2022-08-10T17:38:10.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22b2fc40 con 0x556c22bdb4a0 2022-08-10T17:38:10.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c22b29440 con 0x556c22c19f30 2022-08-10T17:38:10.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58650/0 (socket says 172.21.15.150:58650) 2022-08-10T17:38:10.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a5bfff700 1 -- 172.21.15.150:0/3490261656 learned_addr learned my addr 172.21.15.150:0/3490261656 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22c14d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.118+0000 7f2a60b50700 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22bd5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 -- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 msgr2=0x556c22bd5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22bd5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 -- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 msgr2=0x556c22c14d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22c14d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 -- 172.21.15.150:0/3490261656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c229b25e0 con 0x556c22c19b60 2022-08-10T17:38:10.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005390 tx=0x7f2a4c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364e0dc9a39ed3bf server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a51ffb700 1 -- 172.21.15.150:0/3490261656 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0053c0 con 0x556c22c19b60 2022-08-10T17:38:10.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a51ffb700 1 -- 172.21.15.150:0/3490261656 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c003e80 con 0x556c22c19b60 2022-08-10T17:38:10.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a51ffb700 1 -- 172.21.15.150:0/3490261656 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c021650 con 0x556c22c19b60 2022-08-10T17:38:10.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a6e509b80 1 -- 172.21.15.150:0/3490261656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 msgr2=0x556c22c1e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005390 tx=0x7f2a4c011000 comp rx=0 tx=0).stop 2022-08-10T17:38:10.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a6e509b80 1 -- 172.21.15.150:0/3490261656 shutdown_connections 2022-08-10T17:38:10.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22bd5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.119+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c1e690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/3490261656 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22c14d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 -- 172.21.15.150:0/3490261656 >> 172.21.15.150:0/3490261656 conn(0x556c22bcfdb0 msgr2=0x556c22bd8780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 -- 172.21.15.150:0/3490261656 shutdown_connections 2022-08-10T17:38:10.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 -- 172.21.15.150:0/3490261656 wait complete. 2022-08-10T17:38:10.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 -- start start 2022-08-10T17:38:10.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.120+0000 7f2a6e509b80 1 Processor -- start 2022-08-10T17:38:10.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.121+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19b60 0x556c22c2a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22c15da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22a180c0 con 0x556c22bdb4a0 2022-08-10T17:38:10.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22bda760 con 0x556c22c19b60 2022-08-10T17:38:10.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c22bd58b0 con 0x556c22c19f30 2022-08-10T17:38:10.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 10 client.0 _ll_register_callbacks cb 0x556c229d6240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:10.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58656/0 (socket says 172.21.15.150:58656) 2022-08-10T17:38:10.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 -- 172.21.15.150:0/2323593735 learned_addr learned my addr 172.21.15.150:0/2323593735 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a60b50700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22c15da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19b60 0x556c22c2a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 -- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 msgr2=0x556c22c15da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22c15da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 -- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19b60 msgr2=0x556c22c2a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19b60 0x556c22c2a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 -- 172.21.15.150:0/2323593735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c00f040 con 0x556c22bdb4a0 2022-08-10T17:38:10.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c003ac0 tx=0x7f2a4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95c32aba2982994 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:10.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0053c0 con 0x556c22bdb4a0 2022-08-10T17:38:10.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2a4c013420 con 0x556c22bdb4a0 2022-08-10T17:38:10.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c22acbce0 con 0x556c22bdb4a0 2022-08-10T17:38:10.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4c0135e0 con 0x556c22bdb4a0 2022-08-10T17:38:10.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 10 client.4809 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:10.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.122+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556c2295ed90 con 0x556c22bdb4a0 2022-08-10T17:38:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c22acbce0 con 0x556c22bdb4a0 2022-08-10T17:38:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7f2a4c013740 con 0x556c22bdb4a0 2022-08-10T17:38:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 10 client.4809 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:10.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2022-08-10T17:38:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 20 client.4809 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16580 0x556c22c1d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 4 client.4809 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2022-08-10T17:38:10.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 --> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c22acba00 con 0x556c22c16580 2022-08-10T17:38:10.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16580 0x556c22c1d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a32ffd700 10 client.4809 ms_handle_connect on v2:172.21.15.197:6837/4060491020 2022-08-10T17:38:10.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.123+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16580 0x556c22c1d900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6401ed31e523dd6 server_cookie=e63704733331e085 in_seq=0 out_seq=0 2022-08-10T17:38:10.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a32ffd700 1 -- 172.21.15.150:0/2323593735 <== mds.1 v2:172.21.15.197:6837/4060491020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x556c22acba00 con 0x556c22c16580 2022-08-10T17:38:10.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a32ffd700 10 client.4809 handle_command_reply: tid=0 2022-08-10T17:38:10.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 client.4809 shutdown 2022-08-10T17:38:10.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 msgr2=0x556c22bd5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c003ac0 tx=0x7f2a4c000ed0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 shutdown_connections 2022-08-10T17:38:10.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16580 0x556c22c1d900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19f30 0x556c22c15da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a32ffd700 0 client.4809 ms_handle_reset on v2:172.21.15.197:6837/4060491020 2022-08-10T17:38:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22bdb4a0 0x556c22bd5370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/2323593735 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19b60 0x556c22c2a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 >> 172.21.15.150:0/2323593735 conn(0x556c22bcfdb0 msgr2=0x556c22c14cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 shutdown_connections 2022-08-10T17:38:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 1 -- 172.21.15.150:0/2323593735 wait complete. 2022-08-10T17:38:10.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.124+0000 7f2a6e509b80 20 client.4809 trim_cache size 0 max 16384 2022-08-10T17:38:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.141+0000 7f2a6e509b80 1 Processor -- start 2022-08-10T17:38:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 -- start start 2022-08-10T17:38:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22bd4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19b60 0x556c22c13070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22c1bd90 con 0x556c22c19f30 2022-08-10T17:38:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22bdacf0 con 0x556c22bdb4a0 2022-08-10T17:38:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c22bdb170 con 0x556c22c19b60 2022-08-10T17:38:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.142+0000 7f2a60b50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58668/0 (socket says 172.21.15.150:58668) 2022-08-10T17:38:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 -- 172.21.15.150:0/1112868315 learned_addr learned my addr 172.21.15.150:0/1112868315 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22bd4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19b60 0x556c22c13070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 -- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19b60 msgr2=0x556c22c13070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19b60 0x556c22c13070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 -- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 msgr2=0x556c22bd4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22bd4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 -- 172.21.15.150:0/1112868315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c2295d260 con 0x556c22c19f30 2022-08-10T17:38:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a60b50700 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001e80 tx=0x7f2a54007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518941b24e4caf55 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a527fc700 1 -- 172.21.15.150:0/1112868315 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54013a70 con 0x556c22c19f30 2022-08-10T17:38:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a527fc700 1 -- 172.21.15.150:0/1112868315 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54013bd0 con 0x556c22c19f30 2022-08-10T17:38:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a527fc700 1 -- 172.21.15.150:0/1112868315 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54016450 con 0x556c22c19f30 2022-08-10T17:38:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1112868315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 msgr2=0x556c22c135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.143+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001e80 tx=0x7f2a54007040 comp rx=0 tx=0).stop 2022-08-10T17:38:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1112868315 shutdown_connections 2022-08-10T17:38:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19f30 0x556c22c135b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22bdb4a0 0x556c22bd4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1112868315 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22c19b60 0x556c22c13070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1112868315 >> 172.21.15.150:0/1112868315 conn(0x556c22bcfdb0 msgr2=0x556c22c190a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1112868315 shutdown_connections 2022-08-10T17:38:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1112868315 wait complete. 2022-08-10T17:38:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 -- start start 2022-08-10T17:38:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.144+0000 7f2a6e509b80 1 Processor -- start 2022-08-10T17:38:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22bdb4a0 0x556c22c27470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 0x556c22c795b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22c146e0 con 0x556c22c19b60 2022-08-10T17:38:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c22c14a70 con 0x556c22c19f30 2022-08-10T17:38:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c22c279b0 con 0x556c22bdb4a0 2022-08-10T17:38:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a6e509b80 10 client.0 _ll_register_callbacks cb 0x7f2a440830d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58672/0 (socket says 172.21.15.150:58672) 2022-08-10T17:38:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/1966602883 learned_addr learned my addr 172.21.15.150:0/1966602883 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22bdb4a0 0x556c22c27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a60b50700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 0x556c22c795b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22bdb4a0 msgr2=0x556c22c27470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22bdb4a0 0x556c22c27470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 msgr2=0x556c22c795b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 0x556c22c795b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a5b7fe700 1 -- 172.21.15.150:0/1966602883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5400f040 con 0x556c22c19b60 2022-08-10T17:38:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.145+0000 7f2a60b50700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 0x556c22c795b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a5b7fe700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a44000c00 tx=0x7f2a44051210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2282053a0242d776 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003e40 con 0x556c22c19b60 2022-08-10T17:38:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2a44054340 con 0x556c22c19b60 2022-08-10T17:38:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c22bcd570 con 0x556c22c19b60 2022-08-10T17:38:10.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a44054500 con 0x556c22c19b60 2022-08-10T17:38:10.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 10 client.4815 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:10.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556c22a2ba30 con 0x556c22c19b60 2022-08-10T17:38:10.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c22bcd570 con 0x556c22c19b60 2022-08-10T17:38:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7f2a4405b910 con 0x556c22c19b60 2022-08-10T17:38:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 10 client.4815 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 10 client.4815 resolve_mds: resolved name 'b' to daemon mds.b 2022-08-10T17:38:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 20 client.4815 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16a10 0x556c22c16de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 4 client.4815 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2022-08-10T17:38:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 --> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c229b4f10 con 0x556c22c16a10 2022-08-10T17:38:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.146+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16a10 0x556c22c16de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a32ffd700 10 client.4815 ms_handle_connect on v2:172.21.15.197:6837/4060491020 2022-08-10T17:38:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a5bfff700 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16a10 0x556c22c16de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9270fe8aa6ecd54a server_cookie=6bbadd05c31f6ad6 in_seq=0 out_seq=0 2022-08-10T17:38:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a32ffd700 1 -- 172.21.15.150:0/1966602883 <== mds.1 v2:172.21.15.197:6837/4060491020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556c229b4f10 con 0x556c22c16a10 2022-08-10T17:38:10.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a32ffd700 10 client.4815 handle_command_reply: tid=0 2022-08-10T17:38:10.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 client.4815 shutdown 2022-08-10T17:38:10.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 msgr2=0x556c22c79070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a44000c00 tx=0x7f2a44051210 comp rx=0 tx=0).stop 2022-08-10T17:38:10.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 shutdown_connections 2022-08-10T17:38:10.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:6837/4060491020,v1:172.21.15.197:6839/4060491020] conn(0x556c22c16a10 0x556c22c16de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x556c22c19f30 0x556c22c795b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a32ffd700 0 client.4815 ms_handle_reset on v2:172.21.15.197:6837/4060491020 2022-08-10T17:38:10.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x556c22bdb4a0 0x556c22c27470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 --2- 172.21.15.150:0/1966602883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c22c19b60 0x556c22c79070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 >> 172.21.15.150:0/1966602883 conn(0x556c22bcfdb0 msgr2=0x556c22bd5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 shutdown_connections 2022-08-10T17:38:10.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 1 -- 172.21.15.150:0/1966602883 wait complete. 2022-08-10T17:38:10.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.147+0000 7f2a6e509b80 20 client.4815 trim_cache size 0 max 16384 2022-08-10T17:38:10.193 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 1, 2022-08-10T17:38:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4297, 2022-08-10T17:38:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2022-08-10T17:38:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2022-08-10T17:38:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2022-08-10T17:38:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 16.297086042, 2022-08-10T17:38:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 15, 2022-08-10T17:38:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 29, 2022-08-10T17:38:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 29, 2022-08-10T17:38:10.196 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 158.04097543399999 2022-08-10T17:38:10.196 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:10.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 msgr2=0x7f2a40067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 0x7f2a40067590 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0011e0 tx=0x7f2a4c009040 comp rx=0 tx=0).stop 2022-08-10T17:38:10.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 msgr2=0x7f2a5c14b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a44014040 tx=0x7f2a440045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 shutdown_connections 2022-08-10T17:38:10.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2a400650e0 0x7f2a40067590 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2a5c15a570 0x7f2a5c146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2a5c06c860 0x7f2a5c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 --2- 172.21.15.150:0/2915469890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a5c150af0 0x7f2a5c14b8a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 >> 172.21.15.150:0/2915469890 conn(0x7f2a5c0c92f0 msgr2=0x7f2a5c0645e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 shutdown_connections 2022-08-10T17:38:10.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.148+0000 7f2a625b3700 1 -- 172.21.15.150:0/2915469890 wait complete. 2022-08-10T17:38:10.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2022-08-10T17:38:10.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.319+0000 7fa5754b7700 1 Processor -- start 2022-08-10T17:38:10.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.319+0000 7fa5754b7700 1 -- start start 2022-08-10T17:38:10.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa5754b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5700c5530 0x7fa5700c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa5754b7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa5700c6020 0x7fa5700c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa5754b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa570069bc0 con 0x7fa570154460 2022-08-10T17:38:10.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa5754b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57006d8a0 con 0x7fa5700c5530 2022-08-10T17:38:10.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa5754b7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57015a930 con 0x7fa5700c6020 2022-08-10T17:38:10.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5700c5530 0x7fa5700c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa570154460 0x7fa57015a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43126/0 (socket says 172.21.15.150:43126) 2022-08-10T17:38:10.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56effd700 1 -- 172.21.15.150:0/3548892185 learned_addr learned my addr 172.21.15.150:0/3548892185 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:10.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/3548892185 >> v2:172.21.15.197:3300/0 conn(0x7fa5700c6020 0x7fa5700c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 -- 172.21.15.150:0/3548892185 >> v2:172.21.15.197:3300/0 conn(0x7fa5700c6020 msgr2=0x7fa5700c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/3548892185 >> v2:172.21.15.197:3300/0 conn(0x7fa5700c6020 0x7fa5700c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 -- 172.21.15.150:0/3548892185 >> v1:172.21.15.150:6789/0 conn(0x7fa570154460 legacy=0x7fa57015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 -- 172.21.15.150:0/3548892185 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700c5de0 con 0x7fa5700c5530 2022-08-10T17:38:10.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56dffb700 1 -- 172.21.15.150:0/3548892185 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987649166 0 0) 0x7fa570069bc0 con 0x7fa570154460 2022-08-10T17:38:10.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/3548892185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c6b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5700bb4f0 tx=0x7fa560009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf781d430fe670a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.320+0000 7fa56dffb700 1 -- 172.21.15.150:0/3548892185 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600107b0 con 0x7fa5700c5530 2022-08-10T17:38:10.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa56dffb700 1 -- 172.21.15.150:0/3548892185 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560010910 con 0x7fa5700c5530 2022-08-10T17:38:10.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa56dffb700 1 -- 172.21.15.150:0/3548892185 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560010cc0 con 0x7fa5700c5530 2022-08-10T17:38:10.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 -- 172.21.15.150:0/3548892185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 msgr2=0x7fa5700c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 --2- 172.21.15.150:0/3548892185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c6b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5700bb4f0 tx=0x7fa560009990 comp rx=0 tx=0).stop 2022-08-10T17:38:10.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 -- 172.21.15.150:0/3548892185 shutdown_connections 2022-08-10T17:38:10.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 --2- 172.21.15.150:0/3548892185 >> v2:172.21.15.197:3300/0 conn(0x7fa5700c6020 0x7fa5700c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 --2- 172.21.15.150:0/3548892185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c6b30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 -- 172.21.15.150:0/3548892185 >> 172.21.15.150:0/3548892185 conn(0x7fa5700644b0 msgr2=0x7fa57006fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 -- 172.21.15.150:0/3548892185 shutdown_connections 2022-08-10T17:38:10.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.321+0000 7fa5754b7700 1 -- 172.21.15.150:0/3548892185 wait complete. 2022-08-10T17:38:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.322+0000 7fa5754b7700 1 Processor -- start 2022-08-10T17:38:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.322+0000 7fa5754b7700 1 -- start start 2022-08-10T17:38:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 0x7fa57014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 0x7fa570158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701f4340 con 0x7fa5700c5530 2022-08-10T17:38:10.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570153d30 con 0x7fa5700c6020 2022-08-10T17:38:10.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa5754b7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700c4290 con 0x7fa570154460 2022-08-10T17:38:10.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa56effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa56effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58686/0 (socket says 172.21.15.150:58686) 2022-08-10T17:38:10.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa56effd700 1 -- 172.21.15.150:0/1750406621 learned_addr learned my addr 172.21.15.150:0/1750406621 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 0x7fa57014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.323+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 0x7fa570158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 -- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 msgr2=0x7fa570158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 0x7fa570158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 -- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 msgr2=0x7fa57014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 0x7fa57014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 -- 172.21.15.150:0/1750406621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560009310 con 0x7fa5700c5530 2022-08-10T17:38:10.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 0x7fa570158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:10.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 0x7fa57014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:10.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa56effd700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c450 tx=0x7fa56400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa5577fe700 1 -- 172.21.15.150:0/1750406621 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640074e0 con 0x7fa5700c5530 2022-08-10T17:38:10.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa5577fe700 1 -- 172.21.15.150:0/1750406621 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640046f0 con 0x7fa5700c5530 2022-08-10T17:38:10.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700c4500 con 0x7fa5700c5530 2022-08-10T17:38:10.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa5577fe700 1 -- 172.21.15.150:0/1750406621 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564004a60 con 0x7fa5700c5530 2022-08-10T17:38:10.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.324+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5701f39a0 con 0x7fa5700c5530 2022-08-10T17:38:10.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.325+0000 7fa5577fe700 1 -- 172.21.15.150:0/1750406621 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa56401a020 con 0x7fa5700c5530 2022-08-10T17:38:10.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.326+0000 7fa5577fe700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 0x7fa550067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.326+0000 7fa5577fe700 1 -- 172.21.15.150:0/1750406621 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa564081d10 con 0x7fa5700c5530 2022-08-10T17:38:10.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.326+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 0x7fa550067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.326+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 0x7fa550067590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa560009fd0 tx=0x7fa560008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.328+0000 7fa58140db80 1 Processor -- start 2022-08-10T17:38:10.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.328+0000 7fa58140db80 1 -- start start 2022-08-10T17:38:10.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35b60 0x558efab3a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efa9e1c10 con 0x558efab35f30 2022-08-10T17:38:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efaa4bc40 con 0x558efab35b60 2022-08-10T17:38:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efaa45440 con 0x558efaaf74a0 2022-08-10T17:38:10.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58696/0 (socket says 172.21.15.150:58696) 2022-08-10T17:38:10.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2179228996 learned_addr learned my addr 172.21.15.150:0/2179228996 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56effd700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35b60 0x558efab3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 msgr2=0x558efab30d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35b60 msgr2=0x558efab3a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35b60 0x558efab3a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2179228996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558efa8ce5e0 con 0x558efab35f30 2022-08-10T17:38:10.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:10.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa568007680 tx=0x7fa568009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc24495b140a2731 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa554ff9700 1 -- 172.21.15.150:0/2179228996 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568015670 con 0x558efab35f30 2022-08-10T17:38:10.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa554ff9700 1 -- 172.21.15.150:0/2179228996 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800f050 con 0x558efab35f30 2022-08-10T17:38:10.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.329+0000 7fa554ff9700 1 -- 172.21.15.150:0/2179228996 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568015a30 con 0x558efab35f30 2022-08-10T17:38:10.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 -- 172.21.15.150:0/2179228996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 msgr2=0x558efaaf1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa568007680 tx=0x7fa568009750 comp rx=0 tx=0).stop 2022-08-10T17:38:10.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 -- 172.21.15.150:0/2179228996 shutdown_connections 2022-08-10T17:38:10.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaaf1060 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35b60 0x558efab3a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 --2- 172.21.15.150:0/2179228996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 -- 172.21.15.150:0/2179228996 >> 172.21.15.150:0/2179228996 conn(0x558efaaebdb0 msgr2=0x558efaaf4780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 -- 172.21.15.150:0/2179228996 shutdown_connections 2022-08-10T17:38:10.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.330+0000 7fa58140db80 1 -- 172.21.15.150:0/2179228996 wait complete. 2022-08-10T17:38:10.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.331+0000 7fa58140db80 1 -- start start 2022-08-10T17:38:10.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.331+0000 7fa58140db80 1 Processor -- start 2022-08-10T17:38:10.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efab47040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efaaf1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efa9340c0 con 0x558efab35f30 2022-08-10T17:38:10.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efab397f0 con 0x558efaaf74a0 2022-08-10T17:38:10.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efab2d300 con 0x558efab35b60 2022-08-10T17:38:10.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 10 client.0 _ll_register_callbacks cb 0x558efa8f2240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:10.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58702/0 (socket says 172.21.15.150:58702) 2022-08-10T17:38:10.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2942270622 learned_addr learned my addr 172.21.15.150:0/2942270622 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efaaf1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56effd700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efab47040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 msgr2=0x558efaaf1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efaaf1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 msgr2=0x558efab47040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efab47040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 -- 172.21.15.150:0/2942270622 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa568007330 con 0x558efab35f30 2022-08-10T17:38:10.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa568007650 tx=0x7fa5680049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c7f1ab1077aca8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa549ffb700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:10.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56802a680 con 0x558efab35f30 2022-08-10T17:38:10.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa568025070 con 0x558efab35f30 2022-08-10T17:38:10.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558efaae9570 con 0x558efab35f30 2022-08-10T17:38:10.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa568015e30 con 0x558efab35f30 2022-08-10T17:38:10.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 10 client.4830 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:10.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.332+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x558efa87ad90 con 0x558efab35f30 2022-08-10T17:38:10.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558efaae9570 con 0x558efab35f30 2022-08-10T17:38:10.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7fa56802b8c0 con 0x558efab35f30 2022-08-10T17:38:10.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 10 client.4830 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:10.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 10 client.4830 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:38:10.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 20 client.4830 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:10.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efab28b30 0x558efab4a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 4 client.4830 mds_command: new command op to 4317 tid=0[{"prefix": "get_command_descriptions"}] 2022-08-10T17:38:10.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558efa9e7ce0 con 0x558efab28b30 2022-08-10T17:38:10.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa56effd700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efab28b30 0x558efab4a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa549ffb700 10 client.4830 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:38:10.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.333+0000 7fa56effd700 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efab28b30 0x558efab4a140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=206825fca98bd507 server_cookie=f62c39cbca5fe79e in_seq=0 out_seq=0 2022-08-10T17:38:10.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa549ffb700 1 -- 172.21.15.150:0/2942270622 <== mds.0 v2:172.21.15.197:6834/1505577177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x558efa9e7ce0 con 0x558efab28b30 2022-08-10T17:38:10.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa549ffb700 10 client.4830 handle_command_reply: tid=0 2022-08-10T17:38:10.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 client.4830 shutdown 2022-08-10T17:38:10.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 msgr2=0x558efab38e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa568007650 tx=0x7fa5680049c0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 shutdown_connections 2022-08-10T17:38:10.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efab38e00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efab47040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efab28b30 0x558efab4a140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 --2- 172.21.15.150:0/2942270622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efaaf1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa549ffb700 0 client.4830 ms_handle_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:38:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 >> 172.21.15.150:0/2942270622 conn(0x558efaaebdb0 msgr2=0x558efaaf4710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 shutdown_connections 2022-08-10T17:38:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 1 -- 172.21.15.150:0/2942270622 wait complete. 2022-08-10T17:38:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.334+0000 7fa58140db80 20 client.4830 trim_cache size 0 max 16384 2022-08-10T17:38:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.351+0000 7fa58140db80 1 Processor -- start 2022-08-10T17:38:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.351+0000 7fa58140db80 1 -- start start 2022-08-10T17:38:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35f30 0x558efab33f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efab28f00 con 0x558efab35b60 2022-08-10T17:38:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efab3b270 con 0x558efab35f30 2022-08-10T17:38:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efab2f720 con 0x558efaaf74a0 2022-08-10T17:38:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58708/0 (socket says 172.21.15.150:58708) 2022-08-10T17:38:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 -- 172.21.15.150:0/1307211855 learned_addr learned my addr 172.21.15.150:0/1307211855 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56effd700 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35f30 0x558efab33f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 -- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 msgr2=0x558efab30af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 -- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35f30 msgr2=0x558efab33f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35f30 0x558efab33f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.352+0000 7fa56e7fc700 1 -- 172.21.15.150:0/1307211855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5701e2660 con 0x558efab35b60 2022-08-10T17:38:10.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa560006e90 tx=0x7fa56000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb826df091f93a42 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa5557fa700 1 -- 172.21.15.150:0/1307211855 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56002d070 con 0x558efab35b60 2022-08-10T17:38:10.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa5557fa700 1 -- 172.21.15.150:0/1307211855 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560009170 con 0x558efab35b60 2022-08-10T17:38:10.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa5557fa700 1 -- 172.21.15.150:0/1307211855 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560011b90 con 0x558efab35b60 2022-08-10T17:38:10.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 -- 172.21.15.150:0/1307211855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 msgr2=0x558efaaf3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa560006e90 tx=0x7fa56000f000 comp rx=0 tx=0).stop 2022-08-10T17:38:10.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 -- 172.21.15.150:0/1307211855 shutdown_connections 2022-08-10T17:38:10.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efab35f30 0x558efab33f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efaaf74a0 0x558efab30af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 --2- 172.21.15.150:0/1307211855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35b60 0x558efaaf3310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 -- 172.21.15.150:0/1307211855 >> 172.21.15.150:0/1307211855 conn(0x558efaaebdb0 msgr2=0x558efaaf6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 -- 172.21.15.150:0/1307211855 shutdown_connections 2022-08-10T17:38:10.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.353+0000 7fa58140db80 1 -- 172.21.15.150:0/1307211855 wait complete. 2022-08-10T17:38:10.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 -- start start 2022-08-10T17:38:10.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 Processor -- start 2022-08-10T17:38:10.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efaaf3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efab9fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efaaf3c50 con 0x558efab35f30 2022-08-10T17:38:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efab9cd40 con 0x558efaaf74a0 2022-08-10T17:38:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.354+0000 7fa58140db80 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efab36530 con 0x558efab35b60 2022-08-10T17:38:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa58140db80 10 client.0 _ll_register_callbacks cb 0x7fa56404fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-08-10T17:38:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58716/0 (socket says 172.21.15.150:58716) 2022-08-10T17:38:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 -- 172.21.15.150:0/1304867095 learned_addr learned my addr 172.21.15.150:0/1304867095 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56e7fc700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efab9fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56effd700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efaaf3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 -- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 msgr2=0x558efab9fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efab9fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 -- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 msgr2=0x558efaaf3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efaaf3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 -- 172.21.15.150:0/1304867095 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560021050 con 0x558efab35f30 2022-08-10T17:38:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa56f7fe700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558efab3a020 tx=0x7fa56800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5ca655efe6da20 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa549ffb700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2022-08-10T17:38:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56802be70 con 0x558efab35f30 2022-08-10T17:38:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa568025040 con 0x558efab35f30 2022-08-10T17:38:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa56800f050 con 0x558efab35f30 2022-08-10T17:38:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa568009410 con 0x558efab35f30 2022-08-10T17:38:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa58140db80 10 client.4836 fetch_fsmap learned FSMap version 15 2022-08-10T17:38:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x558efa879260 con 0x558efab35f30 2022-08-10T17:38:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.355+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800f050 con 0x558efab35f30 2022-08-10T17:38:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 15) v1 ==== 4222+0+0 (secure 0 0 0) 0x7fa56801f610 con 0x558efab35f30 2022-08-10T17:38:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 10 client.4836 fetch_fsmap finished waiting for FSMap version 15 2022-08-10T17:38:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2022-08-10T17:38:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 20 client.4836 populate_metadata read hostname 'smithi150' 2022-08-10T17:38:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efaba0630 0x558efab96000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 4 client.4836 mds_command: new command op to 4317 tid=0[{"prefix": "status"}] 2022-08-10T17:38:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 --> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558efa9e7a00 con 0x558efaba0630 2022-08-10T17:38:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa56effd700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efaba0630 0x558efab96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa549ffb700 10 client.4836 ms_handle_connect on v2:172.21.15.197:6834/1505577177 2022-08-10T17:38:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa56effd700 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efaba0630 0x558efab96000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b6f1164a402c886 server_cookie=411aaf997993569a in_seq=0 out_seq=0 2022-08-10T17:38:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa549ffb700 1 -- 172.21.15.150:0/1304867095 <== mds.0 v2:172.21.15.197:6834/1505577177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558efa9e7a00 con 0x558efaba0630 2022-08-10T17:38:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa549ffb700 10 client.4836 handle_command_reply: tid=0 2022-08-10T17:38:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 client.4836 shutdown 2022-08-10T17:38:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 msgr2=0x558efaba00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558efab3a020 tx=0x7fa56800b040 comp rx=0 tx=0).stop 2022-08-10T17:38:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 shutdown_connections 2022-08-10T17:38:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558efab35f30 0x558efaba00f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x558efaaf74a0 0x558efaaf3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:6834/1505577177,v1:172.21.15.197:6835/1505577177] conn(0x558efaba0630 0x558efab96000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 --2- 172.21.15.150:0/1304867095 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x558efab35b60 0x558efab9fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa549ffb700 0 client.4836 ms_handle_reset on v2:172.21.15.197:6834/1505577177 2022-08-10T17:38:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.356+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 >> 172.21.15.150:0/1304867095 conn(0x558efaaebdb0 msgr2=0x558efab33f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 shutdown_connections 2022-08-10T17:38:10.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa58140db80 1 -- 172.21.15.150:0/1304867095 wait complete. 2022-08-10T17:38:10.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa58140db80 20 client.4836 trim_cache size 0 max 16384 2022-08-10T17:38:10.395 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:10.396 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:10.396 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2022-08-10T17:38:10.396 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4317, 2022-08-10T17:38:10.396 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2022-08-10T17:38:10.397 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2022-08-10T17:38:10.397 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2022-08-10T17:38:10.397 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 152.96268574800001, 2022-08-10T17:38:10.398 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 15, 2022-08-10T17:38:10.398 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 29, 2022-08-10T17:38:10.398 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 29, 2022-08-10T17:38:10.398 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 158.25252219999999 2022-08-10T17:38:10.398 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 msgr2=0x7fa550067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 0x7fa550067590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa560009fd0 tx=0x7fa560008030 comp rx=0 tx=0).stop 2022-08-10T17:38:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 msgr2=0x7fa5700c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c450 tx=0x7fa56400c810 comp rx=0 tx=0).stop 2022-08-10T17:38:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 shutdown_connections 2022-08-10T17:38:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa5500650e0 0x7fa550067590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa570154460 0x7fa570158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5700c5530 0x7fa5700c3d50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 --2- 172.21.15.150:0/1750406621 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa5700c6020 0x7fa57014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 >> 172.21.15.150:0/1750406621 conn(0x7fa5700644b0 msgr2=0x7fa5700c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 shutdown_connections 2022-08-10T17:38:10.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.357+0000 7fa5754b7700 1 -- 172.21.15.150:0/1750406621 wait complete. 2022-08-10T17:38:10.403 INFO:teuthology.run_tasks:Running task kclient... 2022-08-10T17:38:10.417 INFO:tasks.kclient:Mounting kernel clients... 2022-08-10T17:38:10.417 INFO:tasks.kclient:config is {'client.0': {}} 2022-08-10T17:38:10.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:10.418 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2022-08-10T17:38:10.435 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2022-08-10T17:38:10.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:10.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-08-10T17:38:10.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:10.514 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2022-08-10T17:38:10.616 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2022-08-10T17:38:10.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-08-10T17:38:10.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.736+0000 7fc4f8aae700 1 Processor -- start 2022-08-10T17:38:10.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 -- start start 2022-08-10T17:38:10.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 0x7fc4f4071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4f406f080 0x7fc4f40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f40699a0 con 0x7fc4f4150d10 2022-08-10T17:38:10.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f40c72f0 con 0x7fc4f406f080 2022-08-10T17:38:10.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.737+0000 7fc4f8aae700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f41510e0 con 0x7fc4f4156870 2022-08-10T17:38:10.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4f406f080 0x7fc4f40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4f406f080 0x7fc4f40718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58724/0 (socket says 172.21.15.150:58724) 2022-08-10T17:38:10.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/749851018 learned_addr learned my addr 172.21.15.150:0/749851018 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f1d9b700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 0x7fc4f4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/749851018 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 msgr2=0x7fc4f4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 0x7fc4f4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/749851018 >> v1:172.21.15.197:6789/0 conn(0x7fc4f4150d10 legacy=0x7fc4f415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/749851018 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40c6d30 con 0x7fc4f406f080 2022-08-10T17:38:10.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f1d9b700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 0x7fc4f4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f2d9d700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f406f080 0x7fc4f40718b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009e50 tx=0x7fc4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afc9f82f2a77862 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f159a700 1 -- 172.21.15.150:0/749851018 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00e070 con 0x7fc4f406f080 2022-08-10T17:38:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f159a700 1 -- 172.21.15.150:0/749851018 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00b980 con 0x7fc4f406f080 2022-08-10T17:38:10.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.738+0000 7fc4f159a700 1 -- 172.21.15.150:0/749851018 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00bd30 con 0x7fc4f406f080 2022-08-10T17:38:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 -- 172.21.15.150:0/749851018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f406f080 msgr2=0x7fc4f40718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f406f080 0x7fc4f40718b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009e50 tx=0x7fc4ec00b330 comp rx=0 tx=0).stop 2022-08-10T17:38:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 -- 172.21.15.150:0/749851018 shutdown_connections 2022-08-10T17:38:10.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f406f080 0x7fc4f40718b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/749851018 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f4156870 0x7fc4f4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 -- 172.21.15.150:0/749851018 >> 172.21.15.150:0/749851018 conn(0x7fc4f40ca5a0 msgr2=0x7fc4f40c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 -- 172.21.15.150:0/749851018 shutdown_connections 2022-08-10T17:38:10.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.739+0000 7fc4f8aae700 1 -- 172.21.15.150:0/749851018 wait complete. 2022-08-10T17:38:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.740+0000 7fc4f8aae700 1 Processor -- start 2022-08-10T17:38:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 -- start start 2022-08-10T17:38:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f406f080 0x7fc4f40c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 0x7fc4f4152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c60c0 con 0x7fc4f4156870 2022-08-10T17:38:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4070240 con 0x7fc4f4150d10 2022-08-10T17:38:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.741+0000 7fc4f8aae700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c5e20 con 0x7fc4f406f080 2022-08-10T17:38:10.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58730/0 (socket says 172.21.15.150:58730) 2022-08-10T17:38:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/1165982724 learned_addr learned my addr 172.21.15.150:0/1165982724 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:10.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f1d9b700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 0x7fc4f4152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f259c700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f406f080 0x7fc4f40c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f406f080 msgr2=0x7fc4f40c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f406f080 0x7fc4f40c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 msgr2=0x7fc4f4152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 0x7fc4f4152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 -- 172.21.15.150:0/1165982724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009b30 con 0x7fc4f4156870 2022-08-10T17:38:10.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f1d9b700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 0x7fc4f4152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:10.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f2d9d700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec015040 tx=0x7fc4ec004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec004440 con 0x7fc4f4156870 2022-08-10T17:38:10.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0045c0 con 0x7fc4f4156870 2022-08-10T17:38:10.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0094d0 con 0x7fc4f4156870 2022-08-10T17:38:10.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f40c27f0 con 0x7fc4f4156870 2022-08-10T17:38:10.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.742+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f40704e0 con 0x7fc4f4156870 2022-08-10T17:38:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.743+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f40c2a30 con 0x7fc4f4156870 2022-08-10T17:38:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.744+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc4ec022030 con 0x7fc4f4156870 2022-08-10T17:38:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.744+0000 7fc4eaffd700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 0x7fc4d8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:10.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.744+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc4ec083660 con 0x7fc4f4156870 2022-08-10T17:38:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.744+0000 7fc4f259c700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 0x7fc4d8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.745+0000 7fc4f259c700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 0x7fc4d8067590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4004c30 tx=0x7fc4e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:10.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.748+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc4f40c2a30 con 0x7fc4f4156870 2022-08-10T17:38:10.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.971+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4f40c2a30 con 0x7fc4f4156870 2022-08-10T17:38:10.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.971+0000 7fc4eaffd700 1 -- 172.21.15.150:0/1165982724 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc4f40c2a30 con 0x7fc4f4156870 2022-08-10T17:38:10.975 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-08-10T17:38:10.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 msgr2=0x7fc4d8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 0x7fc4d8067590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4004c30 tx=0x7fc4e4009040 comp rx=0 tx=0).stop 2022-08-10T17:38:10.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 msgr2=0x7fc4f4152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:10.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec015040 tx=0x7fc4ec004950 comp rx=0 tx=0).stop 2022-08-10T17:38:10.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 shutdown_connections 2022-08-10T17:38:10.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4156870 0x7fc4f4152c80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4d80650e0 0x7fc4d8067590 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc4f406f080 0x7fc4f40c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 --2- 172.21.15.150:0/1165982724 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc4f4150d10 0x7fc4f4152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:10.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 >> 172.21.15.150:0/1165982724 conn(0x7fc4f40ca5a0 msgr2=0x7fc4f41545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:10.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 shutdown_connections 2022-08-10T17:38:10.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:10.973+0000 7fc4f8aae700 1 -- 172.21.15.150:0/1165982724 wait complete. 2022-08-10T17:38:10.989 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-08-10T17:38:10.989 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-08-10T17:38:10.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2022-08-10T17:38:10.990 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-08-10T17:38:10.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:10.990 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-08-10T17:38:10.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-08-10T17:38:10.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-08-10T17:38:10.991 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-08-10T17:38:10.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:10.992 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2022-08-10T17:38:11.009 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-08-10T17:38:11.009 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-08-10T17:38:11.010 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2022-08-10T17:38:11.010 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:38:11.010 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2022-08-10T17:38:11.011 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:38:11.011 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:38:11.011 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2022-08-10T17:38:11.011 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:38:11.011 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2022-08-10T17:38:11.012 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-08-10T17:38:11.012 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2022-08-10T17:38:11.012 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-08-10T17:38:11.012 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2022-08-10T17:38:11.013 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-08-10T17:38:11.013 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42365sec preferred_lft 42365sec 2022-08-10T17:38:11.013 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5670:4ef8:a295:d5cc/64 scope link noprefixroute 2022-08-10T17:38:11.013 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2022-08-10T17:38:11.014 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-08-10T17:38:11.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.015 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:38:11.015 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:38:11.015 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2022-08-10T17:38:11.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2022-08-10T17:38:11.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2022-08-10T17:38:11.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-08-10T17:38:11.017 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:38:11.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.126 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-08-10T17:38:11.153 INFO:teuthology.orchestra.run.smithi150.stdout:1 2022-08-10T17:38:11.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.154 DEBUG:teuthology.orchestra.run.smithi150:> route 2022-08-10T17:38:11.213 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2022-08-10T17:38:11.214 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-08-10T17:38:11.214 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-08-10T17:38:11.214 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-08-10T17:38:11.214 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-08-10T17:38:11.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.215 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:38:11.216 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:38:11.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-08-10T17:38:11.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-08-10T17:38:11.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-08-10T17:38:11.217 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:38:11.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.320 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2022-08-10T17:38:11.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.337 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2022-08-10T17:38:11.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.394 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:38:11.395 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:38:11.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-08-10T17:38:11.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-08-10T17:38:11.396 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:38:11.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-08-10T17:38:11.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.489 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:38:11.489 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:38:11.490 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-08-10T17:38:11.490 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-08-10T17:38:11.490 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-08-10T17:38:11.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-08-10T17:38:11.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-08-10T17:38:11.491 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:38:11.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.696 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2022-08-10T17:38:11.696 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2022-08-10T17:38:11.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2022-08-10T17:38:11.697 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2022-08-10T17:38:11.697 DEBUG:teuthology.orchestra.run.smithi150:> ') 2022-08-10T17:38:11.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-08-10T17:38:11.813 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:11.836 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-08-10T17:38:11.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-08-10T17:38:11.837 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:11.892 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-08-10T17:38:11.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:11.893 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-08-10T17:38:11.977 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-08-10T17:38:11.978 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2022-08-10T17:38:11.978 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2022-08-10T17:38:12.100 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-08-10T17:38:12.100 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2022-08-10T17:38:12.101 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2022-08-10T17:38:12.101 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.197:3300,172.21.15.197:3301" 2022-08-10T17:38:12.101 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2022-08-10T17:38:12.165 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-08-10T17:38:12.166 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2022-08-10T17:38:12.166 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2022-08-10T17:38:12.166 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:3300,172.21.15.197:3300,172.21.15.197:3301" 2022-08-10T17:38:12.167 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2022-08-10T17:38:12.167 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.197:6789,172.21.15.197:6790" 2022-08-10T17:38:12.167 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.197:6789,172.21.15.197:6790:/ 2022-08-10T17:38:12.167 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1038d638-5c3e-47f8-a696-c70f19144095" will pass to kernel 2022-08-10T17:38:12.169 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-08-10T17:38:12.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:38:12.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:12.197 INFO:teuthology.run_tasks:Running task mon_thrash... 2022-08-10T17:38:12.214 INFO:tasks.mon_thrash:Beginning mon_thrash... 2022-08-10T17:38:12.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:38:12.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.354+0000 7fb7692dd700 1 Processor -- start 2022-08-10T17:38:12.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.354+0000 7fb7692dd700 1 -- start start 2022-08-10T17:38:12.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7692dd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 0x7fb7640c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7692dd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 0x7fb7640c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7692dd700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7640c36f0 con 0x7fb7640c5570 2022-08-10T17:38:12.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7692dd700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76406ca30 con 0x7fb76406b640 2022-08-10T17:38:12.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7692dd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76414f100 con 0x7fb76414ed30 2022-08-10T17:38:12.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7627fc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 0x7fb7640c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb762ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 0x7fb7640c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7637fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fb7640c5570 0x7fb764155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57774/0 (socket says 172.21.15.150:57774) 2022-08-10T17:38:12.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.355+0000 7fb7637fe700 1 -- 172.21.15.150:0/3552105606 learned_addr learned my addr 172.21.15.150:0/3552105606 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:12.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb761ffb700 1 -- 172.21.15.150:0/3552105606 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423540185 0 0) 0x7fb75c001490 con 0x7fb7640c5570 2022-08-10T17:38:12.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb761ffb700 1 -- 172.21.15.150:0/3552105606 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb750003430 con 0x7fb7640c5570 2022-08-10T17:38:12.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb762ffd700 1 -- 172.21.15.150:0/3552105606 >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 msgr2=0x7fb7640c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:12.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb762ffd700 1 --2- 172.21.15.150:0/3552105606 >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 0x7fb7640c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb762ffd700 1 -- 172.21.15.150:0/3552105606 >> v1:172.21.15.197:6789/0 conn(0x7fb7640c5570 legacy=0x7fb764155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb762ffd700 1 -- 172.21.15.150:0/3552105606 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76406a450 con 0x7fb76414ed30 2022-08-10T17:38:12.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb7627fc700 1 --2- 172.21.15.150:0/3552105606 >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 0x7fb7640c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:12.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb762ffd700 1 --2- 172.21.15.150:0/3552105606 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 0x7fb7640c20f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7580096b0 tx=0x7fb7580099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38481a712a8a431 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb761ffb700 1 -- 172.21.15.150:0/3552105606 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580107b0 con 0x7fb76414ed30 2022-08-10T17:38:12.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb761ffb700 1 -- 172.21.15.150:0/3552105606 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758010910 con 0x7fb76414ed30 2022-08-10T17:38:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.356+0000 7fb761ffb700 1 -- 172.21.15.150:0/3552105606 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758010c80 con 0x7fb76414ed30 2022-08-10T17:38:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 -- 172.21.15.150:0/3552105606 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 msgr2=0x7fb7640c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 --2- 172.21.15.150:0/3552105606 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 0x7fb7640c20f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7580096b0 tx=0x7fb7580099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 -- 172.21.15.150:0/3552105606 shutdown_connections 2022-08-10T17:38:12.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 --2- 172.21.15.150:0/3552105606 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76414ed30 0x7fb7640c20f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 --2- 172.21.15.150:0/3552105606 >> v2:172.21.15.197:3300/0 conn(0x7fb76406b640 0x7fb7640c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 -- 172.21.15.150:0/3552105606 >> 172.21.15.150:0/3552105606 conn(0x7fb76406e1f0 msgr2=0x7fb76406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:12.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 -- 172.21.15.150:0/3552105606 shutdown_connections 2022-08-10T17:38:12.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.357+0000 7fb7692dd700 1 -- 172.21.15.150:0/3552105606 wait complete. 2022-08-10T17:38:12.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.358+0000 7fb7692dd700 1 Processor -- start 2022-08-10T17:38:12.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.358+0000 7fb7692dd700 1 -- start start 2022-08-10T17:38:12.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb7640c5570 0x7fb7640bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb7640beab0 0x7fb7640c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76414fc30 con 0x7fb76414ed30 2022-08-10T17:38:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c0950 con 0x7fb7640beab0 2022-08-10T17:38:12.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7692dd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c0320 con 0x7fb7640c5570 2022-08-10T17:38:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58746/0 (socket says 172.21.15.150:58746) 2022-08-10T17:38:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 -- 172.21.15.150:0/1868294589 learned_addr learned my addr 172.21.15.150:0/1868294589 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:12.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb762ffd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb7640c5570 0x7fb7640bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7637fe700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb7640beab0 0x7fb7640c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 -- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb7640c5570 msgr2=0x7fb7640bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb7640c5570 0x7fb7640bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 -- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb7640beab0 msgr2=0x7fb7640c0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb7640beab0 0x7fb7640c0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.359+0000 7fb7627fc700 1 -- 172.21.15.150:0/1868294589 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009310 con 0x7fb76414ed30 2022-08-10T17:38:12.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb7627fc700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb75400e8e0 tx=0x7fb75400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400eee0 con 0x7fb76414ed30 2022-08-10T17:38:12.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400c850 con 0x7fb76414ed30 2022-08-10T17:38:12.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb758009310 con 0x7fb76414ed30 2022-08-10T17:38:12.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400cc00 con 0x7fb76414ed30 2022-08-10T17:38:12.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.360+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7640bf610 con 0x7fb76414ed30 2022-08-10T17:38:12.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.361+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7640c0a90 con 0x7fb76414ed30 2022-08-10T17:38:12.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.361+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb754019030 con 0x7fb76414ed30 2022-08-10T17:38:12.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.361+0000 7fb74b7fe700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 0x7fb744067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.361+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb754082140 con 0x7fb76414ed30 2022-08-10T17:38:12.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.362+0000 7fb762ffd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 0x7fb744067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.362+0000 7fb762ffd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 0x7fb744067590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7580090b0 tx=0x7fb758008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.366+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb7640c0a90 con 0x7fb76414ed30 2022-08-10T17:38:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.545+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7640c0a90 con 0x7fb76414ed30 2022-08-10T17:38:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.546+0000 7fb74b7fe700 1 -- 172.21.15.150:0/1868294589 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7fb7640c0a90 con 0x7fb76414ed30 2022-08-10T17:38:12.550 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:12.551 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:38:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 msgr2=0x7fb744067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 0x7fb744067590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7580090b0 tx=0x7fb758008030 comp rx=0 tx=0).stop 2022-08-10T17:38:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 msgr2=0x7fb76414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb75400e8e0 tx=0x7fb75400eca0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 shutdown_connections 2022-08-10T17:38:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb7640beab0 0x7fb7640c0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb7440650e0 0x7fb744067590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb7640c5570 0x7fb7640bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 --2- 172.21.15.150:0/1868294589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76414ed30 0x7fb76414af90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 >> 172.21.15.150:0/1868294589 conn(0x7fb76406e1f0 msgr2=0x7fb7640ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:12.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 shutdown_connections 2022-08-10T17:38:12.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.548+0000 7fb7692dd700 1 -- 172.21.15.150:0/1868294589 wait complete. 2022-08-10T17:38:12.564 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-08-10T17:35:27.251819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-08-10T17:35:30.366555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-08-10T17:35:35.008984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-08-10T17:35:36.359965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-08-10T17:35:39.420480+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-08-10T17:38:12.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-08-10T17:38:12.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.685+0000 7f13161d5700 1 Processor -- start 2022-08-10T17:38:12.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 -- start start 2022-08-10T17:38:12.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f131006c5b0 0x7f1310157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f131006c980 0x7f13100c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100c8220 con 0x7f13100c3770 2022-08-10T17:38:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100c2190 con 0x7f131006c5b0 2022-08-10T17:38:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f13161d5700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100c2470 con 0x7f131006c980 2022-08-10T17:38:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f130f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f131006c5b0 0x7f1310157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f130ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f13100c3770 0x7f13100c76b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43204/0 (socket says 172.21.15.150:43204) 2022-08-10T17:38:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.686+0000 7f130ffff700 1 -- 172.21.15.150:0/2753112262 learned_addr learned my addr 172.21.15.150:0/2753112262 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:12.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130effd700 1 --2- 172.21.15.150:0/2753112262 >> v2:172.21.15.197:3300/0 conn(0x7f131006c980 0x7f13100c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130f7fe700 1 -- 172.21.15.150:0/2753112262 >> v2:172.21.15.197:3300/0 conn(0x7f131006c980 msgr2=0x7f13100c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:12.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130f7fe700 1 --2- 172.21.15.150:0/2753112262 >> v2:172.21.15.197:3300/0 conn(0x7f131006c980 0x7f13100c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130f7fe700 1 -- 172.21.15.150:0/2753112262 >> v1:172.21.15.150:6789/0 conn(0x7f13100c3770 legacy=0x7f13100c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130f7fe700 1 -- 172.21.15.150:0/2753112262 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100c2750 con 0x7f131006c5b0 2022-08-10T17:38:12.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130e7fc700 1 -- 172.21.15.150:0/2753112262 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369771288 0 0) 0x7f13100c8220 con 0x7f13100c3770 2022-08-10T17:38:12.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130f7fe700 1 --2- 172.21.15.150:0/2753112262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f131006c5b0 0x7f1310157820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1310067280 tx=0x7f12f8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3029118aefdbf52 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130e7fc700 1 -- 172.21.15.150:0/2753112262 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011830 con 0x7f131006c5b0 2022-08-10T17:38:12.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130e7fc700 1 -- 172.21.15.150:0/2753112262 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8011990 con 0x7f131006c5b0 2022-08-10T17:38:12.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f130e7fc700 1 -- 172.21.15.150:0/2753112262 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011d40 con 0x7f131006c5b0 2022-08-10T17:38:12.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f13161d5700 1 -- 172.21.15.150:0/2753112262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f131006c5b0 msgr2=0x7f1310157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.687+0000 7f13161d5700 1 --2- 172.21.15.150:0/2753112262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f131006c5b0 0x7f1310157820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1310067280 tx=0x7f12f8009990 comp rx=0 tx=0).stop 2022-08-10T17:38:12.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 -- 172.21.15.150:0/2753112262 shutdown_connections 2022-08-10T17:38:12.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 --2- 172.21.15.150:0/2753112262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f131006c5b0 0x7f1310157820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 --2- 172.21.15.150:0/2753112262 >> v2:172.21.15.197:3300/0 conn(0x7f131006c980 0x7f13100c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 -- 172.21.15.150:0/2753112262 >> 172.21.15.150:0/2753112262 conn(0x7f131006e1f0 msgr2=0x7f131006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:12.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 -- 172.21.15.150:0/2753112262 shutdown_connections 2022-08-10T17:38:12.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.688+0000 7f13161d5700 1 -- 172.21.15.150:0/2753112262 wait complete. 2022-08-10T17:38:12.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.689+0000 7f13161d5700 1 Processor -- start 2022-08-10T17:38:12.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.689+0000 7f13161d5700 1 -- start start 2022-08-10T17:38:12.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 0x7f1310068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 0x7f13101517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13101526b0 con 0x7f13100c3770 2022-08-10T17:38:12.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310153e80 con 0x7f131006c980 2022-08-10T17:38:12.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310068fa0 con 0x7f131006c5b0 2022-08-10T17:38:12.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58762/0 (socket says 172.21.15.150:58762) 2022-08-10T17:38:12.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 -- 172.21.15.150:0/1027290637 learned_addr learned my addr 172.21.15.150:0/1027290637 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:12.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130effd700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 0x7f13101517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130f7fe700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 0x7f1310068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 -- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 msgr2=0x7f1310068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 0x7f1310068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 -- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 msgr2=0x7f13101517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 0x7f13101517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 -- 172.21.15.150:0/1027290637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009310 con 0x7f13100c3770 2022-08-10T17:38:12.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130effd700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 0x7f13101517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:12.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130f7fe700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 0x7f1310068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:12.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f130ffff700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f130800c780 tx=0x7f130800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308004e80 con 0x7f13100c3770 2022-08-10T17:38:12.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080070d0 con 0x7f13100c3770 2022-08-10T17:38:12.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1310069280 con 0x7f13100c3770 2022-08-10T17:38:12.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308007440 con 0x7f13100c3770 2022-08-10T17:38:12.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.690+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1310153b10 con 0x7f13100c3770 2022-08-10T17:38:12.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.691+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310154030 con 0x7f13100c3770 2022-08-10T17:38:12.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.692+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f130801a030 con 0x7f13100c3770 2022-08-10T17:38:12.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.692+0000 7f1307fff700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 0x7f12f4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:12.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.692+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1308081630 con 0x7f13100c3770 2022-08-10T17:38:12.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.692+0000 7f130f7fe700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 0x7f12f4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:12.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.693+0000 7f130f7fe700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 0x7f12f4067560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:12.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.696+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1310154030 con 0x7f13100c3770 2022-08-10T17:38:12.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.875+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1310154030 con 0x7f13100c3770 2022-08-10T17:38:12.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.875+0000 7f1307fff700 1 -- 172.21.15.150:0/1027290637 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1310154030 con 0x7f13100c3770 2022-08-10T17:38:12.879 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2022-08-10T17:38:12.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 msgr2=0x7f12f4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 0x7f12f4067560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f801c040 comp rx=0 tx=0).stop 2022-08-10T17:38:12.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 msgr2=0x7f131014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:12.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f130800c780 tx=0x7f130800cb40 comp rx=0 tx=0).stop 2022-08-10T17:38:12.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 shutdown_connections 2022-08-10T17:38:12.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13100c3770 0x7f131014e5c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f12f40650b0 0x7f12f4067560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f131006c5b0 0x7f1310068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 --2- 172.21.15.150:0/1027290637 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f131006c980 0x7f13101517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:12.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 >> 172.21.15.150:0/1027290637 conn(0x7f131006e1f0 msgr2=0x7f1310150990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:12.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 shutdown_connections 2022-08-10T17:38:12.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:12.877+0000 7f13161d5700 1 -- 172.21.15.150:0/1027290637 wait complete. 2022-08-10T17:38:12.893 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-08-10T17:38:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.012+0000 7f90ecba6700 1 Processor -- start 2022-08-10T17:38:13.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.012+0000 7f90ecba6700 1 -- start start 2022-08-10T17:38:13.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90ecba6700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 0x7f90e8068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90ecba6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e8068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90ecba6700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80c6100 con 0x7f90e81540f0 2022-08-10T17:38:13.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90ecba6700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e80c5270 con 0x7f90e81544c0 2022-08-10T17:38:13.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90ecba6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80c5e00 con 0x7f90e80bd4b0 2022-08-10T17:38:13.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e5d9b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 0x7f90e8068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e6d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e8068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e659c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f90e81540f0 0x7f90e8071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57798/0 (socket says 172.21.15.150:57798) 2022-08-10T17:38:13.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e659c700 1 -- 172.21.15.150:0/4251300038 learned_addr learned my addr 172.21.15.150:0/4251300038 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:13.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e6d9d700 1 -- 172.21.15.150:0/4251300038 >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 msgr2=0x7f90e8068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:13.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e6d9d700 1 --2- 172.21.15.150:0/4251300038 >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 0x7f90e8068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e6d9d700 1 -- 172.21.15.150:0/4251300038 >> v1:172.21.15.197:6789/0 conn(0x7f90e81540f0 legacy=0x7f90e8071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e6d9d700 1 -- 172.21.15.150:0/4251300038 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e806eb00 con 0x7f90e80bd4b0 2022-08-10T17:38:13.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.013+0000 7f90e5d9b700 1 --2- 172.21.15.150:0/4251300038 >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 0x7f90e8068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:13.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90e6d9d700 1 --2- 172.21.15.150:0/4251300038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e8068650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009d90 tx=0x7f90e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182b0aff03120527 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90e559a700 1 -- 172.21.15.150:0/4251300038 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000e070 con 0x7f90e80bd4b0 2022-08-10T17:38:13.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90e559a700 1 -- 172.21.15.150:0/4251300038 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000bb20 con 0x7f90e80bd4b0 2022-08-10T17:38:13.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90e559a700 1 -- 172.21.15.150:0/4251300038 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0012430 con 0x7f90e80bd4b0 2022-08-10T17:38:13.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 -- 172.21.15.150:0/4251300038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 msgr2=0x7f90e8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4251300038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e8068650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009d90 tx=0x7f90e000b330 comp rx=0 tx=0).stop 2022-08-10T17:38:13.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 -- 172.21.15.150:0/4251300038 shutdown_connections 2022-08-10T17:38:13.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4251300038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e8068650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4251300038 >> v2:172.21.15.197:3300/0 conn(0x7f90e81544c0 0x7f90e8068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 -- 172.21.15.150:0/4251300038 >> 172.21.15.150:0/4251300038 conn(0x7f90e806d0d0 msgr2=0x7f90e80c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 -- 172.21.15.150:0/4251300038 shutdown_connections 2022-08-10T17:38:13.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.014+0000 7f90ecba6700 1 -- 172.21.15.150:0/4251300038 wait complete. 2022-08-10T17:38:13.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.016+0000 7f90ecba6700 1 Processor -- start 2022-08-10T17:38:13.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.016+0000 7f90ecba6700 1 -- start start 2022-08-10T17:38:13.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.016+0000 7f90ecba6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e80af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.016+0000 7f90ecba6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.016+0000 7f90ecba6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f90e81544c0 0x7f90e814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90ecba6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e815ad00 con 0x7f90e81540f0 2022-08-10T17:38:13.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90ecba6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81f0360 con 0x7f90e81544c0 2022-08-10T17:38:13.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90ecba6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8158cd0 con 0x7f90e80bd4b0 2022-08-10T17:38:13.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58772/0 (socket says 172.21.15.150:58772) 2022-08-10T17:38:13.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 -- 172.21.15.150:0/4114373425 learned_addr learned my addr 172.21.15.150:0/4114373425 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:13.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e659c700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e6d9d700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f90e81544c0 0x7f90e814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 -- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 msgr2=0x7f90e80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e80af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 -- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f90e81544c0 msgr2=0x7f90e814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f90e81544c0 0x7f90e814cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 -- 172.21.15.150:0/4114373425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009310 con 0x7f90e81540f0 2022-08-10T17:38:13.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90e5d9b700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e9e0 tx=0x7f90d800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800c640 con 0x7f90e81540f0 2022-08-10T17:38:13.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800c7a0 con 0x7f90e81540f0 2022-08-10T17:38:13.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e0009a70 con 0x7f90e81540f0 2022-08-10T17:38:13.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800cb30 con 0x7f90e81540f0 2022-08-10T17:38:13.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.017+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e81f0850 con 0x7f90e81540f0 2022-08-10T17:38:13.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.018+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e8072890 con 0x7f90e81540f0 2022-08-10T17:38:13.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.019+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f90d8019030 con 0x7f90e81540f0 2022-08-10T17:38:13.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.019+0000 7f90d6ffd700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 0x7f90c4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.019+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f90d8082290 con 0x7f90e81540f0 2022-08-10T17:38:13.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.019+0000 7f90e659c700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 0x7f90c4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.020+0000 7f90e659c700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 0x7f90c4067590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90dc005790 tx=0x7f90dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.023+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f90d8050270 con 0x7f90e81540f0 2022-08-10T17:38:13.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.199+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f90e80afc80 con 0x7f90e81540f0 2022-08-10T17:38:13.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.200+0000 7f90d6ffd700 1 -- 172.21.15.150:0/4114373425 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f90d800cea0 con 0x7f90e81540f0 2022-08-10T17:38:13.204 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 8 2022-08-10T17:38:13.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 msgr2=0x7f90c4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 0x7f90c4067590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90dc005790 tx=0x7f90dc009040 comp rx=0 tx=0).stop 2022-08-10T17:38:13.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 msgr2=0x7f90e8157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e9e0 tx=0x7f90d800ecf0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 shutdown_connections 2022-08-10T17:38:13.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f90e81544c0 0x7f90e814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f90c40650e0 0x7f90c4067590 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f90e80bd4b0 0x7f90e80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 --2- 172.21.15.150:0/4114373425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e81540f0 0x7f90e8157e30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 >> 172.21.15.150:0/4114373425 conn(0x7f90e806d0d0 msgr2=0x7f90e80c0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 shutdown_connections 2022-08-10T17:38:13.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.202+0000 7f90ecba6700 1 -- 172.21.15.150:0/4114373425 wait complete. 2022-08-10T17:38:13.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-08-10T17:38:13.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.337+0000 7feb47ac2700 1 Processor -- start 2022-08-10T17:38:13.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.337+0000 7feb47ac2700 1 -- start start 2022-08-10T17:38:13.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb47ac2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb4006d850 0x7feb400c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb47ac2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb400c4410 0x7feb400c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb47ac2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb400c39a0 con 0x7feb4006d480 2022-08-10T17:38:13.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb47ac2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb400c4dd0 con 0x7feb4006d850 2022-08-10T17:38:13.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb47ac2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb400b0ff0 con 0x7feb400c4410 2022-08-10T17:38:13.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb4505d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb4006d850 0x7feb400c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb4585e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7feb4006d480 0x7feb400b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43228/0 (socket says 172.21.15.150:43228) 2022-08-10T17:38:13.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.338+0000 7feb4585e700 1 -- 172.21.15.150:0/1999614257 learned_addr learned my addr 172.21.15.150:0/1999614257 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:13.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4605f700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb400c4410 0x7feb400c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4505d700 1 -- 172.21.15.150:0/1999614257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb400c4410 msgr2=0x7feb400c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:13.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4505d700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb400c4410 0x7feb400c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4505d700 1 -- 172.21.15.150:0/1999614257 >> v1:172.21.15.150:6789/0 conn(0x7feb4006d480 legacy=0x7feb400b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4485c700 1 -- 172.21.15.150:0/1999614257 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719876796 0 0) 0x7feb400c39a0 con 0x7feb4006d480 2022-08-10T17:38:13.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4505d700 1 -- 172.21.15.150:0/1999614257 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4006e120 con 0x7feb4006d850 2022-08-10T17:38:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4505d700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d850 0x7feb400c1f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0096b0 tx=0x7feb3c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf4485cdfc199e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4485c700 1 -- 172.21.15.150:0/1999614257 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0107b0 con 0x7feb4006d850 2022-08-10T17:38:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4485c700 1 -- 172.21.15.150:0/1999614257 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c010910 con 0x7feb4006d850 2022-08-10T17:38:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb4485c700 1 -- 172.21.15.150:0/1999614257 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c010cc0 con 0x7feb4006d850 2022-08-10T17:38:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb47ac2700 1 -- 172.21.15.150:0/1999614257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d850 msgr2=0x7feb400c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.339+0000 7feb47ac2700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d850 0x7feb400c1f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0096b0 tx=0x7feb3c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 -- 172.21.15.150:0/1999614257 shutdown_connections 2022-08-10T17:38:13.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb400c4410 0x7feb400c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 --2- 172.21.15.150:0/1999614257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d850 0x7feb400c1f60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 -- 172.21.15.150:0/1999614257 >> 172.21.15.150:0/1999614257 conn(0x7feb4006b3b0 msgr2=0x7feb4006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 -- 172.21.15.150:0/1999614257 shutdown_connections 2022-08-10T17:38:13.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.340+0000 7feb47ac2700 1 -- 172.21.15.150:0/1999614257 wait complete. 2022-08-10T17:38:13.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 Processor -- start 2022-08-10T17:38:13.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 -- start start 2022-08-10T17:38:13.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb4006d850 0x7feb40156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7feb400c4410 0x7feb4014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40069820 con 0x7feb4006d480 2022-08-10T17:38:13.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40069580 con 0x7feb400c4410 2022-08-10T17:38:13.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.341+0000 7feb47ac2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb401f0120 con 0x7feb4006d850 2022-08-10T17:38:13.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58786/0 (socket says 172.21.15.150:58786) 2022-08-10T17:38:13.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 -- 172.21.15.150:0/3515494570 learned_addr learned my addr 172.21.15.150:0/3515494570 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:13.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4505d700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb4006d850 0x7feb40156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4605f700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7feb400c4410 0x7feb4014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 -- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb4006d850 msgr2=0x7feb40156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb4006d850 0x7feb40156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 -- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7feb400c4410 msgr2=0x7feb4014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7feb400c4410 0x7feb4014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 -- 172.21.15.150:0/3515494570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009310 con 0x7feb4006d480 2022-08-10T17:38:13.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb4585e700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c410 tx=0x7feb3000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300072d0 con 0x7feb4006d480 2022-08-10T17:38:13.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30007450 con 0x7feb4006d480 2022-08-10T17:38:13.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300075c0 con 0x7feb4006d480 2022-08-10T17:38:13.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4014d160 con 0x7feb4006d480 2022-08-10T17:38:13.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.342+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb401ef640 con 0x7feb4006d480 2022-08-10T17:38:13.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.343+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40072890 con 0x7feb4006d480 2022-08-10T17:38:13.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.344+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7feb3001a020 con 0x7feb4006d480 2022-08-10T17:38:13.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.344+0000 7feb2e7fc700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 0x7feb20067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.344+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7feb30081bc0 con 0x7feb4006d480 2022-08-10T17:38:13.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.344+0000 7feb4505d700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 0x7feb20067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.345+0000 7feb4505d700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 0x7feb20067560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0090b0 tx=0x7feb3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.348+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7feb3004fba0 con 0x7feb4006d480 2022-08-10T17:38:13.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.529+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb400cbbb0 con 0x7feb4006d480 2022-08-10T17:38:13.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.529+0000 7feb2e7fc700 1 -- 172.21.15.150:0/3515494570 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb300531c0 con 0x7feb4006d480 2022-08-10T17:38:13.533 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:13.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 msgr2=0x7feb20067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 0x7feb20067560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0090b0 tx=0x7feb3c008030 comp rx=0 tx=0).stop 2022-08-10T17:38:13.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 msgr2=0x7feb40154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c410 tx=0x7feb3000c720 comp rx=0 tx=0).stop 2022-08-10T17:38:13.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 shutdown_connections 2022-08-10T17:38:13.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7feb400c4410 0x7feb4014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb4006d480 0x7feb40154f00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7feb200650b0 0x7feb20067560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 --2- 172.21.15.150:0/3515494570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7feb4006d850 0x7feb40156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 >> 172.21.15.150:0/3515494570 conn(0x7feb4006b3b0 msgr2=0x7feb400c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 shutdown_connections 2022-08-10T17:38:13.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.531+0000 7feb47ac2700 1 -- 172.21.15.150:0/3515494570 wait complete. 2022-08-10T17:38:13.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-08-10T17:38:13.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.666+0000 7f0968282700 1 Processor -- start 2022-08-10T17:38:13.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.666+0000 7f0968282700 1 -- start start 2022-08-10T17:38:13.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f0968282700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09600c4d90 0x7f09600c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f0968282700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 0x7f09600c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f0968282700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600699c0 con 0x7f09600c7220 2022-08-10T17:38:13.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f0968282700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09600c5e10 con 0x7f09600c4d90 2022-08-10T17:38:13.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f0968282700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09600c1c30 con 0x7f09600c2790 2022-08-10T17:38:13.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f096601e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09600c4d90 0x7f09600c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f096601e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09600c4d90 0x7f09600c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58794/0 (socket says 172.21.15.150:58794) 2022-08-10T17:38:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f096601e700 1 -- 172.21.15.150:0/2015231135 learned_addr learned my addr 172.21.15.150:0/2015231135 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:13.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.667+0000 7f096681f700 1 --2- 172.21.15.150:0/2015231135 >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 0x7f09600c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096601e700 1 -- 172.21.15.150:0/2015231135 >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 msgr2=0x7f09600c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:13.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096601e700 1 --2- 172.21.15.150:0/2015231135 >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 0x7f09600c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096601e700 1 -- 172.21.15.150:0/2015231135 >> v1:172.21.15.197:6789/0 conn(0x7f09600c7220 legacy=0x7f09600c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096601e700 1 -- 172.21.15.150:0/2015231135 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960068e40 con 0x7f09600c4d90 2022-08-10T17:38:13.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096681f700 1 --2- 172.21.15.150:0/2015231135 >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 0x7f09600c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096601e700 1 --2- 172.21.15.150:0/2015231135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c4d90 0x7f09600c5160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0960157e20 tx=0x7f095000bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78919aeddc6056b7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096501c700 1 -- 172.21.15.150:0/2015231135 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950004230 con 0x7f09600c4d90 2022-08-10T17:38:13.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096501c700 1 -- 172.21.15.150:0/2015231135 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950004390 con 0x7f09600c4d90 2022-08-10T17:38:13.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f096501c700 1 -- 172.21.15.150:0/2015231135 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000dc60 con 0x7f09600c4d90 2022-08-10T17:38:13.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 -- 172.21.15.150:0/2015231135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c4d90 msgr2=0x7f09600c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 --2- 172.21.15.150:0/2015231135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c4d90 0x7f09600c5160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0960157e20 tx=0x7f095000bd00 comp rx=0 tx=0).stop 2022-08-10T17:38:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 -- 172.21.15.150:0/2015231135 shutdown_connections 2022-08-10T17:38:13.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 --2- 172.21.15.150:0/2015231135 >> v2:172.21.15.197:3300/0 conn(0x7f09600c2790 0x7f09600c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 --2- 172.21.15.150:0/2015231135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c4d90 0x7f09600c5160 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.668+0000 7f0968282700 1 -- 172.21.15.150:0/2015231135 >> 172.21.15.150:0/2015231135 conn(0x7f096006d0d0 msgr2=0x7f09600c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.669+0000 7f0968282700 1 -- 172.21.15.150:0/2015231135 shutdown_connections 2022-08-10T17:38:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.669+0000 7f0968282700 1 -- 172.21.15.150:0/2015231135 wait complete. 2022-08-10T17:38:13.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 Processor -- start 2022-08-10T17:38:13.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 -- start start 2022-08-10T17:38:13.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09600c4d90 0x7f09600bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09600c7220 0x7f09601ebba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960153dd0 con 0x7f09600c2790 2022-08-10T17:38:13.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601568b0 con 0x7f09600c7220 2022-08-10T17:38:13.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f0968282700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960156bb0 con 0x7f09600c4d90 2022-08-10T17:38:13.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f096601e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.670+0000 7f096601e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58798/0 (socket says 172.21.15.150:58798) 2022-08-10T17:38:13.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 -- 172.21.15.150:0/1557049493 learned_addr learned my addr 172.21.15.150:0/1557049493 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:13.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096681f700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09600c7220 0x7f09601ebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096581d700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09600c4d90 0x7f09600bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 -- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09600c4d90 msgr2=0x7f09600bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09600c4d90 0x7f09600bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 -- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09600c7220 msgr2=0x7f09601ebba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09600c7220 0x7f09601ebba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 -- 172.21.15.150:0/1557049493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095000b680 con 0x7f09600c2790 2022-08-10T17:38:13.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f096601e700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0950000c00 tx=0x7f09500045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095001e070 con 0x7f09600c2790 2022-08-10T17:38:13.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095000de50 con 0x7f09600c2790 2022-08-10T17:38:13.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960156e90 con 0x7f09600c2790 2022-08-10T17:38:13.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950003c80 con 0x7f09600c2790 2022-08-10T17:38:13.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.671+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09601574d0 con 0x7f09600c2790 2022-08-10T17:38:13.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.672+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0960072890 con 0x7f09600c2790 2022-08-10T17:38:13.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.672+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f09500193f0 con 0x7f09600c2790 2022-08-10T17:38:13.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.673+0000 7f094effd700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 0x7f0940067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.673+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0950083280 con 0x7f09600c2790 2022-08-10T17:38:13.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.673+0000 7f096581d700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 0x7f0940067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.673+0000 7f096581d700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 0x7f0940067560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09600c30e0 tx=0x7f095c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:13.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.677+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0950051200 con 0x7f09600c2790 2022-08-10T17:38:13.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.854+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0960069120 con 0x7f09600c2790 2022-08-10T17:38:13.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.854+0000 7f094effd700 1 -- 172.21.15.150:0/1557049493 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0950054820 con 0x7f09600c2790 2022-08-10T17:38:13.859 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 64 2022-08-10T17:38:13.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 msgr2=0x7f0940067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 0x7f0940067560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09600c30e0 tx=0x7f095c009040 comp rx=0 tx=0).stop 2022-08-10T17:38:13.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 msgr2=0x7f0960153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:13.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0950000c00 tx=0x7f09500045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 shutdown_connections 2022-08-10T17:38:13.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09600c7220 0x7f09601ebba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09600c2790 0x7f0960153890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09400650b0 0x7f0940067560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 --2- 172.21.15.150:0/1557049493 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09600c4d90 0x7f09600bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:13.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 >> 172.21.15.150:0/1557049493 conn(0x7f096006d0d0 msgr2=0x7f09600c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:13.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 shutdown_connections 2022-08-10T17:38:13.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.856+0000 7f0968282700 1 -- 172.21.15.150:0/1557049493 wait complete. 2022-08-10T17:38:13.872 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-08-10T17:38:13.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.991+0000 7f6911568700 1 Processor -- start 2022-08-10T17:38:13.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.991+0000 7f6911568700 1 -- start start 2022-08-10T17:38:13.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6911568700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6911568700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f690c0c79e0 0x7f690c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:13.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6911568700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0c89e0 con 0x7f690c150aa0 2022-08-10T17:38:13.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6911568700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0c8cc0 con 0x7f690c0c79e0 2022-08-10T17:38:13.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6911568700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0c8fa0 con 0x7f690c0c80e0 2022-08-10T17:38:13.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f690c0c79e0 0x7f690c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:13.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f690c150aa0 0x7f690c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43254/0 (socket says 172.21.15.150:43254) 2022-08-10T17:38:13.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f690c0c79e0 0x7f690c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58808/0 (socket says 172.21.15.150:58808) 2022-08-10T17:38:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690affd700 1 -- 172.21.15.150:0/249431145 learned_addr learned my addr 172.21.15.150:0/249431145 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690a7fc700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 -- 172.21.15.150:0/249431145 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 msgr2=0x7f690c071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:14.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 -- 172.21.15.150:0/249431145 >> v1:172.21.15.150:6789/0 conn(0x7f690c150aa0 legacy=0x7f690c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 -- 172.21.15.150:0/249431145 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0c9280 con 0x7f690c0c79e0 2022-08-10T17:38:14.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6909ffb700 1 -- 172.21.15.150:0/249431145 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170030117 0 0) 0x7f690c0c89e0 con 0x7f690c150aa0 2022-08-10T17:38:14.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f690b7fe700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c0c79e0 0x7f690c156bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6904009d90 tx=0x7f690400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332212cab778076e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6909ffb700 1 -- 172.21.15.150:0/249431145 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400e070 con 0x7f690c0c79e0 2022-08-10T17:38:14.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6909ffb700 1 -- 172.21.15.150:0/249431145 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400bbd0 con 0x7f690c0c79e0 2022-08-10T17:38:14.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.992+0000 7f6909ffb700 1 -- 172.21.15.150:0/249431145 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904012430 con 0x7f690c0c79e0 2022-08-10T17:38:14.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 -- 172.21.15.150:0/249431145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c0c79e0 msgr2=0x7f690c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c0c79e0 0x7f690c156bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6904009d90 tx=0x7f690400b330 comp rx=0 tx=0).stop 2022-08-10T17:38:14.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 -- 172.21.15.150:0/249431145 shutdown_connections 2022-08-10T17:38:14.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c0c79e0 0x7f690c156bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 --2- 172.21.15.150:0/249431145 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 -- 172.21.15.150:0/249431145 >> 172.21.15.150:0/249431145 conn(0x7f690c068d60 msgr2=0x7f690c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 -- 172.21.15.150:0/249431145 shutdown_connections 2022-08-10T17:38:14.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.993+0000 7f6911568700 1 -- 172.21.15.150:0/249431145 wait complete. 2022-08-10T17:38:14.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.994+0000 7f6911568700 1 Processor -- start 2022-08-10T17:38:14.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.994+0000 7f6911568700 1 -- start start 2022-08-10T17:38:14.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f690c0c79e0 0x7f690c1ef250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c1ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c158b30 con 0x7f690c150aa0 2022-08-10T17:38:14.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c15ac00 con 0x7f690c0c79e0 2022-08-10T17:38:14.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f6911568700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1efd50 con 0x7f690c0c80e0 2022-08-10T17:38:14.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58812/0 (socket says 172.21.15.150:58812) 2022-08-10T17:38:14.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 -- 172.21.15.150:0/3995032259 learned_addr learned my addr 172.21.15.150:0/3995032259 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:14.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690a7fc700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c1ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690affd700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f690c0c79e0 0x7f690c1ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 -- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 msgr2=0x7f690c1ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c1ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 -- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f690c0c79e0 msgr2=0x7f690c1ef250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f690c0c79e0 0x7f690c1ef250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690b7fe700 1 -- 172.21.15.150:0/3995032259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009a70 con 0x7f690c150aa0 2022-08-10T17:38:14.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.995+0000 7f690a7fc700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c1ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:14.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f690b7fe700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f690400b370 tx=0x7f6904004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040044d0 con 0x7f690c150aa0 2022-08-10T17:38:14.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904020070 con 0x7f690c150aa0 2022-08-10T17:38:14.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c158d10 con 0x7f690c150aa0 2022-08-10T17:38:14.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040125e0 con 0x7f690c150aa0 2022-08-10T17:38:14.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.996+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c1592d0 con 0x7f690c150aa0 2022-08-10T17:38:14.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.997+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c1ecf70 con 0x7f690c150aa0 2022-08-10T17:38:14.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.997+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6904012740 con 0x7f690c150aa0 2022-08-10T17:38:14.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.997+0000 7f68f37fe700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 0x7f68ec067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.997+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6904022070 con 0x7f690c150aa0 2022-08-10T17:38:14.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.998+0000 7f690affd700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 0x7f68ec067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:13.998+0000 7f690affd700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 0x7f68ec067590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6900000f60 tx=0x7f6900007b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.002+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f690c1ecf70 con 0x7f690c150aa0 2022-08-10T17:38:14.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.179+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f690c1ecf70 con 0x7f690c150aa0 2022-08-10T17:38:14.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.179+0000 7f68f37fe700 1 -- 172.21.15.150:0/3995032259 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f690c1ecf70 con 0x7f690c150aa0 2022-08-10T17:38:14.184 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:14.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 msgr2=0x7f68ec067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 0x7f68ec067590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6900000f60 tx=0x7f6900007b10 comp rx=0 tx=0).stop 2022-08-10T17:38:14.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 msgr2=0x7f690c1ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f690400b370 tx=0x7f6904004950 comp rx=0 tx=0).stop 2022-08-10T17:38:14.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 shutdown_connections 2022-08-10T17:38:14.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f690c150aa0 0x7f690c1ed790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f690c0c79e0 0x7f690c1ef250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f68ec0650e0 0x7f68ec067590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 --2- 172.21.15.150:0/3995032259 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f690c0c80e0 0x7f690c1ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 >> 172.21.15.150:0/3995032259 conn(0x7f690c068d60 msgr2=0x7f690c0c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 shutdown_connections 2022-08-10T17:38:14.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.181+0000 7f6911568700 1 -- 172.21.15.150:0/3995032259 wait complete. 2022-08-10T17:38:14.197 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2022-08-10T17:38:14.197 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:38:14.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.313+0000 7fa85c762700 1 Processor -- start 2022-08-10T17:38:14.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.313+0000 7fa85c762700 1 -- start start 2022-08-10T17:38:14.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.314+0000 7fa85c762700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa85406c860 0x7fa8540c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.314+0000 7fa85c762700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540c4dc0 con 0x7fa854150af0 2022-08-10T17:38:14.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.314+0000 7fa85c762700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540c5940 con 0x7fa85415a570 2022-08-10T17:38:14.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.314+0000 7fa85c762700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540c9fc0 con 0x7fa85406c860 2022-08-10T17:38:14.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa85a4fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa854150af0 0x7fa854159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43266/0 (socket says 172.21.15.150:43266) 2022-08-10T17:38:14.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa85a4fe700 1 -- 172.21.15.150:0/2675342519 learned_addr learned my addr 172.21.15.150:0/2675342519 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:14.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa859cfd700 1 --2- 172.21.15.150:0/2675342519 >> v2:172.21.15.197:3300/0 conn(0x7fa85406c860 0x7fa8540c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157801385 0 0) 0x7fa8540c4dc0 con 0x7fa854150af0 2022-08-10T17:38:14.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa83c003430 con 0x7fa854150af0 2022-08-10T17:38:14.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286924493 0 0) 0x7fa8540c5940 con 0x7fa85415a570 2022-08-10T17:38:14.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8540c4dc0 con 0x7fa85415a570 2022-08-10T17:38:14.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647727086 0 0) 0x7fa83c003430 con 0x7fa854150af0 2022-08-10T17:38:14.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa859cfd700 1 -- 172.21.15.150:0/2675342519 >> v1:172.21.15.197:6789/0 conn(0x7fa85415a570 legacy=0x7fa8540c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa859cfd700 1 -- 172.21.15.150:0/2675342519 >> v1:172.21.15.150:6789/0 conn(0x7fa854150af0 legacy=0x7fa854159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa859cfd700 1 -- 172.21.15.150:0/2675342519 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85406f9a0 con 0x7fa85406c860 2022-08-10T17:38:14.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa859cfd700 1 --2- 172.21.15.150:0/2675342519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa85406c860 0x7fa8540c3ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8500096b0 tx=0x7fa8500099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4e7e175f36954dd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844001670 con 0x7fa85406c860 2022-08-10T17:38:14.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850004030 con 0x7fa85406c860 2022-08-10T17:38:14.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.315+0000 7fa8594fc700 1 -- 172.21.15.150:0/2675342519 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8500043c0 con 0x7fa85406c860 2022-08-10T17:38:14.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 -- 172.21.15.150:0/2675342519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa85406c860 msgr2=0x7fa8540c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 --2- 172.21.15.150:0/2675342519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa85406c860 0x7fa8540c3ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8500096b0 tx=0x7fa8500099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 -- 172.21.15.150:0/2675342519 shutdown_connections 2022-08-10T17:38:14.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 --2- 172.21.15.150:0/2675342519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa85406c860 0x7fa8540c3ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 -- 172.21.15.150:0/2675342519 >> 172.21.15.150:0/2675342519 conn(0x7fa8540c92f0 msgr2=0x7fa8540c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 -- 172.21.15.150:0/2675342519 shutdown_connections 2022-08-10T17:38:14.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.316+0000 7fa85c762700 1 -- 172.21.15.150:0/2675342519 wait complete. 2022-08-10T17:38:14.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.317+0000 7fa85c762700 1 Processor -- start 2022-08-10T17:38:14.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.317+0000 7fa85c762700 1 -- start start 2022-08-10T17:38:14.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa854150af0 0x7fa85414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa85415a570 0x7fa8540bab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540bbd30 con 0x7fa85406c860 2022-08-10T17:38:14.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540bd280 con 0x7fa854150af0 2022-08-10T17:38:14.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85c762700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85414af20 con 0x7fa85415a570 2022-08-10T17:38:14.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58822/0 (socket says 172.21.15.150:58822) 2022-08-10T17:38:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 -- 172.21.15.150:0/2112700726 learned_addr learned my addr 172.21.15.150:0/2112700726 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa859cfd700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa854150af0 0x7fa85414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85acff700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa85415a570 0x7fa8540bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 -- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa85415a570 msgr2=0x7fa8540bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa85415a570 0x7fa8540bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 -- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa854150af0 msgr2=0x7fa85414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa854150af0 0x7fa85414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 -- 172.21.15.150:0/2112700726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009310 con 0x7fa85406c860 2022-08-10T17:38:14.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.318+0000 7fa85a4fe700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8440017a0 tx=0x7fa84400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.319+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440074e0 con 0x7fa85406c860 2022-08-10T17:38:14.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.319+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8440046f0 con 0x7fa85406c860 2022-08-10T17:38:14.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.319+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8541f0250 con 0x7fa85406c860 2022-08-10T17:38:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.319+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844004a80 con 0x7fa85406c860 2022-08-10T17:38:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.319+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8541f0530 con 0x7fa85406c860 2022-08-10T17:38:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.320+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa854157810 con 0x7fa85406c860 2022-08-10T17:38:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.320+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa84401a020 con 0x7fa85406c860 2022-08-10T17:38:14.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.320+0000 7fa842ffd700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 0x7fa834067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.320+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa844081e10 con 0x7fa85406c860 2022-08-10T17:38:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.321+0000 7fa859cfd700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 0x7fa834067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.321+0000 7fa859cfd700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 0x7fa834067590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa850000c00 tx=0x7fa850008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.324+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa84404fdf0 con 0x7fa85406c860 2022-08-10T17:38:14.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.496+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa85406e290 con 0x7fa8340650e0 2022-08-10T17:38:14.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.507+0000 7fa842ffd700 1 -- 172.21.15.150:0/2112700726 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392599 (secure 0 0 0) 0x7fa85406e290 con 0x7fa8340650e0 2022-08-10T17:38:14.516 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:14.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 msgr2=0x7fa834067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 0x7fa834067590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa850000c00 tx=0x7fa850008030 comp rx=0 tx=0).stop 2022-08-10T17:38:14.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 msgr2=0x7fa8540ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8440017a0 tx=0x7fa84400c7e0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 shutdown_connections 2022-08-10T17:38:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa8340650e0 0x7fa834067590 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa85415a570 0x7fa8540bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85406c860 0x7fa8540ba320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 --2- 172.21.15.150:0/2112700726 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa854150af0 0x7fa85414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 >> 172.21.15.150:0/2112700726 conn(0x7fa8540c92f0 msgr2=0x7fa854063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 shutdown_connections 2022-08-10T17:38:14.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.511+0000 7fa85c762700 1 -- 172.21.15.150:0/2112700726 wait complete. 2022-08-10T17:38:14.523 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:38:14.527 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2022-08-10T17:38:13.260712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597583,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70976,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":68160,"kb_avail":754903744,"statfs":{"total":773094113280,"available":773021433856,"internally_reserved":0,"allocated":2818048,"data_stored":2264686,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69795840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2684,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003418"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885839+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:38:04.885839+0000","last_peered":"2022-08-10T17:38:04.885839+0000","last_clean":"2022-08-10T17:38:04.885839+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:38:04.885839+0000","last_undegraded":"2022-08-10T17:38:04.885839+0000","last_fullsized":"2022-08-10T17:38:04.885839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885117+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:38:04.885117+0000","last_peered":"2022-08-10T17:38:04.885117+0000","last_clean":"2022-08-10T17:38:04.885117+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:38:04.885117+0000","last_undegraded":"2022-08-10T17:38:04.885117+0000","last_fullsized":"2022-08-10T17:38:04.885117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.234808+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:19.234808+0000","last_peered":"2022-08-10T17:36:19.234808+0000","last_clean":"2022-08-10T17:36:19.234808+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:19.234808+0000","last_undegraded":"2022-08-10T17:36:19.234808+0000","last_fullsized":"2022-08-10T17:36:19.234808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859324+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:37:58.859324+0000","last_peered":"2022-08-10T17:37:58.859324+0000","last_clean":"2022-08-10T17:37:58.859324+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:37:58.859324+0000","last_undegraded":"2022-08-10T17:37:58.859324+0000","last_fullsized":"2022-08-10T17:37:58.859324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.958567+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:18.958567+0000","last_peered":"2022-08-10T17:36:18.958567+0000","last_clean":"2022-08-10T17:36:18.958567+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:18.958567+0000","last_undegraded":"2022-08-10T17:36:18.958567+0000","last_fullsized":"2022-08-10T17:36:18.958567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.861305+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:58.861305+0000","last_peered":"2022-08-10T17:37:58.861305+0000","last_clean":"2022-08-10T17:37:58.861305+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:58.861305+0000","last_undegraded":"2022-08-10T17:37:58.861305+0000","last_fullsized":"2022-08-10T17:37:58.861305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.886940+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.886940+0000","last_peered":"2022-08-10T17:38:04.886940+0000","last_clean":"2022-08-10T17:38:04.886940+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.886940+0000","last_undegraded":"2022-08-10T17:38:04.886940+0000","last_fullsized":"2022-08-10T17:38:04.886940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.860606+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:37:58.860606+0000","last_peered":"2022-08-10T17:37:58.860606+0000","last_clean":"2022-08-10T17:37:58.860606+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:37:58.860606+0000","last_undegraded":"2022-08-10T17:37:58.860606+0000","last_fullsized":"2022-08-10T17:37:58.860606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887462+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:38:04.887462+0000","last_peered":"2022-08-10T17:38:04.887462+0000","last_clean":"2022-08-10T17:38:04.887462+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:38:04.887462+0000","last_undegraded":"2022-08-10T17:38:04.887462+0000","last_fullsized":"2022-08-10T17:38:04.887462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'15","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.890483+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:38:04.890483+0000","last_peered":"2022-08-10T17:38:04.890483+0000","last_clean":"2022-08-10T17:38:04.890483+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:38:04.890483+0000","last_undegraded":"2022-08-10T17:38:04.890483+0000","last_fullsized":"2022-08-10T17:38:04.890483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.958839+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:18.958839+0000","last_peered":"2022-08-10T17:36:18.958839+0000","last_clean":"2022-08-10T17:36:18.958839+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:18.958839+0000","last_undegraded":"2022-08-10T17:36:18.958839+0000","last_fullsized":"2022-08-10T17:36:18.958839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885617+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:38:04.885617+0000","last_peered":"2022-08-10T17:38:04.885617+0000","last_clean":"2022-08-10T17:38:04.885617+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:38:04.885617+0000","last_undegraded":"2022-08-10T17:38:04.885617+0000","last_fullsized":"2022-08-10T17:38:04.885617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.858659+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:37:58.858659+0000","last_peered":"2022-08-10T17:37:58.858659+0000","last_clean":"2022-08-10T17:37:58.858659+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:37:58.858659+0000","last_undegraded":"2022-08-10T17:37:58.858659+0000","last_fullsized":"2022-08-10T17:37:58.858659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:20.058646+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:20.058646+0000","last_peered":"2022-08-10T17:36:20.058646+0000","last_clean":"2022-08-10T17:36:20.058646+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:20.058646+0000","last_undegraded":"2022-08-10T17:36:20.058646+0000","last_fullsized":"2022-08-10T17:36:20.058646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.861471+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:37:58.861471+0000","last_peered":"2022-08-10T17:37:58.861471+0000","last_clean":"2022-08-10T17:37:58.861471+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:37:58.861471+0000","last_undegraded":"2022-08-10T17:37:58.861471+0000","last_fullsized":"2022-08-10T17:37:58.861471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.858727+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:37:58.858727+0000","last_peered":"2022-08-10T17:37:58.858727+0000","last_clean":"2022-08-10T17:37:58.858727+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:37:58.858727+0000","last_undegraded":"2022-08-10T17:37:58.858727+0000","last_fullsized":"2022-08-10T17:37:58.858727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057695+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:19.057695+0000","last_peered":"2022-08-10T17:36:19.057695+0000","last_clean":"2022-08-10T17:36:19.057695+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:19.057695+0000","last_undegraded":"2022-08-10T17:36:19.057695+0000","last_fullsized":"2022-08-10T17:36:19.057695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.863825+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:37:58.863825+0000","last_peered":"2022-08-10T17:37:58.863825+0000","last_clean":"2022-08-10T17:37:58.863825+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:37:58.863825+0000","last_undegraded":"2022-08-10T17:37:58.863825+0000","last_fullsized":"2022-08-10T17:37:58.863825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885153+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:38:04.885153+0000","last_peered":"2022-08-10T17:38:04.885153+0000","last_clean":"2022-08-10T17:38:04.885153+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:38:04.885153+0000","last_undegraded":"2022-08-10T17:38:04.885153+0000","last_fullsized":"2022-08-10T17:38:04.885153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.235014+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:19.235014+0000","last_peered":"2022-08-10T17:36:19.235014+0000","last_clean":"2022-08-10T17:36:19.235014+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:19.235014+0000","last_undegraded":"2022-08-10T17:36:19.235014+0000","last_fullsized":"2022-08-10T17:36:19.235014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.886998+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:38:04.886998+0000","last_peered":"2022-08-10T17:38:04.886998+0000","last_clean":"2022-08-10T17:38:04.886998+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:38:04.886998+0000","last_undegraded":"2022-08-10T17:38:04.886998+0000","last_fullsized":"2022-08-10T17:38:04.886998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859637+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:37:58.859637+0000","last_peered":"2022-08-10T17:37:58.859637+0000","last_clean":"2022-08-10T17:37:58.859637+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:37:58.859637+0000","last_undegraded":"2022-08-10T17:37:58.859637+0000","last_fullsized":"2022-08-10T17:37:58.859637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885811+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:38:04.885811+0000","last_peered":"2022-08-10T17:38:04.885811+0000","last_clean":"2022-08-10T17:38:04.885811+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:38:04.885811+0000","last_undegraded":"2022-08-10T17:38:04.885811+0000","last_fullsized":"2022-08-10T17:38:04.885811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.862044+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:37:58.862044+0000","last_peered":"2022-08-10T17:37:58.862044+0000","last_clean":"2022-08-10T17:37:58.862044+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:37:58.862044+0000","last_undegraded":"2022-08-10T17:37:58.862044+0000","last_fullsized":"2022-08-10T17:37:58.862044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887027+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:38:04.887027+0000","last_peered":"2022-08-10T17:38:04.887027+0000","last_clean":"2022-08-10T17:38:04.887027+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:38:04.887027+0000","last_undegraded":"2022-08-10T17:38:04.887027+0000","last_fullsized":"2022-08-10T17:38:04.887027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.235283+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:19.235283+0000","last_peered":"2022-08-10T17:36:19.235283+0000","last_clean":"2022-08-10T17:36:19.235283+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:19.235283+0000","last_undegraded":"2022-08-10T17:36:19.235283+0000","last_fullsized":"2022-08-10T17:36:19.235283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.890251+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:38:04.890251+0000","last_peered":"2022-08-10T17:38:04.890251+0000","last_clean":"2022-08-10T17:38:04.890251+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:38:04.890251+0000","last_undegraded":"2022-08-10T17:38:04.890251+0000","last_fullsized":"2022-08-10T17:38:04.890251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7215,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9312,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362528,"statfs":{"total":96636764160,"available":96627228672,"internally_reserved":0,"allocated":417792,"data_stored":729129,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.503}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58299999999999996}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.65700000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82299999999999995}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.95999999999999996}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.93000000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9308,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362532,"statfs":{"total":96636764160,"available":96627232768,"internally_reserved":0,"allocated":413696,"data_stored":725524,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.753}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.22700000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8780,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363060,"statfs":{"total":96636764160,"available":96627773440,"internally_reserved":0,"allocated":331776,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":2.5630000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":2.5859999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":2.6160000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":2.8340000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":3.089},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":2.9340000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":3.1059999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":3.048}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":3.1269999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":3.0030000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":3.024},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":3.0630000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":2.96},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":2.9889999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8808,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363032,"statfs":{"total":96636764160,"available":96627744768,"internally_reserved":0,"allocated":360448,"data_stored":138823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48599999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8720,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363120,"statfs":{"total":96636764160,"available":96627834880,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.378}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.434},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:38:14.536 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:38:14.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.683+0000 7f18dedcb700 1 Processor -- start 2022-08-10T17:38:14.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.683+0000 7f18dedcb700 1 -- start start 2022-08-10T17:38:14.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dedcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 0x7f18d80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dedcb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f18d8158170 0x7f18d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dedcb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d80c1f40 con 0x7f18d8157780 2022-08-10T17:38:14.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dedcb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80c7d90 con 0x7f18d8158170 2022-08-10T17:38:14.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dedcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8069130 con 0x7f18d8151290 2022-08-10T17:38:14.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dcb67700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 0x7f18d80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dd368700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f18d8157780 0x7f18d80c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:57866/0 (socket says 172.21.15.150:57866) 2022-08-10T17:38:14.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18d7fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f18d8158170 0x7f18d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.684+0000 7f18dd368700 1 -- 172.21.15.150:0/2799897404 learned_addr learned my addr 172.21.15.150:0/2799897404 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:14.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d77fe700 1 -- 172.21.15.150:0/2799897404 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272623134 0 0) 0x7f18d80c1f40 con 0x7f18d8157780 2022-08-10T17:38:14.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d77fe700 1 -- 172.21.15.150:0/2799897404 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18bc003430 con 0x7f18d8157780 2022-08-10T17:38:14.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d7fff700 1 -- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 msgr2=0x7f18d80c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:14.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d7fff700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 0x7f18d80c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d7fff700 1 -- 172.21.15.150:0/2799897404 >> v1:172.21.15.197:6789/0 conn(0x7f18d8157780 legacy=0x7f18d80c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d7fff700 1 -- 172.21.15.150:0/2799897404 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80c2220 con 0x7f18d8158170 2022-08-10T17:38:14.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18dcb67700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 0x7f18d80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:14.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d7fff700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8158170 0x7f18d8068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18c40096e0 tx=0x7f18c40099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a066e1e903735ba server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d77fe700 1 -- 172.21.15.150:0/2799897404 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40107b0 con 0x7f18d8158170 2022-08-10T17:38:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d77fe700 1 -- 172.21.15.150:0/2799897404 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4010910 con 0x7f18d8158170 2022-08-10T17:38:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18d77fe700 1 -- 172.21.15.150:0/2799897404 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4010cc0 con 0x7f18d8158170 2022-08-10T17:38:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18dedcb700 1 -- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8158170 msgr2=0x7f18d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.685+0000 7f18dedcb700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8158170 0x7f18d8068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18c40096e0 tx=0x7f18c40099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 -- 172.21.15.150:0/2799897404 shutdown_connections 2022-08-10T17:38:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8151290 0x7f18d80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 --2- 172.21.15.150:0/2799897404 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8158170 0x7f18d8068bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 -- 172.21.15.150:0/2799897404 >> 172.21.15.150:0/2799897404 conn(0x7f18d806f880 msgr2=0x7f18d806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 -- 172.21.15.150:0/2799897404 shutdown_connections 2022-08-10T17:38:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.686+0000 7f18dedcb700 1 -- 172.21.15.150:0/2799897404 wait complete. 2022-08-10T17:38:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.687+0000 7f18dedcb700 1 Processor -- start 2022-08-10T17:38:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.687+0000 7f18dedcb700 1 -- start start 2022-08-10T17:38:14.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8151290 0x7f18d80c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8157780 0x7f18d814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c9330 con 0x7f18d8158170 2022-08-10T17:38:14.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8149e20 con 0x7f18d8151290 2022-08-10T17:38:14.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dedcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d814e6b0 con 0x7f18d8157780 2022-08-10T17:38:14.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dd368700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dd368700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58840/0 (socket says 172.21.15.150:58840) 2022-08-10T17:38:14.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dd368700 1 -- 172.21.15.150:0/3186828380 learned_addr learned my addr 172.21.15.150:0/3186828380 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:14.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18dcb67700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8151290 0x7f18d80c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.688+0000 7f18d7fff700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8157780 0x7f18d814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 -- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8157780 msgr2=0x7f18d814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8157780 0x7f18d814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 -- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8151290 msgr2=0x7f18d80c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8151290 0x7f18d80c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 -- 172.21.15.150:0/3186828380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0092b0 con 0x7f18d8158170 2022-08-10T17:38:14.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dd368700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c730 tx=0x7f18d000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00070f0 con 0x7f18d8158170 2022-08-10T17:38:14.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0007250 con 0x7f18d8158170 2022-08-10T17:38:14.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c4009310 con 0x7f18d8158170 2022-08-10T17:38:14.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0007600 con 0x7f18d8158170 2022-08-10T17:38:14.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.689+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81ed650 con 0x7f18d8158170 2022-08-10T17:38:14.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.690+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8070610 con 0x7f18d8158170 2022-08-10T17:38:14.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.690+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f18d0019030 con 0x7f18d8158170 2022-08-10T17:38:14.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.691+0000 7f18d57fa700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 0x7f18c0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:14.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.691+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f18d0081780 con 0x7f18d8158170 2022-08-10T17:38:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.691+0000 7f18dcb67700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 0x7f18c0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.691+0000 7f18dcb67700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 0x7f18c0067560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009ac0 tx=0x7f18cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.695+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f18d004f700 con 0x7f18d8158170 2022-08-10T17:38:14.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.869+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18d8145630 con 0x7f18c00650b0 2022-08-10T17:38:14.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.881+0000 7f18d57fa700 1 -- 172.21.15.150:0/3186828380 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392599 (secure 0 0 0) 0x7f18d8145630 con 0x7f18c00650b0 2022-08-10T17:38:14.890 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:14.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 msgr2=0x7f18c0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 0x7f18c0067560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009ac0 tx=0x7f18cc008040 comp rx=0 tx=0).stop 2022-08-10T17:38:14.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 msgr2=0x7f18d814a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:14.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c730 tx=0x7f18d000caf0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 shutdown_connections 2022-08-10T17:38:14.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d8158170 0x7f18d814a240 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18d8151290 0x7f18d80c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f18c00650b0 0x7f18c0067560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 --2- 172.21.15.150:0/3186828380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f18d8157780 0x7f18d814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:14.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.884+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 >> 172.21.15.150:0/3186828380 conn(0x7f18d806f880 msgr2=0x7f18d814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:14.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.885+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 shutdown_connections 2022-08-10T17:38:14.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:14.885+0000 7f18dedcb700 1 -- 172.21.15.150:0/3186828380 wait complete. 2022-08-10T17:38:14.897 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:38:14.900 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2022-08-10T17:38:13.260712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597583,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70976,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":68160,"kb_avail":754903744,"statfs":{"total":773094113280,"available":773021433856,"internally_reserved":0,"allocated":2818048,"data_stored":2264686,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69795840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2684,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003418"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679818+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:36:17.679818+0000","last_peered":"2022-08-10T17:36:17.679818+0000","last_clean":"2022-08-10T17:36:17.679818+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:36:17.679818+0000","last_undegraded":"2022-08-10T17:36:17.679818+0000","last_fullsized":"2022-08-10T17:36:17.679818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673843+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:36:17.673843+0000","last_peered":"2022-08-10T17:36:17.673843+0000","last_clean":"2022-08-10T17:36:17.673843+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:36:17.673843+0000","last_undegraded":"2022-08-10T17:36:17.673843+0000","last_fullsized":"2022-08-10T17:36:17.673843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674844+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:36:17.674844+0000","last_peered":"2022-08-10T17:36:17.674844+0000","last_clean":"2022-08-10T17:36:17.674844+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:36:17.674844+0000","last_undegraded":"2022-08-10T17:36:17.674844+0000","last_fullsized":"2022-08-10T17:36:17.674844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690389+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:36:17.690389+0000","last_peered":"2022-08-10T17:36:17.690389+0000","last_clean":"2022-08-10T17:36:17.690389+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:36:17.690389+0000","last_undegraded":"2022-08-10T17:36:17.690389+0000","last_fullsized":"2022-08-10T17:36:17.690389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690182+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:36:17.690182+0000","last_peered":"2022-08-10T17:36:17.690182+0000","last_clean":"2022-08-10T17:36:17.690182+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:36:17.690182+0000","last_undegraded":"2022-08-10T17:36:17.690182+0000","last_fullsized":"2022-08-10T17:36:17.690182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674542+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:36:17.674542+0000","last_peered":"2022-08-10T17:36:17.674542+0000","last_clean":"2022-08-10T17:36:17.674542+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:36:17.674542+0000","last_undegraded":"2022-08-10T17:36:17.674542+0000","last_fullsized":"2022-08-10T17:36:17.674542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690310+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:36:17.690310+0000","last_peered":"2022-08-10T17:36:17.690310+0000","last_clean":"2022-08-10T17:36:17.690310+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:36:17.690310+0000","last_undegraded":"2022-08-10T17:36:17.690310+0000","last_fullsized":"2022-08-10T17:36:17.690310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673426+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:36:17.673426+0000","last_peered":"2022-08-10T17:36:17.673426+0000","last_clean":"2022-08-10T17:36:17.673426+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:36:17.673426+0000","last_undegraded":"2022-08-10T17:36:17.673426+0000","last_fullsized":"2022-08-10T17:36:17.673426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690192+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:36:17.690192+0000","last_peered":"2022-08-10T17:36:17.690192+0000","last_clean":"2022-08-10T17:36:17.690192+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:36:17.690192+0000","last_undegraded":"2022-08-10T17:36:17.690192+0000","last_fullsized":"2022-08-10T17:36:17.690192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674065+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:36:17.674065+0000","last_peered":"2022-08-10T17:36:17.674065+0000","last_clean":"2022-08-10T17:36:17.674065+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:36:17.674065+0000","last_undegraded":"2022-08-10T17:36:17.674065+0000","last_fullsized":"2022-08-10T17:36:17.674065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674965+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:36:17.674965+0000","last_peered":"2022-08-10T17:36:17.674965+0000","last_clean":"2022-08-10T17:36:17.674965+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:36:17.674965+0000","last_undegraded":"2022-08-10T17:36:17.674965+0000","last_fullsized":"2022-08-10T17:36:17.674965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679732+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:36:17.679732+0000","last_peered":"2022-08-10T17:36:17.679732+0000","last_clean":"2022-08-10T17:36:17.679732+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:36:17.679732+0000","last_undegraded":"2022-08-10T17:36:17.679732+0000","last_fullsized":"2022-08-10T17:36:17.679732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679549+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:36:17.679549+0000","last_peered":"2022-08-10T17:36:17.679549+0000","last_clean":"2022-08-10T17:36:17.679549+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:36:17.679549+0000","last_undegraded":"2022-08-10T17:36:17.679549+0000","last_fullsized":"2022-08-10T17:36:17.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673672+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:36:17.673672+0000","last_peered":"2022-08-10T17:36:17.673672+0000","last_clean":"2022-08-10T17:36:17.673672+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:36:17.673672+0000","last_undegraded":"2022-08-10T17:36:17.673672+0000","last_fullsized":"2022-08-10T17:36:17.673672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690097+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:36:17.690097+0000","last_peered":"2022-08-10T17:36:17.690097+0000","last_clean":"2022-08-10T17:36:17.690097+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:36:17.690097+0000","last_undegraded":"2022-08-10T17:36:17.690097+0000","last_fullsized":"2022-08-10T17:36:17.690097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674186+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:36:17.674186+0000","last_peered":"2022-08-10T17:36:17.674186+0000","last_clean":"2022-08-10T17:36:17.674186+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:36:17.674186+0000","last_undegraded":"2022-08-10T17:36:17.674186+0000","last_fullsized":"2022-08-10T17:36:17.674186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690290+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:36:17.690290+0000","last_peered":"2022-08-10T17:36:17.690290+0000","last_clean":"2022-08-10T17:36:17.690290+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:36:17.690290+0000","last_undegraded":"2022-08-10T17:36:17.690290+0000","last_fullsized":"2022-08-10T17:36:17.690290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675056+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:36:17.675056+0000","last_peered":"2022-08-10T17:36:17.675056+0000","last_clean":"2022-08-10T17:36:17.675056+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:36:17.675056+0000","last_undegraded":"2022-08-10T17:36:17.675056+0000","last_fullsized":"2022-08-10T17:36:17.675056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679427+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:36:17.679427+0000","last_peered":"2022-08-10T17:36:17.679427+0000","last_clean":"2022-08-10T17:36:17.679427+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:36:17.679427+0000","last_undegraded":"2022-08-10T17:36:17.679427+0000","last_fullsized":"2022-08-10T17:36:17.679427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674739+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:36:17.674739+0000","last_peered":"2022-08-10T17:36:17.674739+0000","last_clean":"2022-08-10T17:36:17.674739+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:36:17.674739+0000","last_undegraded":"2022-08-10T17:36:17.674739+0000","last_fullsized":"2022-08-10T17:36:17.674739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690684+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:36:17.690684+0000","last_peered":"2022-08-10T17:36:17.690684+0000","last_clean":"2022-08-10T17:36:17.690684+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:36:17.690684+0000","last_undegraded":"2022-08-10T17:36:17.690684+0000","last_fullsized":"2022-08-10T17:36:17.690684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689871+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:36:17.689871+0000","last_peered":"2022-08-10T17:36:17.689871+0000","last_clean":"2022-08-10T17:36:17.689871+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:36:17.689871+0000","last_undegraded":"2022-08-10T17:36:17.689871+0000","last_fullsized":"2022-08-10T17:36:17.689871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675630+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:36:17.675630+0000","last_peered":"2022-08-10T17:36:17.675630+0000","last_clean":"2022-08-10T17:36:17.675630+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:36:17.675630+0000","last_undegraded":"2022-08-10T17:36:17.675630+0000","last_fullsized":"2022-08-10T17:36:17.675630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690209+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:36:17.690209+0000","last_peered":"2022-08-10T17:36:17.690209+0000","last_clean":"2022-08-10T17:36:17.690209+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:36:17.690209+0000","last_undegraded":"2022-08-10T17:36:17.690209+0000","last_fullsized":"2022-08-10T17:36:17.690209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681933+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:36:17.681933+0000","last_peered":"2022-08-10T17:36:17.681933+0000","last_clean":"2022-08-10T17:36:17.681933+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:36:17.681933+0000","last_undegraded":"2022-08-10T17:36:17.681933+0000","last_fullsized":"2022-08-10T17:36:17.681933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681872+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:36:17.681872+0000","last_peered":"2022-08-10T17:36:17.681872+0000","last_clean":"2022-08-10T17:36:17.681872+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:36:17.681872+0000","last_undegraded":"2022-08-10T17:36:17.681872+0000","last_fullsized":"2022-08-10T17:36:17.681872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674271+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:36:17.674271+0000","last_peered":"2022-08-10T17:36:17.674271+0000","last_clean":"2022-08-10T17:36:17.674271+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:36:17.674271+0000","last_undegraded":"2022-08-10T17:36:17.674271+0000","last_fullsized":"2022-08-10T17:36:17.674271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674908+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:36:17.674908+0000","last_peered":"2022-08-10T17:36:17.674908+0000","last_clean":"2022-08-10T17:36:17.674908+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:36:17.674908+0000","last_undegraded":"2022-08-10T17:36:17.674908+0000","last_fullsized":"2022-08-10T17:36:17.674908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885839+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:38:04.885839+0000","last_peered":"2022-08-10T17:38:04.885839+0000","last_clean":"2022-08-10T17:38:04.885839+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:38:04.885839+0000","last_undegraded":"2022-08-10T17:38:04.885839+0000","last_fullsized":"2022-08-10T17:38:04.885839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676181+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:36:17.676181+0000","last_peered":"2022-08-10T17:36:17.676181+0000","last_clean":"2022-08-10T17:36:17.676181+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:36:17.676181+0000","last_undegraded":"2022-08-10T17:36:17.676181+0000","last_fullsized":"2022-08-10T17:36:17.676181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690431+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:36:17.690431+0000","last_peered":"2022-08-10T17:36:17.690431+0000","last_clean":"2022-08-10T17:36:17.690431+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:36:17.690431+0000","last_undegraded":"2022-08-10T17:36:17.690431+0000","last_fullsized":"2022-08-10T17:36:17.690431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885117+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:38:04.885117+0000","last_peered":"2022-08-10T17:38:04.885117+0000","last_clean":"2022-08-10T17:38:04.885117+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:38:04.885117+0000","last_undegraded":"2022-08-10T17:38:04.885117+0000","last_fullsized":"2022-08-10T17:38:04.885117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690323+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:36:17.690323+0000","last_peered":"2022-08-10T17:36:17.690323+0000","last_clean":"2022-08-10T17:36:17.690323+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:36:17.690323+0000","last_undegraded":"2022-08-10T17:36:17.690323+0000","last_fullsized":"2022-08-10T17:36:17.690323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690404+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:36:17.690404+0000","last_peered":"2022-08-10T17:36:17.690404+0000","last_clean":"2022-08-10T17:36:17.690404+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:36:17.690404+0000","last_undegraded":"2022-08-10T17:36:17.690404+0000","last_fullsized":"2022-08-10T17:36:17.690404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.234808+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:19.234808+0000","last_peered":"2022-08-10T17:36:19.234808+0000","last_clean":"2022-08-10T17:36:19.234808+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:19.234808+0000","last_undegraded":"2022-08-10T17:36:19.234808+0000","last_fullsized":"2022-08-10T17:36:19.234808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690600+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:36:17.690600+0000","last_peered":"2022-08-10T17:36:17.690600+0000","last_clean":"2022-08-10T17:36:17.690600+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:36:17.690600+0000","last_undegraded":"2022-08-10T17:36:17.690600+0000","last_fullsized":"2022-08-10T17:36:17.690600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690816+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:36:17.690816+0000","last_peered":"2022-08-10T17:36:17.690816+0000","last_clean":"2022-08-10T17:36:17.690816+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:36:17.690816+0000","last_undegraded":"2022-08-10T17:36:17.690816+0000","last_fullsized":"2022-08-10T17:36:17.690816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859324+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:37:58.859324+0000","last_peered":"2022-08-10T17:37:58.859324+0000","last_clean":"2022-08-10T17:37:58.859324+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:37:58.859324+0000","last_undegraded":"2022-08-10T17:37:58.859324+0000","last_fullsized":"2022-08-10T17:37:58.859324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675877+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:36:17.675877+0000","last_peered":"2022-08-10T17:36:17.675877+0000","last_clean":"2022-08-10T17:36:17.675877+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:36:17.675877+0000","last_undegraded":"2022-08-10T17:36:17.675877+0000","last_fullsized":"2022-08-10T17:36:17.675877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689843+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:36:17.689843+0000","last_peered":"2022-08-10T17:36:17.689843+0000","last_clean":"2022-08-10T17:36:17.689843+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:36:17.689843+0000","last_undegraded":"2022-08-10T17:36:17.689843+0000","last_fullsized":"2022-08-10T17:36:17.689843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675667+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:36:17.675667+0000","last_peered":"2022-08-10T17:36:17.675667+0000","last_clean":"2022-08-10T17:36:17.675667+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:36:17.675667+0000","last_undegraded":"2022-08-10T17:36:17.675667+0000","last_fullsized":"2022-08-10T17:36:17.675667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675931+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:36:17.675931+0000","last_peered":"2022-08-10T17:36:17.675931+0000","last_clean":"2022-08-10T17:36:17.675931+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:36:17.675931+0000","last_undegraded":"2022-08-10T17:36:17.675931+0000","last_fullsized":"2022-08-10T17:36:17.675931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.958567+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:36:18.958567+0000","last_peered":"2022-08-10T17:36:18.958567+0000","last_clean":"2022-08-10T17:36:18.958567+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:36:18.958567+0000","last_undegraded":"2022-08-10T17:36:18.958567+0000","last_fullsized":"2022-08-10T17:36:18.958567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681436+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:36:17.681436+0000","last_peered":"2022-08-10T17:36:17.681436+0000","last_clean":"2022-08-10T17:36:17.681436+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:36:17.681436+0000","last_undegraded":"2022-08-10T17:36:17.681436+0000","last_fullsized":"2022-08-10T17:36:17.681436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681060+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:36:17.681060+0000","last_peered":"2022-08-10T17:36:17.681060+0000","last_clean":"2022-08-10T17:36:17.681060+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:36:17.681060+0000","last_undegraded":"2022-08-10T17:36:17.681060+0000","last_fullsized":"2022-08-10T17:36:17.681060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'12","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.861305+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:37:58.861305+0000","last_peered":"2022-08-10T17:37:58.861305+0000","last_clean":"2022-08-10T17:37:58.861305+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:37:58.861305+0000","last_undegraded":"2022-08-10T17:37:58.861305+0000","last_fullsized":"2022-08-10T17:37:58.861305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674785+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:36:17.674785+0000","last_peered":"2022-08-10T17:36:17.674785+0000","last_clean":"2022-08-10T17:36:17.674785+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:36:17.674785+0000","last_undegraded":"2022-08-10T17:36:17.674785+0000","last_fullsized":"2022-08-10T17:36:17.674785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674279+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:36:17.674279+0000","last_peered":"2022-08-10T17:36:17.674279+0000","last_clean":"2022-08-10T17:36:17.674279+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:36:17.674279+0000","last_undegraded":"2022-08-10T17:36:17.674279+0000","last_fullsized":"2022-08-10T17:36:17.674279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.886940+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.886940+0000","last_peered":"2022-08-10T17:38:04.886940+0000","last_clean":"2022-08-10T17:38:04.886940+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.886940+0000","last_undegraded":"2022-08-10T17:38:04.886940+0000","last_fullsized":"2022-08-10T17:38:04.886940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675954+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:36:17.675954+0000","last_peered":"2022-08-10T17:36:17.675954+0000","last_clean":"2022-08-10T17:36:17.675954+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:36:17.675954+0000","last_undegraded":"2022-08-10T17:36:17.675954+0000","last_fullsized":"2022-08-10T17:36:17.675954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675737+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:36:17.675737+0000","last_peered":"2022-08-10T17:36:17.675737+0000","last_clean":"2022-08-10T17:36:17.675737+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:36:17.675737+0000","last_undegraded":"2022-08-10T17:36:17.675737+0000","last_fullsized":"2022-08-10T17:36:17.675737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.860606+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:37:58.860606+0000","last_peered":"2022-08-10T17:37:58.860606+0000","last_clean":"2022-08-10T17:37:58.860606+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:37:58.860606+0000","last_undegraded":"2022-08-10T17:37:58.860606+0000","last_fullsized":"2022-08-10T17:37:58.860606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673924+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:36:17.673924+0000","last_peered":"2022-08-10T17:36:17.673924+0000","last_clean":"2022-08-10T17:36:17.673924+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:36:17.673924+0000","last_undegraded":"2022-08-10T17:36:17.673924+0000","last_fullsized":"2022-08-10T17:36:17.673924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676338+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:36:17.676338+0000","last_peered":"2022-08-10T17:36:17.676338+0000","last_clean":"2022-08-10T17:36:17.676338+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:36:17.676338+0000","last_undegraded":"2022-08-10T17:36:17.676338+0000","last_fullsized":"2022-08-10T17:36:17.676338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887462+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:38:04.887462+0000","last_peered":"2022-08-10T17:38:04.887462+0000","last_clean":"2022-08-10T17:38:04.887462+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:38:04.887462+0000","last_undegraded":"2022-08-10T17:38:04.887462+0000","last_fullsized":"2022-08-10T17:38:04.887462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690410+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:36:17.690410+0000","last_peered":"2022-08-10T17:36:17.690410+0000","last_clean":"2022-08-10T17:36:17.690410+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:36:17.690410+0000","last_undegraded":"2022-08-10T17:36:17.690410+0000","last_fullsized":"2022-08-10T17:36:17.690410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673618+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:36:17.673618+0000","last_peered":"2022-08-10T17:36:17.673618+0000","last_clean":"2022-08-10T17:36:17.673618+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:36:17.673618+0000","last_undegraded":"2022-08-10T17:36:17.673618+0000","last_fullsized":"2022-08-10T17:36:17.673618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'15","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.890483+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:38:04.890483+0000","last_peered":"2022-08-10T17:38:04.890483+0000","last_clean":"2022-08-10T17:38:04.890483+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:38:04.890483+0000","last_undegraded":"2022-08-10T17:38:04.890483+0000","last_fullsized":"2022-08-10T17:38:04.890483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676371+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:36:17.676371+0000","last_peered":"2022-08-10T17:36:17.676371+0000","last_clean":"2022-08-10T17:36:17.676371+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:36:17.676371+0000","last_undegraded":"2022-08-10T17:36:17.676371+0000","last_fullsized":"2022-08-10T17:36:17.676371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690413+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:36:17.690413+0000","last_peered":"2022-08-10T17:36:17.690413+0000","last_clean":"2022-08-10T17:36:17.690413+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:36:17.690413+0000","last_undegraded":"2022-08-10T17:36:17.690413+0000","last_fullsized":"2022-08-10T17:36:17.690413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.958839+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:36:18.958839+0000","last_peered":"2022-08-10T17:36:18.958839+0000","last_clean":"2022-08-10T17:36:18.958839+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:36:18.958839+0000","last_undegraded":"2022-08-10T17:36:18.958839+0000","last_fullsized":"2022-08-10T17:36:18.958839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673377+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:36:17.673377+0000","last_peered":"2022-08-10T17:36:17.673377+0000","last_clean":"2022-08-10T17:36:17.673377+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:36:17.673377+0000","last_undegraded":"2022-08-10T17:36:17.673377+0000","last_fullsized":"2022-08-10T17:36:17.673377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679087+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:36:17.679087+0000","last_peered":"2022-08-10T17:36:17.679087+0000","last_clean":"2022-08-10T17:36:17.679087+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:36:17.679087+0000","last_undegraded":"2022-08-10T17:36:17.679087+0000","last_fullsized":"2022-08-10T17:36:17.679087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690646+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:36:17.690646+0000","last_peered":"2022-08-10T17:36:17.690646+0000","last_clean":"2022-08-10T17:36:17.690646+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:36:17.690646+0000","last_undegraded":"2022-08-10T17:36:17.690646+0000","last_fullsized":"2022-08-10T17:36:17.690646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673598+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:36:17.673598+0000","last_peered":"2022-08-10T17:36:17.673598+0000","last_clean":"2022-08-10T17:36:17.673598+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:36:17.673598+0000","last_undegraded":"2022-08-10T17:36:17.673598+0000","last_fullsized":"2022-08-10T17:36:17.673598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679333+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:36:17.679333+0000","last_peered":"2022-08-10T17:36:17.679333+0000","last_clean":"2022-08-10T17:36:17.679333+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:36:17.679333+0000","last_undegraded":"2022-08-10T17:36:17.679333+0000","last_fullsized":"2022-08-10T17:36:17.679333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'1","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.691045+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:36:17.691045+0000","last_peered":"2022-08-10T17:36:17.691045+0000","last_clean":"2022-08-10T17:36:17.691045+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:36:17.691045+0000","last_undegraded":"2022-08-10T17:36:17.691045+0000","last_fullsized":"2022-08-10T17:36:17.691045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690634+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:36:17.690634+0000","last_peered":"2022-08-10T17:36:17.690634+0000","last_clean":"2022-08-10T17:36:17.690634+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:36:17.690634+0000","last_undegraded":"2022-08-10T17:36:17.690634+0000","last_fullsized":"2022-08-10T17:36:17.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679391+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:36:17.679391+0000","last_peered":"2022-08-10T17:36:17.679391+0000","last_clean":"2022-08-10T17:36:17.679391+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:36:17.679391+0000","last_undegraded":"2022-08-10T17:36:17.679391+0000","last_fullsized":"2022-08-10T17:36:17.679391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885617+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:38:04.885617+0000","last_peered":"2022-08-10T17:38:04.885617+0000","last_clean":"2022-08-10T17:38:04.885617+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:38:04.885617+0000","last_undegraded":"2022-08-10T17:38:04.885617+0000","last_fullsized":"2022-08-10T17:38:04.885617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690366+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:36:17.690366+0000","last_peered":"2022-08-10T17:36:17.690366+0000","last_clean":"2022-08-10T17:36:17.690366+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:36:17.690366+0000","last_undegraded":"2022-08-10T17:36:17.690366+0000","last_fullsized":"2022-08-10T17:36:17.690366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679520+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:36:17.679520+0000","last_peered":"2022-08-10T17:36:17.679520+0000","last_clean":"2022-08-10T17:36:17.679520+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:36:17.679520+0000","last_undegraded":"2022-08-10T17:36:17.679520+0000","last_fullsized":"2022-08-10T17:36:17.679520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.858659+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:37:58.858659+0000","last_peered":"2022-08-10T17:37:58.858659+0000","last_clean":"2022-08-10T17:37:58.858659+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:37:58.858659+0000","last_undegraded":"2022-08-10T17:37:58.858659+0000","last_fullsized":"2022-08-10T17:37:58.858659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674643+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:36:17.674643+0000","last_peered":"2022-08-10T17:36:17.674643+0000","last_clean":"2022-08-10T17:36:17.674643+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:36:17.674643+0000","last_undegraded":"2022-08-10T17:36:17.674643+0000","last_fullsized":"2022-08-10T17:36:17.674643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681195+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:36:17.681195+0000","last_peered":"2022-08-10T17:36:17.681195+0000","last_clean":"2022-08-10T17:36:17.681195+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:36:17.681195+0000","last_undegraded":"2022-08-10T17:36:17.681195+0000","last_fullsized":"2022-08-10T17:36:17.681195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:20.058646+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:36:20.058646+0000","last_peered":"2022-08-10T17:36:20.058646+0000","last_clean":"2022-08-10T17:36:20.058646+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:36:20.058646+0000","last_undegraded":"2022-08-10T17:36:20.058646+0000","last_fullsized":"2022-08-10T17:36:20.058646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674833+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:36:17.674833+0000","last_peered":"2022-08-10T17:36:17.674833+0000","last_clean":"2022-08-10T17:36:17.674833+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:36:17.674833+0000","last_undegraded":"2022-08-10T17:36:17.674833+0000","last_fullsized":"2022-08-10T17:36:17.674833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673954+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:36:17.673954+0000","last_peered":"2022-08-10T17:36:17.673954+0000","last_clean":"2022-08-10T17:36:17.673954+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:36:17.673954+0000","last_undegraded":"2022-08-10T17:36:17.673954+0000","last_fullsized":"2022-08-10T17:36:17.673954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.861471+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:37:58.861471+0000","last_peered":"2022-08-10T17:37:58.861471+0000","last_clean":"2022-08-10T17:37:58.861471+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:37:58.861471+0000","last_undegraded":"2022-08-10T17:37:58.861471+0000","last_fullsized":"2022-08-10T17:37:58.861471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675161+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:36:17.675161+0000","last_peered":"2022-08-10T17:36:17.675161+0000","last_clean":"2022-08-10T17:36:17.675161+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:36:17.675161+0000","last_undegraded":"2022-08-10T17:36:17.675161+0000","last_fullsized":"2022-08-10T17:36:17.675161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674858+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:36:17.674858+0000","last_peered":"2022-08-10T17:36:17.674858+0000","last_clean":"2022-08-10T17:36:17.674858+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:36:17.674858+0000","last_undegraded":"2022-08-10T17:36:17.674858+0000","last_fullsized":"2022-08-10T17:36:17.674858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.858727+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:37:58.858727+0000","last_peered":"2022-08-10T17:37:58.858727+0000","last_clean":"2022-08-10T17:37:58.858727+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:37:58.858727+0000","last_undegraded":"2022-08-10T17:37:58.858727+0000","last_fullsized":"2022-08-10T17:37:58.858727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.058896+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:36:19.058896+0000","last_peered":"2022-08-10T17:36:19.058896+0000","last_clean":"2022-08-10T17:36:19.058896+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:36:19.058896+0000","last_undegraded":"2022-08-10T17:36:19.058896+0000","last_fullsized":"2022-08-10T17:36:19.058896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690044+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:36:17.690044+0000","last_peered":"2022-08-10T17:36:17.690044+0000","last_clean":"2022-08-10T17:36:17.690044+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:36:17.690044+0000","last_undegraded":"2022-08-10T17:36:17.690044+0000","last_fullsized":"2022-08-10T17:36:17.690044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057695+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:36:19.057695+0000","last_peered":"2022-08-10T17:36:19.057695+0000","last_clean":"2022-08-10T17:36:19.057695+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:36:19.057695+0000","last_undegraded":"2022-08-10T17:36:19.057695+0000","last_fullsized":"2022-08-10T17:36:19.057695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681220+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:36:17.681220+0000","last_peered":"2022-08-10T17:36:17.681220+0000","last_clean":"2022-08-10T17:36:17.681220+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:36:17.681220+0000","last_undegraded":"2022-08-10T17:36:17.681220+0000","last_fullsized":"2022-08-10T17:36:17.681220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690105+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:36:17.690105+0000","last_peered":"2022-08-10T17:36:17.690105+0000","last_clean":"2022-08-10T17:36:17.690105+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:36:17.690105+0000","last_undegraded":"2022-08-10T17:36:17.690105+0000","last_fullsized":"2022-08-10T17:36:17.690105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.863825+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:37:58.863825+0000","last_peered":"2022-08-10T17:37:58.863825+0000","last_clean":"2022-08-10T17:37:58.863825+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:37:58.863825+0000","last_undegraded":"2022-08-10T17:37:58.863825+0000","last_fullsized":"2022-08-10T17:37:58.863825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681343+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:36:17.681343+0000","last_peered":"2022-08-10T17:36:17.681343+0000","last_clean":"2022-08-10T17:36:17.681343+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:36:17.681343+0000","last_undegraded":"2022-08-10T17:36:17.681343+0000","last_fullsized":"2022-08-10T17:36:17.681343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679678+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:36:17.679678+0000","last_peered":"2022-08-10T17:36:17.679678+0000","last_clean":"2022-08-10T17:36:17.679678+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:36:17.679678+0000","last_undegraded":"2022-08-10T17:36:17.679678+0000","last_fullsized":"2022-08-10T17:36:17.679678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885153+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:38:04.885153+0000","last_peered":"2022-08-10T17:38:04.885153+0000","last_clean":"2022-08-10T17:38:04.885153+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:38:04.885153+0000","last_undegraded":"2022-08-10T17:38:04.885153+0000","last_fullsized":"2022-08-10T17:38:04.885153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.682018+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:36:17.682018+0000","last_peered":"2022-08-10T17:36:17.682018+0000","last_clean":"2022-08-10T17:36:17.682018+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:36:17.682018+0000","last_undegraded":"2022-08-10T17:36:17.682018+0000","last_fullsized":"2022-08-10T17:36:17.682018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690650+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:36:17.690650+0000","last_peered":"2022-08-10T17:36:17.690650+0000","last_clean":"2022-08-10T17:36:17.690650+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:36:17.690650+0000","last_undegraded":"2022-08-10T17:36:17.690650+0000","last_fullsized":"2022-08-10T17:36:17.690650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.235014+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:36:19.235014+0000","last_peered":"2022-08-10T17:36:19.235014+0000","last_clean":"2022-08-10T17:36:19.235014+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:36:19.235014+0000","last_undegraded":"2022-08-10T17:36:19.235014+0000","last_fullsized":"2022-08-10T17:36:19.235014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690081+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:36:17.690081+0000","last_peered":"2022-08-10T17:36:17.690081+0000","last_clean":"2022-08-10T17:36:17.690081+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:36:17.690081+0000","last_undegraded":"2022-08-10T17:36:17.690081+0000","last_fullsized":"2022-08-10T17:36:17.690081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673795+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:36:17.673795+0000","last_peered":"2022-08-10T17:36:17.673795+0000","last_clean":"2022-08-10T17:36:17.673795+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:36:17.673795+0000","last_undegraded":"2022-08-10T17:36:17.673795+0000","last_fullsized":"2022-08-10T17:36:17.673795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.886998+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:38:04.886998+0000","last_peered":"2022-08-10T17:38:04.886998+0000","last_clean":"2022-08-10T17:38:04.886998+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:38:04.886998+0000","last_undegraded":"2022-08-10T17:38:04.886998+0000","last_fullsized":"2022-08-10T17:38:04.886998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690108+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:36:17.690108+0000","last_peered":"2022-08-10T17:36:17.690108+0000","last_clean":"2022-08-10T17:36:17.690108+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:36:17.690108+0000","last_undegraded":"2022-08-10T17:36:17.690108+0000","last_fullsized":"2022-08-10T17:36:17.690108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690872+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:36:17.690872+0000","last_peered":"2022-08-10T17:36:17.690872+0000","last_clean":"2022-08-10T17:36:17.690872+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:36:17.690872+0000","last_undegraded":"2022-08-10T17:36:17.690872+0000","last_fullsized":"2022-08-10T17:36:17.690872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690178+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:36:17.690178+0000","last_peered":"2022-08-10T17:36:17.690178+0000","last_clean":"2022-08-10T17:36:17.690178+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:36:17.690178+0000","last_undegraded":"2022-08-10T17:36:17.690178+0000","last_fullsized":"2022-08-10T17:36:17.690178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673617+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:36:17.673617+0000","last_peered":"2022-08-10T17:36:17.673617+0000","last_clean":"2022-08-10T17:36:17.673617+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:36:17.673617+0000","last_undegraded":"2022-08-10T17:36:17.673617+0000","last_fullsized":"2022-08-10T17:36:17.673617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859637+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:37:58.859637+0000","last_peered":"2022-08-10T17:37:58.859637+0000","last_clean":"2022-08-10T17:37:58.859637+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:37:58.859637+0000","last_undegraded":"2022-08-10T17:37:58.859637+0000","last_fullsized":"2022-08-10T17:37:58.859637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675607+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:36:17.675607+0000","last_peered":"2022-08-10T17:36:17.675607+0000","last_clean":"2022-08-10T17:36:17.675607+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:36:17.675607+0000","last_undegraded":"2022-08-10T17:36:17.675607+0000","last_fullsized":"2022-08-10T17:36:17.675607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675461+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:36:17.675461+0000","last_peered":"2022-08-10T17:36:17.675461+0000","last_clean":"2022-08-10T17:36:17.675461+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:36:17.675461+0000","last_undegraded":"2022-08-10T17:36:17.675461+0000","last_fullsized":"2022-08-10T17:36:17.675461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.885811+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:38:04.885811+0000","last_peered":"2022-08-10T17:38:04.885811+0000","last_clean":"2022-08-10T17:38:04.885811+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:38:04.885811+0000","last_undegraded":"2022-08-10T17:38:04.885811+0000","last_fullsized":"2022-08-10T17:38:04.885811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673499+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:36:17.673499+0000","last_peered":"2022-08-10T17:36:17.673499+0000","last_clean":"2022-08-10T17:36:17.673499+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:36:17.673499+0000","last_undegraded":"2022-08-10T17:36:17.673499+0000","last_fullsized":"2022-08-10T17:36:17.673499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681455+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:36:17.681455+0000","last_peered":"2022-08-10T17:36:17.681455+0000","last_clean":"2022-08-10T17:36:17.681455+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:36:17.681455+0000","last_undegraded":"2022-08-10T17:36:17.681455+0000","last_fullsized":"2022-08-10T17:36:17.681455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'5","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.862044+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:37:58.862044+0000","last_peered":"2022-08-10T17:37:58.862044+0000","last_clean":"2022-08-10T17:37:58.862044+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:37:58.862044+0000","last_undegraded":"2022-08-10T17:37:58.862044+0000","last_fullsized":"2022-08-10T17:37:58.862044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679551+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:36:17.679551+0000","last_peered":"2022-08-10T17:36:17.679551+0000","last_clean":"2022-08-10T17:36:17.679551+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:36:17.679551+0000","last_undegraded":"2022-08-10T17:36:17.679551+0000","last_fullsized":"2022-08-10T17:36:17.679551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690240+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:36:17.690240+0000","last_peered":"2022-08-10T17:36:17.690240+0000","last_clean":"2022-08-10T17:36:17.690240+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:36:17.690240+0000","last_undegraded":"2022-08-10T17:36:17.690240+0000","last_fullsized":"2022-08-10T17:36:17.690240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674114+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:17.674114+0000","last_peered":"2022-08-10T17:36:17.674114+0000","last_clean":"2022-08-10T17:36:17.674114+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:17.674114+0000","last_undegraded":"2022-08-10T17:36:17.674114+0000","last_fullsized":"2022-08-10T17:36:17.674114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674582+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:36:17.674582+0000","last_peered":"2022-08-10T17:36:17.674582+0000","last_clean":"2022-08-10T17:36:17.674582+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:36:17.674582+0000","last_undegraded":"2022-08-10T17:36:17.674582+0000","last_fullsized":"2022-08-10T17:36:17.674582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674298+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:36:17.674298+0000","last_peered":"2022-08-10T17:36:17.674298+0000","last_clean":"2022-08-10T17:36:17.674298+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:36:17.674298+0000","last_undegraded":"2022-08-10T17:36:17.674298+0000","last_fullsized":"2022-08-10T17:36:17.674298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887027+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:38:04.887027+0000","last_peered":"2022-08-10T17:38:04.887027+0000","last_clean":"2022-08-10T17:38:04.887027+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:38:04.887027+0000","last_undegraded":"2022-08-10T17:38:04.887027+0000","last_fullsized":"2022-08-10T17:38:04.887027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674161+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:36:17.674161+0000","last_peered":"2022-08-10T17:36:17.674161+0000","last_clean":"2022-08-10T17:36:17.674161+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:36:17.674161+0000","last_undegraded":"2022-08-10T17:36:17.674161+0000","last_fullsized":"2022-08-10T17:36:17.674161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673826+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:36:17.673826+0000","last_peered":"2022-08-10T17:36:17.673826+0000","last_clean":"2022-08-10T17:36:17.673826+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:36:17.673826+0000","last_undegraded":"2022-08-10T17:36:17.673826+0000","last_fullsized":"2022-08-10T17:36:17.673826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.235283+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:36:19.235283+0000","last_peered":"2022-08-10T17:36:19.235283+0000","last_clean":"2022-08-10T17:36:19.235283+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:36:19.235283+0000","last_undegraded":"2022-08-10T17:36:19.235283+0000","last_fullsized":"2022-08-10T17:36:19.235283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675914+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:36:17.675914+0000","last_peered":"2022-08-10T17:36:17.675914+0000","last_clean":"2022-08-10T17:36:17.675914+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:36:17.675914+0000","last_undegraded":"2022-08-10T17:36:17.675914+0000","last_fullsized":"2022-08-10T17:36:17.675914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681138+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:36:17.681138+0000","last_peered":"2022-08-10T17:36:17.681138+0000","last_clean":"2022-08-10T17:36:17.681138+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:36:17.681138+0000","last_undegraded":"2022-08-10T17:36:17.681138+0000","last_fullsized":"2022-08-10T17:36:17.681138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.890251+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:38:04.890251+0000","last_peered":"2022-08-10T17:38:04.890251+0000","last_clean":"2022-08-10T17:38:04.890251+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:38:04.890251+0000","last_undegraded":"2022-08-10T17:38:04.890251+0000","last_fullsized":"2022-08-10T17:38:04.890251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673453+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:36:17.673453+0000","last_peered":"2022-08-10T17:36:17.673453+0000","last_clean":"2022-08-10T17:36:17.673453+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:36:17.673453+0000","last_undegraded":"2022-08-10T17:36:17.673453+0000","last_fullsized":"2022-08-10T17:36:17.673453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.689913+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:36:17.689913+0000","last_peered":"2022-08-10T17:36:17.689913+0000","last_clean":"2022-08-10T17:36:17.689913+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:36:17.689913+0000","last_undegraded":"2022-08-10T17:36:17.689913+0000","last_fullsized":"2022-08-10T17:36:17.689913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.676029+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:36:17.676029+0000","last_peered":"2022-08-10T17:36:17.676029+0000","last_clean":"2022-08-10T17:36:17.676029+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:36:17.676029+0000","last_undegraded":"2022-08-10T17:36:17.676029+0000","last_fullsized":"2022-08-10T17:36:17.676029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.674462+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:36:17.674462+0000","last_peered":"2022-08-10T17:36:17.674462+0000","last_clean":"2022-08-10T17:36:17.674462+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:36:17.674462+0000","last_undegraded":"2022-08-10T17:36:17.674462+0000","last_fullsized":"2022-08-10T17:36:17.674462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.675656+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:36:17.675656+0000","last_peered":"2022-08-10T17:36:17.675656+0000","last_clean":"2022-08-10T17:36:17.675656+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:36:17.675656+0000","last_undegraded":"2022-08-10T17:36:17.675656+0000","last_fullsized":"2022-08-10T17:36:17.675656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681447+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:36:17.681447+0000","last_peered":"2022-08-10T17:36:17.681447+0000","last_clean":"2022-08-10T17:36:17.681447+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:36:17.681447+0000","last_undegraded":"2022-08-10T17:36:17.681447+0000","last_fullsized":"2022-08-10T17:36:17.681447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7215,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9312,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362528,"statfs":{"total":96636764160,"available":96627228672,"internally_reserved":0,"allocated":417792,"data_stored":729129,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73099999999999998,"5min":0.747,"15min":0.747},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.63300000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70099999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.503}]},{"osd":4,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74299999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.64800000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:37:31 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.752},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58299999999999996}]},{"osd":4,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58899999999999997,"5min":0.751,"15min":0.751},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66100000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68400000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:37:33 2022","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":133690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34699999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.46500000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.39600000000000002},"min":{"1min":0.33400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.63200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41999999999999998},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.65700000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.78200000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82299999999999995}]},{"osd":5,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80300000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.496,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.95999999999999996}]},{"osd":6,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.93000000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:29 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9308,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362532,"statfs":{"total":96636764160,"available":96627232768,"internally_reserved":0,"allocated":413696,"data_stored":725524,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83099999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73799999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.753}]},{"osd":7,"last update":"Wed Aug 10 17:37:36 2022","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.81599999999999995,"5min":1.026,"15min":1.026},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.437,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.379,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.22700000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.879,"15min":0.879},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.76200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.75,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83699999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8780,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363060,"statfs":{"total":96636764160,"available":96627773440,"internally_reserved":0,"allocated":331776,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":2.5630000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54900000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":2.5859999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":2.6160000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":2.8340000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":3.089},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.35499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":2.9340000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":3.1059999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":3.048}]},{"osd":5,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":3.1269999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":3.0030000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":3.024},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":3.0630000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":2.96},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":2.9889999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8808,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363032,"statfs":{"total":96636764160,"available":96627744768,"internally_reserved":0,"allocated":360448,"data_stored":138823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.996,"15min":0.996},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48599999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.64100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.755,"15min":0.755},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.629,"5min":0.87,"15min":0.87},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63600000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:37:30 2022","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67100000000000004,"5min":1.054,"15min":1.054},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8720,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363120,"statfs":{"total":96636764160,"available":96627834880,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.47099999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73999999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77700000000000002,"5min":1.171,"15min":1.171},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.378}]},{"osd":6,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.434},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:37:28 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:38:14.909 INFO:tasks.mon_thrash.ceph_manager:clean! 2022-08-10T17:38:14.910 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:38:15.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.056+0000 7f63b4af2700 1 Processor -- start 2022-08-10T17:38:15.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.056+0000 7f63b4af2700 1 -- start start 2022-08-10T17:38:15.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63b4af2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b006c8a0 0x7f63b0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63b4af2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63b014ed40 0x7f63b0158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63b4af2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00c48e0 con 0x7f63b014e970 2022-08-10T17:38:15.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63b4af2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00c13a0 con 0x7f63b014ed40 2022-08-10T17:38:15.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63b4af2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00bcd00 con 0x7f63b006c8a0 2022-08-10T17:38:15.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63b014ed40 0x7f63b0158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63b014ed40 0x7f63b0158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58844/0 (socket says 172.21.15.150:58844) 2022-08-10T17:38:15.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 -- 172.21.15.150:0/2300063189 learned_addr learned my addr 172.21.15.150:0/2300063189 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63add9b700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b006c8a0 0x7f63b0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 -- 172.21.15.150:0/2300063189 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b006c8a0 msgr2=0x7f63b0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b006c8a0 0x7f63b0157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 -- 172.21.15.150:0/2300063189 >> v1:172.21.15.197:6789/0 conn(0x7f63b014e970 legacy=0x7f63b00689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.057+0000 7f63aed9d700 1 -- 172.21.15.150:0/2300063189 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0064550 con 0x7f63b014ed40 2022-08-10T17:38:15.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63aed9d700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b014ed40 0x7f63b0158250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009e80 tx=0x7f63a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfc2476f18d38df server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63ad59a700 1 -- 172.21.15.150:0/2300063189 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800e070 con 0x7f63b014ed40 2022-08-10T17:38:15.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63ad59a700 1 -- 172.21.15.150:0/2300063189 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800b940 con 0x7f63b014ed40 2022-08-10T17:38:15.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63ad59a700 1 -- 172.21.15.150:0/2300063189 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800bcf0 con 0x7f63b014ed40 2022-08-10T17:38:15.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 -- 172.21.15.150:0/2300063189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b014ed40 msgr2=0x7f63b0158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b014ed40 0x7f63b0158250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009e80 tx=0x7f63a800b330 comp rx=0 tx=0).stop 2022-08-10T17:38:15.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 -- 172.21.15.150:0/2300063189 shutdown_connections 2022-08-10T17:38:15.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b014ed40 0x7f63b0158250 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 --2- 172.21.15.150:0/2300063189 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b006c8a0 0x7f63b0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 -- 172.21.15.150:0/2300063189 >> 172.21.15.150:0/2300063189 conn(0x7f63b00c92f0 msgr2=0x7f63b00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 -- 172.21.15.150:0/2300063189 shutdown_connections 2022-08-10T17:38:15.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.058+0000 7f63b4af2700 1 -- 172.21.15.150:0/2300063189 wait complete. 2022-08-10T17:38:15.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.060+0000 7f63b4af2700 1 Processor -- start 2022-08-10T17:38:15.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.060+0000 7f63b4af2700 1 -- start start 2022-08-10T17:38:15.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f63b014e970 0x7f63b0140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b014ed40 0x7f63b0141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0146ff0 con 0x7f63b006c8a0 2022-08-10T17:38:15.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01472d0 con 0x7f63b014e970 2022-08-10T17:38:15.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63b4af2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01475b0 con 0x7f63b014ed40 2022-08-10T17:38:15.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58848/0 (socket says 172.21.15.150:58848) 2022-08-10T17:38:15.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 -- 172.21.15.150:0/1463772242 learned_addr learned my addr 172.21.15.150:0/1463772242 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63aed9d700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b014ed40 0x7f63b0141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63add9b700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f63b014e970 0x7f63b0140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 -- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b014ed40 msgr2=0x7f63b0141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b014ed40 0x7f63b0141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 -- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f63b014e970 msgr2=0x7f63b0140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f63b014e970 0x7f63b0140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.061+0000 7f63ae59c700 1 -- 172.21.15.150:0/1463772242 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8009b30 con 0x7f63b006c8a0 2022-08-10T17:38:15.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f63ae59c700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c410 tx=0x7f63a400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011790 con 0x7f63b006c8a0 2022-08-10T17:38:15.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a40118f0 con 0x7f63b006c8a0 2022-08-10T17:38:15.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011ca0 con 0x7f63b006c8a0 2022-08-10T17:38:15.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b0147890 con 0x7f63b006c8a0 2022-08-10T17:38:15.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.062+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b01495c0 con 0x7f63b006c8a0 2022-08-10T17:38:15.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.063+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b0147db0 con 0x7f63b006c8a0 2022-08-10T17:38:15.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.063+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f63a4010050 con 0x7f63b006c8a0 2022-08-10T17:38:15.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.063+0000 7f639effd700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 0x7f638c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.064+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f63a4081c50 con 0x7f63b006c8a0 2022-08-10T17:38:15.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.064+0000 7f63add9b700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 0x7f638c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.064+0000 7f63add9b700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 0x7f638c067560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63b0064c10 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.068+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f63b0147db0 con 0x7f63b006c8a0 2022-08-10T17:38:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.245+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b0072890 con 0x7f63b006c8a0 2022-08-10T17:38:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.245+0000 7f639effd700 1 -- 172.21.15.150:0/1463772242 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7f63a404fcf0 con 0x7f63b006c8a0 2022-08-10T17:38:15.250 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:15.250 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:38:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 msgr2=0x7f638c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 0x7f638c067560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f63b0064c10 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2022-08-10T17:38:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 msgr2=0x7f63b0142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c410 tx=0x7f63a400c7d0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 shutdown_connections 2022-08-10T17:38:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f638c0650b0 0x7f638c067560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63b014ed40 0x7f63b0141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b006c8a0 0x7f63b0142850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 --2- 172.21.15.150:0/1463772242 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f63b014e970 0x7f63b0140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 >> 172.21.15.150:0/1463772242 conn(0x7f63b00c92f0 msgr2=0x7f63b00c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 shutdown_connections 2022-08-10T17:38:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.248+0000 7f63b4af2700 1 -- 172.21.15.150:0/1463772242 wait complete. 2022-08-10T17:38:15.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-08-10T17:35:27.251819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-08-10T17:35:30.366555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-08-10T17:35:35.008984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-08-10T17:35:36.359965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-08-10T17:35:39.420480+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-08-10T17:38:15.265 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-08-10T17:38:15.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.384+0000 7f07af1cc700 1 Processor -- start 2022-08-10T17:38:15.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 -- start start 2022-08-10T17:38:15.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07a806c860 0x7f07a80c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a815a570 0x7f07a80c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80c4dc0 con 0x7f07a8150af0 2022-08-10T17:38:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80c5940 con 0x7f07a806c860 2022-08-10T17:38:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07af1cc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80c9fc0 con 0x7f07a815a570 2022-08-10T17:38:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07a7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07a806c860 0x7f07a80c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07a7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07a806c860 0x7f07a80c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58858/0 (socket says 172.21.15.150:58858) 2022-08-10T17:38:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.385+0000 7f07a7fff700 1 -- 172.21.15.150:0/1199131697 learned_addr learned my addr 172.21.15.150:0/1199131697 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07ad769700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a815a570 0x7f07a80c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a7fff700 1 -- 172.21.15.150:0/1199131697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a815a570 msgr2=0x7f07a80c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a7fff700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a815a570 0x7f07a80c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a7fff700 1 -- 172.21.15.150:0/1199131697 >> v1:172.21.15.197:6789/0 conn(0x7f07a8150af0 legacy=0x7f07a8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a7fff700 1 -- 172.21.15.150:0/1199131697 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a806f9a0 con 0x7f07a806c860 2022-08-10T17:38:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a7fff700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a806c860 0x7f07a80c3ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0794006fd0 tx=0x7f0794009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c1095ea598ee3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a77fe700 1 -- 172.21.15.150:0/1199131697 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794011830 con 0x7f07a806c860 2022-08-10T17:38:15.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a77fe700 1 -- 172.21.15.150:0/1199131697 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07940119b0 con 0x7f07a806c860 2022-08-10T17:38:15.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.386+0000 7f07a77fe700 1 -- 172.21.15.150:0/1199131697 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794011d60 con 0x7f07a806c860 2022-08-10T17:38:15.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 -- 172.21.15.150:0/1199131697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a806c860 msgr2=0x7f07a80c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a806c860 0x7f07a80c3ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0794006fd0 tx=0x7f0794009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:15.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 -- 172.21.15.150:0/1199131697 shutdown_connections 2022-08-10T17:38:15.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a815a570 0x7f07a80c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1199131697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a806c860 0x7f07a80c3ec0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 -- 172.21.15.150:0/1199131697 >> 172.21.15.150:0/1199131697 conn(0x7f07a80c92f0 msgr2=0x7f07a80c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 -- 172.21.15.150:0/1199131697 shutdown_connections 2022-08-10T17:38:15.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.387+0000 7f07af1cc700 1 -- 172.21.15.150:0/1199131697 wait complete. 2022-08-10T17:38:15.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.388+0000 7f07af1cc700 1 Processor -- start 2022-08-10T17:38:15.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.388+0000 7f07af1cc700 1 -- start start 2022-08-10T17:38:15.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a806c860 0x7f07a8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07a815a570 0x7f07a8142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81f0b80 con 0x7f07a8150af0 2022-08-10T17:38:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81f08a0 con 0x7f07a815a570 2022-08-10T17:38:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07af1cc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8157f10 con 0x7f07a806c860 2022-08-10T17:38:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58864/0 (socket says 172.21.15.150:58864) 2022-08-10T17:38:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 -- 172.21.15.150:0/1047833182 learned_addr learned my addr 172.21.15.150:0/1047833182 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07acf68700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a806c860 0x7f07a8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07ad769700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07a815a570 0x7f07a8142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 -- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a806c860 msgr2=0x7f07a8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a806c860 0x7f07a8158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 -- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07a815a570 msgr2=0x7f07a8142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07a815a570 0x7f07a8142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 -- 172.21.15.150:0/1047833182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940093e0 con 0x7f07a8150af0 2022-08-10T17:38:15.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.389+0000 7f07a7fff700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0794013000 tx=0x7f07940045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.390+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794004450 con 0x7f07a8150af0 2022-08-10T17:38:15.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.390+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794003520 con 0x7f07a8150af0 2022-08-10T17:38:15.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.390+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a81581f0 con 0x7f07a8150af0 2022-08-10T17:38:15.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.390+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07940038b0 con 0x7f07a8150af0 2022-08-10T17:38:15.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.390+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a81587b0 con 0x7f07a8150af0 2022-08-10T17:38:15.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.391+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a806e290 con 0x7f07a8150af0 2022-08-10T17:38:15.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.391+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f079400f050 con 0x7f07a8150af0 2022-08-10T17:38:15.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.391+0000 7f07a57fa700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 0x7f0790067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.391+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0794083460 con 0x7f07a8150af0 2022-08-10T17:38:15.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.392+0000 7f07acf68700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 0x7f0790067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.392+0000 7f07acf68700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 0x7f0790067560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f079c007fd0 tx=0x7f079c007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.399+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0794051440 con 0x7f07a8150af0 2022-08-10T17:38:15.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.576+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07a81589a0 con 0x7f07a8150af0 2022-08-10T17:38:15.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.576+0000 7f07a57fa700 1 -- 172.21.15.150:0/1047833182 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0794015070 con 0x7f07a8150af0 2022-08-10T17:38:15.580 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2022-08-10T17:38:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 msgr2=0x7f0790067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 0x7f0790067560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f079c007fd0 tx=0x7f079c007d40 comp rx=0 tx=0).stop 2022-08-10T17:38:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 msgr2=0x7f07a814f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0794013000 tx=0x7f07940045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 shutdown_connections 2022-08-10T17:38:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07a815a570 0x7f07a8142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f07900650b0 0x7f0790067560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07a806c860 0x7f07a8158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 --2- 172.21.15.150:0/1047833182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07a8150af0 0x7f07a814f370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 >> 172.21.15.150:0/1047833182 conn(0x7f07a80c92f0 msgr2=0x7f07a814d560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 shutdown_connections 2022-08-10T17:38:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.578+0000 7f07af1cc700 1 -- 172.21.15.150:0/1047833182 wait complete. 2022-08-10T17:38:15.594 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-08-10T17:38:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 Processor -- start 2022-08-10T17:38:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 -- start start 2022-08-10T17:38:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c040c3410 0x7f4c040c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 0x7f4c04071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c040c7560 con 0x7f4c040c3c80 2022-08-10T17:38:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0415aae0 con 0x7f4c040c3410 2022-08-10T17:38:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.715+0000 7f4c0ab41700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04159e60 con 0x7f4c040c37e0 2022-08-10T17:38:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c040c3410 0x7f4c040c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c040c3410 0x7f4c040c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58870/0 (socket says 172.21.15.150:58870) 2022-08-10T17:38:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 -- 172.21.15.150:0/604666070 learned_addr learned my addr 172.21.15.150:0/604666070 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 -- 172.21.15.150:0/604666070 >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 msgr2=0x7f4c04071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c03fff700 1 --2- 172.21.15.150:0/604666070 >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 0x7f4c04071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 --2- 172.21.15.150:0/604666070 >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 0x7f4c04071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 -- 172.21.15.150:0/604666070 >> v1:172.21.15.197:6789/0 conn(0x7f4c040c3c80 legacy=0x7f4c040681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 -- 172.21.15.150:0/604666070 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0415a140 con 0x7f4c040c3410 2022-08-10T17:38:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c03fff700 1 --2- 172.21.15.150:0/604666070 >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 0x7f4c04071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c088dd700 1 --2- 172.21.15.150:0/604666070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3410 0x7f4c040c6cd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cac10 tx=0x7f4bf8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8109b139c27ff706 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c037fe700 1 -- 172.21.15.150:0/604666070 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011830 con 0x7f4c040c3410 2022-08-10T17:38:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c037fe700 1 -- 172.21.15.150:0/604666070 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8011990 con 0x7f4c040c3410 2022-08-10T17:38:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.716+0000 7f4c037fe700 1 -- 172.21.15.150:0/604666070 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011d20 con 0x7f4c040c3410 2022-08-10T17:38:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 -- 172.21.15.150:0/604666070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3410 msgr2=0x7f4c040c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/604666070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3410 0x7f4c040c6cd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cac10 tx=0x7f4bf8009a60 comp rx=0 tx=0).stop 2022-08-10T17:38:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 -- 172.21.15.150:0/604666070 shutdown_connections 2022-08-10T17:38:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/604666070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3410 0x7f4c040c6cd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/604666070 >> v2:172.21.15.197:3300/0 conn(0x7f4c040c37e0 0x7f4c04071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 -- 172.21.15.150:0/604666070 >> 172.21.15.150:0/604666070 conn(0x7f4c040ca5a0 msgr2=0x7f4c040c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 -- 172.21.15.150:0/604666070 shutdown_connections 2022-08-10T17:38:15.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.717+0000 7f4c0ab41700 1 -- 172.21.15.150:0/604666070 wait complete. 2022-08-10T17:38:15.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.718+0000 7f4c0ab41700 1 Processor -- start 2022-08-10T17:38:15.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.718+0000 7f4c0ab41700 1 -- start start 2022-08-10T17:38:15.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c040c3410 0x7f4c041ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 0x7f4c041590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c040c2af0 con 0x7f4c040c3c80 2022-08-10T17:38:15.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04159630 con 0x7f4c040c37e0 2022-08-10T17:38:15.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c0ab41700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0414b0d0 con 0x7f4c040c3410 2022-08-10T17:38:15.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58880/0 (socket says 172.21.15.150:58880) 2022-08-10T17:38:15.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 -- 172.21.15.150:0/138040271 learned_addr learned my addr 172.21.15.150:0/138040271 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:15.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c088dd700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c040c3410 0x7f4c041ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c03fff700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 0x7f4c041590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 -- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c040c3410 msgr2=0x7f4c041ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c040c3410 0x7f4c041ec2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 -- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 msgr2=0x7f4c041590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 0x7f4c041590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c090de700 1 -- 172.21.15.150:0/138040271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80093e0 con 0x7f4c040c3c80 2022-08-10T17:38:15.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.719+0000 7f4c03fff700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 0x7f4c041590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:15.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c090de700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00b9d0 tx=0x7f4bfc00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc003a80 con 0x7f4c040c3c80 2022-08-10T17:38:15.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc003be0 con 0x7f4c040c3c80 2022-08-10T17:38:15.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00c7b0 con 0x7f4c040c3c80 2022-08-10T17:38:15.737 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0414c940 con 0x7f4c040c3c80 2022-08-10T17:38:15.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.720+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0414c660 con 0x7f4c040c3c80 2022-08-10T17:38:15.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.721+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0414d020 con 0x7f4c040c3c80 2022-08-10T17:38:15.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.721+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4bfc00c910 con 0x7f4c040c3c80 2022-08-10T17:38:15.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.721+0000 7f4c017fa700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 0x7f4bec067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:15.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.721+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4bfc082030 con 0x7f4c040c3c80 2022-08-10T17:38:15.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.722+0000 7f4c088dd700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 0x7f4bec067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:15.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.722+0000 7f4c088dd700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 0x7f4bec067590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:15.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.725+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4bfc04b6b0 con 0x7f4c040c3c80 2022-08-10T17:38:15.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.901+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c0415a420 con 0x7f4c040c3c80 2022-08-10T17:38:15.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.902+0000 7f4c017fa700 1 -- 172.21.15.150:0/138040271 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c0414d020 con 0x7f4c040c3c80 2022-08-10T17:38:15.906 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 8 2022-08-10T17:38:15.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 msgr2=0x7f4bec067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 0x7f4bec067590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8008030 comp rx=0 tx=0).stop 2022-08-10T17:38:15.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 msgr2=0x7f4c041e3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:15.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00b9d0 tx=0x7f4bfc00bd90 comp rx=0 tx=0).stop 2022-08-10T17:38:15.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 shutdown_connections 2022-08-10T17:38:15.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c040c3c80 0x7f4c041e3210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bec0650e0 0x7f4bec067590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c040c3410 0x7f4c041ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 --2- 172.21.15.150:0/138040271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c040c37e0 0x7f4c041590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:15.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 >> 172.21.15.150:0/138040271 conn(0x7f4c040ca5a0 msgr2=0x7f4c04070030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:15.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 shutdown_connections 2022-08-10T17:38:15.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:15.904+0000 7f4c0ab41700 1 -- 172.21.15.150:0/138040271 wait complete. 2022-08-10T17:38:15.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-08-10T17:38:16.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 Processor -- start 2022-08-10T17:38:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 -- start start 2022-08-10T17:38:16.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94e00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c57f0 con 0x7f94e0158b80 2022-08-10T17:38:16.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c4ba0 con 0x7f94e01554d0 2022-08-10T17:38:16.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e721e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0158760 con 0x7f94e00c2110 2022-08-10T17:38:16.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e57bb700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f94e0158b80 0x7f94e006a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43336/0 (socket says 172.21.15.150:43336) 2022-08-10T17:38:16.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.039+0000 7f94e57bb700 1 -- 172.21.15.150:0/3850546888 learned_addr learned my addr 172.21.15.150:0/3850546888 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:16.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94dffff700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94e00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443369544 0 0) 0x7f94e00c57f0 con 0x7f94e0158b80 2022-08-10T17:38:16.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c4003430 con 0x7f94e0158b80 2022-08-10T17:38:16.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055954415 0 0) 0x7f94c4003430 con 0x7f94e0158b80 2022-08-10T17:38:16.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 msgr2=0x7f94e00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:16.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94e00c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 >> v1:172.21.15.197:6789/0 conn(0x7f94e01554d0 legacy=0x7f94e00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00c5120 con 0x7f94e0158b80 2022-08-10T17:38:16.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f94d80019f0 con 0x7f94e0158b80 2022-08-10T17:38:16.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 >> v1:172.21.15.150:6789/0 conn(0x7f94e0158b80 legacy=0x7f94e006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94c40038b0 0x7f94c4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94c40046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c4004c10 0x7f94c4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0158760 con 0x7f94c40038b0 2022-08-10T17:38:16.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400ba50 con 0x7f94c4004c10 2022-08-10T17:38:16.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400bc10 con 0x7f94e00c2110 2022-08-10T17:38:16.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94c40038b0 0x7f94c4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94dffff700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94c40046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e57bb700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c4004c10 0x7f94c4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 -- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 msgr2=0x7f94c40046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:16.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e00c2110 0x7f94c40046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 -- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c4004c10 msgr2=0x7f94c4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:16.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c4004c10 0x7f94c4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e4fba700 1 -- 172.21.15.150:0/3850546888 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4003430 con 0x7f94c40038b0 2022-08-10T17:38:16.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.040+0000 7f94e57bb700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c4004c10 0x7f94c4005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:16.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e4fba700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94c40038b0 0x7f94c4003cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94c4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1276fa4038a8806 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40052d0 con 0x7f94c40038b0 2022-08-10T17:38:16.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4003500 con 0x7f94c40038b0 2022-08-10T17:38:16.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94df7fe700 1 -- 172.21.15.150:0/3850546888 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40038b0 con 0x7f94c40038b0 2022-08-10T17:38:16.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 -- 172.21.15.150:0/3850546888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94c40038b0 msgr2=0x7f94c4003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 --2- 172.21.15.150:0/3850546888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94c40038b0 0x7f94c4003cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94c4005700 comp rx=0 tx=0).stop 2022-08-10T17:38:16.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e57bb700 1 -- 172.21.15.150:0/3850546888 reap_dead start 2022-08-10T17:38:16.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 -- 172.21.15.150:0/3850546888 shutdown_connections 2022-08-10T17:38:16.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 -- 172.21.15.150:0/3850546888 >> 172.21.15.150:0/3850546888 conn(0x7f94e006fae0 msgr2=0x7f94e006fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 -- 172.21.15.150:0/3850546888 shutdown_connections 2022-08-10T17:38:16.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.041+0000 7f94e721e700 1 -- 172.21.15.150:0/3850546888 wait complete. 2022-08-10T17:38:16.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.042+0000 7f94e721e700 1 Processor -- start 2022-08-10T17:38:16.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.042+0000 7f94e721e700 1 -- start start 2022-08-10T17:38:16.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c40038b0 0x7f94e014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e01de270 0x7f94e00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0155c90 con 0x7f94e0157140 2022-08-10T17:38:16.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01ed010 con 0x7f94c40038b0 2022-08-10T17:38:16.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94e721e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01ed2d0 con 0x7f94e01de270 2022-08-10T17:38:16.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94dffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94dffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58898/0 (socket says 172.21.15.150:58898) 2022-08-10T17:38:16.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.043+0000 7f94dffff700 1 -- 172.21.15.150:0/2911661442 learned_addr learned my addr 172.21.15.150:0/2911661442 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:16.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94e4fba700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c40038b0 0x7f94e014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94e57bb700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e01de270 0x7f94e00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 -- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e01de270 msgr2=0x7f94e00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e01de270 0x7f94e00696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 -- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c40038b0 msgr2=0x7f94e014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c40038b0 0x7f94e014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 -- 172.21.15.150:0/2911661442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e01e1310 con 0x7f94e0157140 2022-08-10T17:38:16.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dffff700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94cc011960 tx=0x7f94cc011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00f940 con 0x7f94e0157140 2022-08-10T17:38:16.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00faa0 con 0x7f94e0157140 2022-08-10T17:38:16.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e01e15f0 con 0x7f94e0157140 2022-08-10T17:38:16.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00fe70 con 0x7f94e0157140 2022-08-10T17:38:16.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.044+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00c8bb0 con 0x7f94e0157140 2022-08-10T17:38:16.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.045+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0155dd0 con 0x7f94e0157140 2022-08-10T17:38:16.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.045+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f94cc014440 con 0x7f94e0157140 2022-08-10T17:38:16.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.046+0000 7f94dd7fa700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 0x7f94c8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.046+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f94cc082960 con 0x7f94e0157140 2022-08-10T17:38:16.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.046+0000 7f94e4fba700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 0x7f94c8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.046+0000 7f94e4fba700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 0x7f94c8067590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94d4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.050+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f94e0155dd0 con 0x7f94e0157140 2022-08-10T17:38:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.227+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94e0155dd0 con 0x7f94e0157140 2022-08-10T17:38:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.227+0000 7f94dd7fa700 1 -- 172.21.15.150:0/2911661442 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94e0155dd0 con 0x7f94e0157140 2022-08-10T17:38:16.232 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:16.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 msgr2=0x7f94c8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 0x7f94c8067590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94d4009030 comp rx=0 tx=0).stop 2022-08-10T17:38:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 msgr2=0x7f94e0069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94cc011960 tx=0x7f94cc011d20 comp rx=0 tx=0).stop 2022-08-10T17:38:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 shutdown_connections 2022-08-10T17:38:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f94c80650e0 0x7f94c8067590 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f94e01de270 0x7f94e00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f94c40038b0 0x7f94e014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.229+0000 7f94e721e700 1 --2- 172.21.15.150:0/2911661442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0157140 0x7f94e0069160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.230+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 >> 172.21.15.150:0/2911661442 conn(0x7f94e006fae0 msgr2=0x7f94e00c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.230+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 shutdown_connections 2022-08-10T17:38:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.230+0000 7f94e721e700 1 -- 172.21.15.150:0/2911661442 wait complete. 2022-08-10T17:38:16.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-08-10T17:38:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 Processor -- start 2022-08-10T17:38:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 -- start start 2022-08-10T17:38:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a70068110 0x7f9a700684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a7006e190 0x7f9a700b9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a70068d10 con 0x7f9a700c41a0 2022-08-10T17:38:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7006f1f0 con 0x7f9a70068110 2022-08-10T17:38:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.365+0000 7f9a76ee8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70068a20 con 0x7f9a7006e190 2022-08-10T17:38:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a70068110 0x7f9a700684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a75485700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9a700c41a0 0x7f9a700c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43356/0 (socket says 172.21.15.150:43356) 2022-08-10T17:38:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a75485700 1 -- 172.21.15.150:0/3208220858 learned_addr learned my addr 172.21.15.150:0/3208220858 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a6ffff700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a7006e190 0x7f9a700b9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 -- 172.21.15.150:0/3208220858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a7006e190 msgr2=0x7f9a700b9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a7006e190 0x7f9a700b9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 -- 172.21.15.150:0/3208220858 >> v1:172.21.15.150:6789/0 conn(0x7f9a700c41a0 legacy=0x7f9a700c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 -- 172.21.15.150:0/3208220858 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700c58c0 con 0x7f9a70068110 2022-08-10T17:38:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a74c84700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a70068110 0x7f9a700684e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a640096e0 tx=0x7f9a640099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d84d961e3a65909 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a6f7fe700 1 -- 172.21.15.150:0/3208220858 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64011830 con 0x7f9a70068110 2022-08-10T17:38:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a6f7fe700 1 -- 172.21.15.150:0/3208220858 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64011990 con 0x7f9a70068110 2022-08-10T17:38:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.366+0000 7f9a6f7fe700 1 -- 172.21.15.150:0/3208220858 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64011d20 con 0x7f9a70068110 2022-08-10T17:38:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 -- 172.21.15.150:0/3208220858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a70068110 msgr2=0x7f9a700684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a70068110 0x7f9a700684e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a640096e0 tx=0x7f9a640099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 -- 172.21.15.150:0/3208220858 shutdown_connections 2022-08-10T17:38:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a70068110 0x7f9a700684e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/3208220858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a7006e190 0x7f9a700b9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 -- 172.21.15.150:0/3208220858 >> 172.21.15.150:0/3208220858 conn(0x7f9a700c91e0 msgr2=0x7f9a700c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 -- 172.21.15.150:0/3208220858 shutdown_connections 2022-08-10T17:38:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.367+0000 7f9a76ee8700 1 -- 172.21.15.150:0/3208220858 wait complete. 2022-08-10T17:38:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.368+0000 7f9a76ee8700 1 Processor -- start 2022-08-10T17:38:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.368+0000 7f9a76ee8700 1 -- start start 2022-08-10T17:38:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 0x7f9a700b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a700c41a0 0x7f9a701ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70146f90 con 0x7f9a7006e190 2022-08-10T17:38:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a701473b0 con 0x7f9a700c41a0 2022-08-10T17:38:16.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700b5fb0 con 0x7f9a70068110 2022-08-10T17:38:16.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58912/0 (socket says 172.21.15.150:58912) 2022-08-10T17:38:16.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 -- 172.21.15.150:0/2178948745 learned_addr learned my addr 172.21.15.150:0/2178948745 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a74c84700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 0x7f9a700b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a75485700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a700c41a0 0x7f9a701ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 -- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 msgr2=0x7f9a700b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 0x7f9a700b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 -- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a700c41a0 msgr2=0x7f9a701ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a700c41a0 0x7f9a701ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 -- 172.21.15.150:0/2178948745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009310 con 0x7f9a7006e190 2022-08-10T17:38:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a74c84700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 0x7f9a700b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:16.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6ffff700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c5a0 tx=0x7f9a5c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c004220 con 0x7f9a7006e190 2022-08-10T17:38:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c004380 con 0x7f9a7006e190 2022-08-10T17:38:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a700b6290 con 0x7f9a7006e190 2022-08-10T17:38:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.369+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c011820 con 0x7f9a7006e190 2022-08-10T17:38:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.370+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a700c35d0 con 0x7f9a7006e190 2022-08-10T17:38:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.371+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a701470d0 con 0x7f9a7006e190 2022-08-10T17:38:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.371+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9a5c011980 con 0x7f9a7006e190 2022-08-10T17:38:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.371+0000 7f9a6d7fa700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 0x7f9a58067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.371+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9a5c082250 con 0x7f9a7006e190 2022-08-10T17:38:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.371+0000 7f9a74c84700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 0x7f9a58067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.372+0000 7f9a74c84700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 0x7f9a58067560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a640090b0 tx=0x7f9a64008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.375+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f9a701470d0 con 0x7f9a7006e190 2022-08-10T17:38:16.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.549+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a701470d0 con 0x7f9a7006e190 2022-08-10T17:38:16.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.550+0000 7f9a6d7fa700 1 -- 172.21.15.150:0/2178948745 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a701470d0 con 0x7f9a7006e190 2022-08-10T17:38:16.554 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 64 2022-08-10T17:38:16.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.551+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 msgr2=0x7f9a58067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.551+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 0x7f9a58067560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a640090b0 tx=0x7f9a64008030 comp rx=0 tx=0).stop 2022-08-10T17:38:16.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.551+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 msgr2=0x7f9a700c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.551+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c5a0 tx=0x7f9a5c00c960 comp rx=0 tx=0).stop 2022-08-10T17:38:16.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 shutdown_connections 2022-08-10T17:38:16.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a700c41a0 0x7f9a701ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a580650b0 0x7f9a58067560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a70068110 0x7f9a700b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 --2- 172.21.15.150:0/2178948745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7006e190 0x7f9a700c28c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 >> 172.21.15.150:0/2178948745 conn(0x7f9a700c91e0 msgr2=0x7f9a7014f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 shutdown_connections 2022-08-10T17:38:16.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.552+0000 7f9a76ee8700 1 -- 172.21.15.150:0/2178948745 wait complete. 2022-08-10T17:38:16.567 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-08-10T17:38:16.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.689+0000 7fc7025fd700 1 Processor -- start 2022-08-10T17:38:16.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.689+0000 7fc7025fd700 1 -- start start 2022-08-10T17:38:16.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc7025fd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc6fc1544c0 0x7fc6fc068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc7025fd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc6fc0bd4b0 0x7fc6fc068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc7025fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc0c6100 con 0x7fc6fc1540f0 2022-08-10T17:38:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc7025fd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c5270 con 0x7fc6fc1544c0 2022-08-10T17:38:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc7025fd700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c5e00 con 0x7fc6fc0bd4b0 2022-08-10T17:38:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc6fc1544c0 0x7fc6fc068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc6fc1540f0 0x7fc6fc071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43366/0 (socket says 172.21.15.150:43366) 2022-08-10T17:38:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fbfff700 1 -- 172.21.15.150:0/477681796 learned_addr learned my addr 172.21.15.150:0/477681796 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc700b9a700 1 --2- 172.21.15.150:0/477681796 >> v2:172.21.15.197:3300/0 conn(0x7fc6fc0bd4b0 0x7fc6fc068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 -- 172.21.15.150:0/477681796 >> v2:172.21.15.197:3300/0 conn(0x7fc6fc0bd4b0 msgr2=0x7fc6fc068650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 --2- 172.21.15.150:0/477681796 >> v2:172.21.15.197:3300/0 conn(0x7fc6fc0bd4b0 0x7fc6fc068650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 -- 172.21.15.150:0/477681796 >> v1:172.21.15.150:6789/0 conn(0x7fc6fc1540f0 legacy=0x7fc6fc071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6faffd700 1 -- 172.21.15.150:0/477681796 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621129659 0 0) 0x7fc6fc0c6100 con 0x7fc6fc1540f0 2022-08-10T17:38:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 -- 172.21.15.150:0/477681796 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc06eb00 con 0x7fc6fc1544c0 2022-08-10T17:38:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.690+0000 7fc6fb7fe700 1 --2- 172.21.15.150:0/477681796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc068110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc157c00 tx=0x7fc6ec009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fa48368f4f258f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc6faffd700 1 -- 172.21.15.150:0/477681796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011830 con 0x7fc6fc1544c0 2022-08-10T17:38:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc6faffd700 1 -- 172.21.15.150:0/477681796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec011990 con 0x7fc6fc1544c0 2022-08-10T17:38:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc6faffd700 1 -- 172.21.15.150:0/477681796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011d40 con 0x7fc6fc1544c0 2022-08-10T17:38:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 -- 172.21.15.150:0/477681796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 msgr2=0x7fc6fc068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 --2- 172.21.15.150:0/477681796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc068110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc157c00 tx=0x7fc6ec009990 comp rx=0 tx=0).stop 2022-08-10T17:38:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 -- 172.21.15.150:0/477681796 shutdown_connections 2022-08-10T17:38:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 --2- 172.21.15.150:0/477681796 >> v2:172.21.15.197:3300/0 conn(0x7fc6fc0bd4b0 0x7fc6fc068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 --2- 172.21.15.150:0/477681796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc068110 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 -- 172.21.15.150:0/477681796 >> 172.21.15.150:0/477681796 conn(0x7fc6fc06d0d0 msgr2=0x7fc6fc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 -- 172.21.15.150:0/477681796 shutdown_connections 2022-08-10T17:38:16.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.691+0000 7fc7025fd700 1 -- 172.21.15.150:0/477681796 wait complete. 2022-08-10T17:38:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.692+0000 7fc7025fd700 1 Processor -- start 2022-08-10T17:38:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.692+0000 7fc7025fd700 1 -- start start 2022-08-10T17:38:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc6fc0bd4b0 0x7fc6fc157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc6fc1540f0 0x7fc6fc159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc1583d0 con 0x7fc6fc1544c0 2022-08-10T17:38:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc154a50 con 0x7fc6fc1540f0 2022-08-10T17:38:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc7025fd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc1ed620 con 0x7fc6fc0bd4b0 2022-08-10T17:38:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc700b9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc700b9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58928/0 (socket says 172.21.15.150:58928) 2022-08-10T17:38:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc700b9a700 1 -- 172.21.15.150:0/3329486458 learned_addr learned my addr 172.21.15.150:0/3329486458 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc6fbfff700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc6fc0bd4b0 0x7fc6fc157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.693+0000 7fc6fb7fe700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc6fc1540f0 0x7fc6fc159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 -- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc6fc0bd4b0 msgr2=0x7fc6fc157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc6fc0bd4b0 0x7fc6fc157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 -- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc6fc1540f0 msgr2=0x7fc6fc159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc6fc1540f0 0x7fc6fc159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 -- 172.21.15.150:0/3329486458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec009310 con 0x7fc6fc1544c0 2022-08-10T17:38:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc700b9a700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400cd70 tx=0x7fc6f400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40038a0 con 0x7fc6fc1544c0 2022-08-10T17:38:16.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4003a00 con 0x7fc6fc1544c0 2022-08-10T17:38:16.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc0c11f0 con 0x7fc6fc1544c0 2022-08-10T17:38:16.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4003d90 con 0x7fc6fc1544c0 2022-08-10T17:38:16.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.694+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc1ed8c0 con 0x7fc6fc1544c0 2022-08-10T17:38:16.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.695+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc064640 con 0x7fc6fc1544c0 2022-08-10T17:38:16.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.695+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc6f401c020 con 0x7fc6fc1544c0 2022-08-10T17:38:16.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.696+0000 7fc6f8ff9700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 0x7fc6dc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:16.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.696+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc6f4012070 con 0x7fc6fc1544c0 2022-08-10T17:38:16.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.696+0000 7fc6fbfff700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 0x7fc6dc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:16.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.697+0000 7fc6fbfff700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 0x7fc6dc067590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000f60 tx=0x7fc6f0007a60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:16.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.700+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc6f4050a50 con 0x7fc6fc1544c0 2022-08-10T17:38:16.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.876+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc6fc06f800 con 0x7fc6fc1544c0 2022-08-10T17:38:16.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.876+0000 7fc6f8ff9700 1 -- 172.21.15.150:0/3329486458 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc6f4054070 con 0x7fc6fc1544c0 2022-08-10T17:38:16.881 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2022-08-10T17:38:16.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 msgr2=0x7fc6dc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 0x7fc6dc067590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000f60 tx=0x7fc6f0007a60 comp rx=0 tx=0).stop 2022-08-10T17:38:16.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 msgr2=0x7fc6fc159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:16.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400cd70 tx=0x7fc6f400a570 comp rx=0 tx=0).stop 2022-08-10T17:38:16.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 shutdown_connections 2022-08-10T17:38:16.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6fc1544c0 0x7fc6fc159c60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6dc0650e0 0x7fc6dc067590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc6fc0bd4b0 0x7fc6fc157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 --2- 172.21.15.150:0/3329486458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc6fc1540f0 0x7fc6fc159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:16.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.878+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 >> 172.21.15.150:0/3329486458 conn(0x7fc6fc06d0d0 msgr2=0x7fc6fc06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:16.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.879+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 shutdown_connections 2022-08-10T17:38:16.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:16.879+0000 7fc7025fd700 1 -- 172.21.15.150:0/3329486458 wait complete. 2022-08-10T17:38:16.894 DEBUG:tasks.mon_thrash:Yielding 2022-08-10T17:38:16.895 INFO:teuthology.run_tasks:Running task workunit... 2022-08-10T17:38:16.908 INFO:tasks.workunit:Pulling workunits from ref e654560905d543d628247824fe5cbecad893480f 2022-08-10T17:38:16.909 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-08-10T17:38:16.909 INFO:tasks.workunit:timeout=3h 2022-08-10T17:38:16.909 INFO:tasks.workunit:cleanup=True 2022-08-10T17:38:16.910 DEBUG:teuthology.orchestra.run.smithi150:> stat -- /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:16.911 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:38:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-08-10T17:38:16.928 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 2fh/47d Inode: 1 Links: 2 2022-08-10T17:38:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-10T17:38:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:cephfs_t:s0 2022-08-10T17:38:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-08-10T17:38:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2022-08-10 17:35:42.396320722 +0000 2022-08-10T17:38:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2022-08-10 17:37:50.503507091 +0000 2022-08-10T17:38:16.930 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2022-08-10 17:35:42.396320722 +0000 2022-08-10T17:38:16.930 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-08-10T17:38:16.930 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-08-10T17:38:16.999 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e654560905d543d628247824fe5cbecad893480f 2022-08-10T17:38:17.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.030+0000 7fdf1ec19700 1 Processor -- start 2022-08-10T17:38:17.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.030+0000 7fdf1ec19700 1 -- start start 2022-08-10T17:38:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.031+0000 7fdf1ec19700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf180c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.031+0000 7fdf1ec19700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180c36f0 con 0x7fdf180c5570 2022-08-10T17:38:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.031+0000 7fdf1ec19700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1806ca30 con 0x7fdf1806b640 2022-08-10T17:38:17.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.031+0000 7fdf1ec19700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1814f100 con 0x7fdf1814ed30 2022-08-10T17:38:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.031+0000 7fdf1c9b5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf180c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1d1b6700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdf180c5570 0x7fdf18155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43384/0 (socket says 172.21.15.150:43384) 2022-08-10T17:38:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1d1b6700 1 -- 172.21.15.150:0/3286404288 learned_addr learned my addr 172.21.15.150:0/3286404288 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:17.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf177fe700 1 -- 172.21.15.150:0/3286404288 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446658715 0 0) 0x7fdf10001490 con 0x7fdf180c5570 2022-08-10T17:38:17.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf177fe700 1 -- 172.21.15.150:0/3286404288 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc003430 con 0x7fdf180c5570 2022-08-10T17:38:17.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1c9b5700 1 -- 172.21.15.150:0/3286404288 >> v1:172.21.15.197:6789/0 conn(0x7fdf1806b640 legacy=0x7fdf180c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1c9b5700 1 -- 172.21.15.150:0/3286404288 >> v1:172.21.15.150:6789/0 conn(0x7fdf180c5570 legacy=0x7fdf18155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1c9b5700 1 -- 172.21.15.150:0/3286404288 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1806a450 con 0x7fdf1814ed30 2022-08-10T17:38:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf1c9b5700 1 --2- 172.21.15.150:0/3286404288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf180c20f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0096e0 tx=0x7fdf0c0099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4383fe4f8f4b7d55 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf177fe700 1 -- 172.21.15.150:0/3286404288 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0107b0 con 0x7fdf1814ed30 2022-08-10T17:38:17.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf177fe700 1 -- 172.21.15.150:0/3286404288 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c010910 con 0x7fdf1814ed30 2022-08-10T17:38:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.032+0000 7fdf177fe700 1 -- 172.21.15.150:0/3286404288 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c010c80 con 0x7fdf1814ed30 2022-08-10T17:38:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 -- 172.21.15.150:0/3286404288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 msgr2=0x7fdf180c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/3286404288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf180c20f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0096e0 tx=0x7fdf0c0099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 -- 172.21.15.150:0/3286404288 shutdown_connections 2022-08-10T17:38:17.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/3286404288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf180c20f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 -- 172.21.15.150:0/3286404288 >> 172.21.15.150:0/3286404288 conn(0x7fdf1806e1f0 msgr2=0x7fdf1806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 -- 172.21.15.150:0/3286404288 shutdown_connections 2022-08-10T17:38:17.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.033+0000 7fdf1ec19700 1 -- 172.21.15.150:0/3286404288 wait complete. 2022-08-10T17:38:17.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.034+0000 7fdf1ec19700 1 Processor -- start 2022-08-10T17:38:17.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.034+0000 7fdf1ec19700 1 -- start start 2022-08-10T17:38:17.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 0x7fdf180c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf18155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180c7460 con 0x7fdf180681c0 2022-08-10T17:38:17.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180c76b0 con 0x7fdf180c5570 2022-08-10T17:38:17.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1ec19700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180687a0 con 0x7fdf1814ed30 2022-08-10T17:38:17.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1d1b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1d1b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58942/0 (socket says 172.21.15.150:58942) 2022-08-10T17:38:17.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.035+0000 7fdf1d1b6700 1 -- 172.21.15.150:0/4026440534 learned_addr learned my addr 172.21.15.150:0/4026440534 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:17.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1c9b5700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 0x7fdf180c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf17fff700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf18155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 -- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 msgr2=0x7fdf18155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf18155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 -- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 msgr2=0x7fdf180c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 0x7fdf180c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 -- 172.21.15.150:0/4026440534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009310 con 0x7fdf180681c0 2022-08-10T17:38:17.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1c9b5700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 0x7fdf180c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:17.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1d1b6700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c730 tx=0x7fdf1000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100070f0 con 0x7fdf180681c0 2022-08-10T17:38:17.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10007250 con 0x7fdf180681c0 2022-08-10T17:38:17.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf18068a80 con 0x7fdf180681c0 2022-08-10T17:38:17.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100075e0 con 0x7fdf180681c0 2022-08-10T17:38:17.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.036+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf18069040 con 0x7fdf180681c0 2022-08-10T17:38:17.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.037+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf18069260 con 0x7fdf180681c0 2022-08-10T17:38:17.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.038+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdf10019030 con 0x7fdf180681c0 2022-08-10T17:38:17.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.038+0000 7fdf157fa700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 0x7fdf00067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.038+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdf100815f0 con 0x7fdf180681c0 2022-08-10T17:38:17.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.038+0000 7fdf1c9b5700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 0x7fdf00067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.039+0000 7fdf1c9b5700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 0x7fdf00067590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.042+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fdf1004f550 con 0x7fdf180681c0 2022-08-10T17:38:17.054 INFO:tasks.workunit.client.0.smithi150.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-08-10T17:38:17.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.265+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf180c36f0 con 0x7fdf180681c0 2022-08-10T17:38:17.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.265+0000 7fdf157fa700 1 -- 172.21.15.150:0/4026440534 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6152 (secure 0 0 0) 0x7fdf180c36f0 con 0x7fdf180681c0 2022-08-10T17:38:17.270 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:38:17.270 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:38:04.920762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":40,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:38:17.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 msgr2=0x7fdf00067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 0x7fdf00067590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c01c040 comp rx=0 tx=0).stop 2022-08-10T17:38:17.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 msgr2=0x7fdf18156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c730 tx=0x7fdf1000ca40 comp rx=0 tx=0).stop 2022-08-10T17:38:17.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 shutdown_connections 2022-08-10T17:38:17.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf180681c0 0x7fdf18156100 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdf180c5570 0x7fdf180c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdf000650e0 0x7fdf00067590 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 --2- 172.21.15.150:0/4026440534 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdf1814ed30 0x7fdf18155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 >> 172.21.15.150:0/4026440534 conn(0x7fdf1806e1f0 msgr2=0x7fdf180c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 shutdown_connections 2022-08-10T17:38:17.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.267+0000 7fdf1ec19700 1 -- 172.21.15.150:0/4026440534 wait complete. 2022-08-10T17:38:17.274 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 15 2022-08-10T17:38:17.283 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2022-08-10T17:38:17.283 INFO:tasks.mon_thrash.mon_thrasher:seed: 1660153094, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2022-08-10T17:38:17.284 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:38:17.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:38:17.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 Processor -- start 2022-08-10T17:38:17.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 -- start start 2022-08-10T17:38:17.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb564150e70 0x7fb564157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640644b0 0x7fb56406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5641578c0 con 0x7fb56406fef0 2022-08-10T17:38:17.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640c6780 con 0x7fb564150e70 2022-08-10T17:38:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb5691f7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640c6a60 con 0x7fb5640644b0 2022-08-10T17:38:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb56359e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb56406fef0 0x7fb56406bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43408/0 (socket says 172.21.15.150:43408) 2022-08-10T17:38:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.441+0000 7fb56359e700 1 -- 172.21.15.150:0/963181685 learned_addr learned my addr 172.21.15.150:0/963181685 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:17.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640644b0 0x7fb56406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb562d9d700 1 --2- 172.21.15.150:0/963181685 >> v2:172.21.15.197:3300/0 conn(0x7fb564150e70 0x7fb564157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786526161 0 0) 0x7fb5641578c0 con 0x7fb56406fef0 2022-08-10T17:38:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb544003430 con 0x7fb56406fef0 2022-08-10T17:38:17.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741516176 0 0) 0x7fb544003430 con 0x7fb56406fef0 2022-08-10T17:38:17.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640644b0 msgr2=0x7fb56406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:17.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640644b0 0x7fb56406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 >> v2:172.21.15.197:3300/0 conn(0x7fb564150e70 msgr2=0x7fb564157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:17.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 --2- 172.21.15.150:0/963181685 >> v2:172.21.15.197:3300/0 conn(0x7fb564150e70 0x7fb564157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406b4e0 con 0x7fb56406fef0 2022-08-10T17:38:17.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fb55c0019f0 con 0x7fb56406fef0 2022-08-10T17:38:17.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb562d9d700 1 --2- 172.21.15.150:0/963181685 >> v2:172.21.15.197:3300/0 conn(0x7fb564150e70 0x7fb564157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:17.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 >> v1:172.21.15.150:6789/0 conn(0x7fb56406fef0 legacy=0x7fb56406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb544003880 0x7fb544003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5440042b0 0x7fb544004770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb544004de0 0x7fb54400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640c6780 con 0x7fb5440042b0 2022-08-10T17:38:17.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640c6a60 con 0x7fb544003880 2022-08-10T17:38:17.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54400bdd0 con 0x7fb544004de0 2022-08-10T17:38:17.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640644b0 0x7fb56406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:17.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb562d9d700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb544003880 0x7fb544003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5440042b0 0x7fb544004770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb56359e700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb544004de0 0x7fb54400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.442+0000 7fb56259c700 1 -- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb544004de0 msgr2=0x7fb54400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:17.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb544004de0 0x7fb54400b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56259c700 1 -- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb544003880 msgr2=0x7fb544003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:17.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb544003880 0x7fb544003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56259c700 1 -- 172.21.15.150:0/963181685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544003430 con 0x7fb5440042b0 2022-08-10T17:38:17.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56259c700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5440042b0 0x7fb544004770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb56406d8b0 tx=0x7fb544005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accb2791e7fbe4a3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554004030 con 0x7fb5440042b0 2022-08-10T17:38:17.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554004190 con 0x7fb5440042b0 2022-08-10T17:38:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb561d9b700 1 -- 172.21.15.150:0/963181685 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554003520 con 0x7fb5440042b0 2022-08-10T17:38:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 -- 172.21.15.150:0/963181685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5440042b0 msgr2=0x7fb544004770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 --2- 172.21.15.150:0/963181685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5440042b0 0x7fb544004770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb56406d8b0 tx=0x7fb544005700 comp rx=0 tx=0).stop 2022-08-10T17:38:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb56359e700 1 -- 172.21.15.150:0/963181685 reap_dead start 2022-08-10T17:38:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 -- 172.21.15.150:0/963181685 shutdown_connections 2022-08-10T17:38:17.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 -- 172.21.15.150:0/963181685 >> 172.21.15.150:0/963181685 conn(0x7fb5640c9d60 msgr2=0x7fb5640c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 -- 172.21.15.150:0/963181685 shutdown_connections 2022-08-10T17:38:17.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.443+0000 7fb5691f7700 1 -- 172.21.15.150:0/963181685 wait complete. 2022-08-10T17:38:17.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.445+0000 7fb5691f7700 1 Processor -- start 2022-08-10T17:38:17.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.445+0000 7fb5691f7700 1 -- start start 2022-08-10T17:38:17.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.445+0000 7fb5691f7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5440042b0 0x7fb5641ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640bfcf0 0x7fb564151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564152ea0 con 0x7fb5640ba320 2022-08-10T17:38:17.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564153f60 con 0x7fb5440042b0 2022-08-10T17:38:17.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564151770 con 0x7fb5640bfcf0 2022-08-10T17:38:17.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58970/0 (socket says 172.21.15.150:58970) 2022-08-10T17:38:17.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 -- 172.21.15.150:0/2491003813 learned_addr learned my addr 172.21.15.150:0/2491003813 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:17.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb562d9d700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5440042b0 0x7fb5641ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56259c700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640bfcf0 0x7fb564151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 -- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640bfcf0 msgr2=0x7fb564151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640bfcf0 0x7fb564151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 -- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5440042b0 msgr2=0x7fb5641ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5440042b0 0x7fb5641ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 -- 172.21.15.150:0/2491003813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640bfb10 con 0x7fb5640ba320 2022-08-10T17:38:17.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb56359e700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0073d0 tx=0x7fb55c0076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c017070 con 0x7fb5640ba320 2022-08-10T17:38:17.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c011640 con 0x7fb5640ba320 2022-08-10T17:38:17.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5641ed840 con 0x7fb5640ba320 2022-08-10T17:38:17.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0117f0 con 0x7fb5640ba320 2022-08-10T17:38:17.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.446+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb564151490 con 0x7fb5640ba320 2022-08-10T17:38:17.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.447+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56406e650 con 0x7fb5640ba320 2022-08-10T17:38:17.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.448+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb55c011950 con 0x7fb5640ba320 2022-08-10T17:38:17.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.448+0000 7fb55b7fe700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 0x7fb548067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.448+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb55c081cb0 con 0x7fb5640ba320 2022-08-10T17:38:17.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.448+0000 7fb562d9d700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 0x7fb548067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.449+0000 7fb562d9d700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 0x7fb548067590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0092e0 tx=0x7fb54c0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.452+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb55c04fc90 con 0x7fb5640ba320 2022-08-10T17:38:17.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.703+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb56406b7c0 con 0x7fb5640ba320 2022-08-10T17:38:17.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.703+0000 7fb55b7fe700 1 -- 172.21.15.150:0/2491003813 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fb55c0532b0 con 0x7fb5640ba320 2022-08-10T17:38:17.708 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":185,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:38:17.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 msgr2=0x7fb548067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 0x7fb548067590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0092e0 tx=0x7fb54c0090e0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 msgr2=0x7fb5640baaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0073d0 tx=0x7fb55c0076e0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 shutdown_connections 2022-08-10T17:38:17.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5640ba320 0x7fb5640baaa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5440042b0 0x7fb5641ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5480650e0 0x7fb548067590 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 --2- 172.21.15.150:0/2491003813 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5640bfcf0 0x7fb564151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 >> 172.21.15.150:0/2491003813 conn(0x7fb5640c9d60 msgr2=0x7fb56414ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 shutdown_connections 2022-08-10T17:38:17.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.705+0000 7fb5691f7700 1 -- 172.21.15.150:0/2491003813 wait complete. 2022-08-10T17:38:17.722 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:38:17.722 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:38:17.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:38:17.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.860+0000 7f6beb981700 1 Processor -- start 2022-08-10T17:38:17.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.860+0000 7f6beb981700 1 -- start start 2022-08-10T17:38:17.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6beb981700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 0x7f6be40ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6beb981700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 0x7f6be406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6beb981700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c3600 con 0x7f6be406b1b0 2022-08-10T17:38:17.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6beb981700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40c6080 con 0x7f6be406ea90 2022-08-10T17:38:17.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6beb981700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be406ae80 con 0x7f6be40c3230 2022-08-10T17:38:17.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be971d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 0x7f6be40ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be9f1e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 0x7f6be406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be8f1c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f6be406b1b0 0x7f6be40c4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:58010/0 (socket says 172.21.15.150:58010) 2022-08-10T17:38:17.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be8f1c700 1 -- 172.21.15.150:0/3708384997 learned_addr learned my addr 172.21.15.150:0/3708384997 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:17.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be971d700 1 -- 172.21.15.150:0/3708384997 >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 msgr2=0x7f6be406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:17.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be971d700 1 --2- 172.21.15.150:0/3708384997 >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 0x7f6be406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be971d700 1 -- 172.21.15.150:0/3708384997 >> v1:172.21.15.197:6789/0 conn(0x7f6be406b1b0 legacy=0x7f6be40c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be971d700 1 -- 172.21.15.150:0/3708384997 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40c5900 con 0x7f6be40c3230 2022-08-10T17:38:17.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.861+0000 7f6be9f1e700 1 --2- 172.21.15.150:0/3708384997 >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 0x7f6be406f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:17.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6be971d700 1 --2- 172.21.15.150:0/3708384997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 0x7f6be40ca420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6be00096b0 tx=0x7f6be00099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebfab76b8263910 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6bd3fff700 1 -- 172.21.15.150:0/3708384997 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00107b0 con 0x7f6be40c3230 2022-08-10T17:38:17.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6bd3fff700 1 -- 172.21.15.150:0/3708384997 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0010910 con 0x7f6be40c3230 2022-08-10T17:38:17.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6bd3fff700 1 -- 172.21.15.150:0/3708384997 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0010cc0 con 0x7f6be40c3230 2022-08-10T17:38:17.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 -- 172.21.15.150:0/3708384997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 msgr2=0x7f6be40ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 --2- 172.21.15.150:0/3708384997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 0x7f6be40ca420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6be00096b0 tx=0x7f6be00099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 -- 172.21.15.150:0/3708384997 shutdown_connections 2022-08-10T17:38:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 --2- 172.21.15.150:0/3708384997 >> v2:172.21.15.197:3300/0 conn(0x7f6be406ea90 0x7f6be406f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 --2- 172.21.15.150:0/3708384997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be40c3230 0x7f6be40ca420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 -- 172.21.15.150:0/3708384997 >> 172.21.15.150:0/3708384997 conn(0x7f6be4068110 msgr2=0x7f6be4068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 -- 172.21.15.150:0/3708384997 shutdown_connections 2022-08-10T17:38:17.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.862+0000 7f6beb981700 1 -- 172.21.15.150:0/3708384997 wait complete. 2022-08-10T17:38:17.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 Processor -- start 2022-08-10T17:38:17.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 -- start start 2022-08-10T17:38:17.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be406b1b0 0x7f6be41dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 0x7f6be41e0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6be41e08a0 0x7f6be40c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41e1c80 con 0x7f6be406ea90 2022-08-10T17:38:17.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40af440 con 0x7f6be41e08a0 2022-08-10T17:38:17.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6beb981700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41522a0 con 0x7f6be406b1b0 2022-08-10T17:38:17.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6be8f1c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 0x7f6be41e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6be8f1c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 0x7f6be41e0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58984/0 (socket says 172.21.15.150:58984) 2022-08-10T17:38:17.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.864+0000 7f6be8f1c700 1 -- 172.21.15.150:0/2608325826 learned_addr learned my addr 172.21.15.150:0/2608325826 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:17.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be9f1e700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6be41e08a0 0x7f6be40c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be971d700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be406b1b0 0x7f6be41dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be406b1b0 msgr2=0x7f6be41dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6be406b1b0 0x7f6be41dfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6be41e08a0 msgr2=0x7f6be40c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6be41e08a0 0x7f6be40c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009a70 con 0x7f6be406ea90 2022-08-10T17:38:17.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6be8f1c700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 0x7f6be41e0360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c340 tx=0x7f6bd400c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40074e0 con 0x7f6be406ea90 2022-08-10T17:38:17.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4007640 con 0x7f6be406ea90 2022-08-10T17:38:17.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be0009310 con 0x7f6be406ea90 2022-08-10T17:38:17.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40059c0 con 0x7f6be406ea90 2022-08-10T17:38:17.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.865+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be4151800 con 0x7f6be406ea90 2022-08-10T17:38:17.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.866+0000 7f6beb981700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 0x7f6be40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.866+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41e0c70 con 0x7f6be40c79e0 2022-08-10T17:38:17.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.866+0000 7f6be971d700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 0x7f6be40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.866+0000 7f6be971d700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6be4072890 con 0x7f6be40c79e0 2022-08-10T17:38:17.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6bd4019030 con 0x7f6be406ea90 2022-08-10T17:38:17.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6be971d700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 0x7f6be40c84e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6be406dfb0 tx=0x7f6be00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6bc40650b0 0x7f6bc4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6bd40813d0 con 0x7f6be406ea90 2022-08-10T17:38:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be001f070 con 0x7f6be40c79e0 2022-08-10T17:38:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6be9f1e700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6bc40650b0 0x7f6bc4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f6be0010e70 con 0x7f6be40c79e0 2022-08-10T17:38:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 msgr2=0x7f6be40c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 0x7f6be40c84e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6be406dfb0 tx=0x7f6be00045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 msgr2=0x7f6be40c84e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.867+0000 7f6bd1ffb700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be40c79e0 0x7f6be40c84e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.868+0000 7f6be9f1e700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6bc40650b0 0x7f6bc4067560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc007660 tx=0x7f6bdc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6beb981700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 0x7f6be405f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:17.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40c4880 con 0x7f6be405f380 2022-08-10T17:38:17.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6be971d700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 0x7f6be405f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:17.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6be971d700 1 -- 172.21.15.150:0/2608325826 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6be406f150 con 0x7f6be405f380 2022-08-10T17:38:17.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6be971d700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 0x7f6be405f780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009600 tx=0x7f6be0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:17.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0004230 con 0x7f6be405f380 2022-08-10T17:38:17.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4889 (secure 0 0 0) 0x7f6be0011e90 con 0x7f6be405f380 2022-08-10T17:38:17.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 msgr2=0x7f6be405f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 0x7f6be405f780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009600 tx=0x7f6be0010000 comp rx=0 tx=0).stop 2022-08-10T17:38:17.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 msgr2=0x7f6be405f780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:17.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.875+0000 7f6bd1ffb700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be405f380 0x7f6be405f780 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:17.893 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:17.893 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:17.894 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:17.894 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:38:17.894 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2022-08-10T17:38:17.895 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:38:17.895 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:38:17.895 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:38:17.895 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:38:17.895 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.896 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 186, 2022-08-10T17:38:17.896 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:17.896 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:38:17.896 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:38:17.897 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:17.897 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:17.897 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:17.897 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:17.897 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:17.898 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:17.898 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:17.898 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:17.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:17.899 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:38:17.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:38:17.900 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:17.900 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:17.900 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:17.900 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:17.901 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:17.901 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:17.901 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:17.901 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:17.902 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:17.902 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.903 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:38:17.903 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:38:17.903 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:38:17.903 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:38:17.904 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:38:17.904 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:17.904 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:17.904 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:17.905 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:38:17.905 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:38:17.905 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:38:17.905 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:38:17.906 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:38:17.906 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:38:17.906 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:17.906 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:38:17.907 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:17.907 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:17.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:17.908 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:17.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:17.908 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:17.908 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:17.909 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:17.909 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:17.909 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.909 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:38:17.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.910 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:38:17.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.910 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:17.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:17.911 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:17.911 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:17.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:17.912 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:38:17.912 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.913 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:17.913 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:38:17.913 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.914 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.914 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:38:17.915 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:38:17.915 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:17.915 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:17.916 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:17.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.916 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:17.916 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:17.917 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:17.917 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:17.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:38:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:38:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:38:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:38:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:38:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:38:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:38:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:38:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:38:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:38:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:17.929 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:17.929 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:17.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.929 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.930 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:38:17.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.930 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:17.930 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:17.930 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:38:17.931 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.931 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.931 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:38:17.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.932 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:17.932 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:17.932 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:38:17.932 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.932 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.933 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:38:17.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.933 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:17.933 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:17.933 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:38:17.934 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.934 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:17.934 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:38:17.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:17.935 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:17.935 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:17.935 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:17.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:17.936 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:17.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:17.937 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:38:17.937 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:17.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6bc40650b0 msgr2=0x7f6bc4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6bc40650b0 0x7f6bc4067560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc007660 tx=0x7f6bdc00b040 comp rx=0 tx=0).stop 2022-08-10T17:38:17.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 msgr2=0x7f6be41e0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:17.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 --2- 172.21.15.150:0/2608325826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6be406ea90 0x7f6be41e0360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c340 tx=0x7f6bd400c700 comp rx=0 tx=0).stop 2022-08-10T17:38:17.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6be9f1e700 1 -- 172.21.15.150:0/2608325826 reap_dead start 2022-08-10T17:38:17.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6be9f1e700 1 -- 172.21.15.150:0/2608325826 reap_dead start 2022-08-10T17:38:17.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 shutdown_connections 2022-08-10T17:38:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 >> 172.21.15.150:0/2608325826 conn(0x7f6be4068110 msgr2=0x7f6be40684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 shutdown_connections 2022-08-10T17:38:17.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:17.876+0000 7f6beb981700 1 -- 172.21.15.150:0/2608325826 wait complete. 2022-08-10T17:38:17.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:38:18.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.066+0000 7f9fe3351700 1 Processor -- start 2022-08-10T17:38:18.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.066+0000 7f9fe3351700 1 -- start start 2022-08-10T17:38:18.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe3351700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9fdc14ce90 0x7f9fdc156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe3351700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 0x7f9fdc0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe3351700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fdc0c98f0 con 0x7f9fdc06dc90 2022-08-10T17:38:18.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe3351700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc0c4880 con 0x7f9fdc14ce90 2022-08-10T17:38:18.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe3351700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc0c4e20 con 0x7f9fdc06a760 2022-08-10T17:38:18.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe10ed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9fdc14ce90 0x7f9fdc156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe08ec700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9fdc06dc90 0x7f9fdc069910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43442/0 (socket says 172.21.15.150:43442) 2022-08-10T17:38:18.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.067+0000 7f9fe08ec700 1 -- 172.21.15.150:0/3317613863 learned_addr learned my addr 172.21.15.150:0/3317613863 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:18.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe18ee700 1 --2- 172.21.15.150:0/3317613863 >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 0x7f9fdc0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe10ed700 1 -- 172.21.15.150:0/3317613863 >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 msgr2=0x7f9fdc0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:18.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3317613863 >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 0x7f9fdc0c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe10ed700 1 -- 172.21.15.150:0/3317613863 >> v1:172.21.15.150:6789/0 conn(0x7f9fdc06dc90 legacy=0x7f9fdc069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe10ed700 1 -- 172.21.15.150:0/3317613863 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc0c4b40 con 0x7f9fdc14ce90 2022-08-10T17:38:18.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fcbfff700 1 -- 172.21.15.150:0/3317613863 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609648910 0 0) 0x7f9fdc0c98f0 con 0x7f9fdc06dc90 2022-08-10T17:38:18.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe18ee700 1 --2- 172.21.15.150:0/3317613863 >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 0x7f9fdc0c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:38:18.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3317613863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc156b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0c54e0 tx=0x7f9fd8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ec6f2c7d3d37b6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fcbfff700 1 -- 172.21.15.150:0/3317613863 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011830 con 0x7f9fdc14ce90 2022-08-10T17:38:18.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fcbfff700 1 -- 172.21.15.150:0/3317613863 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8011990 con 0x7f9fdc14ce90 2022-08-10T17:38:18.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fcbfff700 1 -- 172.21.15.150:0/3317613863 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011d40 con 0x7f9fdc14ce90 2022-08-10T17:38:18.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.068+0000 7f9fe3351700 1 -- 172.21.15.150:0/3317613863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 msgr2=0x7f9fdc156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3317613863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc156b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0c54e0 tx=0x7f9fd8009990 comp rx=0 tx=0).stop 2022-08-10T17:38:18.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 -- 172.21.15.150:0/3317613863 shutdown_connections 2022-08-10T17:38:18.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3317613863 >> v2:172.21.15.197:3300/0 conn(0x7f9fdc06a760 0x7f9fdc0c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3317613863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc156b60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 -- 172.21.15.150:0/3317613863 >> 172.21.15.150:0/3317613863 conn(0x7f9fdc06b500 msgr2=0x7f9fdc06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:18.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 -- 172.21.15.150:0/3317613863 shutdown_connections 2022-08-10T17:38:18.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.069+0000 7f9fe3351700 1 -- 172.21.15.150:0/3317613863 wait complete. 2022-08-10T17:38:18.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.070+0000 7f9fe3351700 1 Processor -- start 2022-08-10T17:38:18.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.070+0000 7f9fe3351700 1 -- start start 2022-08-10T17:38:18.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fdc06a760 0x7f9fdc150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc06dc90 0x7f9fdc14c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc151b80 con 0x7f9fdc14ce90 2022-08-10T17:38:18.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc153a90 con 0x7f9fdc06dc90 2022-08-10T17:38:18.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc14f7f0 con 0x7f9fdc06a760 2022-08-10T17:38:18.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59004/0 (socket says 172.21.15.150:59004) 2022-08-10T17:38:18.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 -- 172.21.15.150:0/3969414226 learned_addr learned my addr 172.21.15.150:0/3969414226 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:18.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe08ec700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc06dc90 0x7f9fdc14c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fdc06a760 0x7f9fdc150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fdc06a760 msgr2=0x7f9fdc150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fdc06a760 0x7f9fdc150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc06dc90 msgr2=0x7f9fdc14c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc06dc90 0x7f9fdc14c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009310 con 0x7f9fdc14ce90 2022-08-10T17:38:18.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fdc06a760 0x7f9fdc150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:18.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe08ec700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc06dc90 0x7f9fdc14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:38:18.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe18ee700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4007ef0 tx=0x7f9fd400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400de60 con 0x7f9fdc14ce90 2022-08-10T17:38:18.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400f040 con 0x7f9fdc14ce90 2022-08-10T17:38:18.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc14fad0 con 0x7f9fdc14ce90 2022-08-10T17:38:18.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.071+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4003ae0 con 0x7f9fdc14ce90 2022-08-10T17:38:18.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.072+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc150090 con 0x7f9fdc14ce90 2022-08-10T17:38:18.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.072+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 0x7f9fdc1dce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.072+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc1538b0 con 0x7f9fdc1534e0 2022-08-10T17:38:18.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 0x7f9fdc1dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9fd401c030 con 0x7f9fdc14ce90 2022-08-10T17:38:18.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fe10ed700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fdc1eec10 con 0x7f9fdc1534e0 2022-08-10T17:38:18.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 0x7f9fdc1dce30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0c54e0 tx=0x7f9fd8004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fc9ffb700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fbc0650b0 0x7f9fbc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9fd4082470 con 0x7f9fdc14ce90 2022-08-10T17:38:18.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.073+0000 7f9fe08ec700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fbc0650b0 0x7f9fbc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd801a730 con 0x7f9fdc1534e0 2022-08-10T17:38:18.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f9fd801a890 con 0x7f9fdc1534e0 2022-08-10T17:38:18.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 msgr2=0x7f9fdc1dce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 0x7f9fdc1dce30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0c54e0 tx=0x7f9fd8004640 comp rx=0 tx=0).stop 2022-08-10T17:38:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 msgr2=0x7f9fdc1dce30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fc9ffb700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1534e0 0x7f9fdc1dce30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.074+0000 7f9fe08ec700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fbc0650b0 0x7f9fbc067560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc1dd4f0 tx=0x7f9fcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.081+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 0x7f9fdc1ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.081+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0673d0 con 0x7f9fdc1eeef0 2022-08-10T17:38:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.081+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 0x7f9fdc1ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.081+0000 7f9fe10ed700 1 -- 172.21.15.150:0/3969414226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9fdc14d260 con 0x7f9fdc1eeef0 2022-08-10T17:38:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.081+0000 7f9fe10ed700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 0x7f9fdc1ef2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0708e0 tx=0x7f9fd80045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8033660 con 0x7f9fdc1eeef0 2022-08-10T17:38:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f9fd801ae80 con 0x7f9fdc1eeef0 2022-08-10T17:38:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 msgr2=0x7f9fdc1ef2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 0x7f9fdc1ef2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0708e0 tx=0x7f9fd80045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 msgr2=0x7f9fdc1ef2f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fc9ffb700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fdc1eeef0 0x7f9fdc1ef2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.107 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:18.107 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:18.107 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:18.108 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:38:18.108 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2022-08-10T17:38:18.109 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:38:18.109 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:38:18.109 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:38:18.109 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:38:18.110 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.110 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 186, 2022-08-10T17:38:18.110 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:18.110 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:38:18.111 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:38:18.111 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.111 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.112 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.112 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.112 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.113 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.113 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.113 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.113 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.114 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.114 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:38:18.114 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:38:18.114 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.115 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.115 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.115 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.116 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.116 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.116 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.116 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.117 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.117 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.117 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:38:18.118 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:38:18.118 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:38:18.118 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:38:18.118 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:38:18.119 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:18.119 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:18.119 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:18.119 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:38:18.119 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:38:18.120 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:38:18.120 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:38:18.120 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:38:18.120 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:38:18.121 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:18.121 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:38:18.121 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.121 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.122 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.122 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.122 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.122 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.123 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.123 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.123 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.124 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.124 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:38:18.124 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.124 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:38:18.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.125 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:18.125 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:18.125 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.126 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.126 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.126 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:38:18.127 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.128 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.128 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:38:18.128 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.128 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.128 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.129 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:38:18.129 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:38:18.129 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.130 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.130 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.131 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:18.131 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:18.131 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.131 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.132 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.132 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:38:18.132 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.133 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.133 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:38:18.134 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.134 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.134 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.135 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:38:18.135 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:38:18.135 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.135 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.136 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.137 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:18.137 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:18.137 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.137 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:38:18.149 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.150 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.150 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:38:18.150 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.151 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.151 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:38:18.151 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:38:18.152 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.152 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.152 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.152 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.153 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.153 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:38:18.154 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:38:18.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.155 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.155 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.155 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.156 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.156 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.157 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:38:18.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.158 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.158 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.159 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:38:18.159 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.159 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.160 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:38:18.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.161 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.161 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.162 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:38:18.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.162 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.163 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:38:18.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.163 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:38:18.164 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.164 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.165 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.165 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.166 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:38:18.166 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.166 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.166 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:38:18.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.167 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.167 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.167 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.168 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.168 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.168 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:38:18.168 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:18.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fbc0650b0 msgr2=0x7f9fbc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fbc0650b0 0x7f9fbc067560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc1dd4f0 tx=0x7f9fcc009040 comp rx=0 tx=0).stop 2022-08-10T17:38:18.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 msgr2=0x7f9fdc1dc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4007ef0 tx=0x7f9fd400d3b0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe18ee700 1 -- 172.21.15.150:0/3969414226 reap_dead start 2022-08-10T17:38:18.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 shutdown_connections 2022-08-10T17:38:18.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 --2- 172.21.15.150:0/3969414226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc14ce90 0x7f9fdc1dc8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 >> 172.21.15.150:0/3969414226 conn(0x7f9fdc06b500 msgr2=0x7f9fdc0c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:18.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 shutdown_connections 2022-08-10T17:38:18.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.082+0000 7f9fe3351700 1 -- 172.21.15.150:0/3969414226 wait complete. 2022-08-10T17:38:18.173 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:38:18.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.297+0000 7fedf090d700 1 Processor -- start 2022-08-10T17:38:18.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.297+0000 7fedf090d700 1 -- start start 2022-08-10T17:38:18.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fedf090d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedec0bc830 0x7fedec068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fedf090d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec1563c0 con 0x7fedec06c860 2022-08-10T17:38:18.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fedf090d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec150940 con 0x7fedec070040 2022-08-10T17:38:18.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fedf090d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec153590 con 0x7fedec0bc830 2022-08-10T17:38:18.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fedea59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedec0bc830 0x7fedec068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fede9d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fedec06c860 0x7fedec152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43460/0 (socket says 172.21.15.150:43460) 2022-08-10T17:38:18.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.298+0000 7fede9d9b700 1 -- 172.21.15.150:0/940747219 learned_addr learned my addr 172.21.15.150:0/940747219 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:18.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fedea59c700 1 -- 172.21.15.150:0/940747219 >> v1:172.21.15.197:6789/0 conn(0x7fedec070040 legacy=0x7fedec0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:18.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fedea59c700 1 -- 172.21.15.150:0/940747219 >> v1:172.21.15.150:6789/0 conn(0x7fedec06c860 legacy=0x7fedec152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fedea59c700 1 -- 172.21.15.150:0/940747219 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec068870 con 0x7fedec0bc830 2022-08-10T17:38:18.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fedea59c700 1 --2- 172.21.15.150:0/940747219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec0bc830 0x7fedec068110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feddc0096b0 tx=0x7feddc0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79529b97578144fc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fede959a700 1 -- 172.21.15.150:0/940747219 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc004230 con 0x7fedec0bc830 2022-08-10T17:38:18.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fede959a700 1 -- 172.21.15.150:0/940747219 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc004390 con 0x7fedec0bc830 2022-08-10T17:38:18.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.299+0000 7fede959a700 1 -- 172.21.15.150:0/940747219 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc010840 con 0x7fedec0bc830 2022-08-10T17:38:18.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 -- 172.21.15.150:0/940747219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec0bc830 msgr2=0x7fedec068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 --2- 172.21.15.150:0/940747219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec0bc830 0x7fedec068110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feddc0096b0 tx=0x7feddc0099c0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 -- 172.21.15.150:0/940747219 shutdown_connections 2022-08-10T17:38:18.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 --2- 172.21.15.150:0/940747219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec0bc830 0x7fedec068110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 -- 172.21.15.150:0/940747219 >> 172.21.15.150:0/940747219 conn(0x7fedec0c92f0 msgr2=0x7fedec0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:18.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 -- 172.21.15.150:0/940747219 shutdown_connections 2022-08-10T17:38:18.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.300+0000 7fedf090d700 1 -- 172.21.15.150:0/940747219 wait complete. 2022-08-10T17:38:18.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.301+0000 7fedf090d700 1 Processor -- start 2022-08-10T17:38:18.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 -- start start 2022-08-10T17:38:18.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fedec070040 0x7fedec0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bc830 0x7fedec0bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7470 con 0x7fedec06c860 2022-08-10T17:38:18.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0b6370 con 0x7fedec070040 2022-08-10T17:38:18.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedf090d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0b6020 con 0x7fedec0bc830 2022-08-10T17:38:18.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedea59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedea59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59018/0 (socket says 172.21.15.150:59018) 2022-08-10T17:38:18.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.302+0000 7fedea59c700 1 -- 172.21.15.150:0/2159006707 learned_addr learned my addr 172.21.15.150:0/2159006707 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:18.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bc830 msgr2=0x7fedec0bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fede9d9b700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fedec070040 0x7fedec0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedead9d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bc830 0x7fedec0bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bc830 0x7fedec0bacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fedec070040 msgr2=0x7fedec0bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fedec070040 0x7fedec0bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009310 con 0x7fedec06c860 2022-08-10T17:38:18.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedea59c700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fedec0654b0 tx=0x7feddc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0039b0 con 0x7fedec06c860 2022-08-10T17:38:18.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc003b10 con 0x7fedec06c860 2022-08-10T17:38:18.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0beb40 con 0x7fedec06c860 2022-08-10T17:38:18.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc020440 con 0x7fedec06c860 2022-08-10T17:38:18.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.303+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec1ec420 con 0x7fedec06c860 2022-08-10T17:38:18.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.304+0000 7fedf090d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 0x7fedec0bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.304+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec071e00 con 0x7fedec1ebfa0 2022-08-10T17:38:18.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.304+0000 7fede9d9b700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 0x7fedec0bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.304+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7feddc031070 con 0x7fedec06c860 2022-08-10T17:38:18.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.304+0000 7fede9d9b700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedec0bf060 con 0x7fedec1ebfa0 2022-08-10T17:38:18.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fedc80650b0 0x7fedc8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7fede9d9b700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 0x7fedec0bb1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedec153560 tx=0x7fede000d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7feddc086360 con 0x7fedec06c860 2022-08-10T17:38:18.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7fedead9d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fedc80650b0 0x7fedc8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000b070 con 0x7fedec1ebfa0 2022-08-10T17:38:18.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fede00072d0 con 0x7fedec1ebfa0 2022-08-10T17:38:18.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 msgr2=0x7fedec0bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 0x7fedec0bb1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedec153560 tx=0x7fede000d710 comp rx=0 tx=0).stop 2022-08-10T17:38:18.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 msgr2=0x7fedec0bb1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:18.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7feddaffd700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec1ebfa0 0x7fedec0bb1f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.305+0000 7fedead9d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fedc80650b0 0x7fedc8067560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fede4007b70 tx=0x7fede40071c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.312+0000 7fedf090d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 0x7fedec0bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:18.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.312+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec072890 con 0x7fedec0bbe40 2022-08-10T17:38:18.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.312+0000 7fede9d9b700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 0x7fedec0bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:18.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7fede9d9b700 1 -- 172.21.15.150:0/2159006707 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fedec069260 con 0x7fedec0bbe40 2022-08-10T17:38:18.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7fede9d9b700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 0x7fedec0bf420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fede0015000 tx=0x7fede0000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:18.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0013a30 con 0x7fedec0bbe40 2022-08-10T17:38:18.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4717 (secure 0 0 0) 0x7fede0013b90 con 0x7fedec0bbe40 2022-08-10T17:38:18.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 msgr2=0x7fedec0bf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 0x7fedec0bf420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fede0015000 tx=0x7fede0000ed0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 msgr2=0x7fedec0bf420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.313+0000 7feddaffd700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fedec0bbe40 0x7fedec0bf420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.325 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:18.326 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:18.326 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:18.326 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:38:18.326 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 4, 2022-08-10T17:38:18.327 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:38:18.327 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:38:18.327 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:38:18.327 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:38:18.328 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.328 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 186, 2022-08-10T17:38:18.328 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:18.328 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:38:18.329 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:38:18.329 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.329 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.329 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.330 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.331 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.331 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.331 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:38:18.331 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:38:18.332 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.332 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.332 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.332 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.332 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.333 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.333 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.333 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.333 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.334 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.334 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:38:18.334 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:38:18.334 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:38:18.335 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:38:18.335 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:38:18.335 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:18.335 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:18.336 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:18.336 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:38:18.336 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:38:18.336 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:38:18.336 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:38:18.337 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:38:18.337 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:38:18.337 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:18.337 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:38:18.338 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:18.338 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:18.338 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:18.338 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:18.339 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:18.339 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:18.339 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:18.339 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:18.339 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:18.340 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.340 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:38:18.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.340 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:38:18.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.341 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:18.341 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:18.341 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.341 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.342 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.342 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:38:18.342 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.343 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.343 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:38:18.344 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.344 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.344 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:38:18.345 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:38:18.345 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.345 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.345 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.346 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:18.346 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:18.346 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.347 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.347 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.347 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:38:18.348 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.348 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.348 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:38:18.349 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.349 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.349 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.350 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:38:18.350 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:38:18.350 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.350 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.350 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.351 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:18.351 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:18.352 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:18.352 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:18.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.352 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:18.352 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:38:18.353 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.353 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:18.353 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:38:18.354 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:18.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.354 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.355 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:38:18.355 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:38:18.355 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:18.355 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:18.355 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:18.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.356 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.356 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:38:18.357 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:38:18.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.357 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.357 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.357 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.358 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.358 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:38:18.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.359 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.359 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.359 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.359 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.360 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:38:18.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.360 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.360 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.360 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:18.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.361 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:18.361 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:38:18.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:18.362 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:18.362 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:18.362 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:38:18.362 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:18.363 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:18.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:18.363 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:38:18.363 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:18.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fedc80650b0 msgr2=0x7fedc8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fedc80650b0 0x7fedc8067560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fede4007b70 tx=0x7fede40071c0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 msgr2=0x7fedec0bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:18.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fedec0654b0 tx=0x7feddc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedead9d700 1 -- 172.21.15.150:0/2159006707 reap_dead start 2022-08-10T17:38:18.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 shutdown_connections 2022-08-10T17:38:18.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 --2- 172.21.15.150:0/2159006707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedec06c860 0x7fedec0bd130 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:18.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 >> 172.21.15.150:0/2159006707 conn(0x7fedec0c92f0 msgr2=0x7fedec1500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:18.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 shutdown_connections 2022-08-10T17:38:18.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:18.314+0000 7fedf090d700 1 -- 172.21.15.150:0/2159006707 wait complete. 2022-08-10T17:38:18.368 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:38:18.368 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2022-08-10T17:38:18.368 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:38:18.369 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:38:18.369 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:38:18.369 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:38:18.381 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:38:18.381 INFO:tasks.mon_thrash:Sending STOP to mon c 2022-08-10T17:38:18.382 INFO:tasks.ceph.mon.c:Sent signal 19 2022-08-10T17:38:18.382 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:38:33.383 INFO:tasks.mon_thrash:Sending CONT to mon c 2022-08-10T17:38:33.384 INFO:tasks.ceph.mon.c:Sent signal 18 2022-08-10T17:38:33.385 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:38:33.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:38:33.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.537+0000 7f833562a700 1 Processor -- start 2022-08-10T17:38:33.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.537+0000 7f833562a700 1 -- start start 2022-08-10T17:38:33.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f833562a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:33.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f833562a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8330070620 con 0x7f8330150b80 2022-08-10T17:38:33.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f833562a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83300ca810 con 0x7f8330150f50 2022-08-10T17:38:33.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f833562a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300c5ac0 con 0x7f83301573d0 2022-08-10T17:38:33.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832effd700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f83300c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:33.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832e7fc700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f8330150f50 0x7f8330156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:58102/0 (socket says 172.21.15.150:58102) 2022-08-10T17:38:33.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 learned_addr learned my addr 172.21.15.150:0/2712573333 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:33.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:33.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:33.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:33.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:33.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:33.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f83300c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:33.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:33.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:33.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:33.739+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:38:34.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f83300c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:34.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:34.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:34.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:34.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:34.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.140+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:38:34.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f83300c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:34.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:34.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:38:34.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:34.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:34.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:34.941+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:38:36.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f83301621f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:36.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f83301621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:36.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.197:6789/0 conn(0x7f8330150f50 legacy=0x7f8330156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:36.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f83300c42a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:36.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:36.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:36.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83300c5ac0 con 0x7f83100035e0 2022-08-10T17:38:36.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8310008c90 con 0x7f8310006130 2022-08-10T17:38:36.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 msgr2=0x7f8310005a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:36.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:36.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.537+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:36.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.538+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:38:36.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.538+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:36.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.538+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:36.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.538+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:36.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.738+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 msgr2=0x7f8310005a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:36.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.738+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:38:36.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.739+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:36.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.739+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:36.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.739+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:36.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.739+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:36.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:36.739+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:38:36.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:38:36.926 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:38:37.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.139+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 msgr2=0x7f8310005a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:37.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.139+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:38:37.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.140+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:37.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.140+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:37.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.140+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:37.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.140+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:37.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.140+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:38:37.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.940+0000 7f832effd700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 msgr2=0x7f8310005a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:37.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.940+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:38:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.941+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.941+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:38:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.941+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:38:37.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.941+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:38:37.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:37.941+0000 7f832e7fc700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:38:39.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 msgr2=0x7f83100085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:39.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f83100085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 msgr2=0x7f8310005a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:39.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.150:3300/0 conn(0x7f83100035e0 0x7f8310005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 reap_dead start 2022-08-10T17:38:39.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f831000b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f831000ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8330070010 con 0x7f8330150b80 2022-08-10T17:38:39.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83300c5ac0 con 0x7f8310006130 2022-08-10T17:38:39.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832cff9700 1 -- 172.21.15.150:0/2712573333 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8310008c90 con 0x7f83301573d0 2022-08-10T17:38:39.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.537+0000 7f832e7fc700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f831000d560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:39.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f831000b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:39.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> v2:172.21.15.197:3300/0 conn(0x7f8310006130 0x7f831000ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:39.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 msgr2=0x7f831000b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:38:39.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f831000b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 >> v1:172.21.15.150:6789/0 conn(0x7f8330150b80 legacy=0x7f831000d560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:39.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 -- 172.21.15.150:0/2712573333 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330070620 con 0x7f8310006130 2022-08-10T17:38:39.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832effd700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f831000b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:39.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832f7fe700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8310006130 0x7f831000ec80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8330157aa0 tx=0x7f8328004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f44c9f53d52fae server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:39.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832dffb700 1 -- 172.21.15.150:0/2712573333 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328009cd0 con 0x7f8310006130 2022-08-10T17:38:39.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.538+0000 7f832dffb700 1 -- 172.21.15.150:0/2712573333 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832800f040 con 0x7f8310006130 2022-08-10T17:38:39.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f832dffb700 1 -- 172.21.15.150:0/2712573333 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83280166a0 con 0x7f8310006130 2022-08-10T17:38:39.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 -- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8310006130 msgr2=0x7f831000ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:39.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8310006130 0x7f831000ec80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8330157aa0 tx=0x7f8328004530 comp rx=0 tx=0).stop 2022-08-10T17:38:39.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 -- 172.21.15.150:0/2712573333 shutdown_connections 2022-08-10T17:38:39.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8310006130 0x7f831000ec80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 --2- 172.21.15.150:0/2712573333 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83301573d0 0x7f831000b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.539+0000 7f833562a700 1 -- 172.21.15.150:0/2712573333 >> 172.21.15.150:0/2712573333 conn(0x7f8330071e40 msgr2=0x7f833006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:39.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.540+0000 7f833562a700 1 -- 172.21.15.150:0/2712573333 shutdown_connections 2022-08-10T17:38:39.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.540+0000 7f833562a700 1 -- 172.21.15.150:0/2712573333 wait complete. 2022-08-10T17:38:39.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.542+0000 7f833562a700 1 Processor -- start 2022-08-10T17:38:39.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.542+0000 7f833562a700 1 -- start start 2022-08-10T17:38:39.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 0x7f8330157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8330150b80 0x7f83301ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8330154e60 con 0x7f8310006130 2022-08-10T17:38:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83301ef930 con 0x7f83301573d0 2022-08-10T17:38:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f833562a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83301efc10 con 0x7f8330150b80 2022-08-10T17:38:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832effd700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 msgr2=0x7f8330157ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 0x7f8330157ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832f7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832e7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8330150b80 0x7f83301ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832f7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:41476/0 (socket says 172.21.15.150:41476) 2022-08-10T17:38:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.543+0000 7f832f7fe700 1 -- 172.21.15.150:0/1461675405 learned_addr learned my addr 172.21.15.150:0/1461675405 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 -- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8330150b80 msgr2=0x7f83301ef0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8330150b80 0x7f83301ef0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 -- 172.21.15.150:0/1461675405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 msgr2=0x7f8330157ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:38:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 0x7f8330157ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 -- 172.21.15.150:0/1461675405 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320009950 con 0x7f83301573d0 2022-08-10T17:38:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f832f7fe700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83300c74a0 tx=0x7f8328004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328009410 con 0x7f83301573d0 2022-08-10T17:38:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832801f670 con 0x7f83301573d0 2022-08-10T17:38:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832801fa20 con 0x7f83301573d0 2022-08-10T17:38:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83301efef0 con 0x7f83301573d0 2022-08-10T17:38:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.544+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8330154af0 con 0x7f83301573d0 2022-08-10T17:38:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.545+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8330155010 con 0x7f83301573d0 2022-08-10T17:38:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.546+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f832801c020 con 0x7f83301573d0 2022-08-10T17:38:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.546+0000 7f83177fe700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 0x7f8310068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.547+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f83280849c0 con 0x7f83301573d0 2022-08-10T17:38:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.547+0000 7f832effd700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 0x7f8310068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:39.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.547+0000 7f832effd700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 0x7f8310068380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8320003890 tx=0x7f83200095f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:39.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:39.551+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8330155010 con 0x7f83301573d0 2022-08-10T17:38:40.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.063+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8330155010 con 0x7f83301573d0 2022-08-10T17:38:40.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.063+0000 7f83177fe700 1 -- 172.21.15.150:0/1461675405 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1511 (secure 0 0 0) 0x7f8330155010 con 0x7f83301573d0 2022-08-10T17:38:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:38:40.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 msgr2=0x7f8310068380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 0x7f8310068380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8320003890 tx=0x7f83200095f0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 msgr2=0x7f83301595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83300c74a0 tx=0x7f8328004950 comp rx=0 tx=0).stop 2022-08-10T17:38:40.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 shutdown_connections 2022-08-10T17:38:40.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83301573d0 0x7f83301595f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8310006130 0x7f8330157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8310065ed0 0x7f8310068380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 --2- 172.21.15.150:0/1461675405 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8330150b80 0x7f83301ef0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.066+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 >> 172.21.15.150:0/1461675405 conn(0x7f8330071e40 msgr2=0x7f83300c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:40.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.067+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 shutdown_connections 2022-08-10T17:38:40.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.067+0000 7f833562a700 1 -- 172.21.15.150:0/1461675405 wait complete. 2022-08-10T17:38:40.087 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:38:40.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:38:40.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.271+0000 7f07bdc34700 1 Processor -- start 2022-08-10T17:38:40.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.271+0000 7f07bdc34700 1 -- start start 2022-08-10T17:38:40.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07bdc34700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f07b80c1560 0x7f07b815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07bdc34700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b806fae0 con 0x7f07b806a230 2022-08-10T17:38:40.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07bdc34700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b806eb80 con 0x7f07b81577d0 2022-08-10T17:38:40.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07bdc34700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b8157ba0 con 0x7f07b80c1560 2022-08-10T17:38:40.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07b6ffd700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f07b806a230 legacy=0x7f07b80c0e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:40.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07b77fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f07b81577d0 0x7f07b806b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:58154/0 (socket says 172.21.15.150:58154) 2022-08-10T17:38:40.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07b77fe700 1 -- 172.21.15.150:0/95692565 learned_addr learned my addr 172.21.15.150:0/95692565 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:40.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.272+0000 7f07b7fff700 1 --2- 172.21.15.150:0/95692565 >> v2:172.21.15.197:3300/0 conn(0x7f07b80c1560 0x7f07b815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b7fff700 1 -- 172.21.15.150:0/95692565 >> v1:172.21.15.197:6789/0 conn(0x7f07b81577d0 legacy=0x7f07b806b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b7fff700 1 -- 172.21.15.150:0/95692565 >> v1:172.21.15.150:6789/0 conn(0x7f07b806a230 legacy=0x7f07b80c0e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:40.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b7fff700 1 -- 172.21.15.150:0/95692565 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b806ee60 con 0x7f07b80c1560 2022-08-10T17:38:40.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b7fff700 1 --2- 172.21.15.150:0/95692565 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80c1560 0x7f07b815ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009d90 tx=0x7f07b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7742dd173078b1df server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b67fc700 1 -- 172.21.15.150:0/95692565 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000e070 con 0x7f07b80c1560 2022-08-10T17:38:40.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b67fc700 1 -- 172.21.15.150:0/95692565 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000bb90 con 0x7f07b80c1560 2022-08-10T17:38:40.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.273+0000 7f07b67fc700 1 -- 172.21.15.150:0/95692565 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00038a0 con 0x7f07b80c1560 2022-08-10T17:38:40.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 -- 172.21.15.150:0/95692565 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80c1560 msgr2=0x7f07b815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 --2- 172.21.15.150:0/95692565 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80c1560 0x7f07b815ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009d90 tx=0x7f07b000b330 comp rx=0 tx=0).stop 2022-08-10T17:38:40.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 -- 172.21.15.150:0/95692565 shutdown_connections 2022-08-10T17:38:40.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 --2- 172.21.15.150:0/95692565 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80c1560 0x7f07b815ef70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 -- 172.21.15.150:0/95692565 >> 172.21.15.150:0/95692565 conn(0x7f07b80c5940 msgr2=0x7f07b80c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 -- 172.21.15.150:0/95692565 shutdown_connections 2022-08-10T17:38:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.274+0000 7f07bdc34700 1 -- 172.21.15.150:0/95692565 wait complete. 2022-08-10T17:38:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.276+0000 7f07bdc34700 1 Processor -- start 2022-08-10T17:38:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.276+0000 7f07bdc34700 1 -- start start 2022-08-10T17:38:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 0x7f07b814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07b80c1560 0x7f07b80add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07b81577d0 0x7f07b80ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81604f0 con 0x7f07b80c1560 2022-08-10T17:38:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80acc10 con 0x7f07b806a230 2022-08-10T17:38:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07bdc34700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80acef0 con 0x7f07b81577d0 2022-08-10T17:38:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07b6ffd700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07b80c1560 msgr2=0x7f07b80add30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:40.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07b6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07b80c1560 0x7f07b80add30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:40.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07b77fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 0x7f07b814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07b77fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 0x7f07b814b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:41488/0 (socket says 172.21.15.150:41488) 2022-08-10T17:38:40.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.277+0000 7f07b77fe700 1 -- 172.21.15.150:0/1402068111 learned_addr learned my addr 172.21.15.150:0/1402068111 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:40.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b7fff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07b81577d0 0x7f07b80ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07b81577d0 msgr2=0x7f07b80ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f07b81577d0 0x7f07b80ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07b80c1560 msgr2=0x7f07b80add30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:38:40.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07b80c1560 0x7f07b80add30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009a70 con 0x7f07b806a230 2022-08-10T17:38:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07b77fe700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 0x7f07b814b6a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07a800c310 tx=0x7f07a800c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80072d0 con 0x7f07b806a230 2022-08-10T17:38:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8007430 con 0x7f07b806a230 2022-08-10T17:38:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80057c0 con 0x7f07b806a230 2022-08-10T17:38:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.278+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b80ad1d0 con 0x7f07b806a230 2022-08-10T17:38:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.279+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b80ad790 con 0x7f07b806a230 2022-08-10T17:38:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.280+0000 7f07bdc34700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 0x7f07b8160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.280+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b8068380 con 0x7f07b80ac790 2022-08-10T17:38:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.280+0000 7f07b6ffd700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 0x7f07b8160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.280+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f07a8019030 con 0x7f07b806a230 2022-08-10T17:38:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f07b6ffd700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07b8160660 con 0x7f07b80ac790 2022-08-10T17:38:40.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f07b6ffd700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 0x7f07b8160940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07b80c2b60 tx=0x7f07ac00b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0798065060 0x7f0798067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f07a80812d0 con 0x7f07b806a230 2022-08-10T17:38:40.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f07b7fff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0798065060 0x7f0798067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac003b10 con 0x7f07b80ac790 2022-08-10T17:38:40.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f07ac003c70 con 0x7f07b80ac790 2022-08-10T17:38:40.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 msgr2=0x7f07b8160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 0x7f07b8160940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07b80c2b60 tx=0x7f07ac00b6a0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 msgr2=0x7f07b8160940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:40.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.281+0000 7f079ffff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b80ac790 0x7f07b8160940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.282+0000 7f07b7fff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0798065060 0x7f0798067510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b370 tx=0x7f07b0011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.294+0000 7f07bdc34700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 0x7f07b8162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.294+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80ad950 con 0x7f07b8160e80 2022-08-10T17:38:40.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.294+0000 7f07b6ffd700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 0x7f07b8162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f07b6ffd700 1 -- 172.21.15.150:0/1402068111 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f07b8072890 con 0x7f07b8160e80 2022-08-10T17:38:40.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f07b6ffd700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 0x7f07b8162580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07ac013000 tx=0x7f07ac005930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011bf0 con 0x7f07b8160e80 2022-08-10T17:38:40.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5019 (secure 0 0 0) 0x7f07ac01f420 con 0x7f07b8160e80 2022-08-10T17:38:40.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 msgr2=0x7f07b8162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 0x7f07b8162580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07ac013000 tx=0x7f07ac005930 comp rx=0 tx=0).stop 2022-08-10T17:38:40.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 msgr2=0x7f07b8162580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:40.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.295+0000 7f079ffff700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b8160e80 0x7f07b8162580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.306 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:40.307 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:40.307 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:40.307 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:38:40.307 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 6, 2022-08-10T17:38:40.308 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:38:40.308 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:38:40.308 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:38:40.308 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.309 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:38:40.309 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:40.309 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:38:40.309 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:38:40.309 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.310 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.310 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.310 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.310 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.311 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.311 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.311 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.311 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.312 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.312 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:38:40.312 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:38:40.313 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.313 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.313 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.314 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.314 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.322 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.323 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.323 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.323 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.324 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:38:40.324 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:38:40.324 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:38:40.324 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:38:40.325 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:38:40.325 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:40.325 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:40.325 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:40.326 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:38:40.326 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:38:40.326 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:38:40.326 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:38:40.326 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:38:40.327 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:38:40.327 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:40.327 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:38:40.327 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.328 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.328 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.328 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.328 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.329 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.329 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.329 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.329 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.330 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.330 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:38:40.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.330 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:38:40.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.331 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:40.331 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:40.331 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.331 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.332 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.332 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:38:40.332 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.333 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.334 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:38:40.334 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.334 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.334 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.335 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:38:40.335 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:38:40.335 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.335 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.336 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.336 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:40.336 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:40.337 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.337 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.337 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.338 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:38:40.338 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.339 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.339 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:38:40.339 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.339 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.339 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.340 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:38:40.340 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:38:40.340 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.341 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.341 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.342 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:40.342 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:40.342 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.342 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.343 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.343 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:38:40.343 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.344 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.344 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:38:40.345 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.345 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.345 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.345 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:38:40.346 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:38:40.346 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.346 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.346 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.347 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.347 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.347 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:38:40.348 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:38:40.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.348 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.348 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.349 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.349 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.349 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.349 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:38:40.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.350 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.350 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.350 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:38:40.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.351 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.351 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:38:40.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.351 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.351 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.352 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:38:40.352 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.352 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.352 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:38:40.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.353 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:38:40.353 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.353 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.354 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.354 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.355 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:38:40.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.355 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:38:40.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.356 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.356 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.356 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.357 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.357 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.357 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:38:40.357 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:40.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0798065060 msgr2=0x7f0798067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0798065060 0x7f0798067510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b370 tx=0x7f07b0011000 comp rx=0 tx=0).stop 2022-08-10T17:38:40.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 msgr2=0x7f07b814b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 --2- 172.21.15.150:0/1402068111 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f07b806a230 0x7f07b814b6a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07a800c310 tx=0x7f07a800c620 comp rx=0 tx=0).stop 2022-08-10T17:38:40.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07b7fff700 1 -- 172.21.15.150:0/1402068111 reap_dead start 2022-08-10T17:38:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07b7fff700 1 -- 172.21.15.150:0/1402068111 reap_dead start 2022-08-10T17:38:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 shutdown_connections 2022-08-10T17:38:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 >> 172.21.15.150:0/1402068111 conn(0x7f07b80c5940 msgr2=0x7f07b80c2220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 shutdown_connections 2022-08-10T17:38:40.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.296+0000 7f07bdc34700 1 -- 172.21.15.150:0/1402068111 wait complete. 2022-08-10T17:38:40.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:38:40.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.489+0000 7fc518992700 1 Processor -- start 2022-08-10T17:38:40.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.489+0000 7fc518992700 1 -- start start 2022-08-10T17:38:40.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc518992700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 0x7fc51406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc518992700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51406e230 con 0x7fc51415abb0 2022-08-10T17:38:40.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc518992700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5140c4d60 con 0x7fc5140c2110 2022-08-10T17:38:40.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc518992700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51406d990 con 0x7fc5140c10d0 2022-08-10T17:38:40.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc512d9d700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fc5140c2110 0x7fc5140c25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:58174/0 (socket says 172.21.15.150:58174) 2022-08-10T17:38:40.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc512d9d700 1 -- 172.21.15.150:0/489522641 learned_addr learned my addr 172.21.15.150:0/489522641 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:38:40.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51259c700 1 --2- 172.21.15.150:0/489522641 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 0x7fc51406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc511d9b700 1 -- 172.21.15.150:0/489522641 >> v1:172.21.15.150:6789/0 conn(0x7fc51415abb0 legacy=0x7fc5140c5860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:38:40.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51159a700 1 -- 172.21.15.150:0/489522641 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487256961 0 0) 0x7fc50c001490 con 0x7fc5140c2110 2022-08-10T17:38:40.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51159a700 1 -- 172.21.15.150:0/489522641 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f8003430 con 0x7fc5140c2110 2022-08-10T17:38:40.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51259c700 1 -- 172.21.15.150:0/489522641 >> v1:172.21.15.197:6789/0 conn(0x7fc5140c2110 legacy=0x7fc5140c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51259c700 1 -- 172.21.15.150:0/489522641 >> v1:172.21.15.150:6789/0 conn(0x7fc51415abb0 legacy=0x7fc5140c5860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:38:40.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.490+0000 7fc51259c700 1 -- 172.21.15.150:0/489522641 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51406dc70 con 0x7fc5140c10d0 2022-08-10T17:38:40.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc51259c700 1 --2- 172.21.15.150:0/489522641 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 0x7fc51406d2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc5040096e0 tx=0x7fc5040099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=376a93398e25b743 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc51159a700 1 -- 172.21.15.150:0/489522641 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504004230 con 0x7fc5140c10d0 2022-08-10T17:38:40.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc51159a700 1 -- 172.21.15.150:0/489522641 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504004390 con 0x7fc5140c10d0 2022-08-10T17:38:40.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc51159a700 1 -- 172.21.15.150:0/489522641 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040107b0 con 0x7fc5140c10d0 2022-08-10T17:38:40.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc518992700 1 -- 172.21.15.150:0/489522641 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 msgr2=0x7fc51406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.491+0000 7fc518992700 1 --2- 172.21.15.150:0/489522641 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 0x7fc51406d2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc5040096e0 tx=0x7fc5040099f0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.492+0000 7fc518992700 1 -- 172.21.15.150:0/489522641 shutdown_connections 2022-08-10T17:38:40.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.492+0000 7fc518992700 1 --2- 172.21.15.150:0/489522641 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc5140c10d0 0x7fc51406d2e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.492+0000 7fc518992700 1 -- 172.21.15.150:0/489522641 >> 172.21.15.150:0/489522641 conn(0x7fc51406fae0 msgr2=0x7fc51406fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:40.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.492+0000 7fc518992700 1 -- 172.21.15.150:0/489522641 shutdown_connections 2022-08-10T17:38:40.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.492+0000 7fc518992700 1 -- 172.21.15.150:0/489522641 wait complete. 2022-08-10T17:38:40.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.493+0000 7fc518992700 1 Processor -- start 2022-08-10T17:38:40.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.493+0000 7fc518992700 1 -- start start 2022-08-10T17:38:40.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 0x7fc51414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5140c2110 0x7fc5141ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51415abb0 0x7fc51414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514068bc0 con 0x7fc5140c2110 2022-08-10T17:38:40.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514154030 con 0x7fc5140c10d0 2022-08-10T17:38:40.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc518992700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc514069880 con 0x7fc51415abb0 2022-08-10T17:38:40.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc511d9b700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5140c2110 msgr2=0x7fc5141ef680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:38:40.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc511d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5140c2110 0x7fc5141ef680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:38:40.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc51259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 0x7fc51414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc51259c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 0x7fc51414fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:41506/0 (socket says 172.21.15.150:41506) 2022-08-10T17:38:40.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc51259c700 1 -- 172.21.15.150:0/684006529 learned_addr learned my addr 172.21.15.150:0/684006529 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:38:40.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.494+0000 7fc512d9d700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51415abb0 0x7fc51414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51415abb0 msgr2=0x7fc51414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51415abb0 0x7fc51414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5140c2110 msgr2=0x7fc5141ef680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:38:40.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5140c2110 0x7fc5141ef680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504009310 con 0x7fc5140c10d0 2022-08-10T17:38:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc512d9d700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51415abb0 0x7fc51414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:38:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc51259c700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 0x7fc51414fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc504014040 tx=0x7fc5040045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504003720 con 0x7fc5140c10d0 2022-08-10T17:38:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5040038c0 con 0x7fc5140c10d0 2022-08-10T17:38:40.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504003c70 con 0x7fc5140c10d0 2022-08-10T17:38:40.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc514154450 con 0x7fc5140c10d0 2022-08-10T17:38:40.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.495+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5140688e0 con 0x7fc5140c10d0 2022-08-10T17:38:40.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.496+0000 7fc518992700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 0x7fc51414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.496+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140644b0 con 0x7fc51414f620 2022-08-10T17:38:40.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.497+0000 7fc511d9b700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 0x7fc51414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.497+0000 7fc511d9b700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc514154170 con 0x7fc51414f620 2022-08-10T17:38:40.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.497+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc50402d070 con 0x7fc5140c10d0 2022-08-10T17:38:40.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.497+0000 7fc511d9b700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 0x7fc51414e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc51415a590 tx=0x7fc50800b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.497+0000 7fc502ffd700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4f0065060 0x7fc4f0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc504083340 con 0x7fc5140c10d0 2022-08-10T17:38:40.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc512d9d700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4f0065060 0x7fc4f0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508003b00 con 0x7fc51414f620 2022-08-10T17:38:40.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fc508003c60 con 0x7fc51414f620 2022-08-10T17:38:40.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 msgr2=0x7fc51414e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 0x7fc51414e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc51415a590 tx=0x7fc50800b6a0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 msgr2=0x7fc51414e330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:40.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc502ffd700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc51414f620 0x7fc51414e330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.498+0000 7fc512d9d700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4f0065060 0x7fc4f0067510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007fd0 tx=0x7fc50c007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.505+0000 7fc518992700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 0x7fc5141e2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:38:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.505+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc514067100 con 0x7fc514068110 2022-08-10T17:38:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.505+0000 7fc511d9b700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 0x7fc5141e2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:38:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.505+0000 7fc511d9b700 1 -- 172.21.15.150:0/684006529 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc514072890 con 0x7fc514068110 2022-08-10T17:38:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc511d9b700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 0x7fc5141e2ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc508009fd0 tx=0x7fc508005920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:38:40.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011a50 con 0x7fc514068110 2022-08-10T17:38:40.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4874 (secure 0 0 0) 0x7fc508021440 con 0x7fc514068110 2022-08-10T17:38:40.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 msgr2=0x7fc5141e2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 0x7fc5141e2ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc508009fd0 tx=0x7fc508005920 comp rx=0 tx=0).stop 2022-08-10T17:38:40.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 msgr2=0x7fc5141e2ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:38:40.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc502ffd700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc514068110 0x7fc5141e2ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.520 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:38:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:38:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 6, 2022-08-10T17:38:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:38:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:38:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:38:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:38:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:38:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:38:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:38:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:38:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:38:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:38:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:38:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:38:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:38:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:38:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:38:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:38:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:38:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:38:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:38:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:38:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:38:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:38:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:38:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:38:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:38:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:38:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:38:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:38:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:38:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:38:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:38:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:38:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:38:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:38:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:38:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:38:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:38:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:38:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:38:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:38:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:38:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:38:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:38:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:38:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:38:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:38:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:38:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:38:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:38:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:38:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:38:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:38:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:38:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:38:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:38:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:38:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:38:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:38:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:38:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:38:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:38:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:38:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:38:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:38:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:38:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:38:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:38:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:38:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:38:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:38:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:38:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:38:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:38:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:38:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:38:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:38:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:38:40.563 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:38:40.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4f0065060 msgr2=0x7fc4f0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4f0065060 0x7fc4f0067510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007fd0 tx=0x7fc50c007dc0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 msgr2=0x7fc51414fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:38:40.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 --2- 172.21.15.150:0/684006529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc5140c10d0 0x7fc51414fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc504014040 tx=0x7fc5040045d0 comp rx=0 tx=0).stop 2022-08-10T17:38:40.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc512d9d700 1 -- 172.21.15.150:0/684006529 reap_dead start 2022-08-10T17:38:40.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc512d9d700 1 -- 172.21.15.150:0/684006529 reap_dead start 2022-08-10T17:38:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 shutdown_connections 2022-08-10T17:38:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.506+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 >> 172.21.15.150:0/684006529 conn(0x7fc51406fae0 msgr2=0x7fc5140c5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:38:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.507+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 shutdown_connections 2022-08-10T17:38:40.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:38:40.507+0000 7fc518992700 1 -- 172.21.15.150:0/684006529 wait complete. 2022-08-10T17:38:40.568 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:38:54.547 INFO:tasks.workunit.client.0.smithi150.stderr:Note: switching to 'e654560905d543d628247824fe5cbecad893480f'. 2022-08-10T17:38:54.547 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.548 INFO:tasks.workunit.client.0.smithi150.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-08-10T17:38:54.548 INFO:tasks.workunit.client.0.smithi150.stderr:changes and commit them, and you can discard any commits you make in this 2022-08-10T17:38:54.548 INFO:tasks.workunit.client.0.smithi150.stderr:state without impacting any branches by switching back to a branch. 2022-08-10T17:38:54.549 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.549 INFO:tasks.workunit.client.0.smithi150.stderr:If you want to create a new branch to retain commits you create, you may 2022-08-10T17:38:54.549 INFO:tasks.workunit.client.0.smithi150.stderr:do so (now or later) by using -c with the switch command. Example: 2022-08-10T17:38:54.550 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.550 INFO:tasks.workunit.client.0.smithi150.stderr: git switch -c 2022-08-10T17:38:54.551 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.551 INFO:tasks.workunit.client.0.smithi150.stderr:Or undo this operation with: 2022-08-10T17:38:54.551 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.552 INFO:tasks.workunit.client.0.smithi150.stderr: git switch - 2022-08-10T17:38:54.552 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.552 INFO:tasks.workunit.client.0.smithi150.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-08-10T17:38:54.553 INFO:tasks.workunit.client.0.smithi150.stderr: 2022-08-10T17:38:54.553 INFO:tasks.workunit.client.0.smithi150.stderr:HEAD is now at e654560905d qa: Default to Ubuntu 22.04 2022-08-10T17:38:54.555 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-08-10T17:38:54.583 INFO:tasks.workunit.client.0.smithi150.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-08-10T17:38:54.585 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-08-10T17:38:54.585 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-08-10T17:38:55.068 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-08-10T17:38:55.137 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-08-10T17:38:55.176 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-08-10T17:38:55.178 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-08-10T17:38:55.178 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-08-10T17:38:55.215 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-08-10T17:38:55.219 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2022-08-10T17:38:55.219 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-08-10T17:38:55.277 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2022-08-10T17:38:55.278 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2022-08-10T17:38:55.279 DEBUG:teuthology.orchestra.run.smithi150:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e654560905d543d628247824fe5cbecad893480f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2022-08-10T17:38:55.617 INFO:tasks.workunit.client.0.smithi150.stderr:Cloning into 'ffsb'... 2022-08-10T17:38:56.763 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-08-10T17:38:57.771 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether build environment is sane... yes 2022-08-10T17:38:57.781 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2022-08-10T17:38:57.781 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gawk... gawk 2022-08-10T17:38:57.795 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether make sets $(MAKE)... yes 2022-08-10T17:38:57.830 INFO:tasks.workunit.client.0.smithi150.stdout:checking build system type... x86_64-unknown-linux-gnu 2022-08-10T17:38:57.831 INFO:tasks.workunit.client.0.smithi150.stdout:checking host system type... x86_64-unknown-linux-gnu 2022-08-10T17:38:57.841 INFO:tasks.workunit.client.0.smithi150.stdout:checking for style of include used by make... GNU 2022-08-10T17:38:57.845 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc... gcc 2022-08-10T17:38:57.898 INFO:tasks.workunit.client.0.smithi150.stdout:checking for C compiler default output file name... a.out 2022-08-10T17:38:57.899 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether the C compiler works... yes 2022-08-10T17:38:57.902 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are cross compiling... no 2022-08-10T17:38:57.939 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of executables... 2022-08-10T17:38:57.969 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of object files... o 2022-08-10T17:38:57.997 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are using the GNU C compiler... yes 2022-08-10T17:38:58.593 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc accepts -g... yes 2022-08-10T17:38:58.636 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc option to accept ISO C89... none needed 2022-08-10T17:38:58.722 INFO:tasks.workunit.client.0.smithi150.stdout:checking dependency style of gcc... gcc3 2022-08-10T17:38:58.764 INFO:tasks.workunit.client.0.smithi150.stdout:checking how to run the C preprocessor... gcc -E 2022-08-10T17:38:58.988 INFO:tasks.workunit.client.0.smithi150.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2022-08-10T17:38:58.989 INFO:tasks.workunit.client.0.smithi150.stdout:checking for egrep... /usr/bin/grep -E 2022-08-10T17:38:58.996 INFO:tasks.workunit.client.0.smithi150.stdout:checking for AIX... no 2022-08-10T17:38:59.013 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc... (cached) gcc 2022-08-10T17:38:59.021 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are using the GNU C compiler... (cached) yes 2022-08-10T17:38:59.022 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc accepts -g... (cached) yes 2022-08-10T17:38:59.023 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2022-08-10T17:38:59.023 INFO:tasks.workunit.client.0.smithi150.stdout:checking dependency style of gcc... (cached) gcc3 2022-08-10T17:38:59.067 INFO:tasks.workunit.client.0.smithi150.stdout:checking for main in -lm... yes 2022-08-10T17:38:59.111 INFO:tasks.workunit.client.0.smithi150.stdout:checking for main in -lpthread... yes 2022-08-10T17:38:59.243 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ANSI C header files... yes 2022-08-10T17:38:59.282 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2022-08-10T17:38:59.322 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/types.h... yes 2022-08-10T17:38:59.364 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/stat.h... yes 2022-08-10T17:38:59.406 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdlib.h... yes 2022-08-10T17:38:59.449 INFO:tasks.workunit.client.0.smithi150.stdout:checking for string.h... yes 2022-08-10T17:38:59.492 INFO:tasks.workunit.client.0.smithi150.stdout:checking for memory.h... yes 2022-08-10T17:38:59.534 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strings.h... yes 2022-08-10T17:38:59.577 INFO:tasks.workunit.client.0.smithi150.stdout:checking for inttypes.h... yes 2022-08-10T17:38:59.620 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdint.h... yes 2022-08-10T17:38:59.663 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... yes 2022-08-10T17:38:59.993 INFO:tasks.workunit.client.0.smithi150.stdout:checking pthread.h usability... yes 2022-08-10T17:39:00.012 INFO:tasks.workunit.client.0.smithi150.stdout:checking pthread.h presence... yes 2022-08-10T17:39:00.013 INFO:tasks.workunit.client.0.smithi150.stdout:checking for pthread.h... yes 2022-08-10T17:39:00.059 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h usability... yes 2022-08-10T17:39:00.077 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h presence... yes 2022-08-10T17:39:00.078 INFO:tasks.workunit.client.0.smithi150.stdout:checking for fcntl.h... yes 2022-08-10T17:39:00.125 INFO:tasks.workunit.client.0.smithi150.stdout:checking limits.h usability... yes 2022-08-10T17:39:00.141 INFO:tasks.workunit.client.0.smithi150.stdout:checking limits.h presence... yes 2022-08-10T17:39:00.141 INFO:tasks.workunit.client.0.smithi150.stdout:checking for limits.h... yes 2022-08-10T17:39:00.155 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdint.h... (cached) yes 2022-08-10T17:39:00.194 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h usability... yes 2022-08-10T17:39:00.211 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h presence... yes 2022-08-10T17:39:00.212 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/time.h... yes 2022-08-10T17:39:00.225 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... (cached) yes 2022-08-10T17:39:00.264 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/vfs.h usability... yes 2022-08-10T17:39:00.280 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/vfs.h presence... yes 2022-08-10T17:39:00.280 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/vfs.h... yes 2022-08-10T17:39:00.323 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/limits.h usability... no 2022-08-10T17:39:00.340 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/limits.h presence... no 2022-08-10T17:39:00.340 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/limits.h... no 2022-08-10T17:39:00.370 INFO:tasks.workunit.client.0.smithi150.stdout:checking for an ANSI C-conforming const... yes 2022-08-10T17:39:00.400 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether time.h and sys/time.h may both be included... yes 2022-08-10T17:39:00.401 INFO:tasks.workunit.client.0.smithi150.stdout:checking for function prototypes... yes 2022-08-10T17:39:00.424 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether setvbuf arguments are reversed... no 2022-08-10T17:39:00.489 INFO:tasks.workunit.client.0.smithi150.stdout:checking for system... yes 2022-08-10T17:39:00.546 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gettimeofday... yes 2022-08-10T17:39:00.568 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:39:00.569 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:39:00.569 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:39:00.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:39:00.572 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:39:00.573 INFO:tasks.mon_thrash:Sending STOP to mon c 2022-08-10T17:39:00.573 INFO:tasks.ceph.mon.c:Sent signal 19 2022-08-10T17:39:00.574 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:39:00.604 INFO:tasks.workunit.client.0.smithi150.stdout:checking for mkdir... yes 2022-08-10T17:39:00.666 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strerror... yes 2022-08-10T17:39:00.724 INFO:tasks.workunit.client.0.smithi150.stdout:checking for open64... yes 2022-08-10T17:39:00.782 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stat64... yes 2022-08-10T17:39:00.841 INFO:tasks.workunit.client.0.smithi150.stdout:checking for fseeko64... yes 2022-08-10T17:39:00.900 INFO:tasks.workunit.client.0.smithi150.stdout:checking for lrand48_r... yes 2022-08-10T17:39:00.958 INFO:tasks.workunit.client.0.smithi150.stdout:checking for srand48_r... yes 2022-08-10T17:39:00.980 INFO:tasks.workunit.client.0.smithi150.stdout:configure: creating ./config.status 2022-08-10T17:39:01.071 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating Makefile 2022-08-10T17:39:01.083 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating config.h 2022-08-10T17:39:01.099 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: executing depfiles commands 2022-08-10T17:39:01.143 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: executing default commands 2022-08-10T17:39:01.187 INFO:tasks.workunit.client.0.smithi150.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2022-08-10T17:39:01.189 INFO:tasks.workunit.client.0.smithi150.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2022-08-10T17:39:01.190 INFO:tasks.workunit.client.0.smithi150.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2022-08-10T17:39:01.190 INFO:tasks.workunit.client.0.smithi150.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2022-08-10T17:39:01.190 INFO:tasks.workunit.client.0.smithi150.stderr: to install the `Automake' and `Perl' packages. Grab them from 2022-08-10T17:39:01.191 INFO:tasks.workunit.client.0.smithi150.stderr: any GNU archive site. 2022-08-10T17:39:01.191 INFO:tasks.workunit.client.0.smithi150.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2022-08-10T17:39:01.193 INFO:tasks.workunit.client.0.smithi150.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2022-08-10T17:39:01.194 INFO:tasks.workunit.client.0.smithi150.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2022-08-10T17:39:01.194 INFO:tasks.workunit.client.0.smithi150.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2022-08-10T17:39:01.194 INFO:tasks.workunit.client.0.smithi150.stderr: You might want to install the `Automake' and `Perl' packages. 2022-08-10T17:39:01.194 INFO:tasks.workunit.client.0.smithi150.stderr: Grab them from any GNU archive site. 2022-08-10T17:39:01.207 INFO:tasks.workunit.client.0.smithi150.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2022-08-10T17:39:02.108 INFO:tasks.workunit.client.0.smithi150.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2022-08-10T17:39:02.109 INFO:tasks.workunit.client.0.smithi150.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2022-08-10T17:39:02.109 INFO:tasks.workunit.client.0.smithi150.stderr:If you have problems, you may need to regenerate the build system entirely. 2022-08-10T17:39:02.109 INFO:tasks.workunit.client.0.smithi150.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2022-08-10T17:39:02.266 INFO:tasks.workunit.client.0.smithi150.stdout:/bin/sh ./config.status --recheck 2022-08-10T17:39:02.315 INFO:tasks.workunit.client.0.smithi150.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2022-08-10T17:39:02.412 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-08-10T17:39:03.420 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether build environment is sane... yes 2022-08-10T17:39:03.425 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2022-08-10T17:39:03.425 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gawk... gawk 2022-08-10T17:39:03.464 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether make sets $(MAKE)... yes 2022-08-10T17:39:03.498 INFO:tasks.workunit.client.0.smithi150.stdout:checking build system type... x86_64-unknown-linux-gnu 2022-08-10T17:39:03.498 INFO:tasks.workunit.client.0.smithi150.stdout:checking host system type... x86_64-unknown-linux-gnu 2022-08-10T17:39:03.510 INFO:tasks.workunit.client.0.smithi150.stdout:checking for style of include used by make... GNU 2022-08-10T17:39:04.229 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc... gcc 2022-08-10T17:39:04.928 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether the C compiler works... yes 2022-08-10T17:39:04.928 INFO:tasks.workunit.client.0.smithi150.stdout:checking for C compiler default output file name... a.out 2022-08-10T17:39:04.966 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of executables... 2022-08-10T17:39:05.002 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are cross compiling... no 2022-08-10T17:39:05.038 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of object files... o 2022-08-10T17:39:05.062 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are using the GNU C compiler... yes 2022-08-10T17:39:05.085 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc accepts -g... yes 2022-08-10T17:39:05.118 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc option to accept ISO C89... none needed 2022-08-10T17:39:07.241 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:39:07.244 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:39:08.768 INFO:tasks.workunit.client.0.smithi150.stdout:checking dependency style of gcc... gcc3 2022-08-10T17:39:08.809 INFO:tasks.workunit.client.0.smithi150.stdout:checking how to run the C preprocessor... gcc -E 2022-08-10T17:39:08.858 INFO:tasks.workunit.client.0.smithi150.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2022-08-10T17:39:08.859 INFO:tasks.workunit.client.0.smithi150.stdout:checking for egrep... /usr/bin/grep -E 2022-08-10T17:39:08.983 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ANSI C header files... yes 2022-08-10T17:39:09.015 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/types.h... yes 2022-08-10T17:39:09.053 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/stat.h... yes 2022-08-10T17:39:09.131 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdlib.h... yes 2022-08-10T17:39:09.168 INFO:tasks.workunit.client.0.smithi150.stdout:checking for string.h... yes 2022-08-10T17:39:09.204 INFO:tasks.workunit.client.0.smithi150.stdout:checking for memory.h... yes 2022-08-10T17:39:09.240 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strings.h... yes 2022-08-10T17:39:09.277 INFO:tasks.workunit.client.0.smithi150.stdout:checking for inttypes.h... yes 2022-08-10T17:39:09.313 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdint.h... yes 2022-08-10T17:39:09.351 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... yes 2022-08-10T17:39:09.394 INFO:tasks.workunit.client.0.smithi150.stdout:checking minix/config.h usability... no 2022-08-10T17:39:09.695 INFO:tasks.workunit.client.0.smithi150.stdout:checking minix/config.h presence... no 2022-08-10T17:39:09.695 INFO:tasks.workunit.client.0.smithi150.stdout:checking for minix/config.h... no 2022-08-10T17:39:09.745 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2022-08-10T17:39:09.745 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc... (cached) gcc 2022-08-10T17:39:10.311 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are using the GNU C compiler... (cached) yes 2022-08-10T17:39:10.312 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc accepts -g... (cached) yes 2022-08-10T17:39:10.312 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2022-08-10T17:39:10.312 INFO:tasks.workunit.client.0.smithi150.stdout:checking dependency style of gcc... (cached) gcc3 2022-08-10T17:39:10.628 INFO:tasks.workunit.client.0.smithi150.stdout:checking for main in -lm... yes 2022-08-10T17:39:10.670 INFO:tasks.workunit.client.0.smithi150.stdout:checking for main in -lpthread... yes 2022-08-10T17:39:10.671 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ANSI C header files... (cached) yes 2022-08-10T17:39:10.709 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2022-08-10T17:39:11.333 INFO:tasks.workunit.client.0.smithi150.stdout:checking pthread.h usability... yes 2022-08-10T17:39:11.349 INFO:tasks.workunit.client.0.smithi150.stdout:checking pthread.h presence... yes 2022-08-10T17:39:11.349 INFO:tasks.workunit.client.0.smithi150.stdout:checking for pthread.h... yes 2022-08-10T17:39:11.397 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h usability... yes 2022-08-10T17:39:11.411 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h presence... yes 2022-08-10T17:39:11.412 INFO:tasks.workunit.client.0.smithi150.stdout:checking for fcntl.h... yes 2022-08-10T17:39:11.462 INFO:tasks.workunit.client.0.smithi150.stdout:checking limits.h usability... yes 2022-08-10T17:39:11.475 INFO:tasks.workunit.client.0.smithi150.stdout:checking limits.h presence... yes 2022-08-10T17:39:11.475 INFO:tasks.workunit.client.0.smithi150.stdout:checking for limits.h... yes 2022-08-10T17:39:11.490 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdint.h... (cached) yes 2022-08-10T17:39:11.523 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h usability... yes 2022-08-10T17:39:11.536 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h presence... yes 2022-08-10T17:39:11.537 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/time.h... yes 2022-08-10T17:39:11.550 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... (cached) yes 2022-08-10T17:39:11.583 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/vfs.h usability... yes 2022-08-10T17:39:12.548 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/vfs.h presence... yes 2022-08-10T17:39:12.548 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/vfs.h... yes 2022-08-10T17:39:12.647 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/limits.h usability... no 2022-08-10T17:39:12.668 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/limits.h presence... no 2022-08-10T17:39:12.669 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/limits.h... no 2022-08-10T17:39:12.693 INFO:tasks.workunit.client.0.smithi150.stdout:checking for an ANSI C-conforming const... yes 2022-08-10T17:39:12.719 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether time.h and sys/time.h may both be included... yes 2022-08-10T17:39:12.770 INFO:tasks.workunit.client.0.smithi150.stdout:checking for system... yes 2022-08-10T17:39:12.824 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gettimeofday... yes 2022-08-10T17:39:12.876 INFO:tasks.workunit.client.0.smithi150.stdout:checking for mkdir... yes 2022-08-10T17:39:12.928 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strerror... yes 2022-08-10T17:39:12.979 INFO:tasks.workunit.client.0.smithi150.stdout:checking for open64... yes 2022-08-10T17:39:13.595 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stat64... yes 2022-08-10T17:39:13.941 INFO:tasks.workunit.client.0.smithi150.stdout:checking for fseeko64... yes 2022-08-10T17:39:13.994 INFO:tasks.workunit.client.0.smithi150.stdout:checking for lrand48_r... yes 2022-08-10T17:39:14.047 INFO:tasks.workunit.client.0.smithi150.stdout:checking for srand48_r... yes 2022-08-10T17:39:14.071 INFO:tasks.workunit.client.0.smithi150.stdout:configure: creating ./config.status 2022-08-10T17:39:14.127 INFO:tasks.workunit.client.0.smithi150.stdout: /bin/sh ./config.status 2022-08-10T17:39:14.171 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating Makefile 2022-08-10T17:39:14.182 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating config.h 2022-08-10T17:39:14.201 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: executing depfiles commands 2022-08-10T17:39:14.218 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: executing default commands 2022-08-10T17:39:14.524 INFO:tasks.workunit.client.0.smithi150.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2022-08-10T17:39:14.670 INFO:tasks.workunit.client.0.smithi150.stdout:rm -f stamp-h1 2022-08-10T17:39:14.671 INFO:tasks.workunit.client.0.smithi150.stdout:touch config.h.in 2022-08-10T17:39:14.672 INFO:tasks.workunit.client.0.smithi150.stdout:cd . && /bin/sh ./config.status config.h 2022-08-10T17:39:14.710 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating config.h 2022-08-10T17:39:14.731 INFO:tasks.workunit.client.0.smithi150.stdout:make all-am 2022-08-10T17:39:14.736 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2022-08-10T17:39:14.736 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2022-08-10T17:39:15.135 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2022-08-10T17:39:15.137 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2022-08-10T17:39:15.199 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2022-08-10T17:39:15.201 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2022-08-10T17:39:15.279 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/main.Tpo .deps/main.Po 2022-08-10T17:39:15.281 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2022-08-10T17:39:15.368 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2022-08-10T17:39:15.370 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2022-08-10T17:39:15.477 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2022-08-10T17:39:15.480 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2022-08-10T17:39:15.526 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2022-08-10T17:39:15.529 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2022-08-10T17:39:15.567 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2022-08-10T17:39:15.569 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2022-08-10T17:39:15.575 INFO:tasks.mon_thrash:Sending CONT to mon c 2022-08-10T17:39:15.575 INFO:tasks.ceph.mon.c:Sent signal 18 2022-08-10T17:39:15.576 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:39:15.576 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:15.620 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2022-08-10T17:39:15.623 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2022-08-10T17:39:15.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.698+0000 7fbfc2b71700 1 Processor -- start 2022-08-10T17:39:15.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.698+0000 7fbfc2b71700 1 -- start start 2022-08-10T17:39:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc2b71700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfbc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc2b71700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0bf640 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc2b71700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc156400 con 0x7fbfbc0705d0 2022-08-10T17:39:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc2b71700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1566e0 con 0x7fbfbc14d080 2022-08-10T17:39:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc110e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbfbc06c0e0 0x7fbfbc0c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43756/0 (socket says 172.21.15.150:43756) 2022-08-10T17:39:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.699+0000 7fbfc110e700 1 -- 172.21.15.150:0/3892976661 learned_addr learned my addr 172.21.15.150:0/3892976661 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc090d700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfbc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581726336 0 0) 0x7fbfb4001490 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa0003430 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628001125 0 0) 0x7fbfbc156400 con 0x7fbfbc0705d0 2022-08-10T17:39:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb4001490 con 0x7fbfbc0705d0 2022-08-10T17:39:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007954566 0 0) 0x7fbfa0003430 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 msgr2=0x7fbfbc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfbc06bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 >> v1:172.21.15.197:6789/0 conn(0x7fbfbc0705d0 legacy=0x7fbfbc0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc1569c0 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fbfb4001b80 con 0x7fbfbc06c0e0 2022-08-10T17:39:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 >> v1:172.21.15.150:6789/0 conn(0x7fbfbc06c0e0 legacy=0x7fbfbc0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0003a40 0x7fbfa0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfa00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa0004c10 0x7fbfa0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1566e0 con 0x7fbfa0004c10 2022-08-10T17:39:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa000b940 con 0x7fbfa0003a40 2022-08-10T17:39:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa000bb00 con 0x7fbfbc14d080 2022-08-10T17:39:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa0004c10 0x7fbfa0005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc090d700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0003a40 0x7fbfa0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfbbfff700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfa00046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 -- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 msgr2=0x7fbfa00046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc14d080 0x7fbfa00046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 -- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0003a40 msgr2=0x7fbfa0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0003a40 0x7fbfa0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc110e700 1 -- 172.21.15.150:0/3892976661 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0003430 con 0x7fbfa0004c10 2022-08-10T17:39:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.700+0000 7fbfc090d700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0003a40 0x7fbfa0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:39:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc110e700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa0004c10 0x7fbfa0005080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc06c4b0 tx=0x7fbfa0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c81ee5bfa88bbf5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400cdd0 con 0x7fbfa0004c10 2022-08-10T17:39:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4005b60 con 0x7fbfa0004c10 2022-08-10T17:39:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfbb7fe700 1 -- 172.21.15.150:0/3892976661 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40070d0 con 0x7fbfa0004c10 2022-08-10T17:39:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 -- 172.21.15.150:0/3892976661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa0004c10 msgr2=0x7fbfa0005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/3892976661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfa0004c10 0x7fbfa0005080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc06c4b0 tx=0x7fbfa0005700 comp rx=0 tx=0).stop 2022-08-10T17:39:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc110e700 1 -- 172.21.15.150:0/3892976661 reap_dead start 2022-08-10T17:39:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 -- 172.21.15.150:0/3892976661 shutdown_connections 2022-08-10T17:39:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 -- 172.21.15.150:0/3892976661 >> 172.21.15.150:0/3892976661 conn(0x7fbfbc0c8a10 msgr2=0x7fbfbc0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 -- 172.21.15.150:0/3892976661 shutdown_connections 2022-08-10T17:39:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.701+0000 7fbfc2b71700 1 -- 172.21.15.150:0/3892976661 wait complete. 2022-08-10T17:39:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.703+0000 7fbfc2b71700 1 Processor -- start 2022-08-10T17:39:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.703+0000 7fbfc2b71700 1 -- start start 2022-08-10T17:39:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0004c10 0x7fbfbc149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc153ea0 0x7fbfbc1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0bd860 con 0x7fbfbc1e8350 2022-08-10T17:39:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0bcd90 con 0x7fbfa0004c10 2022-08-10T17:39:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1e7ec0 con 0x7fbfbc153ea0 2022-08-10T17:39:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59320/0 (socket says 172.21.15.150:59320) 2022-08-10T17:39:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 -- 172.21.15.150:0/561889427 learned_addr learned my addr 172.21.15.150:0/561889427 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc090d700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0004c10 0x7fbfbc149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfbbfff700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc153ea0 0x7fbfbc1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 -- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc153ea0 msgr2=0x7fbfbc1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc153ea0 0x7fbfbc1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 -- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0004c10 msgr2=0x7fbfbc149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0004c10 0x7fbfbc149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 -- 172.21.15.150:0/561889427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0be400 con 0x7fbfbc1e8350 2022-08-10T17:39:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc110e700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400ce00 tx=0x7fbfb4001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4022070 con 0x7fbfbc1e8350 2022-08-10T17:39:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40011c0 con 0x7fbfbc1e8350 2022-08-10T17:39:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc1e87a0 con 0x7fbfbc1e8350 2022-08-10T17:39:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.704+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400cee0 con 0x7fbfbc1e8350 2022-08-10T17:39:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.705+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc0be670 con 0x7fbfbc1e8350 2022-08-10T17:39:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.706+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc1e8000 con 0x7fbfbc1e8350 2022-08-10T17:39:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.706+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fbfb4010070 con 0x7fbfbc1e8350 2022-08-10T17:39:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.706+0000 7fbfb97fa700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 0x7fbfa4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.706+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fbfb40828a0 con 0x7fbfbc1e8350 2022-08-10T17:39:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.706+0000 7fbfc090d700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 0x7fbfa4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.707+0000 7fbfc090d700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 0x7fbfa4067590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000abd0 tx=0x7fbfb000a1f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.711+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fbfb4050880 con 0x7fbfbc1e8350 2022-08-10T17:39:15.783 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2022-08-10T17:39:15.785 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2022-08-10T17:39:15.894 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2022-08-10T17:39:15.896 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2022-08-10T17:39:15.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.971+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbfbc0bf640 con 0x7fbfbc1e8350 2022-08-10T17:39:15.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.972+0000 7fbfb97fa700 1 -- 172.21.15.150:0/561889427 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7fbfbc0bf640 con 0x7fbfbc1e8350 2022-08-10T17:39:15.977 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.973+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 msgr2=0x7fbfa4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.973+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 0x7fbfa4067590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000abd0 tx=0x7fbfb000a1f0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 msgr2=0x7fbfbc0bc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:15.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400ce00 tx=0x7fbfb4001e40 comp rx=0 tx=0).stop 2022-08-10T17:39:15.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 shutdown_connections 2022-08-10T17:39:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfbc1e8350 0x7fbfbc0bc850 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbfa0004c10 0x7fbfbc149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbfa40650e0 0x7fbfa4067590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 --2- 172.21.15.150:0/561889427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbfbc153ea0 0x7fbfbc1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:15.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 >> 172.21.15.150:0/561889427 conn(0x7fbfbc0c8a10 msgr2=0x7fbfbc154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 shutdown_connections 2022-08-10T17:39:15.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:15.974+0000 7fbfc2b71700 1 -- 172.21.15.150:0/561889427 wait complete. 2022-08-10T17:39:15.990 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:39:15.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:39:16.033 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2022-08-10T17:39:16.035 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2022-08-10T17:39:16.097 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2022-08-10T17:39:16.100 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2022-08-10T17:39:16.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.113+0000 7f093ab6d700 1 Processor -- start 2022-08-10T17:39:16.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.113+0000 7f093ab6d700 1 -- start start 2022-08-10T17:39:16.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f093ab6d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f09340c7030 0x7f093406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f093ab6d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340bb090 con 0x7f09340c3920 2022-08-10T17:39:16.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f093ab6d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0934064ae0 con 0x7f09340cb790 2022-08-10T17:39:16.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f093ab6d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340c33c0 con 0x7f09340c7030 2022-08-10T17:39:16.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f0938909700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f09340c3920 0x7f09340c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43772/0 (socket says 172.21.15.150:43772) 2022-08-10T17:39:16.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.114+0000 7f0938909700 1 -- 172.21.15.150:0/3533725183 learned_addr learned my addr 172.21.15.150:0/3533725183 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:16.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 --2- 172.21.15.150:0/3533725183 >> v2:172.21.15.197:3300/0 conn(0x7f09340c7030 0x7f093406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616045187 0 0) 0x7f09340bb090 con 0x7f09340c3920 2022-08-10T17:39:16.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0918003430 con 0x7f09340c3920 2022-08-10T17:39:16.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912610410 0 0) 0x7f0918003430 con 0x7f09340c3920 2022-08-10T17:39:16.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 >> v2:172.21.15.197:3300/0 conn(0x7f09340c7030 msgr2=0x7f093406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 --2- 172.21.15.150:0/3533725183 >> v2:172.21.15.197:3300/0 conn(0x7f09340c7030 0x7f093406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 >> v1:172.21.15.197:6789/0 conn(0x7f09340cb790 legacy=0x7f0934158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340b0b70 con 0x7f09340c3920 2022-08-10T17:39:16.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f0928001670 con 0x7f09340c3920 2022-08-10T17:39:16.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 >> v1:172.21.15.150:6789/0 conn(0x7f09340c3920 legacy=0x7f09340c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0918003880 0x7f0918003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 0x7f0918004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0918005080 0x7f091800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c33c0 con 0x7f09180046d0 2022-08-10T17:39:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091800bf00 con 0x7f0918005080 2022-08-10T17:39:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091800c0c0 con 0x7f0918003880 2022-08-10T17:39:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 0x7f0918004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0938909700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0918003880 0x7f0918003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f093910a700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0918005080 0x7f091800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 -- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0918003880 msgr2=0x7f0918003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0918003880 0x7f0918003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 -- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0918005080 msgr2=0x7f091800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0918005080 0x7f091800b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 -- 172.21.15.150:0/3533725183 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918003430 con 0x7f09180046d0 2022-08-10T17:39:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f093910a700 1 -- 172.21.15.150:0/3533725183 reap_dead start 2022-08-10T17:39:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.115+0000 7f0933fff700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 0x7f0918004b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09200099d0 tx=0x7f0918005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b497b27a54310d58 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000e500 con 0x7f09180046d0 2022-08-10T17:39:16.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092000e660 con 0x7f09180046d0 2022-08-10T17:39:16.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f09337fe700 1 -- 172.21.15.150:0/3533725183 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000e9f0 con 0x7f09180046d0 2022-08-10T17:39:16.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 -- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 msgr2=0x7f0918004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 0x7f0918004b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09200099d0 tx=0x7f0918005700 comp rx=0 tx=0).stop 2022-08-10T17:39:16.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 -- 172.21.15.150:0/3533725183 shutdown_connections 2022-08-10T17:39:16.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 --2- 172.21.15.150:0/3533725183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09180046d0 0x7f0918004b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 -- 172.21.15.150:0/3533725183 >> 172.21.15.150:0/3533725183 conn(0x7f09340cab60 msgr2=0x7f09340caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 -- 172.21.15.150:0/3533725183 shutdown_connections 2022-08-10T17:39:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.116+0000 7f093ab6d700 1 -- 172.21.15.150:0/3533725183 wait complete. 2022-08-10T17:39:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.117+0000 7f093ab6d700 1 Processor -- start 2022-08-10T17:39:16.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 -- start start 2022-08-10T17:39:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09180046d0 0x7f09341ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f093414e6f0 0x7f093414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340bab40 con 0x7f09341e9be0 2022-08-10T17:39:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09341eab30 con 0x7f093414e6f0 2022-08-10T17:39:16.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.118+0000 7f093ab6d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09341dec50 con 0x7f09180046d0 2022-08-10T17:39:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59338/0 (socket says 172.21.15.150:59338) 2022-08-10T17:39:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 -- 172.21.15.150:0/392134355 learned_addr learned my addr 172.21.15.150:0/392134355 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:16.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f093910a700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f093414e6f0 0x7f093414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09180046d0 msgr2=0x7f09341ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09180046d0 0x7f09341ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f093414e6f0 msgr2=0x7f093414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f093414e6f0 0x7f093414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09341de3b0 con 0x7f09341e9be0 2022-08-10T17:39:16.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f0933fff700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f091800bed0 tx=0x7f0920004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920022070 con 0x7f09341e9be0 2022-08-10T17:39:16.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092000fed0 con 0x7f09341e9be0 2022-08-10T17:39:16.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09341de690 con 0x7f09341e9be0 2022-08-10T17:39:16.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000e500 con 0x7f09341e9be0 2022-08-10T17:39:16.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.119+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09341ed1c0 con 0x7f09341e9be0 2022-08-10T17:39:16.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.120+0000 7f093ab6d700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 0x7f09340c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.120+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340bab40 con 0x7f09341ed350 2022-08-10T17:39:16.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.120+0000 7f0938909700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 0x7f09340c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.120+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f092002e030 con 0x7f09341e9be0 2022-08-10T17:39:16.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.120+0000 7f0938909700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09340c2810 con 0x7f09341ed350 2022-08-10T17:39:16.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f0938909700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 0x7f09340c5420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09280011e0 tx=0x7f09280049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f091c0650e0 0x7f091c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0920083570 con 0x7f09341e9be0 2022-08-10T17:39:16.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f093910a700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f091c0650e0 0x7f091c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928017070 con 0x7f09341ed350 2022-08-10T17:39:16.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f0928012560 con 0x7f09341ed350 2022-08-10T17:39:16.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 msgr2=0x7f09340c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 0x7f09340c5420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09280011e0 tx=0x7f09280049d0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 msgr2=0x7f09340c5420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f09317fa700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341ed350 0x7f09340c5420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.121+0000 7f093910a700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f091c0650e0 0x7f091c067590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09340c5090 tx=0x7f092c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.128+0000 7f093ab6d700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 0x7f09341dcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.128+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09341ed720 con 0x7f09340c5960 2022-08-10T17:39:16.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.128+0000 7f0938909700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 0x7f09341dcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f0938909700 1 -- 172.21.15.150:0/392134355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09340c5d60 con 0x7f09340c5960 2022-08-10T17:39:16.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f0938909700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 0x7f09341dcdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0928015040 tx=0x7f0928001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928012e90 con 0x7f09340c5960 2022-08-10T17:39:16.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4378 (secure 0 0 0) 0x7f0928013e10 con 0x7f09340c5960 2022-08-10T17:39:16.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 msgr2=0x7f09341dcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 0x7f09341dcdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0928015040 tx=0x7f0928001e70 comp rx=0 tx=0).stop 2022-08-10T17:39:16.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 msgr2=0x7f09341dcdb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.129+0000 7f09317fa700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09340c5960 0x7f09341dcdb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.150 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:16.150 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:16.151 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:16.151 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:39:16.151 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:16.151 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:16.151 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:16.152 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:16.152 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:16.152 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.152 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:39:16.153 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.153 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:16.153 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:16.153 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.154 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.154 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.154 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.154 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.155 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.155 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.155 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.156 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.156 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.156 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:16.157 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:16.157 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.157 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.157 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.158 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.158 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.158 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.158 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.159 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.159 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.159 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.160 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:16.160 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:16.160 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:16.160 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:16.160 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:16.161 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:16.161 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.161 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.162 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:16.162 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:16.162 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:16.163 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:16.163 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:16.164 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:16.164 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.165 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:16.165 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.165 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.166 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.166 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.167 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.167 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.167 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.168 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.168 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.168 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.169 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:16.169 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.170 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:16.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.170 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:16.171 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:16.171 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.171 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.172 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.172 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:16.172 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.173 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.173 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:16.173 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.174 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.174 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.175 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.175 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.176 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.176 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.177 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.178 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:16.179 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:16.179 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.180 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.181 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.181 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:16.182 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.183 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.184 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:16.184 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.185 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.186 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.187 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.187 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.188 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.188 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.190 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:16.190 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:16.191 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.191 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.192 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.193 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:16.193 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.194 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.194 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.195 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.195 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:16.196 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.196 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.197 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.197 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.198 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.198 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.198 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.199 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.199 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.199 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.199 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.200 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.200 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:16.200 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:16.200 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.201 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.201 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.201 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.201 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.202 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.202 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:16.202 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.203 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.203 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.203 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:39:16.203 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.204 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.204 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:16.204 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:16.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f091c0650e0 msgr2=0x7f091c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f091c0650e0 0x7f091c067590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09340c5090 tx=0x7f092c009040 comp rx=0 tx=0).stop 2022-08-10T17:39:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 msgr2=0x7f09341ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f091800bed0 tx=0x7f0920004640 comp rx=0 tx=0).stop 2022-08-10T17:39:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093910a700 1 -- 172.21.15.150:0/392134355 reap_dead start 2022-08-10T17:39:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 shutdown_connections 2022-08-10T17:39:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 --2- 172.21.15.150:0/392134355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341e9be0 0x7f09341ed9c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 >> 172.21.15.150:0/392134355 conn(0x7f09340cab60 msgr2=0x7f09340c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 shutdown_connections 2022-08-10T17:39:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.130+0000 7f093ab6d700 1 -- 172.21.15.150:0/392134355 wait complete. 2022-08-10T17:39:16.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:39:16.210 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2022-08-10T17:39:16.210 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2022-08-10T17:39:16.267 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/util.Tpo .deps/util.Po 2022-08-10T17:39:16.269 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2022-08-10T17:39:16.295 INFO:tasks.workunit.client.0.smithi150.stderr:In file included from parser.h:22, 2022-08-10T17:39:16.295 INFO:tasks.workunit.client.0.smithi150.stderr: from parser.c:25: 2022-08-10T17:39:16.295 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c: In function ‘init_filesys’: 2022-08-10T17:39:16.296 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.296 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.296 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.296 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.297 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.297 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.297 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.297 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.298 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.298 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.298 INFO:tasks.workunit.client.0.smithi150.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2022-08-10T17:39:16.298 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.299 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.299 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2022-08-10T17:39:16.299 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.299 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.300 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.300 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.300 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.300 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.301 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.301 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.301 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.301 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.302 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.302 INFO:tasks.workunit.client.0.smithi150.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2022-08-10T17:39:16.302 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.302 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.303 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2022-08-10T17:39:16.303 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.303 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.303 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.304 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.304 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.304 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.304 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.305 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.305 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.305 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.305 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.306 INFO:tasks.workunit.client.0.smithi150.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2022-08-10T17:39:16.306 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.306 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.306 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2022-08-10T17:39:16.307 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.307 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.307 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.308 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.308 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.308 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.308 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.309 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.309 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.309 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.309 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.309 INFO:tasks.workunit.client.0.smithi150.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2022-08-10T17:39:16.310 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.310 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.310 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2022-08-10T17:39:16.310 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.311 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c: In function ‘init_tg_stats’: 2022-08-10T17:39:16.311 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.311 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.311 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.312 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.312 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.312 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.312 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.313 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.313 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.313 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.313 INFO:tasks.workunit.client.0.smithi150.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2022-08-10T17:39:16.314 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.314 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.314 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, 2022-08-10T17:39:16.314 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.315 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.315 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.315 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.315 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.315 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.316 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.316 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.316 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.316 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.317 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.317 INFO:tasks.workunit.client.0.smithi150.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2022-08-10T17:39:16.317 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.317 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.318 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, 2022-08-10T17:39:16.318 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.318 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.318 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.319 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.319 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.319 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.319 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.320 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.320 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.320 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.320 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.321 INFO:tasks.workunit.client.0.smithi150.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2022-08-10T17:39:16.321 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.321 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.321 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, 2022-08-10T17:39:16.321 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.322 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2022-08-10T17:39:16.322 INFO:tasks.workunit.client.0.smithi150.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2022-08-10T17:39:16.322 INFO:tasks.workunit.client.0.smithi150.stderr: ^ 2022-08-10T17:39:16.323 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2022-08-10T17:39:16.323 INFO:tasks.workunit.client.0.smithi150.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2022-08-10T17:39:16.323 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~ 2022-08-10T17:39:16.323 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2022-08-10T17:39:16.323 INFO:tasks.workunit.client.0.smithi150.stderr: container_of(ptr, type, member) 2022-08-10T17:39:16.324 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~ 2022-08-10T17:39:16.324 INFO:tasks.workunit.client.0.smithi150.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2022-08-10T17:39:16.324 INFO:tasks.workunit.client.0.smithi150.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2022-08-10T17:39:16.324 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~ 2022-08-10T17:39:16.325 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2022-08-10T17:39:16.325 INFO:tasks.workunit.client.0.smithi150.stderr: list_for_each_entry(tmp_list, 2022-08-10T17:39:16.325 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.367+0000 7fa7c1bbc700 1 Processor -- start 2022-08-10T17:39:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.367+0000 7fa7c1bbc700 1 -- start start 2022-08-10T17:39:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7c1bbc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc158170 0x7fa7bc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7c1bbc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7bc068bf0 0x7fa7bc0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7c1bbc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0c1f40 con 0x7fa7bc151290 2022-08-10T17:39:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7c1bbc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c7d90 con 0x7fa7bc068bf0 2022-08-10T17:39:16.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7c1bbc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c2220 con 0x7fa7bc158170 2022-08-10T17:39:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7bc068bf0 0x7fa7bc0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7bc068bf0 0x7fa7bc0c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59352/0 (socket says 172.21.15.150:59352) 2022-08-10T17:39:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 -- 172.21.15.150:0/4088375009 learned_addr learned my addr 172.21.15.150:0/4088375009 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:16.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7baffd700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc158170 0x7fa7bc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 -- 172.21.15.150:0/4088375009 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc158170 msgr2=0x7fa7bc0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc158170 0x7fa7bc0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.368+0000 7fa7bbfff700 1 -- 172.21.15.150:0/4088375009 >> v1:172.21.15.197:6789/0 conn(0x7fa7bc151290 legacy=0x7fa7bc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7bbfff700 1 -- 172.21.15.150:0/4088375009 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0c2500 con 0x7fa7bc068bf0 2022-08-10T17:39:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7bbfff700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc068bf0 0x7fa7bc0c2910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680c25de4aea1e8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7ba7fc700 1 -- 172.21.15.150:0/4088375009 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400e070 con 0x7fa7bc068bf0 2022-08-10T17:39:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7ba7fc700 1 -- 172.21.15.150:0/4088375009 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400b910 con 0x7fa7bc068bf0 2022-08-10T17:39:16.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7ba7fc700 1 -- 172.21.15.150:0/4088375009 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400bcc0 con 0x7fa7bc068bf0 2022-08-10T17:39:16.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/4088375009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc068bf0 msgr2=0x7fa7bc0c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc068bf0 0x7fa7bc0c2910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b400b330 comp rx=0 tx=0).stop 2022-08-10T17:39:16.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/4088375009 shutdown_connections 2022-08-10T17:39:16.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc068bf0 0x7fa7bc0c2910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/4088375009 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc158170 0x7fa7bc0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.369+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/4088375009 >> 172.21.15.150:0/4088375009 conn(0x7fa7bc06f880 msgr2=0x7fa7bc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.370+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/4088375009 shutdown_connections 2022-08-10T17:39:16.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.370+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/4088375009 wait complete. 2022-08-10T17:39:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.371+0000 7fa7c1bbc700 1 Processor -- start 2022-08-10T17:39:16.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.371+0000 7fa7c1bbc700 1 -- start start 2022-08-10T17:39:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc068bf0 0x7fa7bc0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc151290 0x7fa7bc1efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 0x7fa7bc0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c5ca0 con 0x7fa7bc158170 2022-08-10T17:39:16.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cdcf0 con 0x7fa7bc151290 2022-08-10T17:39:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c6c20 con 0x7fa7bc068bf0 2022-08-10T17:39:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 0x7fa7bc0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 0x7fa7bc0c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59358/0 (socket says 172.21.15.150:59358) 2022-08-10T17:39:16.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 learned_addr learned my addr 172.21.15.150:0/1278798677 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7baffd700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc151290 0x7fa7bc1efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bb7fe700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc068bf0 0x7fa7bc0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc068bf0 msgr2=0x7fa7bc0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7bc068bf0 0x7fa7bc0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc151290 msgr2=0x7fa7bc1efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc151290 0x7fa7bc1efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4009b30 con 0x7fa7bc158170 2022-08-10T17:39:16.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7bbfff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 0x7fa7bc0c4d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b680 tx=0x7fa7b4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004450 con 0x7fa7bc158170 2022-08-10T17:39:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40045d0 con 0x7fa7bc158170 2022-08-10T17:39:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0cd750 con 0x7fa7bc158170 2022-08-10T17:39:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40099b0 con 0x7fa7bc158170 2022-08-10T17:39:16.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.372+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0c5930 con 0x7fa7bc158170 2022-08-10T17:39:16.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.373+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 0x7fa7bc1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.373+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0644b0 con 0x7fa7bc153b90 2022-08-10T17:39:16.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.373+0000 7fa7bb7fe700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 0x7fa7bc1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa7b402c070 con 0x7fa7bc158170 2022-08-10T17:39:16.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7bb7fe700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7bc071e10 con 0x7fa7bc153b90 2022-08-10T17:39:16.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7bb7fe700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 0x7fa7bc1467a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00f3e0 tx=0x7fa7ac00f7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa79c0650b0 0x7fa79c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa7b4083d20 con 0x7fa7bc158170 2022-08-10T17:39:16.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7baffd700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa79c0650b0 0x7fa79c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00fe50 con 0x7fa7bc153b90 2022-08-10T17:39:16.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fa7ac0052e0 con 0x7fa7bc153b90 2022-08-10T17:39:16.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 msgr2=0x7fa7bc1467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 0x7fa7bc1467a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00f3e0 tx=0x7fa7ac00f7a0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 msgr2=0x7fa7bc1467a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.374+0000 7fa7a3fff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc153b90 0x7fa7bc1467a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.375+0000 7fa7baffd700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa79c0650b0 0x7fa79c067560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc14a260 tx=0x7fa7b00090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.381+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 0x7fa7bc146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.381+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c5ac0 con 0x7fa7bc0c7fc0 2022-08-10T17:39:16.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.382+0000 7fa7bb7fe700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 0x7fa7bc146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.382+0000 7fa7bb7fe700 1 -- 172.21.15.150:0/1278798677 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa7bc072890 con 0x7fa7bc0c7fc0 2022-08-10T17:39:16.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.382+0000 7fa7bb7fe700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 0x7fa7bc146ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac017000 tx=0x7fa7ac0010d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.382+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac01cc30 con 0x7fa7bc0c7fc0 2022-08-10T17:39:16.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7fa7ac01cd90 con 0x7fa7bc0c7fc0 2022-08-10T17:39:16.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 msgr2=0x7fa7bc146ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7a3fff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 0x7fa7bc146ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac017000 tx=0x7fa7ac0010d0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7a3fff700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 msgr2=0x7fa7bc146ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7a3fff700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7bc0c7fc0 0x7fa7bc146ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.398 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:39:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:39:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.418 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.418 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.418 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.419 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.419 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.419 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.420 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:16.420 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:16.420 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.421 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.421 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.421 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:16.421 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.422 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.423 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:16.423 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.423 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.423 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.424 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.425 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.425 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:16.426 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:16.426 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.426 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.427 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.427 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:16.427 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.428 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.428 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:16.428 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.428 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.429 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.429 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.429 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.430 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.430 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.430 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.430 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.431 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:16.431 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:16.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.432 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.432 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.432 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.432 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.433 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.433 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:16.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.433 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.434 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.434 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:39:16.434 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.434 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.434 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:16.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.435 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.435 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.435 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:39:16.436 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.436 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.436 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:16.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.437 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:39:16.437 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.437 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.438 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.438 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.438 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:16.438 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.439 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.439 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:16.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.439 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.440 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.440 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.440 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.440 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.441 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:16.441 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:16.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa79c0650b0 msgr2=0x7fa79c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa79c0650b0 0x7fa79c067560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc14a260 tx=0x7fa7b00090e0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 msgr2=0x7fa7bc0c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 --2- 172.21.15.150:0/1278798677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc158170 0x7fa7bc0c4d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b680 tx=0x7fa7b4004950 comp rx=0 tx=0).stop 2022-08-10T17:39:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 reap_dead start 2022-08-10T17:39:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7bbfff700 1 -- 172.21.15.150:0/1278798677 reap_dead start 2022-08-10T17:39:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 shutdown_connections 2022-08-10T17:39:16.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 >> 172.21.15.150:0/1278798677 conn(0x7fa7bc06f880 msgr2=0x7fa7bc1498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 shutdown_connections 2022-08-10T17:39:16.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.383+0000 7fa7c1bbc700 1 -- 172.21.15.150:0/1278798677 wait complete. 2022-08-10T17:39:16.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:39:16.446 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c: In function ‘set_weight’: 2022-08-10T17:39:16.447 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:623:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2022-08-10T17:39:16.447 INFO:tasks.workunit.client.0.smithi150.stderr: strncpy (op, tmp_config->name, len - 7); 2022-08-10T17:39:16.447 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.447 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:620:10: note: length computed here 2022-08-10T17:39:16.448 INFO:tasks.workunit.client.0.smithi150.stderr: len = strlen(tmp_config->name); 2022-08-10T17:39:16.448 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.448 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c: In function ‘get_weight_total’: 2022-08-10T17:39:16.448 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:645:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2022-08-10T17:39:16.449 INFO:tasks.workunit.client.0.smithi150.stderr: strncpy (op, tmp_config->name, len - 7); 2022-08-10T17:39:16.449 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.449 INFO:tasks.workunit.client.0.smithi150.stderr:parser.c:642:10: note: length computed here 2022-08-10T17:39:16.449 INFO:tasks.workunit.client.0.smithi150.stderr: len = strlen(tmp_config->name); 2022-08-10T17:39:16.450 INFO:tasks.workunit.client.0.smithi150.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2022-08-10T17:39:16.539 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2022-08-10T17:39:16.542 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2022-08-10T17:39:16.595 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2022-08-10T17:39:16.598 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2022-08-10T17:39:16.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.605+0000 7f63689fa700 1 Processor -- start 2022-08-10T17:39:16.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.605+0000 7f63689fa700 1 -- start start 2022-08-10T17:39:16.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f63689fa700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f63641544d0 0x7f6364071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f63689fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f63640718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f63689fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636406a050 con 0x7f636406ea90 2022-08-10T17:39:16.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f63689fa700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63640c6220 con 0x7f63641544d0 2022-08-10T17:39:16.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f63689fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c4420 con 0x7f636415a970 2022-08-10T17:39:16.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f6361d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f636406ea90 0x7f636415a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43816/0 (socket says 172.21.15.150:43816) 2022-08-10T17:39:16.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.606+0000 7f6361d9b700 1 -- 172.21.15.150:0/2574485926 learned_addr learned my addr 172.21.15.150:0/2574485926 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:16.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636259c700 1 --2- 172.21.15.150:0/2574485926 >> v2:172.21.15.197:3300/0 conn(0x7f63641544d0 0x7f6364071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6362d9d700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f63640718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379294930 0 0) 0x7f636406a050 con 0x7f636406ea90 2022-08-10T17:39:16.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6348003430 con 0x7f636406ea90 2022-08-10T17:39:16.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488550798 0 0) 0x7f6348003430 con 0x7f636406ea90 2022-08-10T17:39:16.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 msgr2=0x7f63640718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f63640718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 >> v2:172.21.15.197:3300/0 conn(0x7f63641544d0 msgr2=0x7f6364071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 --2- 172.21.15.150:0/2574485926 >> v2:172.21.15.197:3300/0 conn(0x7f63641544d0 0x7f6364071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640c4700 con 0x7f636406ea90 2022-08-10T17:39:16.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f6358001670 con 0x7f636406ea90 2022-08-10T17:39:16.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 >> v1:172.21.15.150:6789/0 conn(0x7f636406ea90 legacy=0x7f636415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f6348003880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6348003e00 0x7f63480046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348004c10 0x7f6348005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c6220 con 0x7f6348003e00 2022-08-10T17:39:16.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c4420 con 0x7f6348004c10 2022-08-10T17:39:16.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634800b890 con 0x7f636415a970 2022-08-10T17:39:16.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6348003e00 0x7f63480046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f636259c700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f6348003880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6362d9d700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348004c10 0x7f6348005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 -- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 msgr2=0x7f6348003880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636415a970 0x7f6348003880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 -- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348004c10 msgr2=0x7f6348005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348004c10 0x7f6348005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.607+0000 7f6361d9b700 1 -- 172.21.15.150:0/2574485926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348003430 con 0x7f6348003e00 2022-08-10T17:39:16.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f6361d9b700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6348003e00 0x7f63480046d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f635800c0e0 tx=0x7f6348005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7ebc63750bce68 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800cc80 con 0x7f6348003e00 2022-08-10T17:39:16.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635800ce00 con 0x7f6348003e00 2022-08-10T17:39:16.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f636159a700 1 -- 172.21.15.150:0/2574485926 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358007310 con 0x7f6348003e00 2022-08-10T17:39:16.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 -- 172.21.15.150:0/2574485926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6348003e00 msgr2=0x7f63480046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 --2- 172.21.15.150:0/2574485926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6348003e00 0x7f63480046d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f635800c0e0 tx=0x7f6348005700 comp rx=0 tx=0).stop 2022-08-10T17:39:16.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f6362d9d700 1 -- 172.21.15.150:0/2574485926 reap_dead start 2022-08-10T17:39:16.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 -- 172.21.15.150:0/2574485926 shutdown_connections 2022-08-10T17:39:16.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 -- 172.21.15.150:0/2574485926 >> 172.21.15.150:0/2574485926 conn(0x7f6364068110 msgr2=0x7f6364068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 -- 172.21.15.150:0/2574485926 shutdown_connections 2022-08-10T17:39:16.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.608+0000 7f63689fa700 1 -- 172.21.15.150:0/2574485926 wait complete. 2022-08-10T17:39:16.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 Processor -- start 2022-08-10T17:39:16.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 -- start start 2022-08-10T17:39:16.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348003e00 0x7f6364155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636414b9e0 0x7f63641eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 0x7f63641ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6364154b80 con 0x7f636406f860 2022-08-10T17:39:16.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.610+0000 7f63689fa700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636414fb50 con 0x7f6348003e00 2022-08-10T17:39:16.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f63689fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640ca730 con 0x7f636414b9e0 2022-08-10T17:39:16.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 0x7f63641ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 0x7f63641ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59382/0 (socket says 172.21.15.150:59382) 2022-08-10T17:39:16.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 learned_addr learned my addr 172.21.15.150:0/623092228 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:16.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f636259c700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348003e00 0x7f6364155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6361d9b700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636414b9e0 0x7f63641eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636414b9e0 msgr2=0x7f63641eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f636414b9e0 0x7f63641eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348003e00 msgr2=0x7f6364155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6348003e00 0x7f6364155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63641ef9f0 con 0x7f636406f860 2022-08-10T17:39:16.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6362d9d700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 0x7f63641ee160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f636406e380 tx=0x7f635c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00e040 con 0x7f636406f860 2022-08-10T17:39:16.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00f040 con 0x7f636406f860 2022-08-10T17:39:16.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63641571c0 con 0x7f636406f860 2022-08-10T17:39:16.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00fc40 con 0x7f636406f860 2022-08-10T17:39:16.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.611+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6364156010 con 0x7f636406f860 2022-08-10T17:39:16.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.612+0000 7f63689fa700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 0x7f63641ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.612+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c9f40 con 0x7f63641ef430 2022-08-10T17:39:16.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.612+0000 7f636259c700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 0x7f63641ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f636259c700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6364154f10 con 0x7f63641ef430 2022-08-10T17:39:16.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f635c00fda0 con 0x7f636406f860 2022-08-10T17:39:16.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f636259c700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 0x7f63641ee6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6354014960 tx=0x7f6354014a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f63400650b0 0x7f6340067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f635c0827a0 con 0x7f636406f860 2022-08-10T17:39:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6361d9b700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f63400650b0 0x7f6340067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540158b0 con 0x7f63641ef430 2022-08-10T17:39:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f6354015a10 con 0x7f63641ef430 2022-08-10T17:39:16.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 msgr2=0x7f63641ee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 0x7f63641ee6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6354014960 tx=0x7f6354014a40 comp rx=0 tx=0).stop 2022-08-10T17:39:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 msgr2=0x7f63641ee6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.613+0000 7f6352ffd700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641ef430 0x7f63641ee6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.615+0000 7f6361d9b700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f63400650b0 0x7f6340067560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6358000c00 tx=0x7f635800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.620+0000 7f63689fa700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 0x7f63641ebba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.620+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640ca4b0 con 0x7f63641eb7d0 2022-08-10T17:39:16.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.621+0000 7f636259c700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 0x7f63641ebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.621+0000 7f636259c700 1 -- 172.21.15.150:0/623092228 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f63641ef800 con 0x7f63641eb7d0 2022-08-10T17:39:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.621+0000 7f636259c700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 0x7f63641ebba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6354014960 tx=0x7f6354004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.621+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540058a0 con 0x7f63641eb7d0 2022-08-10T17:39:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4886 (secure 0 0 0) 0x7f6354005a00 con 0x7f63641eb7d0 2022-08-10T17:39:16.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 msgr2=0x7f63641ebba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6352ffd700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 0x7f63641ebba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6354014960 tx=0x7f6354004640 comp rx=0 tx=0).stop 2022-08-10T17:39:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6352ffd700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 msgr2=0x7f63641ebba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:16.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6352ffd700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f63641eb7d0 0x7f63641ebba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.644 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:16.644 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:16.644 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:16.644 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:39:16.645 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:16.645 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:16.645 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:16.645 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:16.645 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:16.646 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.646 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:39:16.646 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.646 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:16.647 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:16.647 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.647 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.647 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.648 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.648 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.648 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.648 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.649 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.649 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.649 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.649 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:16.649 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:16.650 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.650 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.650 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.650 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.651 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.651 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.651 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.651 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.652 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.652 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.652 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:16.652 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:16.653 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:16.653 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:16.653 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:16.653 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:16.654 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.654 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:16.654 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:16.654 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:16.655 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:16.655 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:16.655 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:16.655 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:16.655 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:16.656 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:16.656 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:16.656 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:16.656 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:16.657 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:16.657 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:16.657 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:16.657 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:16.658 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:16.658 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:16.658 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.658 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:16.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.659 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:16.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.659 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:16.660 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:16.660 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.660 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.661 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.661 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:16.661 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.662 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.662 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:16.662 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.663 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.663 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.663 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.664 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:16.664 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.664 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.664 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.665 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:16.665 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:16.666 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.666 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.666 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.667 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:16.667 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.668 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.668 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:16.668 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.668 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.668 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.669 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.669 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:16.669 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.670 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.670 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.671 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:16.671 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:16.671 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:16.671 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:16.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.672 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:16.672 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:16.672 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.673 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:16.673 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:16.673 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:16.674 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.674 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.674 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.675 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:16.675 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:16.675 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:16.675 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:16.675 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.676 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.676 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:16.676 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:16.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.677 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.677 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.677 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.677 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.678 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.678 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:16.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.678 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.679 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.679 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.679 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.680 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:16.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.680 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.680 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.680 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:39:16.681 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.681 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.681 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:16.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.682 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.682 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.682 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:39:16.682 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.682 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:16.683 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:16.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:16.683 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:16.683 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:16.684 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:16.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:16.684 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:16.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:16.684 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:16.685 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:16.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f63400650b0 msgr2=0x7f6340067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f63400650b0 0x7f6340067560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6358000c00 tx=0x7f635800a000 comp rx=0 tx=0).stop 2022-08-10T17:39:16.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 msgr2=0x7f63641ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 --2- 172.21.15.150:0/623092228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f636406f860 0x7f63641ee160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f636406e380 tx=0x7f635c011ed0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 reap_dead start 2022-08-10T17:39:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f6362d9d700 1 -- 172.21.15.150:0/623092228 reap_dead start 2022-08-10T17:39:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 shutdown_connections 2022-08-10T17:39:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 >> 172.21.15.150:0/623092228 conn(0x7f6364068110 msgr2=0x7f63641523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 shutdown_connections 2022-08-10T17:39:16.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.622+0000 7f63689fa700 1 -- 172.21.15.150:0/623092228 wait complete. 2022-08-10T17:39:16.689 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:39:16.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:39:16.690 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2022-08-10T17:39:16.691 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2022-08-10T17:39:16.718 INFO:tasks.workunit.client.0.smithi150.stdout:mv -f .deps/list.Tpo .deps/list.Po 2022-08-10T17:39:16.721 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2022-08-10T17:39:16.779 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2022-08-10T17:39:16.782 INFO:tasks.workunit.client.0.smithi150.stdout:FFSB version 6.0-RC2 started 2022-08-10T17:39:16.783 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.786 INFO:tasks.workunit.client.0.smithi150.stdout:benchmark time = 300 2022-08-10T17:39:16.787 INFO:tasks.workunit.client.0.smithi150.stdout:ThreadGroup 0 2022-08-10T17:39:16.787 INFO:tasks.workunit.client.0.smithi150.stdout:================ 2022-08-10T17:39:16.787 INFO:tasks.workunit.client.0.smithi150.stdout: num_threads = 32 2022-08-10T17:39:16.787 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.788 INFO:tasks.workunit.client.0.smithi150.stdout: read_random = off 2022-08-10T17:39:16.788 INFO:tasks.workunit.client.0.smithi150.stdout: read_size = 0 (0B) 2022-08-10T17:39:16.788 INFO:tasks.workunit.client.0.smithi150.stdout: read_blocksize = 0 (0B) 2022-08-10T17:39:16.788 INFO:tasks.workunit.client.0.smithi150.stdout: read_skip = off 2022-08-10T17:39:16.789 INFO:tasks.workunit.client.0.smithi150.stdout: read_skipsize = 0 (0B) 2022-08-10T17:39:16.789 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.789 INFO:tasks.workunit.client.0.smithi150.stdout: write_random = on 2022-08-10T17:39:16.789 INFO:tasks.workunit.client.0.smithi150.stdout: write_size = 5242880 (5MB) 2022-08-10T17:39:16.789 INFO:tasks.workunit.client.0.smithi150.stdout: fsync_file = 0 2022-08-10T17:39:16.790 INFO:tasks.workunit.client.0.smithi150.stdout: write_blocksize = 4096 (4KB) 2022-08-10T17:39:16.790 INFO:tasks.workunit.client.0.smithi150.stdout: wait time = 0 2022-08-10T17:39:16.790 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.790 INFO:tasks.workunit.client.0.smithi150.stdout: op weights 2022-08-10T17:39:16.791 INFO:tasks.workunit.client.0.smithi150.stdout: read = 0 (0.00%) 2022-08-10T17:39:16.791 INFO:tasks.workunit.client.0.smithi150.stdout: readall = 0 (0.00%) 2022-08-10T17:39:16.791 INFO:tasks.workunit.client.0.smithi150.stdout: write = 1 (100.00%) 2022-08-10T17:39:16.791 INFO:tasks.workunit.client.0.smithi150.stdout: create = 0 (0.00%) 2022-08-10T17:39:16.792 INFO:tasks.workunit.client.0.smithi150.stdout: append = 0 (0.00%) 2022-08-10T17:39:16.792 INFO:tasks.workunit.client.0.smithi150.stdout: delete = 0 (0.00%) 2022-08-10T17:39:16.792 INFO:tasks.workunit.client.0.smithi150.stdout: metaop = 0 (0.00%) 2022-08-10T17:39:16.792 INFO:tasks.workunit.client.0.smithi150.stdout: createdir = 0 (0.00%) 2022-08-10T17:39:16.792 INFO:tasks.workunit.client.0.smithi150.stdout: stat = 0 (0.00%) 2022-08-10T17:39:16.793 INFO:tasks.workunit.client.0.smithi150.stdout: writeall = 0 (0.00%) 2022-08-10T17:39:16.793 INFO:tasks.workunit.client.0.smithi150.stdout: writeall_fsync = 0 (0.00%) 2022-08-10T17:39:16.793 INFO:tasks.workunit.client.0.smithi150.stdout: open_close = 0 (0.00%) 2022-08-10T17:39:16.793 INFO:tasks.workunit.client.0.smithi150.stdout: write_fsync = 0 (0.00%) 2022-08-10T17:39:16.793 INFO:tasks.workunit.client.0.smithi150.stdout: create_fsync = 0 (0.00%) 2022-08-10T17:39:16.794 INFO:tasks.workunit.client.0.smithi150.stdout: append_fsync = 0 (0.00%) 2022-08-10T17:39:16.794 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.794 INFO:tasks.workunit.client.0.smithi150.stdout:FileSystem . 2022-08-10T17:39:16.794 INFO:tasks.workunit.client.0.smithi150.stdout:========== 2022-08-10T17:39:16.795 INFO:tasks.workunit.client.0.smithi150.stdout: num_dirs = 0 2022-08-10T17:39:16.795 INFO:tasks.workunit.client.0.smithi150.stdout: starting files = 128 2022-08-10T17:39:16.795 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.796 INFO:tasks.workunit.client.0.smithi150.stdout: min file size = 104857600 (100MB) 2022-08-10T17:39:16.796 INFO:tasks.workunit.client.0.smithi150.stdout: max file size = 104857600 (100MB) 2022-08-10T17:39:16.796 INFO:tasks.workunit.client.0.smithi150.stdout: directio = off 2022-08-10T17:39:16.796 INFO:tasks.workunit.client.0.smithi150.stdout: alignedio = on 2022-08-10T17:39:16.796 INFO:tasks.workunit.client.0.smithi150.stdout: bufferedio = off 2022-08-10T17:39:16.797 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.797 INFO:tasks.workunit.client.0.smithi150.stdout: aging is off 2022-08-10T17:39:16.797 INFO:tasks.workunit.client.0.smithi150.stdout: current utilization = 0.01% 2022-08-10T17:39:16.797 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:39:16.797 INFO:tasks.workunit.client.0.smithi150.stdout:checking existing fs: . 2022-08-10T17:39:16.798 INFO:tasks.workunit.client.0.smithi150.stdout:recreating new fileset 2022-08-10T17:39:16.799 INFO:tasks.workunit.client.0.smithi150.stderr:opendir: No such file or directory 2022-08-10T17:39:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 Processor -- start 2022-08-10T17:39:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 -- start start 2022-08-10T17:39:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 0x7f2ea4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2ea40c6950 0x7f2ea40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea4157bd0 con 0x7f2ea4150e20 2022-08-10T17:39:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea4157150 con 0x7f2ea40c6950 2022-08-10T17:39:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea977f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4157330 con 0x7f2ea41511f0 2022-08-10T17:39:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.819+0000 7f2ea2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2ea4150e20 0x7f2ea415ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43840/0 (socket says 172.21.15.150:43840) 2022-08-10T17:39:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea2ffd700 1 -- 172.21.15.150:0/143829242 learned_addr learned my addr 172.21.15.150:0/143829242 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/143829242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 0x7f2ea4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea37fe700 1 --2- 172.21.15.150:0/143829242 >> v2:172.21.15.197:3300/0 conn(0x7f2ea40c6950 0x7f2ea40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea1ffb700 1 -- 172.21.15.150:0/143829242 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609531521 0 0) 0x7f2e94001110 con 0x7f2ea4150e20 2022-08-10T17:39:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea1ffb700 1 -- 172.21.15.150:0/143829242 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e90003430 con 0x7f2ea4150e20 2022-08-10T17:39:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 -- 172.21.15.150:0/143829242 >> v2:172.21.15.197:3300/0 conn(0x7f2ea40c6950 msgr2=0x7f2ea40c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/143829242 >> v2:172.21.15.197:3300/0 conn(0x7f2ea40c6950 0x7f2ea40c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 -- 172.21.15.150:0/143829242 >> v1:172.21.15.150:6789/0 conn(0x7f2ea4150e20 legacy=0x7f2ea415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 -- 172.21.15.150:0/143829242 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4157610 con 0x7f2ea41511f0 2022-08-10T17:39:16.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/143829242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 0x7f2ea4156c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e980096b0 tx=0x7f2e980099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a793820cec389c2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea1ffb700 1 -- 172.21.15.150:0/143829242 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980107b0 con 0x7f2ea41511f0 2022-08-10T17:39:16.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea1ffb700 1 -- 172.21.15.150:0/143829242 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98010910 con 0x7f2ea41511f0 2022-08-10T17:39:16.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.820+0000 7f2ea1ffb700 1 -- 172.21.15.150:0/143829242 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98010c80 con 0x7f2ea41511f0 2022-08-10T17:39:16.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 -- 172.21.15.150:0/143829242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 msgr2=0x7f2ea4156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 --2- 172.21.15.150:0/143829242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 0x7f2ea4156c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e980096b0 tx=0x7f2e980099c0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 -- 172.21.15.150:0/143829242 shutdown_connections 2022-08-10T17:39:16.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 --2- 172.21.15.150:0/143829242 >> v2:172.21.15.197:3300/0 conn(0x7f2ea40c6950 0x7f2ea40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 --2- 172.21.15.150:0/143829242 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea41511f0 0x7f2ea4156c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 -- 172.21.15.150:0/143829242 >> 172.21.15.150:0/143829242 conn(0x7f2ea4071370 msgr2=0x7f2ea4071770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:16.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 -- 172.21.15.150:0/143829242 shutdown_connections 2022-08-10T17:39:16.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.821+0000 7f2ea977f700 1 -- 172.21.15.150:0/143829242 wait complete. 2022-08-10T17:39:16.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.822+0000 7f2ea977f700 1 Processor -- start 2022-08-10T17:39:16.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.822+0000 7f2ea977f700 1 -- start start 2022-08-10T17:39:16.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea40c6950 0x7f2ea40cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ea41511f0 0x7f2ea414b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea41ed180 con 0x7f2ea4150e20 2022-08-10T17:39:16.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4153f40 con 0x7f2ea41511f0 2022-08-10T17:39:16.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea977f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea41ec800 con 0x7f2ea40c6950 2022-08-10T17:39:16.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59400/0 (socket says 172.21.15.150:59400) 2022-08-10T17:39:16.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 -- 172.21.15.150:0/4122327266 learned_addr learned my addr 172.21.15.150:0/4122327266 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:16.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea37fe700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ea41511f0 0x7f2ea414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea2ffd700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea40c6950 0x7f2ea40cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 -- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea40c6950 msgr2=0x7f2ea40cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea40c6950 0x7f2ea40cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 -- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ea41511f0 msgr2=0x7f2ea414b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:16.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ea41511f0 0x7f2ea414b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:16.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.823+0000 7f2ea27fc700 1 -- 172.21.15.150:0/4122327266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009310 con 0x7f2ea4150e20 2022-08-10T17:39:16.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2ea27fc700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009a00 tx=0x7f2e980045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98004460 con 0x7f2ea4150e20 2022-08-10T17:39:16.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98010730 con 0x7f2ea4150e20 2022-08-10T17:39:16.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea4154200 con 0x7f2ea4150e20 2022-08-10T17:39:16.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98003740 con 0x7f2ea4150e20 2022-08-10T17:39:16.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.824+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea41ecac0 con 0x7f2ea4150e20 2022-08-10T17:39:16.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.825+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4068af0 con 0x7f2ea4150e20 2022-08-10T17:39:16.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.825+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2e9800f070 con 0x7f2ea4150e20 2022-08-10T17:39:16.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.826+0000 7f2e8b7fe700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 0x7f2e84067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:16.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.826+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2e98083020 con 0x7f2ea4150e20 2022-08-10T17:39:16.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.826+0000 7f2ea2ffd700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 0x7f2e84067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:16.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.826+0000 7f2ea2ffd700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 0x7f2e84067560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007fd0 tx=0x7f2e94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:16.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:16.830+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2e98050f20 con 0x7f2ea4150e20 2022-08-10T17:39:17.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.089+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2ea4072890 con 0x7f2ea4150e20 2022-08-10T17:39:17.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.090+0000 7f2e8b7fe700 1 -- 172.21.15.150:0/4122327266 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2e98054540 con 0x7f2ea4150e20 2022-08-10T17:39:17.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.093+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 msgr2=0x7f2e84067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:17.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.093+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 0x7f2e84067560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007fd0 tx=0x7f2e94009040 comp rx=0 tx=0).stop 2022-08-10T17:39:17.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.093+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 msgr2=0x7f2ea41edc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:17.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.093+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009a00 tx=0x7f2e980045d0 comp rx=0 tx=0).stop 2022-08-10T17:39:17.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 shutdown_connections 2022-08-10T17:39:17.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2ea41511f0 0x7f2ea414b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:17.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2e840650b0 0x7f2e84067560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:17.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2ea40c6950 0x7f2ea40cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:17.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 --2- 172.21.15.150:0/4122327266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ea4150e20 0x7f2ea41edc40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:17.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 >> 172.21.15.150:0/4122327266 conn(0x7f2ea4071370 msgr2=0x7f2ea40c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:17.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 shutdown_connections 2022-08-10T17:39:17.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:17.094+0000 7f2ea977f700 1 -- 172.21.15.150:0/4122327266 wait complete. 2022-08-10T17:39:17.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:39:27.113 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:39:27.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:27.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.236+0000 7f96a70b7700 1 Processor -- start 2022-08-10T17:39:27.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.236+0000 7f96a70b7700 1 -- start start 2022-08-10T17:39:27.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a70b7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 0x7f96a00c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a70b7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a70b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00c39a0 con 0x7f96a006d850 2022-08-10T17:39:27.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a70b7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00c4dd0 con 0x7f96a006d480 2022-08-10T17:39:27.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a70b7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00b0ff0 con 0x7f96a00c4410 2022-08-10T17:39:27.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f969ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f96a006d850 0x7f96a00b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44104/0 (socket says 172.21.15.150:44104) 2022-08-10T17:39:27.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f969ffff700 1 -- 172.21.15.150:0/1438291572 learned_addr learned my addr 172.21.15.150:0/1438291572 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:27.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a4e53700 1 --2- 172.21.15.150:0/1438291572 >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 0x7f96a00c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a5654700 1 --2- 172.21.15.150:0/1438291572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f969f7fe700 1 -- 172.21.15.150:0/1438291572 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786215875 0 0) 0x7f96a00c39a0 con 0x7f96a006d850 2022-08-10T17:39:27.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f969f7fe700 1 -- 172.21.15.150:0/1438291572 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9684003430 con 0x7f96a006d850 2022-08-10T17:39:27.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a5654700 1 -- 172.21.15.150:0/1438291572 >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 msgr2=0x7f96a00c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:27.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a5654700 1 --2- 172.21.15.150:0/1438291572 >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 0x7f96a00c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a5654700 1 -- 172.21.15.150:0/1438291572 >> v1:172.21.15.150:6789/0 conn(0x7f96a006d850 legacy=0x7f96a00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a5654700 1 -- 172.21.15.150:0/1438291572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a006e120 con 0x7f96a00c4410 2022-08-10T17:39:27.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.237+0000 7f96a4e53700 1 --2- 172.21.15.150:0/1438291572 >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 0x7f96a00c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:39:27.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a5654700 1 --2- 172.21.15.150:0/1438291572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c4890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9698009d90 tx=0x7f969800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257ca0ab9c3eddd3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f969f7fe700 1 -- 172.21.15.150:0/1438291572 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800e070 con 0x7f96a00c4410 2022-08-10T17:39:27.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f969f7fe700 1 -- 172.21.15.150:0/1438291572 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969800bb20 con 0x7f96a00c4410 2022-08-10T17:39:27.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f969f7fe700 1 -- 172.21.15.150:0/1438291572 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800be90 con 0x7f96a00c4410 2022-08-10T17:39:27.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 -- 172.21.15.150:0/1438291572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 msgr2=0x7f96a00c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1438291572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c4890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9698009d90 tx=0x7f969800b330 comp rx=0 tx=0).stop 2022-08-10T17:39:27.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 -- 172.21.15.150:0/1438291572 shutdown_connections 2022-08-10T17:39:27.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1438291572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c4890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1438291572 >> v2:172.21.15.197:3300/0 conn(0x7f96a006d480 0x7f96a00c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 -- 172.21.15.150:0/1438291572 >> 172.21.15.150:0/1438291572 conn(0x7f96a006b3b0 msgr2=0x7f96a006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 -- 172.21.15.150:0/1438291572 shutdown_connections 2022-08-10T17:39:27.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.238+0000 7f96a70b7700 1 -- 172.21.15.150:0/1438291572 wait complete. 2022-08-10T17:39:27.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.239+0000 7f96a70b7700 1 Processor -- start 2022-08-10T17:39:27.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.239+0000 7f96a70b7700 1 -- start start 2022-08-10T17:39:27.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96a006d480 0x7f96a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01deff0 con 0x7f96a006d850 2022-08-10T17:39:27.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0151220 con 0x7f96a006d480 2022-08-10T17:39:27.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f96a70b7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01514e0 con 0x7f96a00c4410 2022-08-10T17:39:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f969ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f969ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59664/0 (socket says 172.21.15.150:59664) 2022-08-10T17:39:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.240+0000 7f969ffff700 1 -- 172.21.15.150:0/1966784739 learned_addr learned my addr 172.21.15.150:0/1966784739 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f96a4e53700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96a006d480 0x7f96a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f96a5654700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 -- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 msgr2=0x7f96a00c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 -- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96a006d480 msgr2=0x7f96a0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96a006d480 0x7f96a0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 -- 172.21.15.150:0/1966784739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009310 con 0x7f96a006d850 2022-08-10T17:39:27.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969ffff700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3c0 tx=0x7f968c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0074e0 con 0x7f96a006d850 2022-08-10T17:39:27.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c007640 con 0x7f96a006d850 2022-08-10T17:39:27.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9698009a70 con 0x7f96a006d850 2022-08-10T17:39:27.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c005a00 con 0x7f96a006d850 2022-08-10T17:39:27.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.241+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a0151aa0 con 0x7f96a006d850 2022-08-10T17:39:27.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.242+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0072890 con 0x7f96a006d850 2022-08-10T17:39:27.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.242+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f968c019030 con 0x7f96a006d850 2022-08-10T17:39:27.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.243+0000 7f969d7fa700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 0x7f9688067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.243+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f968c0814c0 con 0x7f96a006d850 2022-08-10T17:39:27.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.243+0000 7f96a4e53700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 0x7f9688067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.243+0000 7f96a4e53700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 0x7f9688067590 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9694009ad0 tx=0x7f9694008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.247+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f968c04f4a0 con 0x7f96a006d850 2022-08-10T17:39:27.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.507+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f96a00c2010 con 0x7f96a006d850 2022-08-10T17:39:27.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.508+0000 7f969d7fa700 1 -- 172.21.15.150:0/1966784739 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f968c017070 con 0x7f96a006d850 2022-08-10T17:39:27.511 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:27.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 msgr2=0x7f9688067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 0x7f9688067590 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9694009ad0 tx=0x7f9694008040 comp rx=0 tx=0).stop 2022-08-10T17:39:27.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 msgr2=0x7f96a01ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3c0 tx=0x7f968c00c780 comp rx=0 tx=0).stop 2022-08-10T17:39:27.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 shutdown_connections 2022-08-10T17:39:27.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96880650e0 0x7f9688067590 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96a00c4410 0x7f96a00c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96a006d480 0x7f96a0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 --2- 172.21.15.150:0/1966784739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96a006d850 0x7f96a01ed5c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 >> 172.21.15.150:0/1966784739 conn(0x7f96a006b3b0 msgr2=0x7f96a00c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 shutdown_connections 2022-08-10T17:39:27.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.510+0000 7f96a70b7700 1 -- 172.21.15.150:0/1966784739 wait complete. 2022-08-10T17:39:27.524 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:39:27.524 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:39:27.525 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:39:27.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.642+0000 7fc05fe45700 1 Processor -- start 2022-08-10T17:39:27.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05fe45700 1 -- start start 2022-08-10T17:39:27.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05fe45700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc05814ed30 0x7fc0580c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05fe45700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580c36f0 con 0x7fc05806b640 2022-08-10T17:39:27.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05fe45700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05806ca30 con 0x7fc0580c5570 2022-08-10T17:39:27.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05fe45700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05814f100 con 0x7fc05814ed30 2022-08-10T17:39:27.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.643+0000 7fc05dbe1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc05814ed30 0x7fc0580c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05d3e0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc05806b640 0x7fc0580c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44120/0 (socket says 172.21.15.150:44120) 2022-08-10T17:39:27.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05dbe1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc05814ed30 0x7fc0580c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59672/0 (socket says 172.21.15.150:59672) 2022-08-10T17:39:27.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05d3e0700 1 -- 172.21.15.150:0/3113071300 learned_addr learned my addr 172.21.15.150:0/3113071300 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:27.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05dbe1700 1 -- 172.21.15.150:0/3113071300 >> v1:172.21.15.197:6789/0 conn(0x7fc0580c5570 legacy=0x7fc058155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05dbe1700 1 -- 172.21.15.150:0/3113071300 >> v1:172.21.15.150:6789/0 conn(0x7fc05806b640 legacy=0x7fc0580c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05dbe1700 1 -- 172.21.15.150:0/3113071300 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05806a450 con 0x7fc05814ed30 2022-08-10T17:39:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05cbdf700 1 -- 172.21.15.150:0/3113071300 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561862107 0 0) 0x7fc054001110 con 0x7fc05806b640 2022-08-10T17:39:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05dbe1700 1 --2- 172.21.15.150:0/3113071300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05814ed30 0x7fc0580c20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0096b0 tx=0x7fc04c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c4a64d37f3cbf6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05cbdf700 1 -- 172.21.15.150:0/3113071300 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c011830 con 0x7fc05814ed30 2022-08-10T17:39:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05cbdf700 1 -- 172.21.15.150:0/3113071300 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c011990 con 0x7fc05814ed30 2022-08-10T17:39:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.644+0000 7fc05cbdf700 1 -- 172.21.15.150:0/3113071300 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c011d40 con 0x7fc05814ed30 2022-08-10T17:39:27.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 -- 172.21.15.150:0/3113071300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05814ed30 msgr2=0x7fc0580c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3113071300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05814ed30 0x7fc0580c20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0096b0 tx=0x7fc04c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 -- 172.21.15.150:0/3113071300 shutdown_connections 2022-08-10T17:39:27.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3113071300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05814ed30 0x7fc0580c20f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 -- 172.21.15.150:0/3113071300 >> 172.21.15.150:0/3113071300 conn(0x7fc05806e1f0 msgr2=0x7fc05806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 -- 172.21.15.150:0/3113071300 shutdown_connections 2022-08-10T17:39:27.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.645+0000 7fc05fe45700 1 -- 172.21.15.150:0/3113071300 wait complete. 2022-08-10T17:39:27.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.646+0000 7fc05fe45700 1 Processor -- start 2022-08-10T17:39:27.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.646+0000 7fc05fe45700 1 -- start start 2022-08-10T17:39:27.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0580c5570 0x7fc058069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc05814ed30 0x7fc05814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 0x7fc0580c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05814aaf0 con 0x7fc058149030 2022-08-10T17:39:27.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05814b4b0 con 0x7fc0580c5570 2022-08-10T17:39:27.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05fe45700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc058149ee0 con 0x7fc05814ed30 2022-08-10T17:39:27.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 0x7fc0580c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05dbe1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0580c5570 0x7fc058069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 0x7fc0580c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59680/0 (socket says 172.21.15.150:59680) 2022-08-10T17:39:27.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 learned_addr learned my addr 172.21.15.150:0/3500805626 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:27.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05d3e0700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc05814ed30 0x7fc05814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc05814ed30 msgr2=0x7fc05814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc05814ed30 0x7fc05814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0580c5570 msgr2=0x7fc058069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc0580c5570 0x7fc058069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009310 con 0x7fc058149030 2022-08-10T17:39:27.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.647+0000 7fc05e3e2700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 0x7fc0580c71e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c730 tx=0x7fc05000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050003a80 con 0x7fc058149030 2022-08-10T17:39:27.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc050003be0 con 0x7fc058149030 2022-08-10T17:39:27.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05814a1c0 con 0x7fc058149030 2022-08-10T17:39:27.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500050d0 con 0x7fc058149030 2022-08-10T17:39:27.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05814a780 con 0x7fc058149030 2022-08-10T17:39:27.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 0x7fc0581475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05814a910 con 0x7fc05806b640 2022-08-10T17:39:27.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.648+0000 7fc05dbe1700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 0x7fc0581475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc05dbe1700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc05806ac50 con 0x7fc05806b640 2022-08-10T17:39:27.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc05dbe1700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 0x7fc0581475c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0096b0 tx=0x7fc04c004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc050019030 con 0x7fc058149030 2022-08-10T17:39:27.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0380650e0 0x7fc038067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc0500816b0 con 0x7fc058149030 2022-08-10T17:39:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c01acc0 con 0x7fc05806b640 2022-08-10T17:39:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc05d3e0700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0380650e0 0x7fc038067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fc04c01ae20 con 0x7fc05806b640 2022-08-10T17:39:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 msgr2=0x7fc0581475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 0x7fc0581475c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0096b0 tx=0x7fc04c004640 comp rx=0 tx=0).stop 2022-08-10T17:39:27.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 msgr2=0x7fc0581475c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:27.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.649+0000 7fc04a7fc700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc05806b640 0x7fc0581475c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.650+0000 7fc05d3e0700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0380650e0 0x7fc038067590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc058152540 tx=0x7fc054007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.656+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 0x7fc0581ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.656+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580644b0 con 0x7fc058147b00 2022-08-10T17:39:27.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.656+0000 7fc05dbe1700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 0x7fc0581ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.656+0000 7fc05dbe1700 1 -- 172.21.15.150:0/3500805626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc058147f00 con 0x7fc058147b00 2022-08-10T17:39:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05dbe1700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 0x7fc0581ef910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009a00 tx=0x7fc04c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c025470 con 0x7fc058147b00 2022-08-10T17:39:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7fc04c003eb0 con 0x7fc058147b00 2022-08-10T17:39:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 msgr2=0x7fc0581ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 0x7fc0581ef910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009a00 tx=0x7fc04c011000 comp rx=0 tx=0).stop 2022-08-10T17:39:27.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 msgr2=0x7fc0581ef910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:27.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc04a7fc700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058147b00 0x7fc0581ef910 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.681 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:27.682 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:27.682 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:27.682 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:39:27.683 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:27.683 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:27.683 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:27.683 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:27.684 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:27.684 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.684 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:39:27.684 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:27.684 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:27.685 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:27.685 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.685 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.685 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.685 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.686 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.686 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.686 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.686 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.687 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:27.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:27.688 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.688 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.688 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.688 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.689 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.689 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.689 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.689 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.689 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.690 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.690 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:27.691 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:27.691 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:27.691 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:27.691 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:27.692 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:27.692 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:27.692 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:27.692 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:27.693 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:27.693 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:27.693 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:27.693 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:27.693 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:27.694 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:27.694 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:27.694 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.694 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.695 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.695 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.695 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.695 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.696 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.696 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.696 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.696 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.696 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:27.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.697 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:27.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.697 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:27.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:27.698 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.698 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.699 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:27.699 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:27.700 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.700 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.700 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.701 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:27.701 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:27.701 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.702 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.702 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.703 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:27.703 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:27.703 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.704 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.704 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:27.704 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.705 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.705 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:27.705 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.706 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.706 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:27.706 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:27.707 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.707 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.707 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.708 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:27.708 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:27.708 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.708 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.709 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.709 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:27.709 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.710 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.710 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:27.710 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.711 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.711 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.711 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:27.712 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:27.712 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.712 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.712 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.712 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.713 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.713 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:27.713 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:27.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.714 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.714 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:27.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.715 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.715 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:27.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.715 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.716 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.716 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:39:27.716 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.716 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.717 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:27.717 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0380650e0 msgr2=0x7fc038067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc0380650e0 0x7fc038067590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc058152540 tx=0x7fc054007c90 comp rx=0 tx=0).stop 2022-08-10T17:39:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 msgr2=0x7fc0580c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 --2- 172.21.15.150:0/3500805626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc058149030 0x7fc0580c71e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c730 tx=0x7fc05000ca40 comp rx=0 tx=0).stop 2022-08-10T17:39:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 reap_dead start 2022-08-10T17:39:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05e3e2700 1 -- 172.21.15.150:0/3500805626 reap_dead start 2022-08-10T17:39:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 shutdown_connections 2022-08-10T17:39:27.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 >> 172.21.15.150:0/3500805626 conn(0x7fc05806e1f0 msgr2=0x7fc058157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 shutdown_connections 2022-08-10T17:39:27.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.657+0000 7fc05fe45700 1 -- 172.21.15.150:0/3500805626 wait complete. 2022-08-10T17:39:27.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:39:27.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.840+0000 7f88fbf6f700 1 Processor -- start 2022-08-10T17:39:27.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.840+0000 7f88fbf6f700 1 -- start start 2022-08-10T17:39:27.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fbf6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88f41544c0 0x7f88f4068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fbf6f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40c6100 con 0x7f88f40bd4b0 2022-08-10T17:39:27.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fbf6f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40c5e00 con 0x7f88f41540f0 2022-08-10T17:39:27.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fbf6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40c5270 con 0x7f88f41544c0 2022-08-10T17:39:27.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f950a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88f41544c0 0x7f88f4068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fa50c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f88f40bd4b0 0x7f88f4161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44142/0 (socket says 172.21.15.150:44142) 2022-08-10T17:39:27.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88fa50c700 1 -- 172.21.15.150:0/1282575048 learned_addr learned my addr 172.21.15.150:0/1282575048 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:27.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f950a700 1 -- 172.21.15.150:0/1282575048 >> v1:172.21.15.197:6789/0 conn(0x7f88f41540f0 legacy=0x7f88f4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:27.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f950a700 1 -- 172.21.15.150:0/1282575048 >> v1:172.21.15.150:6789/0 conn(0x7f88f40bd4b0 legacy=0x7f88f4161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f950a700 1 -- 172.21.15.150:0/1282575048 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f406eb00 con 0x7f88f41544c0 2022-08-10T17:39:27.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f8d09700 1 -- 172.21.15.150:0/1282575048 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074047956 0 0) 0x7f88f40c6100 con 0x7f88f40bd4b0 2022-08-10T17:39:27.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.841+0000 7f88f950a700 1 --2- 172.21.15.150:0/1282575048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41544c0 0x7f88f4068110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88f00096b0 tx=0x7f88f00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d931f165570e696 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88f8d09700 1 -- 172.21.15.150:0/1282575048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004230 con 0x7f88f41544c0 2022-08-10T17:39:27.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88f8d09700 1 -- 172.21.15.150:0/1282575048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0004390 con 0x7f88f41544c0 2022-08-10T17:39:27.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88f8d09700 1 -- 172.21.15.150:0/1282575048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011870 con 0x7f88f41544c0 2022-08-10T17:39:27.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1282575048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41544c0 msgr2=0x7f88f4068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1282575048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41544c0 0x7f88f4068110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88f00096b0 tx=0x7f88f00099c0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1282575048 shutdown_connections 2022-08-10T17:39:27.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1282575048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41544c0 0x7f88f4068110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1282575048 >> 172.21.15.150:0/1282575048 conn(0x7f88f406d0d0 msgr2=0x7f88f40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1282575048 shutdown_connections 2022-08-10T17:39:27.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.842+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1282575048 wait complete. 2022-08-10T17:39:27.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.843+0000 7f88fbf6f700 1 Processor -- start 2022-08-10T17:39:27.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.843+0000 7f88fbf6f700 1 -- start start 2022-08-10T17:39:27.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88f40bd4b0 0x7f88f4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 0x7f88f4157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41544c0 0x7f88f41504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4150a00 con 0x7f88f41540f0 2022-08-10T17:39:27.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41e1810 con 0x7f88f41544c0 2022-08-10T17:39:27.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fbf6f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41e1af0 con 0x7f88f40bd4b0 2022-08-10T17:39:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88f950a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 0x7f88f4157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88f950a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 0x7f88f4157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59696/0 (socket says 172.21.15.150:59696) 2022-08-10T17:39:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88f950a700 1 -- 172.21.15.150:0/1348071887 learned_addr learned my addr 172.21.15.150:0/1348071887 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88f9d0b700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88f40bd4b0 0x7f88f4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.844+0000 7f88fa50c700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41544c0 0x7f88f41504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88f40bd4b0 msgr2=0x7f88f4159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88f40bd4b0 0x7f88f4159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41544c0 msgr2=0x7f88f41504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41544c0 0x7f88f41504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0009310 con 0x7f88f41540f0 2022-08-10T17:39:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88f950a700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 0x7f88f4157c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88f00090b0 tx=0x7f88f00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011da0 con 0x7f88f41540f0 2022-08-10T17:39:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f001f070 con 0x7f88f41540f0 2022-08-10T17:39:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f4159020 con 0x7f88f41540f0 2022-08-10T17:39:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0003760 con 0x7f88f41540f0 2022-08-10T17:39:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.845+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f41595e0 con 0x7f88f41540f0 2022-08-10T17:39:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 0x7f88f41ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40672f0 con 0x7f88f41573d0 2022-08-10T17:39:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88f9d0b700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 0x7f88f41ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f88f002a020 con 0x7f88f41540f0 2022-08-10T17:39:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88f9d0b700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88f4158e80 con 0x7f88f41573d0 2022-08-10T17:39:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88f9d0b700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 0x7f88f41ef370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88e400f4d0 tx=0x7f88e400f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.846+0000 7f88e27fc700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88d40650e0 0x7f88d4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f88f0083850 con 0x7f88f41540f0 2022-08-10T17:39:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88fa50c700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88d40650e0 0x7f88d4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4004240 con 0x7f88f41573d0 2022-08-10T17:39:27.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f88e40043a0 con 0x7f88f41573d0 2022-08-10T17:39:27.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 msgr2=0x7f88f41ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 0x7f88f41ef370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88e400f4d0 tx=0x7f88e400f890 comp rx=0 tx=0).stop 2022-08-10T17:39:27.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 msgr2=0x7f88f41ef370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:27.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88e27fc700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41573d0 0x7f88f41ef370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.847+0000 7f88fa50c700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88d40650e0 0x7f88d4067590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0012e0 tx=0x7f88ec007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.853+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 0x7f88f41ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.853+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40c9560 con 0x7f88f41577a0 2022-08-10T17:39:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.854+0000 7f88f9d0b700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 0x7f88f41ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.854+0000 7f88f9d0b700 1 -- 172.21.15.150:0/1348071887 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f88f406df80 con 0x7f88f41577a0 2022-08-10T17:39:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.854+0000 7f88f9d0b700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 0x7f88f41ef8b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f88e400f4d0 tx=0x7f88e4003670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:27.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.854+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4014b80 con 0x7f88f41577a0 2022-08-10T17:39:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f88e4014ce0 con 0x7f88f41577a0 2022-08-10T17:39:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 msgr2=0x7f88f41ef8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88e27fc700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 0x7f88f41ef8b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f88e400f4d0 tx=0x7f88e4003670 comp rx=0 tx=0).stop 2022-08-10T17:39:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88e27fc700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 msgr2=0x7f88f41ef8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:27.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88e27fc700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88f41577a0 0x7f88f41ef8b0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f88e400f4d0 tx=0x7f88e4003670 comp rx=0 tx=0).stop 2022-08-10T17:39:27.868 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:27.868 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:27.869 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:27.869 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:39:27.869 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:27.869 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:27.870 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:27.870 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:27.870 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:27.870 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.870 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:39:27.871 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:27.871 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:27.871 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:27.871 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.872 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.872 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.872 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.872 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.872 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.873 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.873 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.873 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.873 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.874 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:27.874 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:27.874 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.874 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.874 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.875 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.875 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.875 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.875 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.876 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.876 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.876 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.876 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:27.877 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:27.877 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:27.877 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:27.877 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:27.878 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:27.878 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:27.878 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:27.878 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:27.878 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:27.879 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:27.879 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:27.879 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:27.879 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:27.880 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:27.880 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:27.880 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:27.880 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:27.880 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:27.881 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:27.881 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:27.881 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:27.881 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:27.882 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:27.882 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:27.882 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.882 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:27.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.883 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:27.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.883 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:27.883 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:27.884 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.884 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.884 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.884 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:27.885 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.885 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.886 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:27.886 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.886 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.887 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:27.887 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:27.887 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.887 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.888 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.888 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:27.888 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:27.889 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.889 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.889 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.890 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:27.890 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.891 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.891 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:27.891 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.891 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.891 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.892 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:27.892 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:27.892 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.893 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.893 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.893 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:27.894 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:27.894 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:27.894 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:27.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.895 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:27.895 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:27.895 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.896 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:27.896 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:27.896 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:27.896 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.897 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.897 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:27.897 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:27.897 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:27.898 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:27.898 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:27.898 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.898 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.899 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:27.899 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:27.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.900 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.900 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.900 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:27.900 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.900 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.901 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:27.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.901 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.901 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.902 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:39:27.902 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.902 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.902 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:27.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.903 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.903 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.903 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:39:27.903 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.904 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.904 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:27.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.904 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:39:27.905 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.905 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:27.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.905 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.906 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.906 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:27.906 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.906 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:27.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:27.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:27.907 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:27.907 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:27.908 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:27.908 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:27.908 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:27.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:27.908 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:27.909 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:27.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88d40650e0 msgr2=0x7f88d4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88d40650e0 0x7f88d4067590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0012e0 tx=0x7f88ec007f60 comp rx=0 tx=0).stop 2022-08-10T17:39:27.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 msgr2=0x7f88f4157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:27.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 --2- 172.21.15.150:0/1348071887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88f41540f0 0x7f88f4157c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88f00090b0 tx=0x7f88f00045d0 comp rx=0 tx=0).stop 2022-08-10T17:39:27.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fa50c700 1 -- 172.21.15.150:0/1348071887 reap_dead start 2022-08-10T17:39:27.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fa50c700 1 -- 172.21.15.150:0/1348071887 reap_dead start 2022-08-10T17:39:27.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 shutdown_connections 2022-08-10T17:39:27.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 >> 172.21.15.150:0/1348071887 conn(0x7f88f406d0d0 msgr2=0x7f88f4152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:27.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 shutdown_connections 2022-08-10T17:39:27.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:27.855+0000 7f88fbf6f700 1 -- 172.21.15.150:0/1348071887 wait complete. 2022-08-10T17:39:27.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:39:28.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.031+0000 7fba62ade700 1 Processor -- start 2022-08-10T17:39:28.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.031+0000 7fba62ade700 1 -- start start 2022-08-10T17:39:28.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba62ade700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fba5c06c860 0x7fba5c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba62ade700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0c4dc0 con 0x7fba5c150af0 2022-08-10T17:39:28.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba62ade700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0c5940 con 0x7fba5c15a570 2022-08-10T17:39:28.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba62ade700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0c9fc0 con 0x7fba5c06c860 2022-08-10T17:39:28.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba6087a700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fba5c150af0 0x7fba5c159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44156/0 (socket says 172.21.15.150:44156) 2022-08-10T17:39:28.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba6087a700 1 -- 172.21.15.150:0/3973554461 learned_addr learned my addr 172.21.15.150:0/3973554461 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:28.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba5bfff700 1 --2- 172.21.15.150:0/3973554461 >> v2:172.21.15.197:3300/0 conn(0x7fba5c06c860 0x7fba5c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332357992 0 0) 0x7fba5c0c4dc0 con 0x7fba5c150af0 2022-08-10T17:39:28.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.032+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba40003430 con 0x7fba5c150af0 2022-08-10T17:39:28.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542653698 0 0) 0x7fba5c0c5940 con 0x7fba5c15a570 2022-08-10T17:39:28.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0c4dc0 con 0x7fba5c15a570 2022-08-10T17:39:28.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5bfff700 1 -- 172.21.15.150:0/3973554461 >> v1:172.21.15.197:6789/0 conn(0x7fba5c15a570 legacy=0x7fba5c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5bfff700 1 -- 172.21.15.150:0/3973554461 >> v1:172.21.15.150:6789/0 conn(0x7fba5c150af0 legacy=0x7fba5c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185969245 0 0) 0x7fba40003430 con 0x7fba5c150af0 2022-08-10T17:39:28.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5bfff700 1 -- 172.21.15.150:0/3973554461 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c06f9a0 con 0x7fba5c06c860 2022-08-10T17:39:28.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5bfff700 1 --2- 172.21.15.150:0/3973554461 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c06c860 0x7fba5c0c3ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba480096b0 tx=0x7fba480099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f71cd737320d02 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50001670 con 0x7fba5c06c860 2022-08-10T17:39:28.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48004030 con 0x7fba5c06c860 2022-08-10T17:39:28.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba5b7fe700 1 -- 172.21.15.150:0/3973554461 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480043a0 con 0x7fba5c06c860 2022-08-10T17:39:28.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba62ade700 1 -- 172.21.15.150:0/3973554461 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c06c860 msgr2=0x7fba5c0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.033+0000 7fba62ade700 1 --2- 172.21.15.150:0/3973554461 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c06c860 0x7fba5c0c3ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba480096b0 tx=0x7fba480099c0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.034+0000 7fba62ade700 1 -- 172.21.15.150:0/3973554461 shutdown_connections 2022-08-10T17:39:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.034+0000 7fba62ade700 1 --2- 172.21.15.150:0/3973554461 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c06c860 0x7fba5c0c3ec0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.034+0000 7fba62ade700 1 -- 172.21.15.150:0/3973554461 >> 172.21.15.150:0/3973554461 conn(0x7fba5c0c92f0 msgr2=0x7fba5c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.034+0000 7fba62ade700 1 -- 172.21.15.150:0/3973554461 shutdown_connections 2022-08-10T17:39:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.034+0000 7fba62ade700 1 -- 172.21.15.150:0/3973554461 wait complete. 2022-08-10T17:39:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.035+0000 7fba62ade700 1 Processor -- start 2022-08-10T17:39:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.035+0000 7fba62ade700 1 -- start start 2022-08-10T17:39:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c06c860 0x7fba5c1f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c150af0 0x7fba5c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0ba320 con 0x7fba5c15a570 2022-08-10T17:39:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0bd2e0 con 0x7fba5c150af0 2022-08-10T17:39:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0ba550 con 0x7fba5c06c860 2022-08-10T17:39:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59718/0 (socket says 172.21.15.150:59718) 2022-08-10T17:39:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 -- 172.21.15.150:0/1446827246 learned_addr learned my addr 172.21.15.150:0/1446827246 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba5bfff700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c150af0 0x7fba5c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6087a700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c06c860 0x7fba5c1f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c06c860 msgr2=0x7fba5c1f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c06c860 0x7fba5c1f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c150af0 msgr2=0x7fba5c14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c150af0 0x7fba5c14ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009310 con 0x7fba5c15a570 2022-08-10T17:39:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba5bfff700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fba5c150af0 0x7fba5c14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:39:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba6107b700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c7b0 tx=0x7fba5400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54003a80 con 0x7fba5c15a570 2022-08-10T17:39:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54003be0 con 0x7fba5c15a570 2022-08-10T17:39:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c0baaf0 con 0x7fba5c15a570 2022-08-10T17:39:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540050d0 con 0x7fba5c15a570 2022-08-10T17:39:28.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.036+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c0ba810 con 0x7fba5c15a570 2022-08-10T17:39:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.037+0000 7fba62ade700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 0x7fba5c14c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.037+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c071e00 con 0x7fba5c157720 2022-08-10T17:39:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.037+0000 7fba6087a700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 0x7fba5c14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba6087a700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba5c073340 con 0x7fba5c157720 2022-08-10T17:39:28.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fba54010050 con 0x7fba5c15a570 2022-08-10T17:39:28.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba6087a700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 0x7fba5c14c760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba5000e4d0 tx=0x7fba5000e890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fba440650b0 0x7fba44067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fba54081cf0 con 0x7fba5c15a570 2022-08-10T17:39:28.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba5bfff700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fba440650b0 0x7fba44067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50014480 con 0x7fba5c157720 2022-08-10T17:39:28.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fba500145e0 con 0x7fba5c157720 2022-08-10T17:39:28.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 msgr2=0x7fba5c14c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 0x7fba5c14c760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba5000e4d0 tx=0x7fba5000e890 comp rx=0 tx=0).stop 2022-08-10T17:39:28.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 msgr2=0x7fba5c14c760 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:28.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.038+0000 7fba597fa700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c157720 0x7fba5c14c760 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba5000e4d0 tx=0x7fba5000e890 comp rx=0 tx=0).stop 2022-08-10T17:39:28.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.039+0000 7fba5bfff700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fba440650b0 0x7fba44067560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba48008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.045+0000 7fba62ade700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 0x7fba5c14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.045+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c067100 con 0x7fba5c14d3a0 2022-08-10T17:39:28.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.045+0000 7fba6087a700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 0x7fba5c14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba6087a700 1 -- 172.21.15.150:0/1446827246 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fba5c14dce0 con 0x7fba5c14d3a0 2022-08-10T17:39:28.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba6087a700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 0x7fba5c14d7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba50016000 tx=0x7fba50000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50011700 con 0x7fba5c14d3a0 2022-08-10T17:39:28.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4887 (secure 0 0 0) 0x7fba50011860 con 0x7fba5c14d3a0 2022-08-10T17:39:28.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 msgr2=0x7fba5c14d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 0x7fba5c14d7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba50016000 tx=0x7fba50000ed0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 msgr2=0x7fba5c14d7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:28.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba597fa700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fba5c14d3a0 0x7fba5c14d7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.063 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:28.063 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:28.063 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:28.064 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:39:28.064 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 12, 2022-08-10T17:39:28.064 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:28.064 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:28.065 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:39:28.065 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:28.065 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.065 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:39:28.066 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:28.066 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:28.066 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:28.066 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:28.067 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:28.067 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:28.067 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:28.067 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:28.068 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:28.068 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:28.068 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:28.068 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:28.069 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.069 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:28.069 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:28.069 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:28.070 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:28.070 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:28.070 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:28.070 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:28.071 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:28.071 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:28.071 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:28.071 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:28.072 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.072 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:28.072 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:28.073 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:28.073 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:28.073 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:28.073 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:28.074 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:28.074 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:28.074 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:28.074 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:28.075 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:28.075 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:28.075 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:28.075 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:28.076 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:28.076 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:28.076 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:28.076 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:28.076 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:28.077 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:28.077 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:28.077 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:28.077 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:28.078 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:28.078 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:28.078 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.078 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:28.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.079 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:28.079 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.079 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:28.080 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:28.080 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:28.080 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:28.080 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.081 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:28.081 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:28.081 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.082 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:28.082 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:28.082 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.082 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.083 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.083 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:28.083 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:28.084 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:28.084 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:28.084 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:28.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.085 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.085 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:28.085 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:28.086 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:28.086 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:28.086 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.086 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:28.087 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:28.087 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.088 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:28.088 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:28.088 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.088 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.089 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.089 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.089 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:28.089 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:28.090 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:28.090 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:28.090 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:28.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.091 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.091 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:28.091 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:28.091 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:28.092 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:28.092 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.092 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:28.092 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:28.093 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.093 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.093 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:28.094 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:28.094 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:28.094 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.094 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.095 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.095 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:28.095 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:28.095 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:28.096 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:28.096 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:28.096 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.096 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:28.098 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:28.098 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:28.098 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.098 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.099 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:28.099 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.099 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:28.099 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:28.099 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:28.100 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.100 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.100 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:28.100 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.101 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:28.101 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:28.101 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:39:28.101 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.102 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.102 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:28.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.102 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:28.103 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:28.103 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:39:28.103 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.103 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:28.103 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:28.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:28.104 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:28.104 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fba440650b0 msgr2=0x7fba44067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba62ade700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fba440650b0 0x7fba44067560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba48008030 comp rx=0 tx=0).stop 2022-08-10T17:39:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 msgr2=0x7fba5c14ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba62ade700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c7b0 tx=0x7fba5400cb70 comp rx=0 tx=0).stop 2022-08-10T17:39:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba6107b700 1 -- 172.21.15.150:0/1446827246 reap_dead start 2022-08-10T17:39:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.046+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 shutdown_connections 2022-08-10T17:39:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.047+0000 7fba62ade700 1 --2- 172.21.15.150:0/1446827246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba5c15a570 0x7fba5c14ba10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.047+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 >> 172.21.15.150:0/1446827246 conn(0x7fba5c0c92f0 msgr2=0x7fba5c145c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.047+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 shutdown_connections 2022-08-10T17:39:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.047+0000 7fba62ade700 1 -- 172.21.15.150:0/1446827246 wait complete. 2022-08-10T17:39:28.111 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2022-08-10T17:39:28.111 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:39:28.111 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2022-08-10T17:39:28.112 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:39:28.112 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-10T17:39:28.112 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:39:28.126 INFO:tasks.ceph.mon.b:Stopped 2022-08-10T17:39:28.126 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:39:28.127 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:28.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.256+0000 7f5e69dae700 1 Processor -- start 2022-08-10T17:39:28.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.256+0000 7f5e69dae700 1 -- start start 2022-08-10T17:39:28.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e69dae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e6406d480 0x7f5e640c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e69dae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d850 0x7f5e640b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e69dae700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e640c39a0 con 0x7f5e640b0e20 2022-08-10T17:39:28.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e69dae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6406e120 con 0x7f5e6406d480 2022-08-10T17:39:28.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e69dae700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640c5620 con 0x7f5e6406d850 2022-08-10T17:39:28.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e63fff700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f5e640b0e20 legacy=0x7f5e640c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:39:28.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e637fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e6406d480 0x7f5e640c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e637fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e6406d480 0x7f5e640c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59758/0 (socket says 172.21.15.150:59758) 2022-08-10T17:39:28.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e637fe700 1 -- 172.21.15.150:0/1147316087 learned_addr learned my addr 172.21.15.150:0/1147316087 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:28.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.257+0000 7f5e62ffd700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d850 0x7f5e640b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e637fe700 1 -- 172.21.15.150:0/1147316087 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d850 msgr2=0x7f5e640b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:28.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e637fe700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d850 0x7f5e640b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e637fe700 1 -- 172.21.15.150:0/1147316087 >> v1:172.21.15.197:6789/0 conn(0x7f5e640b0e20 legacy=0x7f5e640c4410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:28.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e637fe700 1 -- 172.21.15.150:0/1147316087 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640c5900 con 0x7f5e6406d480 2022-08-10T17:39:28.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e637fe700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6406d480 0x7f5e640c1f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c006fd0 tx=0x7f5e4c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f82f31e1e444ae3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e627fc700 1 -- 172.21.15.150:0/1147316087 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c011830 con 0x7f5e6406d480 2022-08-10T17:39:28.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e627fc700 1 -- 172.21.15.150:0/1147316087 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0119b0 con 0x7f5e6406d480 2022-08-10T17:39:28.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e627fc700 1 -- 172.21.15.150:0/1147316087 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c011d60 con 0x7f5e6406d480 2022-08-10T17:39:28.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 -- 172.21.15.150:0/1147316087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6406d480 msgr2=0x7f5e640c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6406d480 0x7f5e640c1f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c006fd0 tx=0x7f5e4c009a60 comp rx=0 tx=0).stop 2022-08-10T17:39:28.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 -- 172.21.15.150:0/1147316087 shutdown_connections 2022-08-10T17:39:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6406d480 0x7f5e640c1f60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 --2- 172.21.15.150:0/1147316087 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d850 0x7f5e640b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.258+0000 7f5e69dae700 1 -- 172.21.15.150:0/1147316087 >> 172.21.15.150:0/1147316087 conn(0x7f5e6406b3b0 msgr2=0x7f5e6406fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:28.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.259+0000 7f5e69dae700 1 -- 172.21.15.150:0/1147316087 shutdown_connections 2022-08-10T17:39:28.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.259+0000 7f5e69dae700 1 -- 172.21.15.150:0/1147316087 wait complete. 2022-08-10T17:39:28.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.260+0000 7f5e69dae700 1 Processor -- start 2022-08-10T17:39:28.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.260+0000 7f5e69dae700 1 -- start start 2022-08-10T17:39:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 0x7f5e64068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 0x7f5e64068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64150b20 con 0x7f5e640b0e20 2022-08-10T17:39:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64068110 con 0x7f5e6406d850 2022-08-10T17:39:28.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e69dae700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640683b0 con 0x7f5e6406d480 2022-08-10T17:39:28.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e62ffd700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 msgr2=0x7f5e64068840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:28.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e62ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 0x7f5e64068840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:28.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 0x7f5e64068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:45752/0 (socket says 172.21.15.150:45752) 2022-08-10T17:39:28.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 -- 172.21.15.150:0/2192852572 learned_addr learned my addr 172.21.15.150:0/2192852572 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:28.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 -- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 msgr2=0x7f5e64068840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:28.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 0x7f5e64068840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 -- 172.21.15.150:0/2192852572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 msgr2=0x7f5e64068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 0x7f5e64068d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 -- 172.21.15.150:0/2192852572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0093e0 con 0x7f5e6406d480 2022-08-10T17:39:28.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e63fff700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 0x7f5e64068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:39:28.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e637fe700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c014040 tx=0x7f5e4c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.261+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004450 con 0x7f5e6406d480 2022-08-10T17:39:28.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.262+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c01f070 con 0x7f5e6406d480 2022-08-10T17:39:28.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.262+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e641ec880 con 0x7f5e6406d480 2022-08-10T17:39:28.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.262+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c003760 con 0x7f5e6406d480 2022-08-10T17:39:28.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.262+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e64069680 con 0x7f5e6406d480 2022-08-10T17:39:28.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.262+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e64072890 con 0x7f5e6406d480 2022-08-10T17:39:28.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.263+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5e4c00f050 con 0x7f5e6406d480 2022-08-10T17:39:28.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.263+0000 7f5e5bfff700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 0x7f5e48067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:28.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.263+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5e4c021070 con 0x7f5e6406d480 2022-08-10T17:39:28.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.263+0000 7f5e62ffd700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 0x7f5e48067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:28.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.264+0000 7f5e62ffd700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 0x7f5e48067540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e640c9870 tx=0x7f5e54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:28.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.268+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5e4c0514a0 con 0x7f5e6406d480 2022-08-10T17:39:28.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.518+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5e640ca5f0 con 0x7f5e6406d480 2022-08-10T17:39:28.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.519+0000 7f5e5bfff700 1 -- 172.21.15.150:0/2192852572 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f5e4c015020 con 0x7f5e6406d480 2022-08-10T17:39:28.523 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:28.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 msgr2=0x7f5e48067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 0x7f5e48067540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e640c9870 tx=0x7f5e54008040 comp rx=0 tx=0).stop 2022-08-10T17:39:28.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 msgr2=0x7f5e641580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:28.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c014040 tx=0x7f5e4c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 shutdown_connections 2022-08-10T17:39:28.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e640b0e20 0x7f5e64068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e48065090 0x7f5e48067540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e6406d480 0x7f5e641580d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 --2- 172.21.15.150:0/2192852572 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6406d850 0x7f5e64068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:28.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 >> 172.21.15.150:0/2192852572 conn(0x7f5e6406b3b0 msgr2=0x7f5e640cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:28.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 shutdown_connections 2022-08-10T17:39:28.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:28.521+0000 7f5e69dae700 1 -- 172.21.15.150:0/2192852572 wait complete. 2022-08-10T17:39:31.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:32.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.053+0000 7f6b6eb4a700 1 Processor -- start 2022-08-10T17:39:32.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.053+0000 7f6b6eb4a700 1 -- start start 2022-08-10T17:39:32.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.054+0000 7f6b6eb4a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b680700a0 0x7f6b680c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6eb4a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 0x7f6b68154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6eb4a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6806b490 con 0x7f6b6806d930 2022-08-10T17:39:32.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6eb4a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6806bd30 con 0x7f6b680700a0 2022-08-10T17:39:32.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6eb4a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6815adb0 con 0x7f6b6806bec0 2022-08-10T17:39:32.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b67fff700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f6b6806d930 legacy=0x7f6b6815b7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:39:32.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6d0e7700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 msgr2=0x7f6b68154ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:32.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.055+0000 7f6b6d0e7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 0x7f6b68154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:32.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b680700a0 0x7f6b680c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:32.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b680700a0 0x7f6b680c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59844/0 (socket says 172.21.15.150:59844) 2022-08-10T17:39:32.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 -- 172.21.15.150:0/1817534465 learned_addr learned my addr 172.21.15.150:0/1817534465 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:32.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 -- 172.21.15.150:0/1817534465 >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 msgr2=0x7f6b68154ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:32.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 --2- 172.21.15.150:0/1817534465 >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 0x7f6b68154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 -- 172.21.15.150:0/1817534465 >> v1:172.21.15.197:6789/0 conn(0x7f6b6806d930 legacy=0x7f6b6815b7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:32.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.056+0000 7f6b6c8e6700 1 -- 172.21.15.150:0/1817534465 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6806b770 con 0x7f6b680700a0 2022-08-10T17:39:32.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.057+0000 7f6b6c8e6700 1 --2- 172.21.15.150:0/1817534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680c36c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806d8c0 tx=0x7f6b58009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91eba541c3d92f2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:32.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.101+0000 7f6b677fe700 1 -- 172.21.15.150:0/1817534465 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58011830 con 0x7f6b680700a0 2022-08-10T17:39:32.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.101+0000 7f6b677fe700 1 -- 172.21.15.150:0/1817534465 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58011990 con 0x7f6b680700a0 2022-08-10T17:39:32.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.101+0000 7f6b677fe700 1 -- 172.21.15.150:0/1817534465 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58011d40 con 0x7f6b680700a0 2022-08-10T17:39:32.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.107+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/1817534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 msgr2=0x7f6b680c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:32.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.107+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/1817534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680c36c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806d8c0 tx=0x7f6b58009a60 comp rx=0 tx=0).stop 2022-08-10T17:39:32.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/1817534465 shutdown_connections 2022-08-10T17:39:32.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/1817534465 >> v2:172.21.15.197:3300/0 conn(0x7f6b6806bec0 0x7f6b68154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/1817534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680c36c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/1817534465 >> 172.21.15.150:0/1817534465 conn(0x7f6b680c8a10 msgr2=0x7f6b680c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:32.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/1817534465 shutdown_connections 2022-08-10T17:39:32.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.110+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/1817534465 wait complete. 2022-08-10T17:39:32.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.112+0000 7f6b6eb4a700 1 Processor -- start 2022-08-10T17:39:32.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.113+0000 7f6b6eb4a700 1 -- start start 2022-08-10T17:39:32.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b6806bec0 0x7f6b680b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b6806d930 0x7f6b680bf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680c1f10 con 0x7f6b680700a0 2022-08-10T17:39:32.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681fcf90 con 0x7f6b6806d930 2022-08-10T17:39:32.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6eb4a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681fc3c0 con 0x7f6b6806bec0 2022-08-10T17:39:32.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.114+0000 7f6b6d0e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:32.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59856/0 (socket says 172.21.15.150:59856) 2022-08-10T17:39:32.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 -- 172.21.15.150:0/3779756719 learned_addr learned my addr 172.21.15.150:0/3779756719 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:32.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 -- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b6806bec0 msgr2=0x7f6b680b8740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:39:32.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b6806bec0 0x7f6b680b8740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 -- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b6806d930 msgr2=0x7f6b680bf110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:39:32.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b6806d930 0x7f6b680bf110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.115+0000 7f6b6d0e7700 1 -- 172.21.15.150:0/3779756719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580093e0 con 0x7f6b680700a0 2022-08-10T17:39:32.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.116+0000 7f6b6d0e7700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000be60 tx=0x7f6b6000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:32.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.116+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000c980 con 0x7f6b680700a0 2022-08-10T17:39:32.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.116+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000cb00 con 0x7f6b680700a0 2022-08-10T17:39:32.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.116+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60005070 con 0x7f6b680700a0 2022-08-10T17:39:32.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.121+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b680b8c80 con 0x7f6b680700a0 2022-08-10T17:39:32.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.121+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b681fc660 con 0x7f6b680700a0 2022-08-10T17:39:32.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.122+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b681fd140 con 0x7f6b680700a0 2022-08-10T17:39:32.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.140+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6b600051d0 con 0x7f6b680700a0 2022-08-10T17:39:32.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.141+0000 7f6b657fa700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 0x7f6b4c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:32.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.142+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6b60082720 con 0x7f6b680700a0 2022-08-10T17:39:32.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.150+0000 7f6b6c8e6700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 0x7f6b4c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:32.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.154+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6b6004c6b0 con 0x7f6b680700a0 2022-08-10T17:39:32.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.158+0000 7f6b6c8e6700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 0x7f6b4c067560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b58014040 tx=0x7f6b58008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:32.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.657+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6b681fd140 con 0x7f6b680700a0 2022-08-10T17:39:32.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.657+0000 7f6b657fa700 1 -- 172.21.15.150:0/3779756719 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f6b60054040 con 0x7f6b680700a0 2022-08-10T17:39:32.661 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:32.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 msgr2=0x7f6b4c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:32.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 0x7f6b4c067560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b58014040 tx=0x7f6b58008030 comp rx=0 tx=0).stop 2022-08-10T17:39:32.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 msgr2=0x7f6b680bfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:32.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000be60 tx=0x7f6b6000bf40 comp rx=0 tx=0).stop 2022-08-10T17:39:32.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 shutdown_connections 2022-08-10T17:39:32.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b680700a0 0x7f6b680bfd50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b4c0650b0 0x7f6b4c067560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b6806bec0 0x7f6b680b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 --2- 172.21.15.150:0/3779756719 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b6806d930 0x7f6b680bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:32.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 >> 172.21.15.150:0/3779756719 conn(0x7f6b680c8a10 msgr2=0x7f6b68159490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:32.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 shutdown_connections 2022-08-10T17:39:32.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:32.659+0000 7f6b6eb4a700 1 -- 172.21.15.150:0/3779756719 wait complete. 2022-08-10T17:39:35.676 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:36.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.398+0000 7f4b28ffe700 1 Processor -- start 2022-08-10T17:39:36.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.398+0000 7f4b28ffe700 1 -- start start 2022-08-10T17:39:36.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.399+0000 7f4b28ffe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b240cd540 0x7f4b240691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.399+0000 7f4b28ffe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b240696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.399+0000 7f4b28ffe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406fb80 con 0x7f4b24150e10 2022-08-10T17:39:36.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.399+0000 7f4b28ffe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b24157950 con 0x7f4b240cd540 2022-08-10T17:39:36.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.399+0000 7f4b28ffe700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24070720 con 0x7f4b240cd970 2022-08-10T17:39:36.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b240cd540 0x7f4b240691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:36.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b240cd540 0x7f4b240691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59988/0 (socket says 172.21.15.150:59988) 2022-08-10T17:39:36.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 -- 172.21.15.150:0/1486290714 learned_addr learned my addr 172.21.15.150:0/1486290714 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:36.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b22d9d700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b240696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:36.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 -- 172.21.15.150:0/1486290714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 msgr2=0x7f4b240696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:36.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b240696e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 -- 172.21.15.150:0/1486290714 >> v1:172.21.15.150:6789/0 conn(0x7f4b24150e10 legacy=0x7f4b24070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:36.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 -- 172.21.15.150:0/1486290714 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240c1180 con 0x7f4b240cd540 2022-08-10T17:39:36.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.400+0000 7f4b21d9b700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b240691a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009780 tx=0x7f4b14009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973151e7f12dcbb1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:36.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.401+0000 7f4b2159a700 1 -- 172.21.15.150:0/1486290714 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004230 con 0x7f4b240cd540 2022-08-10T17:39:36.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.401+0000 7f4b2159a700 1 -- 172.21.15.150:0/1486290714 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14004390 con 0x7f4b240cd540 2022-08-10T17:39:36.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.401+0000 7f4b2159a700 1 -- 172.21.15.150:0/1486290714 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011850 con 0x7f4b240cd540 2022-08-10T17:39:36.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 -- 172.21.15.150:0/1486290714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 msgr2=0x7f4b240691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:36.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b240691a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009780 tx=0x7f4b14009a90 comp rx=0 tx=0).stop 2022-08-10T17:39:36.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 -- 172.21.15.150:0/1486290714 shutdown_connections 2022-08-10T17:39:36.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b240696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/1486290714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b240691a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 -- 172.21.15.150:0/1486290714 >> 172.21.15.150:0/1486290714 conn(0x7f4b24071df0 msgr2=0x7f4b240cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:36.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 -- 172.21.15.150:0/1486290714 shutdown_connections 2022-08-10T17:39:36.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.402+0000 7f4b28ffe700 1 -- 172.21.15.150:0/1486290714 wait complete. 2022-08-10T17:39:36.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.404+0000 7f4b28ffe700 1 Processor -- start 2022-08-10T17:39:36.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.404+0000 7f4b28ffe700 1 -- start start 2022-08-10T17:39:36.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b241580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 0x7f4b2415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414e8a0 con 0x7f4b240cd540 2022-08-10T17:39:36.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414dcf0 con 0x7f4b24150e10 2022-08-10T17:39:36.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.405+0000 7f4b28ffe700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414cfa0 con 0x7f4b240cd970 2022-08-10T17:39:36.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:36.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59992/0 (socket says 172.21.15.150:59992) 2022-08-10T17:39:36.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 -- 172.21.15.150:0/2157333727 learned_addr learned my addr 172.21.15.150:0/2157333727 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:36.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b22d9d700 1 -- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 msgr2=0x7f4b2415a260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:36.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b22d9d700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 0x7f4b2415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:36.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 -- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 msgr2=0x7f4b241580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:36.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b241580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 -- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 msgr2=0x7f4b2415a260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:36.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 0x7f4b2415a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 -- 172.21.15.150:0/2157333727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140093e0 con 0x7f4b240cd540 2022-08-10T17:39:36.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b2259c700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c760 tx=0x7f4b1c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:36.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c003a80 con 0x7f4b240cd540 2022-08-10T17:39:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c003be0 con 0x7f4b240cd540 2022-08-10T17:39:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.406+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2414df70 con 0x7f4b240cd540 2022-08-10T17:39:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.407+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2414e530 con 0x7f4b240cd540 2022-08-10T17:39:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.407+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0050d0 con 0x7f4b240cd540 2022-08-10T17:39:36.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.408+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24072890 con 0x7f4b240cd540 2022-08-10T17:39:36.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.408+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4b1c019030 con 0x7f4b240cd540 2022-08-10T17:39:36.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.409+0000 7f4b12ffd700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 0x7f4b000674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:36.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.409+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4b1c081700 con 0x7f4b240cd540 2022-08-10T17:39:36.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.410+0000 7f4b21d9b700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 0x7f4b000674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:36.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.415+0000 7f4b21d9b700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 0x7f4b000674e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b240c6e50 tx=0x7f4b14010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:36.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.416+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4b1c04f620 con 0x7f4b240cd540 2022-08-10T17:39:36.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.761+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4b240c1460 con 0x7f4b240cd540 2022-08-10T17:39:36.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.761+0000 7f4b12ffd700 1 -- 172.21.15.150:0/2157333727 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f4b1c017080 con 0x7f4b240cd540 2022-08-10T17:39:36.769 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:36.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 msgr2=0x7f4b000674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:36.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 0x7f4b000674e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b240c6e50 tx=0x7f4b14010000 comp rx=0 tx=0).stop 2022-08-10T17:39:36.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 msgr2=0x7f4b24157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:36.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c760 tx=0x7f4b1c00cb20 comp rx=0 tx=0).stop 2022-08-10T17:39:36.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 shutdown_connections 2022-08-10T17:39:36.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4b24150e10 0x7f4b2415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b240cd540 0x7f4b24157b70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4b00065030 0x7f4b000674e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 --2- 172.21.15.150:0/2157333727 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4b240cd970 0x7f4b241580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 >> 172.21.15.150:0/2157333727 conn(0x7f4b24071df0 msgr2=0x7f4b240691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:36.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 shutdown_connections 2022-08-10T17:39:36.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:36.763+0000 7f4b28ffe700 1 -- 172.21.15.150:0/2157333727 wait complete. 2022-08-10T17:39:37.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:39:37.321 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:39:39.780 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:39:40.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.180+0000 7f4ce4875700 1 Processor -- start 2022-08-10T17:39:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.180+0000 7f4ce4875700 1 -- start start 2022-08-10T17:39:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.182+0000 7f4ce4875700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.182+0000 7f4ce4875700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.182+0000 7f4ce4875700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce006b490 con 0x7f4ce00700a0 2022-08-10T17:39:40.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.182+0000 7f4ce4875700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce006bd30 con 0x7f4ce006bec0 2022-08-10T17:39:40.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.182+0000 7f4ce4875700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce015adb0 con 0x7f4ce006d930 2022-08-10T17:39:40.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cded9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:40.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cde59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4ce00700a0 0x7f4ce015b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44526/0 (socket says 172.21.15.150:44526) 2022-08-10T17:39:40.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cde59c700 1 -- 172.21.15.150:0/3714377828 learned_addr learned my addr 172.21.15.150:0/3714377828 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:40.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cddd9b700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 msgr2=0x7f4ce00c36c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:40.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:40.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:39:40.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:39:40.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:39:40.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.183+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:40.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.384+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:40.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.385+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:39:40.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.385+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:39:40.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.385+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:39:40.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.385+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:39:40.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.388+0000 7f4cddd9b700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 msgr2=0x7f4ce00c36c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:40.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.389+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:39:40.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.786+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:40.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.786+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:39:40.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.786+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:39:40.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.786+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:39:40.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.786+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:39:40.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.794+0000 7f4cddd9b700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 msgr2=0x7f4ce00c36c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:40.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:40.795+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:39:41.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.587+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:41.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.587+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:39:41.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.587+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:39:41.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.587+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:39:41.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.588+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:39:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.596+0000 7f4cddd9b700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 msgr2=0x7f4ce00c36c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:41.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:41.596+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:39:42.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.871+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882851377 0 0) 0x7f4ce006b490 con 0x7f4ce00700a0 2022-08-10T17:39:42.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.871+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc0003430 con 0x7f4ce00700a0 2022-08-10T17:39:42.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333563032 0 0) 0x7f4cc0003430 con 0x7f4ce00700a0 2022-08-10T17:39:42.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 msgr2=0x7f4ce00c36c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:42.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.197:3300/0 conn(0x7f4ce006d930 0x7f4ce00c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 msgr2=0x7f4ce0154ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:42.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 --2- 172.21.15.150:0/3714377828 >> v2:172.21.15.150:3300/0 conn(0x7f4ce006bec0 0x7f4ce0154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce006b770 con 0x7f4ce00700a0 2022-08-10T17:39:42.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f4cd0001580 con 0x7f4ce00700a0 2022-08-10T17:39:42.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.873+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 >> v1:172.21.15.150:6789/0 conn(0x7f4ce00700a0 legacy=0x7f4ce015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:42.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 0x7f4cc0003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4cc00046d0 0x7f4cc0004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0005080 0x7f4cc000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce006bd30 con 0x7f4cc0003880 2022-08-10T17:39:42.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015adb0 con 0x7f4cc0005080 2022-08-10T17:39:42.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc000bf90 con 0x7f4cc00046d0 2022-08-10T17:39:42.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0005080 msgr2=0x7f4cc000b890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:42.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cded9d700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0005080 0x7f4cc000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:42.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 0x7f4cc0003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:42.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4cc00046d0 0x7f4cc0004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:42.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 -- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4cc00046d0 msgr2=0x7f4cc0004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:42.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4cc00046d0 0x7f4cc0004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 -- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0005080 msgr2=0x7f4cc000b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:42.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0005080 0x7f4cc000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cded9d700 1 -- 172.21.15.150:0/3714377828 reap_dead start 2022-08-10T17:39:42.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 -- 172.21.15.150:0/3714377828 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0003430 con 0x7f4cc0003880 2022-08-10T17:39:42.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.874+0000 7f4cde59c700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 0x7f4cc0003c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0007db0 tx=0x7f4cc0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ce90b53fc3c499 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:42.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.876+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00078a0 con 0x7f4cc0003880 2022-08-10T17:39:42.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.876+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000cb50 con 0x7f4cc0003880 2022-08-10T17:39:42.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.876+0000 7f4cdd59a700 1 -- 172.21.15.150:0/3714377828 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00070d0 con 0x7f4cc0003880 2022-08-10T17:39:42.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 -- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 msgr2=0x7f4cc0003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:42.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 0x7f4cc0003c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0007db0 tx=0x7f4cc0005700 comp rx=0 tx=0).stop 2022-08-10T17:39:42.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 -- 172.21.15.150:0/3714377828 shutdown_connections 2022-08-10T17:39:42.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 --2- 172.21.15.150:0/3714377828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cc0003880 0x7f4cc0003c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 -- 172.21.15.150:0/3714377828 >> 172.21.15.150:0/3714377828 conn(0x7f4ce00c8a10 msgr2=0x7f4ce00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:42.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 -- 172.21.15.150:0/3714377828 shutdown_connections 2022-08-10T17:39:42.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.877+0000 7f4ce4875700 1 -- 172.21.15.150:0/3714377828 wait complete. 2022-08-10T17:39:42.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.879+0000 7f4ce4875700 1 Processor -- start 2022-08-10T17:39:42.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.879+0000 7f4ce4875700 1 -- start start 2022-08-10T17:39:42.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 0x7f4ce00c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce00bfd50 0x7f4ce0144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0144cd0 con 0x7f4ce0144880 2022-08-10T17:39:42.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c0f60 con 0x7f4cc0003880 2022-08-10T17:39:42.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4ce4875700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c1190 con 0x7f4ce00bfd50 2022-08-10T17:39:42.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cde59c700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 msgr2=0x7f4ce00c0740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:42.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cde59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 0x7f4ce00c0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:42.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:42.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60148/0 (socket says 172.21.15.150:60148) 2022-08-10T17:39:42.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 -- 172.21.15.150:0/934552968 learned_addr learned my addr 172.21.15.150:0/934552968 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:42.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cddd9b700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce00bfd50 0x7f4ce0144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:42.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 -- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce00bfd50 msgr2=0x7f4ce0144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:42.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce00bfd50 0x7f4ce0144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 -- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 msgr2=0x7f4ce00c0740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:42.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 0x7f4ce00c0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:42.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.880+0000 7f4cded9d700 1 -- 172.21.15.150:0/934552968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00c45b0 con 0x7f4ce0144880 2022-08-10T17:39:42.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4cded9d700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00c6560 tx=0x7f4cd800abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:42.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8007900 con 0x7f4ce0144880 2022-08-10T17:39:42.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8007a60 con 0x7f4ce0144880 2022-08-10T17:39:42.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce0147f10 con 0x7f4ce0144880 2022-08-10T17:39:42.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8007e10 con 0x7f4ce0144880 2022-08-10T17:39:42.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.881+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce0144ee0 con 0x7f4ce0144880 2022-08-10T17:39:42.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.882+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce006f9a0 con 0x7f4ce0144880 2022-08-10T17:39:42.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.882+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4cd8016420 con 0x7f4ce0144880 2022-08-10T17:39:42.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.883+0000 7f4cceffd700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 0x7f4cc4067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:42.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.883+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4cd8082ca0 con 0x7f4ce0144880 2022-08-10T17:39:42.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.883+0000 7f4cde59c700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 0x7f4cc4067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:42.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.883+0000 7f4cde59c700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 0x7f4cc4067540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0015040 tx=0x7f4cd0007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:42.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:42.887+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4cd8087070 con 0x7f4ce0144880 2022-08-10T17:39:43.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.150+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4ce006ba50 con 0x7f4ce0144880 2022-08-10T17:39:43.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.151+0000 7f4cceffd700 1 -- 172.21.15.150:0/934552968 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f4cd8050c20 con 0x7f4ce0144880 2022-08-10T17:39:43.155 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":16,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:39:43.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 msgr2=0x7f4cc4067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 0x7f4cc4067540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0015040 tx=0x7f4cd0007000 comp rx=0 tx=0).stop 2022-08-10T17:39:43.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 msgr2=0x7f4ce0157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00c6560 tx=0x7f4cd800abb0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 shutdown_connections 2022-08-10T17:39:43.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ce0144880 0x7f4ce0157bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4cc0003880 0x7f4ce00c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4cc4065090 0x7f4cc4067540 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 --2- 172.21.15.150:0/934552968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4ce00bfd50 0x7f4ce0144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 >> 172.21.15.150:0/934552968 conn(0x7f4ce00c8a10 msgr2=0x7f4ce00c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:43.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 shutdown_connections 2022-08-10T17:39:43.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.153+0000 7f4ce4875700 1 -- 172.21.15.150:0/934552968 wait complete. 2022-08-10T17:39:43.170 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:39:43.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:39:43.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.299+0000 7f52a927e700 1 Processor -- start 2022-08-10T17:39:43.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.299+0000 7f52a927e700 1 -- start start 2022-08-10T17:39:43.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a927e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a41544d0 0x7f52a4071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a927e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a406a050 con 0x7f52a406ea90 2022-08-10T17:39:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a927e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40c6220 con 0x7f52a415a970 2022-08-10T17:39:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a927e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40c4420 con 0x7f52a41544d0 2022-08-10T17:39:43.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a37fe700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f52a415a970 legacy=0x7f52a41612b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:39:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a27fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f52a406ea90 0x7f52a415a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:44604/0 (socket says 172.21.15.150:44604) 2022-08-10T17:39:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a27fc700 1 -- 172.21.15.150:0/3028011789 learned_addr learned my addr 172.21.15.150:0/3028011789 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:39:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a41544d0 0x7f52a4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.300+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79623020 0 0) 0x7f52a406a050 con 0x7f52a406ea90 2022-08-10T17:39:43.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5290003430 con 0x7f52a406ea90 2022-08-10T17:39:43.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365891970 0 0) 0x7f5290003430 con 0x7f52a406ea90 2022-08-10T17:39:43.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a41544d0 msgr2=0x7f52a4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:43.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a41544d0 0x7f52a4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 >> v1:172.21.15.197:6789/0 conn(0x7f52a415a970 legacy=0x7f52a41612b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:43.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40c4700 con 0x7f52a406ea90 2022-08-10T17:39:43.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5298001670 con 0x7f52a406ea90 2022-08-10T17:39:43.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 >> v1:172.21.15.150:6789/0 conn(0x7f52a406ea90 legacy=0x7f52a415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52900038b0 0x7f5290003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5290004270 0x7f5290004730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5290004f30 0x7f529000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40c4420 con 0x7f5290004270 2022-08-10T17:39:43.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529000be00 con 0x7f52900038b0 2022-08-10T17:39:43.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529000bfc0 con 0x7f5290004f30 2022-08-10T17:39:43.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a41544d0 0x7f52a4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:39:43.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5290004270 0x7f5290004730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a2ffd700 1 -- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52900038b0 msgr2=0x7f5290003ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:43.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52900038b0 0x7f5290003ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:43.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a37fe700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5290004f30 0x7f529000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 -- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5290004f30 msgr2=0x7f529000b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:43.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5290004f30 0x7f529000b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 -- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52900038b0 msgr2=0x7f5290003ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:43.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f52900038b0 0x7f5290003ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 -- 172.21.15.150:0/3028011789 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290003430 con 0x7f5290004270 2022-08-10T17:39:43.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a27fc700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5290004270 0x7f5290004730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52a4069050 tx=0x7f5290005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f4d37aeafe7259 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:43.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.301+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529800cbc0 con 0x7f5290004270 2022-08-10T17:39:43.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529800cd40 con 0x7f5290004270 2022-08-10T17:39:43.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a1ffb700 1 -- 172.21.15.150:0/3028011789 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298007310 con 0x7f5290004270 2022-08-10T17:39:43.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 -- 172.21.15.150:0/3028011789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5290004270 msgr2=0x7f5290004730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 --2- 172.21.15.150:0/3028011789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5290004270 0x7f5290004730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52a4069050 tx=0x7f5290005700 comp rx=0 tx=0).stop 2022-08-10T17:39:43.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a37fe700 1 -- 172.21.15.150:0/3028011789 reap_dead start 2022-08-10T17:39:43.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 -- 172.21.15.150:0/3028011789 shutdown_connections 2022-08-10T17:39:43.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 -- 172.21.15.150:0/3028011789 >> 172.21.15.150:0/3028011789 conn(0x7f52a4068110 msgr2=0x7f52a4068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:43.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 -- 172.21.15.150:0/3028011789 shutdown_connections 2022-08-10T17:39:43.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.302+0000 7f52a927e700 1 -- 172.21.15.150:0/3028011789 wait complete. 2022-08-10T17:39:43.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 Processor -- start 2022-08-10T17:39:43.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 -- start start 2022-08-10T17:39:43.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5290004270 0x7f52a41eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 0x7f52a414a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a4159b00 0x7f52a41481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4148ef0 con 0x7f52a41496d0 2022-08-10T17:39:43.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4147d90 con 0x7f5290004270 2022-08-10T17:39:43.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a927e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a41479f0 con 0x7f52a4159b00 2022-08-10T17:39:43.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.304+0000 7f52a2ffd700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5290004270 msgr2=0x7f52a41eb710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:43.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a2ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5290004270 0x7f52a41eb710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:43.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 0x7f52a414a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a37fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a4159b00 0x7f52a41481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 0x7f52a414a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60168/0 (socket says 172.21.15.150:60168) 2022-08-10T17:39:43.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 -- 172.21.15.150:0/795514078 learned_addr learned my addr 172.21.15.150:0/795514078 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:43.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a4159b00 msgr2=0x7f52a41481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a4159b00 0x7f52a41481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5290004270 msgr2=0x7f52a41eb710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:43.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5290004270 0x7f52a41eb710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a41ebd50 con 0x7f52a41496d0 2022-08-10T17:39:43.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a37fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52a4159b00 0x7f52a41481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:39:43.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a27fc700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 0x7f52a414a240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f529000bdd0 tx=0x7f5298001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:43.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529800ceb0 con 0x7f52a41496d0 2022-08-10T17:39:43.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298001640 con 0x7f52a41496d0 2022-08-10T17:39:43.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980048f0 con 0x7f52a41496d0 2022-08-10T17:39:43.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a41ec030 con 0x7f52a41496d0 2022-08-10T17:39:43.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.305+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a41ec5f0 con 0x7f52a41496d0 2022-08-10T17:39:43.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.306+0000 7f52a927e700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 0x7f52a4146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.306+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4147b80 con 0x7f52a41486f0 2022-08-10T17:39:43.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.306+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 0x7f52a4146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.306+0000 7f52a2ffd700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52a4148000 con 0x7f52a41486f0 2022-08-10T17:39:43.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 0x7f52a4146c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c380 tx=0x7f529400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:43.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294004030 con 0x7f52a41486f0 2022-08-10T17:39:43.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f5294004190 con 0x7f52a41486f0 2022-08-10T17:39:43.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 msgr2=0x7f52a4146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 0x7f52a4146c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c380 tx=0x7f529400eb00 comp rx=0 tx=0).stop 2022-08-10T17:39:43.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 msgr2=0x7f52a4146c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:43.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41486f0 0x7f52a4146c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5298010070 con 0x7f52a41496d0 2022-08-10T17:39:43.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5284064dc0 0x7f5284067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.307+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5298082980 con 0x7f52a41496d0 2022-08-10T17:39:43.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.308+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5284064dc0 0x7f5284067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.308+0000 7f52a2ffd700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5284064dc0 0x7f5284067270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52940090b0 tx=0x7f5294008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:43.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.314+0000 7f52a927e700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 0x7f52a41eec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:43.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.314+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4072890 con 0x7f52a4147190 2022-08-10T17:39:43.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.314+0000 7f52a37fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 0x7f52a41eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:43.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f52a37fe700 1 -- 172.21.15.150:0/795514078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52a406a2a0 con 0x7f52a4147190 2022-08-10T17:39:43.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f52a37fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 0x7f52a41eec50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52a406e0f0 tx=0x7f529c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:43.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c013070 con 0x7f52a4147190 2022-08-10T17:39:43.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4877 (secure 0 0 0) 0x7f529c00be20 con 0x7f52a4147190 2022-08-10T17:39:43.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 msgr2=0x7f52a41eec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 0x7f52a41eec50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52a406e0f0 tx=0x7f529c00b670 comp rx=0 tx=0).stop 2022-08-10T17:39:43.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 msgr2=0x7f52a41eec50 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:43.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.315+0000 7f528b7fe700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4147190 0x7f52a41eec50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:43.339 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:43.339 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:43.339 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:43.339 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:39:43.340 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 16, 2022-08-10T17:39:43.340 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:43.340 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:43.341 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:43.341 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.341 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:39:43.341 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:43.342 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:43.342 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:43.342 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:43.342 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:43.344 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:43.344 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:43.344 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.344 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:43.345 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:43.345 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:43.345 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:43.345 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:43.346 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:43.346 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:43.346 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:43.346 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:43.346 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:43.347 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:43.347 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.347 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:43.348 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:43.348 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:43.348 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:43.348 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:43.349 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:43.349 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:43.349 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:43.349 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:43.349 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:43.350 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:43.350 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:43.350 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:43.350 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:43.351 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:43.351 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:43.352 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:43.352 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:43.352 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:43.352 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:43.353 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:43.353 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:43.353 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:43.353 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:43.353 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:43.354 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.354 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:43.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.354 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:43.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.355 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:43.355 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:43.355 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:43.356 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:43.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.356 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:43.356 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:43.357 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.357 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:43.357 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:43.358 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.358 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.358 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.359 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:43.359 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:43.359 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:43.359 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:43.360 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:43.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.360 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:43.361 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:43.361 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:43.361 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:43.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.361 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:43.362 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:43.362 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.363 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:43.363 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:43.363 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.364 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.364 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.364 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:43.365 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:43.365 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:43.365 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:43.365 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:43.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.366 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:43.366 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:43.366 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:43.367 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:43.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.367 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:43.367 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:43.368 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:43.369 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:43.369 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:43.369 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.369 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.370 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:43.370 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:43.370 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:43.371 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:43.371 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:43.371 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.371 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.372 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:43.372 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:43.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.372 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:43.373 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:43.373 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:43.373 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.373 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.374 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:43.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.374 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:43.374 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:43.375 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:39:43.375 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.375 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.375 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:43.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.376 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:43.376 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:43.376 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:43.377 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.377 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.377 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:43.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.378 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:43.378 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:43.378 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:39:43.378 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.379 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:43.379 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:43.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:43.379 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:43.379 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:43.381 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:43.381 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:43.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5284064dc0 msgr2=0x7f5284067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5284064dc0 0x7f5284067270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52940090b0 tx=0x7f5294008030 comp rx=0 tx=0).stop 2022-08-10T17:39:43.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 msgr2=0x7f52a414a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:43.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 --2- 172.21.15.150:0/795514078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a41496d0 0x7f52a414a240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f529000bdd0 tx=0x7f5298001a00 comp rx=0 tx=0).stop 2022-08-10T17:39:43.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a37fe700 1 -- 172.21.15.150:0/795514078 reap_dead start 2022-08-10T17:39:43.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a37fe700 1 -- 172.21.15.150:0/795514078 reap_dead start 2022-08-10T17:39:43.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 shutdown_connections 2022-08-10T17:39:43.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 >> 172.21.15.150:0/795514078 conn(0x7f52a4068110 msgr2=0x7f52a414dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:43.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 shutdown_connections 2022-08-10T17:39:43.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:43.316+0000 7f52a927e700 1 -- 172.21.15.150:0/795514078 wait complete. 2022-08-10T17:39:43.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:39:43.386 INFO:tasks.workunit.client.0.smithi150.stdout:fs setup took 26 secs 2022-08-10T17:39:45.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.000+0000 7f6a95dd8700 1 Processor -- start 2022-08-10T17:39:45.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.000+0000 7f6a95dd8700 1 -- start start 2022-08-10T17:39:45.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.002+0000 7f6a95dd8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a900c26c0 0x7f6a90070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.002+0000 7f6a95dd8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900c9990 con 0x7f6a900c3340 2022-08-10T17:39:45.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.002+0000 7f6a95dd8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9015b830 con 0x7f6a900c8990 2022-08-10T17:39:45.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.002+0000 7f6a95dd8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9015af60 con 0x7f6a900c26c0 2022-08-10T17:39:45.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.002+0000 7f6a8ffff700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f6a900c8990 legacy=0x7f6a901657d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:39:45.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.005+0000 7f6a8f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a900c26c0 0x7f6a90070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:45.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.005+0000 7f6a8f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a900c26c0 0x7f6a90070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60264/0 (socket says 172.21.15.150:60264) 2022-08-10T17:39:45.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.005+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/1271264879 learned_addr learned my addr 172.21.15.150:0/1271264879 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:45.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.009+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/1271264879 >> v1:172.21.15.197:6789/0 conn(0x7f6a900c8990 legacy=0x7f6a901657d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:39:45.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.009+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/1271264879 >> v1:172.21.15.150:6789/0 conn(0x7f6a900c3340 legacy=0x7f6a9006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:39:45.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.009+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/1271264879 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900c4e80 con 0x7f6a900c26c0 2022-08-10T17:39:45.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.012+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/1271264879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c26c0 0x7f6a90070290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8940961c397e106c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:45.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.032+0000 7f6a8e7fc700 1 -- 172.21.15.150:0/1271264879 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004230 con 0x7f6a900c26c0 2022-08-10T17:39:45.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.032+0000 7f6a8e7fc700 1 -- 172.21.15.150:0/1271264879 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a80004390 con 0x7f6a900c26c0 2022-08-10T17:39:45.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.032+0000 7f6a8e7fc700 1 -- 172.21.15.150:0/1271264879 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80011870 con 0x7f6a900c26c0 2022-08-10T17:39:45.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.034+0000 7f6a95dd8700 1 -- 172.21.15.150:0/1271264879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c26c0 msgr2=0x7f6a90070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:45.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.034+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/1271264879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c26c0 0x7f6a90070290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80009a60 comp rx=0 tx=0).stop 2022-08-10T17:39:45.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.072+0000 7f6a95dd8700 1 -- 172.21.15.150:0/1271264879 shutdown_connections 2022-08-10T17:39:45.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.072+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/1271264879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c26c0 0x7f6a90070290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.072+0000 7f6a95dd8700 1 -- 172.21.15.150:0/1271264879 >> 172.21.15.150:0/1271264879 conn(0x7f6a9006b500 msgr2=0x7f6a9006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:45.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.073+0000 7f6a95dd8700 1 -- 172.21.15.150:0/1271264879 shutdown_connections 2022-08-10T17:39:45.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.086+0000 7f6a95dd8700 1 -- 172.21.15.150:0/1271264879 wait complete. 2022-08-10T17:39:45.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.088+0000 7f6a95dd8700 1 Processor -- start 2022-08-10T17:39:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.088+0000 7f6a95dd8700 1 -- start start 2022-08-10T17:39:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a900c26c0 0x7f6a900c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a900c3340 0x7f6a9015ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 0x7f6a9015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015c0c0 con 0x7f6a900c8990 2022-08-10T17:39:45.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015c3a0 con 0x7f6a900c26c0 2022-08-10T17:39:45.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a95dd8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901f0520 con 0x7f6a900c3340 2022-08-10T17:39:45.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 0x7f6a9015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 0x7f6a9015c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60274/0 (socket says 172.21.15.150:60274) 2022-08-10T17:39:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 learned_addr learned my addr 172.21.15.150:0/387333865 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:39:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a900c26c0 msgr2=0x7f6a900c7720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:39:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.090+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a900c26c0 0x7f6a900c7720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:39:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a900c3340 msgr2=0x7f6a9015ec70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a900c3340 0x7f6a9015ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a900c26c0 msgr2=0x7f6a900c7720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:39:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a900c26c0 0x7f6a900c7720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800093e0 con 0x7f6a900c8990 2022-08-10T17:39:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.092+0000 7f6a8ffff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 0x7f6a9015c830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800be80 tx=0x7f6a8800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.093+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800cd50 con 0x7f6a900c8990 2022-08-10T17:39:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.093+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880060d0 con 0x7f6a900c8990 2022-08-10T17:39:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.093+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88006480 con 0x7f6a900c8990 2022-08-10T17:39:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.093+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a901f0800 con 0x7f6a900c8990 2022-08-10T17:39:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.093+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a901f0dc0 con 0x7f6a900c8990 2022-08-10T17:39:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.095+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 0x7f6a9015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.095+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e1c0 con 0x7f6a90154870 2022-08-10T17:39:45.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.095+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 0x7f6a9015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:45.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.108+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a9015c4e0 con 0x7f6a90154870 2022-08-10T17:39:45.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.108+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6a8801d070 con 0x7f6a900c8990 2022-08-10T17:39:45.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.109+0000 7f6a77fff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a7c065310 0x7f6a7c0677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.109+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6a88082a30 con 0x7f6a900c8990 2022-08-10T17:39:45.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.110+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 0x7f6a9015cd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a800045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:45.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.111+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80011cd0 con 0x7f6a90154870 2022-08-10T17:39:45.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f6a80020070 con 0x7f6a90154870 2022-08-10T17:39:45.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 msgr2=0x7f6a9015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:45.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a77fff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 0x7f6a9015cd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a800045d0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 msgr2=0x7f6a9015cd70 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:45.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a77fff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a90154870 0x7f6a9015cd70 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a800045d0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.112+0000 7f6a8effd700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a7c065310 0x7f6a7c0677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:45.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.116+0000 7f6a8effd700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a7c065310 0x7f6a7c0677c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006efb0 tx=0x7f6a840078a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:45.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.130+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 0x7f6a901f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:39:45.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.130+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900673d0 con 0x7f6a9015f1b0 2022-08-10T17:39:45.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.137+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 0x7f6a901f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:39:45.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.143+0000 7f6a8f7fe700 1 -- 172.21.15.150:0/387333865 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6a9015c200 con 0x7f6a9015f1b0 2022-08-10T17:39:45.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.149+0000 7f6a8f7fe700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 0x7f6a901f3cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:39:45.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8001c450 con 0x7f6a9015f1b0 2022-08-10T17:39:45.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f6a8002c030 con 0x7f6a9015f1b0 2022-08-10T17:39:45.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 msgr2=0x7f6a901f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:45.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 0x7f6a901f3cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80009190 comp rx=0 tx=0).stop 2022-08-10T17:39:45.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 msgr2=0x7f6a901f3cf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:39:45.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.150+0000 7f6a77fff700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a9015f1b0 0x7f6a901f3cf0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80009190 comp rx=0 tx=0).stop 2022-08-10T17:39:45.196 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:39:45.197 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:45.197 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:45.197 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:39:45.198 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 16, 2022-08-10T17:39:45.198 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:39:45.198 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:39:45.198 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:39:45.199 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.199 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:39:45.199 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:45.199 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:39:45.200 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:39:45.200 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:45.200 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:45.200 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:45.201 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:45.201 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:45.201 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:45.201 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:45.201 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:45.202 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:45.202 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.202 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:39:45.202 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:39:45.203 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:45.203 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:45.203 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:45.203 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:45.204 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:45.204 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:45.204 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:45.204 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:45.205 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:45.205 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.205 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.205 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:39:45.206 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:39:45.206 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:39:45.206 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:39:45.206 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:39:45.207 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:39:45.207 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:45.207 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:39:45.207 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:39:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:39:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:39:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:39:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:39:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:39:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:39:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:39:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:39:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:39:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:39:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:39:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:39:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:39:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:39:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:39:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:39:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:39:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:39:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:39:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:39:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:39:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:39:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:39:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:39:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:39:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:39:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:39:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:39:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.223 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:39:45.223 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:39:45.223 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:45.223 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:45.223 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:45.224 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.224 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.224 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:39:45.224 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:39:45.225 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:39:45.225 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:39:45.225 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.225 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:39:45.225 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:39:45.226 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.226 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.226 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.227 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:39:45.227 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:39:45.227 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:39:45.228 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.228 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.228 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.229 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:39:45.229 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:39:45.229 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:39:45.229 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:39:45.230 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:39:45.230 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.230 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.231 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.231 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:39:45.231 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:39:45.232 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.232 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:45.232 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.232 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:45.232 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.233 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.233 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:39:45.233 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.234 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:45.234 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.234 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:45.235 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.235 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.235 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:39:45.235 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.235 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:45.236 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.236 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:45.236 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.236 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.237 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:39:45.237 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.237 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:39:45.237 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.238 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:45.238 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.238 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.239 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:45.239 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.239 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:39:45.239 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.240 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:39:45.240 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:39:45.240 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:39:45.240 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:39:45.241 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:39:45.241 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:39:45.241 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:39:45.242 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:39:45.242 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:39:45.242 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:39:45.242 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:39:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.223+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a7c065310 msgr2=0x7f6a7c0677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:45.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.223+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a7c065310 0x7f6a7c0677c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006efb0 tx=0x7f6a840078a0 comp rx=0 tx=0).stop 2022-08-10T17:39:45.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 msgr2=0x7f6a9015c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:39:45.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 --2- 172.21.15.150:0/387333865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a900c8990 0x7f6a9015c830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800be80 tx=0x7f6a8800bf60 comp rx=0 tx=0).stop 2022-08-10T17:39:45.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 reap_dead start 2022-08-10T17:39:45.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a8ffff700 1 -- 172.21.15.150:0/387333865 reap_dead start 2022-08-10T17:39:45.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 shutdown_connections 2022-08-10T17:39:45.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 >> 172.21.15.150:0/387333865 conn(0x7f6a9006b500 msgr2=0x7f6a9006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:39:45.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 shutdown_connections 2022-08-10T17:39:45.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:39:45.224+0000 7f6a95dd8700 1 -- 172.21.15.150:0/387333865 wait complete. 2022-08-10T17:39:45.352 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:39:47.795 INFO:tasks.workunit.client.0.smithi150.stdout:Syncing()...4 sec 2022-08-10T17:39:47.795 INFO:tasks.workunit.client.0.smithi150.stdout:Starting Actual Benchmark At: Wed Aug 10 17:39:47 2022 2022-08-10T17:39:47.796 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:40:05.354 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:40:05.355 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2022-08-10T17:40:05.355 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-10T17:40:05.356 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-10T17:40:05.361 INFO:tasks.ceph.mon.b:Started 2022-08-10T17:40:05.361 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:40:05.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:05.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.897+0000 7f17a80f7700 1 Processor -- start 2022-08-10T17:40:05.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.897+0000 7f17a80f7700 1 -- start start 2022-08-10T17:40:05.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a80f7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f17a00c4f10 0x7f17a006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a80f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17a00c32f0 0x7f17a00c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a80f7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a0157190 con 0x7f17a0150bd0 2022-08-10T17:40:05.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a80f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a01568c0 con 0x7f17a00c32f0 2022-08-10T17:40:05.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a80f7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a006bc30 con 0x7f17a00c4f10 2022-08-10T17:40:05.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17a00c32f0 0x7f17a00c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:05.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17a00c32f0 0x7f17a00c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32774/0 (socket says 172.21.15.150:32774) 2022-08-10T17:40:05.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 -- 172.21.15.150:0/1434852888 learned_addr learned my addr 172.21.15.150:0/1434852888 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:05.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a5692700 1 --2- 172.21.15.150:0/1434852888 >> v2:172.21.15.197:3300/0 conn(0x7f17a00c4f10 0x7f17a006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:05.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 -- 172.21.15.150:0/1434852888 >> v2:172.21.15.197:3300/0 conn(0x7f17a00c4f10 msgr2=0x7f17a006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:05.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 --2- 172.21.15.150:0/1434852888 >> v2:172.21.15.197:3300/0 conn(0x7f17a00c4f10 0x7f17a006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:05.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.899+0000 7f17a6694700 1 -- 172.21.15.150:0/1434852888 >> v1:172.21.15.197:6789/0 conn(0x7f17a0150bd0 legacy=0x7f17a0159e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:40:05.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.900+0000 7f17a6694700 1 -- 172.21.15.150:0/1434852888 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a006bf10 con 0x7f17a00c32f0 2022-08-10T17:40:05.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.900+0000 7f17a6694700 1 --2- 172.21.15.150:0/1434852888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a00c3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a00bfb20 tx=0x7f1790009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a7607380beb8b6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:05.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.900+0000 7f17a4e91700 1 -- 172.21.15.150:0/1434852888 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790011830 con 0x7f17a00c32f0 2022-08-10T17:40:05.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.900+0000 7f17a4e91700 1 -- 172.21.15.150:0/1434852888 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790011990 con 0x7f17a00c32f0 2022-08-10T17:40:05.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.900+0000 7f17a4e91700 1 -- 172.21.15.150:0/1434852888 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790011d20 con 0x7f17a00c32f0 2022-08-10T17:40:05.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 -- 172.21.15.150:0/1434852888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 msgr2=0x7f17a00c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:05.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 --2- 172.21.15.150:0/1434852888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a00c3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a00bfb20 tx=0x7f1790009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:05.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 -- 172.21.15.150:0/1434852888 shutdown_connections 2022-08-10T17:40:05.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 --2- 172.21.15.150:0/1434852888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a00c3770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:05.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 --2- 172.21.15.150:0/1434852888 >> v2:172.21.15.197:3300/0 conn(0x7f17a00c4f10 0x7f17a006b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:05.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.902+0000 7f17a80f7700 1 -- 172.21.15.150:0/1434852888 >> 172.21.15.150:0/1434852888 conn(0x7f17a00c8a10 msgr2=0x7f17a00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:05.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.903+0000 7f17a80f7700 1 -- 172.21.15.150:0/1434852888 shutdown_connections 2022-08-10T17:40:05.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.903+0000 7f17a80f7700 1 -- 172.21.15.150:0/1434852888 wait complete. 2022-08-10T17:40:05.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.904+0000 7f17a80f7700 1 Processor -- start 2022-08-10T17:40:05.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.905+0000 7f17a80f7700 1 -- start start 2022-08-10T17:40:05.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f17a00c4f10 0x7f17a014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f17a0150bd0 0x7f17a00bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00bc3d0 con 0x7f17a00c32f0 2022-08-10T17:40:05.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00bc180 con 0x7f17a0150bd0 2022-08-10T17:40:05.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a80f7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01489d0 con 0x7f17a00c4f10 2022-08-10T17:40:05.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a5e93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:05.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a5e93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32778/0 (socket says 172.21.15.150:32778) 2022-08-10T17:40:05.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.906+0000 7f17a5e93700 1 -- 172.21.15.150:0/967391289 learned_addr learned my addr 172.21.15.150:0/967391289 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:05.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 -- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f17a00c4f10 msgr2=0x7f17a014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:05.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f17a00c4f10 0x7f17a014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:05.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 -- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f17a0150bd0 msgr2=0x7f17a00bdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:05.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f17a0150bd0 0x7f17a00bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:05.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 -- 172.21.15.150:0/967391289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900093e0 con 0x7f17a00c32f0 2022-08-10T17:40:05.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a5e93700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b3c0 tx=0x7f179c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:05.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c011830 con 0x7f17a00c32f0 2022-08-10T17:40:05.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c0119b0 con 0x7f17a00c32f0 2022-08-10T17:40:05.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c011d60 con 0x7f17a00c32f0 2022-08-10T17:40:05.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00bf730 con 0x7f17a00c32f0 2022-08-10T17:40:05.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.907+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a00bda70 con 0x7f17a00c32f0 2022-08-10T17:40:05.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.911+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f179c021070 con 0x7f17a00c32f0 2022-08-10T17:40:05.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.912+0000 7f178e7fc700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 0x7f1780067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:05.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.912+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f179c081f90 con 0x7f17a00c32f0 2022-08-10T17:40:05.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.912+0000 7f17a5692700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 0x7f1780067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:05.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.914+0000 7f17a5692700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 0x7f1780067560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17980070b0 tx=0x7f1798007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:05.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.968+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00bdc90 con 0x7f17a00c32f0 2022-08-10T17:40:05.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:05.984+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f179c015070 con 0x7f17a00c32f0 2022-08-10T17:40:06.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:06.613+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f17a0072890 con 0x7f17a00c32f0 2022-08-10T17:40:07.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:40:07.408 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:40:10.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.985+0000 7f178e7fc700 1 -- 172.21.15.150:0/967391289 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f179c04ff70 con 0x7f17a00c32f0 2022-08-10T17:40:10.989 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":20,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:10.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.989+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 msgr2=0x7f1780067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:10.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.989+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 0x7f1780067560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17980070b0 tx=0x7f1798007040 comp rx=0 tx=0).stop 2022-08-10T17:40:10.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.989+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 msgr2=0x7f17a014cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:10.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.989+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b3c0 tx=0x7f179c00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:40:10.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 shutdown_connections 2022-08-10T17:40:10.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f17a0150bd0 0x7f17a00bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:10.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a00c32f0 0x7f17a014cd30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:10.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f17800650b0 0x7f1780067560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:10.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 --2- 172.21.15.150:0/967391289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f17a00c4f10 0x7f17a014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:10.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:10.992+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 >> 172.21.15.150:0/967391289 conn(0x7f17a00c8a10 msgr2=0x7f17a00c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:11.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:11.005+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 shutdown_connections 2022-08-10T17:40:11.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:11.005+0000 7f17a80f7700 1 -- 172.21.15.150:0/967391289 wait complete. 2022-08-10T17:40:14.035 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.409+0000 7f4c2c677700 1 Processor -- start 2022-08-10T17:40:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.409+0000 7f4c2c677700 1 -- start start 2022-08-10T17:40:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.410+0000 7f4c2c677700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c240700a0 0x7f4c240c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.410+0000 7f4c2c677700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2406b490 con 0x7f4c2406d930 2022-08-10T17:40:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.410+0000 7f4c2c677700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2406b770 con 0x7f4c2406bec0 2022-08-10T17:40:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.410+0000 7f4c2c677700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2406bd30 con 0x7f4c240700a0 2022-08-10T17:40:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.412+0000 7f4c29c12700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4c2406d930 0x7f4c2415b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45710/0 (socket says 172.21.15.150:45710) 2022-08-10T17:40:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.412+0000 7f4c29c12700 1 -- 172.21.15.150:0/2267605270 learned_addr learned my addr 172.21.15.150:0/2267605270 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.412+0000 7f4c2a413700 1 --2- 172.21.15.150:0/2267605270 >> v2:172.21.15.150:3300/0 conn(0x7f4c240700a0 0x7f4c240c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.413+0000 7f4c2a413700 1 -- 172.21.15.150:0/2267605270 >> v1:172.21.15.197:6789/0 conn(0x7f4c2406bec0 legacy=0x7f4c24154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.413+0000 7f4c2a413700 1 -- 172.21.15.150:0/2267605270 >> v1:172.21.15.150:6789/0 conn(0x7f4c2406d930 legacy=0x7f4c2415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.413+0000 7f4c2a413700 1 -- 172.21.15.150:0/2267605270 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2406ba50 con 0x7f4c240700a0 2022-08-10T17:40:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.413+0000 7f4c2a413700 1 --2- 172.21.15.150:0/2267605270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240c36c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c200096b0 tx=0x7f4c200099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812acd6e3d80fbd5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.416+0000 7f4c29411700 1 -- 172.21.15.150:0/2267605270 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20004230 con 0x7f4c240700a0 2022-08-10T17:40:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.416+0000 7f4c29411700 1 -- 172.21.15.150:0/2267605270 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20004390 con 0x7f4c240700a0 2022-08-10T17:40:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.416+0000 7f4c29411700 1 -- 172.21.15.150:0/2267605270 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200107d0 con 0x7f4c240700a0 2022-08-10T17:40:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.417+0000 7f4c2c677700 1 -- 172.21.15.150:0/2267605270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 msgr2=0x7f4c240c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.417+0000 7f4c2c677700 1 --2- 172.21.15.150:0/2267605270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240c36c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c200096b0 tx=0x7f4c200099c0 comp rx=0 tx=0).stop 2022-08-10T17:40:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.418+0000 7f4c2c677700 1 -- 172.21.15.150:0/2267605270 shutdown_connections 2022-08-10T17:40:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.418+0000 7f4c2c677700 1 --2- 172.21.15.150:0/2267605270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240c36c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.418+0000 7f4c2c677700 1 -- 172.21.15.150:0/2267605270 >> 172.21.15.150:0/2267605270 conn(0x7f4c240c8a10 msgr2=0x7f4c240c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.418+0000 7f4c2c677700 1 -- 172.21.15.150:0/2267605270 shutdown_connections 2022-08-10T17:40:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.418+0000 7f4c2c677700 1 -- 172.21.15.150:0/2267605270 wait complete. 2022-08-10T17:40:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.420+0000 7f4c2c677700 1 Processor -- start 2022-08-10T17:40:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.420+0000 7f4c2c677700 1 -- start start 2022-08-10T17:40:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 0x7f4c240be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:14.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c2406d930 0x7f4c240c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:14.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:14.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240bad10 con 0x7f4c240700a0 2022-08-10T17:40:14.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240bf3b0 con 0x7f4c2406bec0 2022-08-10T17:40:14.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.421+0000 7f4c2c677700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240bf690 con 0x7f4c2406d930 2022-08-10T17:40:14.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:14.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33036/0 (socket says 172.21.15.150:33036) 2022-08-10T17:40:14.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 -- 172.21.15.150:0/152537501 learned_addr learned my addr 172.21.15.150:0/152537501 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:14.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 -- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c2406d930 msgr2=0x7f4c240c7d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:40:14.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c2406d930 0x7f4c240c7d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:14.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 -- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 msgr2=0x7f4c240be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:14.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2a413700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 0x7f4c240be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:14.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 0x7f4c240be3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2ac14700 1 -- 172.21.15.150:0/152537501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20009310 con 0x7f4c240700a0 2022-08-10T17:40:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.422+0000 7f4c2a413700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 0x7f4c240be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:40:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c2ac14700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c700 tx=0x7f4c1c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:14.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c003a80 con 0x7f4c240700a0 2022-08-10T17:40:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c003be0 con 0x7f4c240700a0 2022-08-10T17:40:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0050d0 con 0x7f4c240700a0 2022-08-10T17:40:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c240ba6c0 con 0x7f4c240700a0 2022-08-10T17:40:14.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.423+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c240be8f0 con 0x7f4c240700a0 2022-08-10T17:40:14.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.426+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c00005170 con 0x7f4c240700a0 2022-08-10T17:40:14.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.428+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4c1c019030 con 0x7f4c240700a0 2022-08-10T17:40:14.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.429+0000 7f4c1affd700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 0x7f4c0c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:14.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.429+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4c1c081950 con 0x7f4c240700a0 2022-08-10T17:40:14.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.429+0000 7f4c2a413700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 0x7f4c0c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:14.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.439+0000 7f4c2a413700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 0x7f4c0c067660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:14.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:14.440+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4c1c04f8c0 con 0x7f4c240700a0 2022-08-10T17:40:15.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.086+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4c000056f0 con 0x7f4c240700a0 2022-08-10T17:40:15.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.086+0000 7f4c1affd700 1 -- 172.21.15.150:0/152537501 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f4c1c017600 con 0x7f4c240700a0 2022-08-10T17:40:15.092 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:15.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 msgr2=0x7f4c0c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 0x7f4c0c067660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c20008030 comp rx=0 tx=0).stop 2022-08-10T17:40:15.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 msgr2=0x7f4c240bb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c700 tx=0x7f4c1c00cac0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 shutdown_connections 2022-08-10T17:40:15.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c240700a0 0x7f4c240bb1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c2406bec0 0x7f4c240be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c0c0651b0 0x7f4c0c067660 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c20008030 comp rx=0 tx=0).stop 2022-08-10T17:40:15.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 --2- 172.21.15.150:0/152537501 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c2406d930 0x7f4c240c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.090+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 >> 172.21.15.150:0/152537501 conn(0x7f4c240c8a10 msgr2=0x7f4c24151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:15.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.091+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 shutdown_connections 2022-08-10T17:40:15.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.091+0000 7f4c2c677700 1 -- 172.21.15.150:0/152537501 wait complete. 2022-08-10T17:40:15.116 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:40:15.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:40:15.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.839+0000 7fd1ca231700 1 Processor -- start 2022-08-10T17:40:15.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.839+0000 7fd1ca231700 1 -- start start 2022-08-10T17:40:15.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.840+0000 7fd1ca231700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1c406dc10 0x7fd1c406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.840+0000 7fd1ca231700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c40c3bf0 0x7fd1c40c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.840+0000 7fd1ca231700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40c3990 con 0x7fd1c406b910 2022-08-10T17:40:15.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.840+0000 7fd1ca231700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c4155ff0 con 0x7fd1c406dc10 2022-08-10T17:40:15.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.840+0000 7fd1ca231700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4156570 con 0x7fd1c40c3bf0 2022-08-10T17:40:15.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.841+0000 7fd1c37fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd1c406b910 0x7fd1c406e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45770/0 (socket says 172.21.15.150:45770) 2022-08-10T17:40:15.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.841+0000 7fd1c37fe700 1 -- 172.21.15.150:0/1354650519 learned_addr learned my addr 172.21.15.150:0/1354650519 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:15.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.841+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/1354650519 >> v2:172.21.15.150:3300/0 conn(0x7fd1c406dc10 0x7fd1c406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.841+0000 7fd1c3fff700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c40c3bf0 0x7fd1c40c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.842+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/1354650519 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c40c3bf0 msgr2=0x7fd1c40c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:15.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.842+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c40c3bf0 0x7fd1c40c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.842+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/1354650519 >> v1:172.21.15.150:6789/0 conn(0x7fd1c406b910 legacy=0x7fd1c406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.842+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/1354650519 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c406a280 con 0x7fd1c406dc10 2022-08-10T17:40:15.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.843+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c406ea10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80096b0 tx=0x7fd1b80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc1b971bbe657b9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:15.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.843+0000 7fd1c27fc700 1 -- 172.21.15.150:0/1354650519 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8004230 con 0x7fd1c406dc10 2022-08-10T17:40:15.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.843+0000 7fd1c27fc700 1 -- 172.21.15.150:0/1354650519 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8004390 con 0x7fd1c406dc10 2022-08-10T17:40:15.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.843+0000 7fd1c27fc700 1 -- 172.21.15.150:0/1354650519 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80107d0 con 0x7fd1c406dc10 2022-08-10T17:40:15.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.844+0000 7fd1ca231700 1 -- 172.21.15.150:0/1354650519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 msgr2=0x7fd1c406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.844+0000 7fd1ca231700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c406ea10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80096b0 tx=0x7fd1b80099c0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.847+0000 7fd1ca231700 1 -- 172.21.15.150:0/1354650519 shutdown_connections 2022-08-10T17:40:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.847+0000 7fd1ca231700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c40c3bf0 0x7fd1c40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.847+0000 7fd1ca231700 1 --2- 172.21.15.150:0/1354650519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c406ea10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.847+0000 7fd1ca231700 1 -- 172.21.15.150:0/1354650519 >> 172.21.15.150:0/1354650519 conn(0x7fd1c40c5940 msgr2=0x7fd1c40c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.850+0000 7fd1ca231700 1 -- 172.21.15.150:0/1354650519 shutdown_connections 2022-08-10T17:40:15.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.851+0000 7fd1ca231700 1 -- 172.21.15.150:0/1354650519 wait complete. 2022-08-10T17:40:15.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.853+0000 7fd1ca231700 1 Processor -- start 2022-08-10T17:40:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.858+0000 7fd1ca231700 1 -- start start 2022-08-10T17:40:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c406b910 0x7fd1c40a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c41f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1c40c3bf0 0x7fd1c40bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40abd20 con 0x7fd1c406dc10 2022-08-10T17:40:15.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c41f1130 con 0x7fd1c40c3bf0 2022-08-10T17:40:15.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.859+0000 7fd1ca231700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c41f0660 con 0x7fd1c406b910 2022-08-10T17:40:15.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c3fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1c40c3bf0 0x7fd1c40bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c3fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1c40c3bf0 0x7fd1c40bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:43690/0 (socket says 172.21.15.150:43690) 2022-08-10T17:40:15.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c3fff700 1 -- 172.21.15.150:0/627472114 learned_addr learned my addr 172.21.15.150:0/627472114 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:15.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c37fe700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c406b910 0x7fd1c40a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c41f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c406b910 msgr2=0x7fd1c40a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1c406b910 0x7fd1c40a86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1c40c3bf0 msgr2=0x7fd1c40bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1c40c3bf0 0x7fd1c40bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.860+0000 7fd1c2ffd700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009310 con 0x7fd1c406dc10 2022-08-10T17:40:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.861+0000 7fd1c2ffd700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c41f0120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8013000 tx=0x7fd1b80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:15.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.863+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003720 con 0x7fd1c406dc10 2022-08-10T17:40:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.863+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8003880 con 0x7fd1c406dc10 2022-08-10T17:40:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.863+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003c30 con 0x7fd1c406dc10 2022-08-10T17:40:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.863+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c41f08d0 con 0x7fd1c406dc10 2022-08-10T17:40:15.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.863+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c41f0e50 con 0x7fd1c406dc10 2022-08-10T17:40:15.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.867+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd1b800f070 con 0x7fd1c406dc10 2022-08-10T17:40:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.867+0000 7fd1abfff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1b00652e0 0x7fd1b0067790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.867+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd1b80837a0 con 0x7fd1c406dc10 2022-08-10T17:40:15.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.868+0000 7fd1c37fe700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1b00652e0 0x7fd1b0067790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.871+0000 7fd1ca231700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 0x7fd1a0004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.871+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0007d90 con 0x7fd1a0002a40 2022-08-10T17:40:15.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.872+0000 7fd1c3fff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 0x7fd1a0004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.873+0000 7fd1c3fff700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1a0007f50 con 0x7fd1a0002a40 2022-08-10T17:40:15.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.873+0000 7fd1c3fff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 0x7fd1a0004ef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0085e0 tx=0x7fd1bc0089a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:15.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.873+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc010040 con 0x7fd1a0002a40 2022-08-10T17:40:15.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.874+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd1bc0097c0 con 0x7fd1a0002a40 2022-08-10T17:40:15.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.874+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 msgr2=0x7fd1a0004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.874+0000 7fd1abfff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 0x7fd1a0004ef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0085e0 tx=0x7fd1bc0089a0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.874+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 msgr2=0x7fd1a0004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:15.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.874+0000 7fd1abfff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0002a40 0x7fd1a0004ef0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0085e0 tx=0x7fd1bc0089a0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.875+0000 7fd1c37fe700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1b00652e0 0x7fd1b0067790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4001690 tx=0x7fd1b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:15.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.899+0000 7fd1ca231700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 0x7fd1a00072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:15.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.899+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0007910 con 0x7fd1a0006e30 2022-08-10T17:40:15.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.899+0000 7fd1c3fff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 0x7fd1a00072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:15.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.900+0000 7fd1c3fff700 1 -- 172.21.15.150:0/627472114 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd1a0007ad0 con 0x7fd1a0006e30 2022-08-10T17:40:15.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.900+0000 7fd1c3fff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 0x7fd1a00072b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc018000 tx=0x7fd1bc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:15.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc004640 con 0x7fd1a0006e30 2022-08-10T17:40:15.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4888 (secure 0 0 0) 0x7fd1bc0047a0 con 0x7fd1a0006e30 2022-08-10T17:40:15.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 msgr2=0x7fd1a00072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 0x7fd1a00072b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc018000 tx=0x7fd1bc004950 comp rx=0 tx=0).stop 2022-08-10T17:40:15.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 msgr2=0x7fd1a00072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:15.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.901+0000 7fd1abfff700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a0006e30 0x7fd1a00072b0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc018000 tx=0x7fd1bc004950 comp rx=0 tx=0).stop 2022-08-10T17:40:15.910 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:15.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:15.912 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:15.912 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:40:15.913 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:15.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:15.913 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:15.913 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:15.914 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:15.914 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.914 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 4, 2022-08-10T17:40:15.914 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:15.915 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:15.915 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:15.915 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:15.915 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:15.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:15.916 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:15.916 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:15.916 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:15.917 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:15.917 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:15.917 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:15.917 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.918 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:15.918 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:15.918 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:15.918 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:15.919 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:15.919 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:15.919 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:15.919 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:15.919 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:15.920 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:15.920 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:15.920 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.921 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:15.921 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:15.921 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:15.921 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:15.922 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:15.922 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:15.922 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:15.922 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:15.922 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:15.923 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:15.923 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:15.923 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:15.923 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:15.924 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:15.924 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:15.924 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:15.924 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:15.925 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:15.925 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:15.925 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:15.925 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:15.925 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:15.926 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:15.926 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:15.926 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:15.926 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.927 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:15.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:15.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.928 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:15.928 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:15.928 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:15.928 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:15.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:15.929 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:15.929 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.930 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:15.930 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:15.930 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.931 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.931 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.931 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:15.931 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:15.932 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:15.932 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:15.932 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:15.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.933 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:15.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:15.933 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:15.933 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:15.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.934 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:15.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:15.934 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.935 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:15.935 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:15.936 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.936 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.936 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.936 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:15.937 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:15.937 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:15.937 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:15.937 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:15.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.938 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:15.938 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:15.939 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:15.939 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:15.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:15.939 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:15.940 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.940 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:15.941 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:15.941 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:15.941 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.941 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.942 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:15.942 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:15.942 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:15.942 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:15.943 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:15.943 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.943 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.944 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:15.944 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:15.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.944 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:15.944 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:15.945 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:15.945 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.945 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.945 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:40:15.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.946 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:15.946 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:15.946 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:40:15.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.947 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.947 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:15.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.947 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:15.948 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:15.948 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:15.948 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.948 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.949 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:15.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.949 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:15.949 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:15.949 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:40:15.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.950 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:15.950 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:40:15.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:15.951 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:15.951 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:15.951 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:15.951 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:15.952 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:15.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:15.952 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:15.952 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:15.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.924+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1b00652e0 msgr2=0x7fd1b0067790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.924+0000 7fd1ca231700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1b00652e0 0x7fd1b0067790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4001690 tx=0x7fd1b4009040 comp rx=0 tx=0).stop 2022-08-10T17:40:15.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.924+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 msgr2=0x7fd1c41f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:15.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.924+0000 7fd1ca231700 1 --2- 172.21.15.150:0/627472114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1c406dc10 0x7fd1c41f0120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8013000 tx=0x7fd1b80045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:15.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.924+0000 7fd1c3fff700 1 -- 172.21.15.150:0/627472114 reap_dead start 2022-08-10T17:40:15.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.932+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 shutdown_connections 2022-08-10T17:40:15.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.932+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 >> 172.21.15.150:0/627472114 conn(0x7fd1c40c5940 msgr2=0x7fd1c40c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:15.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.932+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 shutdown_connections 2022-08-10T17:40:15.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:15.932+0000 7fd1ca231700 1 -- 172.21.15.150:0/627472114 wait complete. 2022-08-10T17:40:15.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:40:16.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.195+0000 7f35c72c0700 1 Processor -- start 2022-08-10T17:40:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.196+0000 7f35c72c0700 1 -- start start 2022-08-10T17:40:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.197+0000 7f35c72c0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35c00c26c0 0x7f35c0070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.197+0000 7f35c72c0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c3340 0x7f35c006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.197+0000 7f35c72c0700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00c9990 con 0x7f35c00c8990 2022-08-10T17:40:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.197+0000 7f35c72c0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c015b830 con 0x7f35c00c26c0 2022-08-10T17:40:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.197+0000 7f35c72c0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c015af60 con 0x7f35c00c3340 2022-08-10T17:40:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.198+0000 7f35c505c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35c00c26c0 0x7f35c0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.198+0000 7f35c505c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35c00c26c0 0x7f35c0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33114/0 (socket says 172.21.15.150:33114) 2022-08-10T17:40:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.198+0000 7f35c505c700 1 -- 172.21.15.150:0/866694845 learned_addr learned my addr 172.21.15.150:0/866694845 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.199+0000 7f35c485b700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c3340 0x7f35c006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.199+0000 7f35c505c700 1 -- 172.21.15.150:0/866694845 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c3340 msgr2=0x7f35c006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.199+0000 7f35c505c700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c3340 0x7f35c006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.199+0000 7f35c505c700 1 -- 172.21.15.150:0/866694845 >> v1:172.21.15.197:6789/0 conn(0x7f35c00c8990 legacy=0x7f35c015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:16.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.199+0000 7f35c505c700 1 -- 172.21.15.150:0/866694845 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00c4e80 con 0x7f35c00c26c0 2022-08-10T17:40:16.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.200+0000 7f35c505c700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c26c0 0x7f35c0070290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35bc006fd0 tx=0x7f35bc009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a35d5f88038e12 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.211+0000 7f35b7fff700 1 -- 172.21.15.150:0/866694845 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011830 con 0x7f35c00c26c0 2022-08-10T17:40:16.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.211+0000 7f35b7fff700 1 -- 172.21.15.150:0/866694845 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc0119b0 con 0x7f35c00c26c0 2022-08-10T17:40:16.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.211+0000 7f35b7fff700 1 -- 172.21.15.150:0/866694845 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011d60 con 0x7f35c00c26c0 2022-08-10T17:40:16.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.212+0000 7f35c72c0700 1 -- 172.21.15.150:0/866694845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c26c0 msgr2=0x7f35c0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.212+0000 7f35c72c0700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c26c0 0x7f35c0070290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35bc006fd0 tx=0x7f35bc009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:16.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.214+0000 7f35c72c0700 1 -- 172.21.15.150:0/866694845 shutdown_connections 2022-08-10T17:40:16.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.214+0000 7f35c72c0700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c26c0 0x7f35c0070290 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.214+0000 7f35c72c0700 1 --2- 172.21.15.150:0/866694845 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c3340 0x7f35c006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.214+0000 7f35c72c0700 1 -- 172.21.15.150:0/866694845 >> 172.21.15.150:0/866694845 conn(0x7f35c006b500 msgr2=0x7f35c006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.215+0000 7f35c72c0700 1 -- 172.21.15.150:0/866694845 shutdown_connections 2022-08-10T17:40:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.215+0000 7f35c72c0700 1 -- 172.21.15.150:0/866694845 wait complete. 2022-08-10T17:40:16.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.217+0000 7f35c72c0700 1 Processor -- start 2022-08-10T17:40:16.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.217+0000 7f35c72c0700 1 -- start start 2022-08-10T17:40:16.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c26c0 0x7f35c00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 0x7f35c0144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35c00c8990 0x7f35c0145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c015f310 con 0x7f35c00c3340 2022-08-10T17:40:16.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0144960 con 0x7f35c00c8990 2022-08-10T17:40:16.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.218+0000 7f35c72c0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0146c60 con 0x7f35c00c26c0 2022-08-10T17:40:16.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.219+0000 7f35c585d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35c00c8990 0x7f35c0145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.219+0000 7f35c485b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 0x7f35c0144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 0x7f35c0144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33124/0 (socket says 172.21.15.150:33124) 2022-08-10T17:40:16.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 -- 172.21.15.150:0/2768838369 learned_addr learned my addr 172.21.15.150:0/2768838369 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c505c700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c26c0 0x7f35c00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c26c0 msgr2=0x7f35c00b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35c00c26c0 0x7f35c00b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35c00c8990 msgr2=0x7f35c0145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35c00c8990 0x7f35c0145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.220+0000 7f35c485b700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0093e0 con 0x7f35c00c3340 2022-08-10T17:40:16.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.222+0000 7f35c485b700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 0x7f35c0144df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35b000be60 tx=0x7f35b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.227+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0056630 con 0x7f35c00c3340 2022-08-10T17:40:16.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.227+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0056790 con 0x7f35c00c3340 2022-08-10T17:40:16.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.227+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0056b40 con 0x7f35c00c3340 2022-08-10T17:40:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.227+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c01466a0 con 0x7f35c00c3340 2022-08-10T17:40:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.228+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c01445f0 con 0x7f35c00c3340 2022-08-10T17:40:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.233+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f35b0056ca0 con 0x7f35c00c3340 2022-08-10T17:40:16.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.234+0000 7f35b5ffb700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35a8065180 0x7f35a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.234+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f35b00c64e0 con 0x7f35c00c3340 2022-08-10T17:40:16.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.240+0000 7f35c505c700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35a8065180 0x7f35a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.248+0000 7f35c505c700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35a8065180 0x7f35a8067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35bc006fd0 tx=0x7f35bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.254+0000 7f35c72c0700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 0x7f359c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.254+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c007d90 con 0x7f359c002a40 2022-08-10T17:40:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.258+0000 7f35c585d700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 0x7f359c004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.263+0000 7f35c585d700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f359c007f50 con 0x7f359c002a40 2022-08-10T17:40:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.264+0000 7f35c585d700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 0x7f359c004ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b800ce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800a7a0 con 0x7f359c002a40 2022-08-10T17:40:16.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f35b800a900 con 0x7f359c002a40 2022-08-10T17:40:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 msgr2=0x7f359c004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 0x7f359c004ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b800ce40 comp rx=0 tx=0).stop 2022-08-10T17:40:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 msgr2=0x7f359c004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.268+0000 7f35b5ffb700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c002a40 0x7f359c004ef0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b800ce40 comp rx=0 tx=0).stop 2022-08-10T17:40:16.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.282+0000 7f35c72c0700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 0x7f359c0072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.282+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c007910 con 0x7f359c006e30 2022-08-10T17:40:16.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.283+0000 7f35c585d700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 0x7f359c0072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.283+0000 7f35c585d700 1 -- 172.21.15.150:0/2768838369 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f359c007ad0 con 0x7f359c006e30 2022-08-10T17:40:16.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.283+0000 7f35c585d700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 0x7f359c0072b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b8004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.284+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8021070 con 0x7f359c006e30 2022-08-10T17:40:16.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.285+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4376 (secure 0 0 0) 0x7f35b8004250 con 0x7f359c006e30 2022-08-10T17:40:16.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.285+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 msgr2=0x7f359c0072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.285+0000 7f35b5ffb700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 0x7f359c0072b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b8004980 comp rx=0 tx=0).stop 2022-08-10T17:40:16.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.285+0000 7f35b5ffb700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 msgr2=0x7f359c0072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:16.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.285+0000 7f35b5ffb700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f359c006e30 0x7f359c0072b0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35b800ca80 tx=0x7f35b8004980 comp rx=0 tx=0).stop 2022-08-10T17:40:16.300 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:16.300 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:16.300 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:16.301 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:40:16.301 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:16.301 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:16.301 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:16.302 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:16.302 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:16.302 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.302 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 5, 2022-08-10T17:40:16.303 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:16.303 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:16.303 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:16.303 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.304 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.304 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.304 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.304 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.304 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.305 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.305 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.305 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.305 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.306 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:16.306 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:16.306 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.306 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.307 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.307 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.307 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.307 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.307 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.308 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.308 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.308 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:16.309 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:16.310 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:16.310 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:16.310 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:16.310 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:16.311 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:16.311 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:16.311 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:16.311 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:16.311 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:16.312 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:16.312 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:16.312 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:16.312 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.313 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.313 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.313 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.314 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.314 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.314 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.314 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.314 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.315 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:16.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:16.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.316 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:16.316 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:16.316 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.316 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.317 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.317 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:16.317 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.318 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.318 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:16.318 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.319 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.319 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.319 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:16.320 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:16.320 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.320 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.320 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.321 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:16.321 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:16.321 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.322 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.322 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.322 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:16.323 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.323 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.324 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:16.324 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.324 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.324 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.325 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:16.325 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:16.325 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.325 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.326 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.326 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:16.326 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:16.327 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.327 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.327 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.328 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:16.328 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.329 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.329 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:16.329 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.329 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.329 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.330 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:16.330 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:16.330 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.331 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.331 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.331 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.331 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.332 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:16.332 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:16.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.332 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.333 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.333 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:16.333 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.333 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.333 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:16.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.334 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.334 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.334 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:16.335 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.335 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.335 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:16.336 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:16.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.302+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35a8065180 msgr2=0x7f35a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.302+0000 7f35c72c0700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35a8065180 0x7f35a8067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35bc006fd0 tx=0x7f35bc008030 comp rx=0 tx=0).stop 2022-08-10T17:40:16.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.302+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 msgr2=0x7f35c0144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.302+0000 7f35c72c0700 1 --2- 172.21.15.150:0/2768838369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35c00c3340 0x7f35c0144df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35b000be60 tx=0x7f35b000dab0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.303+0000 7f35c585d700 1 -- 172.21.15.150:0/2768838369 reap_dead start 2022-08-10T17:40:16.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.303+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 shutdown_connections 2022-08-10T17:40:16.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.303+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 >> 172.21.15.150:0/2768838369 conn(0x7f35c006b500 msgr2=0x7f35c00c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:16.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.303+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 shutdown_connections 2022-08-10T17:40:16.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.303+0000 7f35c72c0700 1 -- 172.21.15.150:0/2768838369 wait complete. 2022-08-10T17:40:16.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:40:16.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.785+0000 7f7c5c8c6700 1 Processor -- start 2022-08-10T17:40:16.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.785+0000 7f7c5c8c6700 1 -- start start 2022-08-10T17:40:16.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.786+0000 7f7c5c8c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c580c26c0 0x7f7c58070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.786+0000 7f7c5c8c6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c3340 0x7f7c5806dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.786+0000 7f7c5c8c6700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580c9990 con 0x7f7c580c8990 2022-08-10T17:40:16.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.786+0000 7f7c5c8c6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5815b830 con 0x7f7c580c26c0 2022-08-10T17:40:16.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.786+0000 7f7c5c8c6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5815af60 con 0x7f7c580c3340 2022-08-10T17:40:16.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c580c26c0 0x7f7c58070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c580c26c0 0x7f7c58070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33142/0 (socket says 172.21.15.150:33142) 2022-08-10T17:40:16.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 -- 172.21.15.150:0/2066596930 learned_addr learned my addr 172.21.15.150:0/2066596930 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:16.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 -- 172.21.15.150:0/2066596930 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c3340 msgr2=0x7f7c5806dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:16.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 --2- 172.21.15.150:0/2066596930 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c3340 0x7f7c5806dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 -- 172.21.15.150:0/2066596930 >> v1:172.21.15.197:6789/0 conn(0x7f7c580c8990 legacy=0x7f7c5815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 -- 172.21.15.150:0/2066596930 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580c4e80 con 0x7f7c580c26c0 2022-08-10T17:40:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.788+0000 7f7c5659c700 1 --2- 172.21.15.150:0/2066596930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c580c26c0 0x7f7c58070290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c48006fd0 tx=0x7f7c48009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2a5446a35f2ca4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.790+0000 7f7c5559a700 1 -- 172.21.15.150:0/2066596930 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48011830 con 0x7f7c580c26c0 2022-08-10T17:40:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.790+0000 7f7c5559a700 1 -- 172.21.15.150:0/2066596930 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48011990 con 0x7f7c580c26c0 2022-08-10T17:40:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.790+0000 7f7c5559a700 1 -- 172.21.15.150:0/2066596930 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48011d40 con 0x7f7c580c26c0 2022-08-10T17:40:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.791+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/2066596930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c580c26c0 msgr2=0x7f7c58070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.791+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/2066596930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c580c26c0 0x7f7c58070290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c48006fd0 tx=0x7f7c48009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.795+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/2066596930 shutdown_connections 2022-08-10T17:40:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.795+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/2066596930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c580c26c0 0x7f7c58070290 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c48006fd0 tx=0x7f7c48009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.795+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/2066596930 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c3340 0x7f7c5806dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.795+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/2066596930 >> 172.21.15.150:0/2066596930 conn(0x7f7c5806b500 msgr2=0x7f7c5806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:16.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.802+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/2066596930 shutdown_connections 2022-08-10T17:40:16.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.802+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/2066596930 wait complete. 2022-08-10T17:40:16.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.804+0000 7f7c5c8c6700 1 Processor -- start 2022-08-10T17:40:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.805+0000 7f7c5c8c6700 1 -- start start 2022-08-10T17:40:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c580c3340 0x7f7c580c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c8990 0x7f7c580c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 0x7f7c581332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58140f20 con 0x7f7c581305f0 2022-08-10T17:40:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c7570 con 0x7f7c580c3340 2022-08-10T17:40:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.806+0000 7f7c5c8c6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c6fb0 con 0x7f7c580c8990 2022-08-10T17:40:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 0x7f7c581332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 0x7f7c581332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33152/0 (socket says 172.21.15.150:33152) 2022-08-10T17:40:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 learned_addr learned my addr 172.21.15.150:0/3449469912 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c8990 msgr2=0x7f7c580c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c580c8990 0x7f7c580c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c580c3340 msgr2=0x7f7c580c0c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c580c3340 0x7f7c580c0c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480093e0 con 0x7f7c581305f0 2022-08-10T17:40:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.809+0000 7f7c56d9d700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 0x7f7c581332e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b7b0 tx=0x7f7c5000bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.810+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011890 con 0x7f7c581305f0 2022-08-10T17:40:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.810+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c500119f0 con 0x7f7c581305f0 2022-08-10T17:40:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.810+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580c7290 con 0x7f7c581305f0 2022-08-10T17:40:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.810+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011da0 con 0x7f7c581305f0 2022-08-10T17:40:16.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.810+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58140b40 con 0x7f7c581305f0 2022-08-10T17:40:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.812+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7c50017020 con 0x7f7c581305f0 2022-08-10T17:40:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.813+0000 7f7c46ffd700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7c3c0651b0 0x7f7c3c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.813+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7c500819d0 con 0x7f7c581305f0 2022-08-10T17:40:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.813+0000 7f7c5659c700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7c3c0651b0 0x7f7c3c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.813+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 0x7f7c58141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.813+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580673d0 con 0x7f7c58133820 2022-08-10T17:40:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.815+0000 7f7c55d9b700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 0x7f7c58141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.817+0000 7f7c5659c700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7c3c0651b0 0x7f7c3c067660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806ccc0 tx=0x7f7c48008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.819+0000 7f7c55d9b700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c58133bf0 con 0x7f7c58133820 2022-08-10T17:40:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.819+0000 7f7c55d9b700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 0x7f7c58141240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b340 tx=0x7f7c4c00b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c011830 con 0x7f7c58133820 2022-08-10T17:40:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f7c4c00be70 con 0x7f7c58133820 2022-08-10T17:40:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 msgr2=0x7f7c58141240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 0x7f7c58141240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b340 tx=0x7f7c4c00b700 comp rx=0 tx=0).stop 2022-08-10T17:40:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 msgr2=0x7f7c58141240 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.822+0000 7f7c46ffd700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58133820 0x7f7c58141240 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b340 tx=0x7f7c4c00b700 comp rx=0 tx=0).stop 2022-08-10T17:40:16.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.863+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 0x7f7c58148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:16.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.863+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58140d30 con 0x7f7c58141780 2022-08-10T17:40:16.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.864+0000 7f7c55d9b700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 0x7f7c58148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:16.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.872+0000 7f7c55d9b700 1 -- 172.21.15.150:0/3449469912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7c58072890 con 0x7f7c58141780 2022-08-10T17:40:16.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.873+0000 7f7c55d9b700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 0x7f7c58148220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c0046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:16.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c01ac40 con 0x7f7c58141780 2022-08-10T17:40:16.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7f7c4c01f410 con 0x7f7c58141780 2022-08-10T17:40:16.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 msgr2=0x7f7c58148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 0x7f7c58148220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c0046e0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 msgr2=0x7f7c58148220 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:16.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.875+0000 7f7c46ffd700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c58141780 0x7f7c58148220 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c0046e0 comp rx=0 tx=0).stop 2022-08-10T17:40:16.880 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:16.880 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:16.880 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:16.881 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:40:16.881 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:16.881 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:16.881 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:16.882 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:16.882 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:16.882 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.883 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 5, 2022-08-10T17:40:16.883 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:16.883 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:16.883 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:16.884 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.884 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.884 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.885 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.885 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.885 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.885 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.886 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.886 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.886 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.887 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:16.887 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:16.887 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.887 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.888 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.888 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.888 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.888 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.889 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.889 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.889 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.889 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.890 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:16.890 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:16.891 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:16.891 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:16.891 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:16.891 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:16.892 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:16.892 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:16.892 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:16.892 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:16.893 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:16.893 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:16.893 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:16.894 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:16.894 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:16.894 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:16.894 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:16.895 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:16.895 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:16.895 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:16.895 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:16.896 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:16.896 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:16.896 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:16.897 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:16.897 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.897 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:16.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.898 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:16.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.898 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:16.899 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:16.899 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.899 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.900 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.900 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:16.900 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.901 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.901 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:16.901 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.902 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.902 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.902 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:16.903 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:16.903 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.903 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.903 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.904 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:16.905 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:16.905 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.905 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.906 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.906 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:16.906 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.907 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.908 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:16.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.908 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.908 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.909 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:16.909 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:16.909 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.910 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.910 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.911 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:16.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:16.911 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:16.911 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:16.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:16.912 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:16.913 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.913 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:16.914 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:16.914 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:16.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.915 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.915 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:16.916 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:16.916 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:16.916 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:16.916 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:16.917 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.917 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.918 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:16.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:16.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.918 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.919 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.919 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:16.919 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.919 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.920 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:40:16.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.920 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.921 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.921 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:16.921 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.921 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.922 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:16.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.922 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.922 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.923 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:16.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.923 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.923 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:16.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.924 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:40:16.924 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.924 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:16.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.925 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.926 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.926 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:16.926 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.926 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:16.926 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:40:16.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:16.927 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:16.927 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:16.928 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:16.929 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:16.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.894+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7c3c0651b0 msgr2=0x7f7c3c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.894+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7c3c0651b0 0x7f7c3c067660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806ccc0 tx=0x7f7c48008030 comp rx=0 tx=0).stop 2022-08-10T17:40:16.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.894+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 msgr2=0x7f7c581332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:16.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.894+0000 7f7c5c8c6700 1 --2- 172.21.15.150:0/3449469912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c581305f0 0x7f7c581332e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b7b0 tx=0x7f7c5000bb70 comp rx=0 tx=0).stop 2022-08-10T17:40:16.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.909+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 reap_dead start 2022-08-10T17:40:16.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.909+0000 7f7c56d9d700 1 -- 172.21.15.150:0/3449469912 reap_dead start 2022-08-10T17:40:16.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.910+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 shutdown_connections 2022-08-10T17:40:16.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.910+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 >> 172.21.15.150:0/3449469912 conn(0x7f7c5806b500 msgr2=0x7f7c580c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:16.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.912+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 shutdown_connections 2022-08-10T17:40:16.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:16.918+0000 7f7c5c8c6700 1 -- 172.21.15.150:0/3449469912 wait complete. 2022-08-10T17:40:16.952 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:40:16.952 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:40:17.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.385+0000 7f7b5803b700 1 Processor -- start 2022-08-10T17:40:17.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.385+0000 7f7b5803b700 1 -- start start 2022-08-10T17:40:17.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b5803b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b5006dc90 0x7f7b50069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b5803b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7b5006a760 0x7f7b50069e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b5803b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b500c98f0 con 0x7f7b5014ce90 2022-08-10T17:40:17.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b5803b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500c4880 con 0x7f7b5006dc90 2022-08-10T17:40:17.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b5803b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500c4e20 con 0x7f7b5006a760 2022-08-10T17:40:17.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.386+0000 7f7b555d6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b5006dc90 0x7f7b50069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:17.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b5006dc90 0x7f7b50069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33178/0 (socket says 172.21.15.150:33178) 2022-08-10T17:40:17.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 -- 172.21.15.150:0/2096595190 learned_addr learned my addr 172.21.15.150:0/2096595190 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:17.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b565d8700 1 --2- 172.21.15.150:0/2096595190 >> v2:172.21.15.197:3300/0 conn(0x7f7b5006a760 0x7f7b50069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:17.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 -- 172.21.15.150:0/2096595190 >> v2:172.21.15.197:3300/0 conn(0x7f7b5006a760 msgr2=0x7f7b50069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:17.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 --2- 172.21.15.150:0/2096595190 >> v2:172.21.15.197:3300/0 conn(0x7f7b5006a760 0x7f7b50069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:17.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 -- 172.21.15.150:0/2096595190 >> v1:172.21.15.197:6789/0 conn(0x7f7b5014ce90 legacy=0x7f7b50156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:17.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.387+0000 7f7b555d6700 1 -- 172.21.15.150:0/2096595190 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500c4b40 con 0x7f7b5006dc90 2022-08-10T17:40:17.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.388+0000 7f7b555d6700 1 --2- 172.21.15.150:0/2096595190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b50069910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b500c54e0 tx=0x7f7b40009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f794d6c6baf1ba9e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:17.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.388+0000 7f7b54dd5700 1 -- 172.21.15.150:0/2096595190 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40004230 con 0x7f7b5006dc90 2022-08-10T17:40:17.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.388+0000 7f7b54dd5700 1 -- 172.21.15.150:0/2096595190 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40004390 con 0x7f7b5006dc90 2022-08-10T17:40:17.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.388+0000 7f7b54dd5700 1 -- 172.21.15.150:0/2096595190 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40010ad0 con 0x7f7b5006dc90 2022-08-10T17:40:17.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.389+0000 7f7b5803b700 1 -- 172.21.15.150:0/2096595190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 msgr2=0x7f7b50069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:17.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.389+0000 7f7b5803b700 1 --2- 172.21.15.150:0/2096595190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b50069910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b500c54e0 tx=0x7f7b40009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:17.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 -- 172.21.15.150:0/2096595190 shutdown_connections 2022-08-10T17:40:17.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 --2- 172.21.15.150:0/2096595190 >> v2:172.21.15.197:3300/0 conn(0x7f7b5006a760 0x7f7b50069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:17.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 --2- 172.21.15.150:0/2096595190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b50069910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:17.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 -- 172.21.15.150:0/2096595190 >> 172.21.15.150:0/2096595190 conn(0x7f7b5006b500 msgr2=0x7f7b5006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:17.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 -- 172.21.15.150:0/2096595190 shutdown_connections 2022-08-10T17:40:17.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.390+0000 7f7b5803b700 1 -- 172.21.15.150:0/2096595190 wait complete. 2022-08-10T17:40:17.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.392+0000 7f7b5803b700 1 Processor -- start 2022-08-10T17:40:17.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.397+0000 7f7b5803b700 1 -- start start 2022-08-10T17:40:17.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b5006a760 0x7f7b500b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b5014ce90 0x7f7b501f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500b8640 con 0x7f7b5006dc90 2022-08-10T17:40:17.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b501eff80 con 0x7f7b5006a760 2022-08-10T17:40:17.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.398+0000 7f7b5803b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50152120 con 0x7f7b5014ce90 2022-08-10T17:40:17.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:17.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33182/0 (socket says 172.21.15.150:33182) 2022-08-10T17:40:17.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 -- 172.21.15.150:0/324997198 learned_addr learned my addr 172.21.15.150:0/324997198 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:17.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 -- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b5014ce90 msgr2=0x7f7b501f0480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:17.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b5014ce90 0x7f7b501f0480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:17.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 -- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b5006a760 msgr2=0x7f7b500b5f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:17.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b5006a760 0x7f7b500b5f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:17.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.399+0000 7f7b555d6700 1 -- 172.21.15.150:0/324997198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400093e0 con 0x7f7b5006dc90 2022-08-10T17:40:17.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.401+0000 7f7b555d6700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001a040 tx=0x7f7b400045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:17.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.431+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400040b0 con 0x7f7b5006dc90 2022-08-10T17:40:17.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.431+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40004210 con 0x7f7b5006dc90 2022-08-10T17:40:17.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.431+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40010ab0 con 0x7f7b5006dc90 2022-08-10T17:40:17.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.432+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b50152400 con 0x7f7b5006dc90 2022-08-10T17:40:17.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.432+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b501529c0 con 0x7f7b5006dc90 2022-08-10T17:40:17.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.434+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7b4001e030 con 0x7f7b5006dc90 2022-08-10T17:40:17.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.435+0000 7f7b3e7fc700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 0x7f7b30067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:17.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.435+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7b40083d40 con 0x7f7b5006dc90 2022-08-10T17:40:17.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.435+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5006cee0 con 0x7f7b5006dc90 2022-08-10T17:40:17.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.436+0000 7f7b55dd7700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 0x7f7b30067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:17.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.437+0000 7f7b55dd7700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 0x7f7b30067630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007fd0 tx=0x7f7b4c0078c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:17.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:17.444+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7b40051cb0 con 0x7f7b5006dc90 2022-08-10T17:40:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.099+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f7b50072890 con 0x7f7b5006dc90 2022-08-10T17:40:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.103+0000 7f7b3e7fc700 1 -- 172.21.15.150:0/324997198 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f7b400552d0 con 0x7f7b5006dc90 2022-08-10T17:40:18.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 msgr2=0x7f7b30067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:18.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 0x7f7b30067630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007fd0 tx=0x7f7b4c0078c0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 msgr2=0x7f7b501551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:18.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001a040 tx=0x7f7b400045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 shutdown_connections 2022-08-10T17:40:18.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7b30065180 0x7f7b30067630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b5014ce90 0x7f7b501f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b5006a760 0x7f7b500b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 --2- 172.21.15.150:0/324997198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b5006dc90 0x7f7b501551f0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001a040 tx=0x7f7b400045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:18.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.141+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 >> 172.21.15.150:0/324997198 conn(0x7f7b5006b500 msgr2=0x7f7b500c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:18.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.154+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 shutdown_connections 2022-08-10T17:40:18.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:18.156+0000 7f7b5803b700 1 -- 172.21.15.150:0/324997198 wait complete. 2022-08-10T17:40:18.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:40:28.232 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:40:28.232 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:28.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.595+0000 7f6eee05c700 1 Processor -- start 2022-08-10T17:40:28.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.595+0000 7f6eee05c700 1 -- start start 2022-08-10T17:40:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.596+0000 7f6eee05c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6ee80700a0 0x7f6ee80c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.596+0000 7f6eee05c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806bec0 0x7f6ee8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.596+0000 7f6eee05c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee806b490 con 0x7f6ee806d930 2022-08-10T17:40:28.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.596+0000 7f6eee05c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee806bd30 con 0x7f6ee80700a0 2022-08-10T17:40:28.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.596+0000 7f6eee05c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee815adb0 con 0x7f6ee806bec0 2022-08-10T17:40:28.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6ee80700a0 0x7f6ee80c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6ee80700a0 0x7f6ee80c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44128/0 (socket says 172.21.15.150:44128) 2022-08-10T17:40:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 -- 172.21.15.150:0/3318568666 learned_addr learned my addr 172.21.15.150:0/3318568666 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee7fff700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806bec0 0x7f6ee8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 -- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806bec0 msgr2=0x7f6ee8154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:28.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806bec0 0x7f6ee8154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:28.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 -- 172.21.15.150:0/3318568666 >> v1:172.21.15.197:6789/0 conn(0x7f6ee806d930 legacy=0x7f6ee815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:28.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.597+0000 7f6ee77fe700 1 -- 172.21.15.150:0/3318568666 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee806b770 con 0x7f6ee80700a0 2022-08-10T17:40:28.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.598+0000 7f6ee77fe700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80c36c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009e50 tx=0x7f6ee000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700e6659c28b5f34 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:28.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.601+0000 7f6ee67fc700 1 -- 172.21.15.150:0/3318568666 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000e070 con 0x7f6ee80700a0 2022-08-10T17:40:28.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.601+0000 7f6ee67fc700 1 -- 172.21.15.150:0/3318568666 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000b8d0 con 0x7f6ee80700a0 2022-08-10T17:40:28.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.601+0000 7f6ee67fc700 1 -- 172.21.15.150:0/3318568666 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000bc60 con 0x7f6ee80700a0 2022-08-10T17:40:28.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.602+0000 7f6eee05c700 1 -- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 msgr2=0x7f6ee80c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:28.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.602+0000 7f6eee05c700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80c36c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009e50 tx=0x7f6ee000b330 comp rx=0 tx=0).stop 2022-08-10T17:40:28.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.627+0000 7f6eee05c700 1 -- 172.21.15.150:0/3318568666 shutdown_connections 2022-08-10T17:40:28.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.627+0000 7f6eee05c700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806bec0 0x7f6ee8154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:28.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.627+0000 7f6eee05c700 1 --2- 172.21.15.150:0/3318568666 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80c36c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:28.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.627+0000 7f6eee05c700 1 -- 172.21.15.150:0/3318568666 >> 172.21.15.150:0/3318568666 conn(0x7f6ee80c8a10 msgr2=0x7f6ee80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:28.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.629+0000 7f6eee05c700 1 -- 172.21.15.150:0/3318568666 shutdown_connections 2022-08-10T17:40:28.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.630+0000 7f6eee05c700 1 -- 172.21.15.150:0/3318568666 wait complete. 2022-08-10T17:40:28.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.631+0000 7f6eee05c700 1 Processor -- start 2022-08-10T17:40:28.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.632+0000 7f6eee05c700 1 -- start start 2022-08-10T17:40:28.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806d930 0x7f6ee8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80bd3b0 con 0x7f6ee806bec0 2022-08-10T17:40:28.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80c2640 con 0x7f6ee80700a0 2022-08-10T17:40:28.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.633+0000 7f6eee05c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80b9cf0 con 0x7f6ee806d930 2022-08-10T17:40:28.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.637+0000 7f6ee7fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:28.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.637+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:28.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.637+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33542/0 (socket says 172.21.15.150:33542) 2022-08-10T17:40:28.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.637+0000 7f6ee77fe700 1 -- 172.21.15.150:0/2312518458 learned_addr learned my addr 172.21.15.150:0/2312518458 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:28.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 -- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806d930 msgr2=0x7f6ee8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:28.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806d930 0x7f6ee8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:28.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 -- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 msgr2=0x7f6ee80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:28.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:28.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 -- 172.21.15.150:0/2312518458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009b30 con 0x7f6ee806bec0 2022-08-10T17:40:28.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.638+0000 7f6ee77fe700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8068c70 tx=0x7f6ee0004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:28.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.653+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004440 con 0x7f6ee806bec0 2022-08-10T17:40:28.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.653+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00092e0 con 0x7f6ee806bec0 2022-08-10T17:40:28.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.653+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00047e0 con 0x7f6ee806bec0 2022-08-10T17:40:28.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.654+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee81fc1a0 con 0x7f6ee806bec0 2022-08-10T17:40:28.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.654+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee80bcb10 con 0x7f6ee806bec0 2022-08-10T17:40:28.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.657+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6ee0012430 con 0x7f6ee806bec0 2022-08-10T17:40:28.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.657+0000 7f6ecffff700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 0x7f6ec8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:28.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.657+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6ee0083300 con 0x7f6ee806bec0 2022-08-10T17:40:28.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.658+0000 7f6ee6ffd700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 0x7f6ec8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:28.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.658+0000 7f6ee6ffd700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 0x7f6ec8067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ee81fcd20 tx=0x7f6ed80078a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:28.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.659+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8072890 con 0x7f6ee806bec0 2022-08-10T17:40:28.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:28.669+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6ee0054c40 con 0x7f6ee806bec0 2022-08-10T17:40:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.296+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6ee80bcdf0 con 0x7f6ee806bec0 2022-08-10T17:40:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.297+0000 7f6ecffff700 1 -- 172.21.15.150:0/2312518458 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f6ee0017020 con 0x7f6ee806bec0 2022-08-10T17:40:29.305 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:29.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.315+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 msgr2=0x7f6ec8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.315+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 0x7f6ec8067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ee81fcd20 tx=0x7f6ed80078a0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.315+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 msgr2=0x7f6ee81fbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.315+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8068c70 tx=0x7f6ee0004950 comp rx=0 tx=0).stop 2022-08-10T17:40:29.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 shutdown_connections 2022-08-10T17:40:29.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6ee80700a0 0x7f6ee80be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ee806bec0 0x7f6ee81fbc60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6ec8065180 0x7f6ec8067630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 --2- 172.21.15.150:0/2312518458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6ee806d930 0x7f6ee8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.320+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 >> 172.21.15.150:0/2312518458 conn(0x7f6ee80c8a10 msgr2=0x7f6ee80c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:29.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.321+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 shutdown_connections 2022-08-10T17:40:29.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.322+0000 7f6eee05c700 1 -- 172.21.15.150:0/2312518458 wait complete. 2022-08-10T17:40:29.358 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:40:29.359 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:40:29.359 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:40:29.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.760+0000 7f72fd20c700 1 Processor -- start 2022-08-10T17:40:29.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.762+0000 7f72fd20c700 1 -- start start 2022-08-10T17:40:29.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72fd20c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 0x7f72f80c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72fd20c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80c4180 con 0x7f72f806a4c0 2022-08-10T17:40:29.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72fd20c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80c37d0 con 0x7f72f80c3340 2022-08-10T17:40:29.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72fd20c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80c5110 con 0x7f72f806a890 2022-08-10T17:40:29.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72f6d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f72f806a4c0 0x7f72f815b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:46258/0 (socket says 172.21.15.150:46258) 2022-08-10T17:40:29.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.763+0000 7f72f6d9d700 1 -- 172.21.15.150:0/565807290 learned_addr learned my addr 172.21.15.150:0/565807290 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:29.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.770+0000 7f72f759e700 1 --2- 172.21.15.150:0/565807290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 0x7f72f80c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:29.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.771+0000 7f72f759e700 1 -- 172.21.15.150:0/565807290 >> v1:172.21.15.197:6789/0 conn(0x7f72f80c3340 legacy=0x7f72f80c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.771+0000 7f72f759e700 1 -- 172.21.15.150:0/565807290 >> v1:172.21.15.150:6789/0 conn(0x7f72f806a4c0 legacy=0x7f72f815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.771+0000 7f72f759e700 1 -- 172.21.15.150:0/565807290 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8070280 con 0x7f72f806a890 2022-08-10T17:40:29.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.776+0000 7f72f759e700 1 --2- 172.21.15.150:0/565807290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 0x7f72f80c4bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009dc0 tx=0x7f72f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55db48f887bb9fff server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:29.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.792+0000 7f72f5d9b700 1 -- 172.21.15.150:0/565807290 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000e070 con 0x7f72f806a890 2022-08-10T17:40:29.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.792+0000 7f72f5d9b700 1 -- 172.21.15.150:0/565807290 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000bad0 con 0x7f72f806a890 2022-08-10T17:40:29.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.792+0000 7f72f5d9b700 1 -- 172.21.15.150:0/565807290 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000be80 con 0x7f72f806a890 2022-08-10T17:40:29.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.793+0000 7f72fd20c700 1 -- 172.21.15.150:0/565807290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 msgr2=0x7f72f80c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.793+0000 7f72fd20c700 1 --2- 172.21.15.150:0/565807290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 0x7f72f80c4bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009dc0 tx=0x7f72f000b330 comp rx=0 tx=0).stop 2022-08-10T17:40:29.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.804+0000 7f72fd20c700 1 -- 172.21.15.150:0/565807290 shutdown_connections 2022-08-10T17:40:29.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.804+0000 7f72fd20c700 1 --2- 172.21.15.150:0/565807290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f806a890 0x7f72f80c4bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.804+0000 7f72fd20c700 1 -- 172.21.15.150:0/565807290 >> 172.21.15.150:0/565807290 conn(0x7f72f806b500 msgr2=0x7f72f806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:29.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.816+0000 7f72fd20c700 1 -- 172.21.15.150:0/565807290 shutdown_connections 2022-08-10T17:40:29.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.816+0000 7f72fd20c700 1 -- 172.21.15.150:0/565807290 wait complete. 2022-08-10T17:40:29.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.818+0000 7f72fd20c700 1 Processor -- start 2022-08-10T17:40:29.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.819+0000 7f72fd20c700 1 -- start start 2022-08-10T17:40:29.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 0x7f72f8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72f806a890 0x7f72f814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f80c3340 0x7f72f8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80bfb00 con 0x7f72f806a890 2022-08-10T17:40:29.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80c8170 con 0x7f72f806a4c0 2022-08-10T17:40:29.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.820+0000 7f72fd20c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f814d560 con 0x7f72f80c3340 2022-08-10T17:40:29.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.821+0000 7f72f6d9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 0x7f72f8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:29.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.823+0000 7f72f6d9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 0x7f72f8150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44178/0 (socket says 172.21.15.150:44178) 2022-08-10T17:40:29.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.823+0000 7f72f6d9d700 1 -- 172.21.15.150:0/1895631046 learned_addr learned my addr 172.21.15.150:0/1895631046 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:29.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.824+0000 7f72f6d9d700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f80c3340 msgr2=0x7f72f8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.824+0000 7f72f6d9d700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72f80c3340 0x7f72f8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.824+0000 7f72f6d9d700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72f806a890 msgr2=0x7f72f814cca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:29.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.824+0000 7f72f6d9d700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72f806a890 0x7f72f814cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.824+0000 7f72f6d9d700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0009a70 con 0x7f72f806a4c0 2022-08-10T17:40:29.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.829+0000 7f72f6d9d700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 0x7f72f8150ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001eb0 tx=0x7f72ec01d8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:29.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.831+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0184e0 con 0x7f72f806a4c0 2022-08-10T17:40:29.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.832+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec015790 con 0x7f72f806a4c0 2022-08-10T17:40:29.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.832+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec018660 con 0x7f72f806a4c0 2022-08-10T17:40:29.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.832+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f814d800 con 0x7f72f806a4c0 2022-08-10T17:40:29.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.832+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f80c7290 con 0x7f72f806a4c0 2022-08-10T17:40:29.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.837+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f72ec02b020 con 0x7f72f806a4c0 2022-08-10T17:40:29.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.838+0000 7f72df7fe700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72d8065180 0x7f72d8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.838+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f72ec092e80 con 0x7f72f806a4c0 2022-08-10T17:40:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.846+0000 7f72f659c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72d8065180 0x7f72d8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:29.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.857+0000 7f72f659c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72d8065180 0x7f72d8067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f72f815a0a0 tx=0x7f72e80078a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:29.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.878+0000 7f72fd20c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 0x7f72d4004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.879+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4007d90 con 0x7f72d4002a40 2022-08-10T17:40:29.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.879+0000 7f72f759e700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 0x7f72d4004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:29.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.879+0000 7f72f759e700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72d4007f50 con 0x7f72d4002a40 2022-08-10T17:40:29.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.880+0000 7f72f759e700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 0x7f72d4004ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72f806ac80 tx=0x7f72f00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:29.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.886+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0004610 con 0x7f72d4002a40 2022-08-10T17:40:29.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.887+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f72f0004770 con 0x7f72d4002a40 2022-08-10T17:40:29.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.887+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 msgr2=0x7f72d4004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.887+0000 7f72df7fe700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 0x7f72d4004ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72f806ac80 tx=0x7f72f00040e0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.887+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 msgr2=0x7f72d4004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:29.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.887+0000 7f72df7fe700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4002a40 0x7f72d4004ef0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72f806ac80 tx=0x7f72f00040e0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.902+0000 7f72fd20c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 0x7f72d40072d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:29.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.902+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4007930 con 0x7f72d4006e70 2022-08-10T17:40:29.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.903+0000 7f72f759e700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 0x7f72d40072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:29.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.904+0000 7f72f759e700 1 -- 172.21.15.150:0/1895631046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72d4007af0 con 0x7f72d4006e70 2022-08-10T17:40:29.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.905+0000 7f72f759e700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 0x7f72d40072d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007f20 tx=0x7f72f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:29.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f002c070 con 0x7f72d4006e70 2022-08-10T17:40:29.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4889 (secure 0 0 0) 0x7f72f0012750 con 0x7f72d4006e70 2022-08-10T17:40:29.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 msgr2=0x7f72d40072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 0x7f72d40072d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007f20 tx=0x7f72f0012000 comp rx=0 tx=0).stop 2022-08-10T17:40:29.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 msgr2=0x7f72d40072d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:29.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.907+0000 7f72df7fe700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72d4006e70 0x7f72d40072d0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007f20 tx=0x7f72f0012000 comp rx=0 tx=0).stop 2022-08-10T17:40:29.912 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:40:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 18, 2022-08-10T17:40:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:40:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:40:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:40:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:40:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:29.960 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:29.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72d8065180 msgr2=0x7f72d8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72d8065180 0x7f72d8067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f72f815a0a0 tx=0x7f72e80078a0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 msgr2=0x7f72f8150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 --2- 172.21.15.150:0/1895631046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72f806a4c0 0x7f72f8150ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001eb0 tx=0x7f72ec01d8b0 comp rx=0 tx=0).stop 2022-08-10T17:40:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72f759e700 1 -- 172.21.15.150:0/1895631046 reap_dead start 2022-08-10T17:40:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 shutdown_connections 2022-08-10T17:40:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.917+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 >> 172.21.15.150:0/1895631046 conn(0x7f72f806b500 msgr2=0x7f72f806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:29.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.918+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 shutdown_connections 2022-08-10T17:40:29.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:29.918+0000 7f72fd20c700 1 -- 172.21.15.150:0/1895631046 wait complete. 2022-08-10T17:40:29.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:40:30.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.403+0000 7fdcb85fc700 1 Processor -- start 2022-08-10T17:40:30.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.403+0000 7fdcb85fc700 1 -- start start 2022-08-10T17:40:30.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.404+0000 7fdcb85fc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fdcb00c3340 0x7fdcb00c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.404+0000 7fdcb85fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdcb006a890 0x7fdcb00c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.404+0000 7fdcb85fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00c4180 con 0x7fdcb006a4c0 2022-08-10T17:40:30.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.404+0000 7fdcb85fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00c5110 con 0x7fdcb006a890 2022-08-10T17:40:30.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.404+0000 7fdcb85fc700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00c37d0 con 0x7fdcb00c3340 2022-08-10T17:40:30.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.405+0000 7fdcb6398700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdcb006a4c0 0x7fdcb015b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:46290/0 (socket says 172.21.15.150:46290) 2022-08-10T17:40:30.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.405+0000 7fdcb6398700 1 -- 172.21.15.150:0/2590163013 learned_addr learned my addr 172.21.15.150:0/2590163013 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:30.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.405+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/2590163013 >> v2:172.21.15.150:3300/0 conn(0x7fdcb006a890 0x7fdcb00c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.406+0000 7fdcb5b97700 1 --2- 172.21.15.150:0/2590163013 >> v2:172.21.15.197:3300/0 conn(0x7fdcb00c3340 0x7fdcb00c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.406+0000 7fdcb6b99700 1 -- 172.21.15.150:0/2590163013 >> v2:172.21.15.197:3300/0 conn(0x7fdcb00c3340 msgr2=0x7fdcb00c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:30.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.406+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/2590163013 >> v2:172.21.15.197:3300/0 conn(0x7fdcb00c3340 0x7fdcb00c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.406+0000 7fdcb6b99700 1 -- 172.21.15.150:0/2590163013 >> v1:172.21.15.150:6789/0 conn(0x7fdcb006a4c0 legacy=0x7fdcb015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:30.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.406+0000 7fdcb6b99700 1 -- 172.21.15.150:0/2590163013 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0070280 con 0x7fdcb006a890 2022-08-10T17:40:30.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.407+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/2590163013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb006a890 0x7fdcb00c8910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c68a0 tx=0x7fdca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797e23daaad1332c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.407+0000 7fdcb5396700 1 -- 172.21.15.150:0/2590163013 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e070 con 0x7fdcb006a890 2022-08-10T17:40:30.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.407+0000 7fdcb5396700 1 -- 172.21.15.150:0/2590163013 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca800bb90 con 0x7fdcb006a890 2022-08-10T17:40:30.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.407+0000 7fdcb5396700 1 -- 172.21.15.150:0/2590163013 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80038a0 con 0x7fdcb006a890 2022-08-10T17:40:30.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.408+0000 7fdcb85fc700 1 -- 172.21.15.150:0/2590163013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb006a890 msgr2=0x7fdcb00c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.408+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/2590163013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb006a890 0x7fdcb00c8910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c68a0 tx=0x7fdca800b330 comp rx=0 tx=0).stop 2022-08-10T17:40:30.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 -- 172.21.15.150:0/2590163013 shutdown_connections 2022-08-10T17:40:30.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/2590163013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb006a890 0x7fdcb00c8910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/2590163013 >> v2:172.21.15.197:3300/0 conn(0x7fdcb00c3340 0x7fdcb00c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 -- 172.21.15.150:0/2590163013 >> 172.21.15.150:0/2590163013 conn(0x7fdcb006b500 msgr2=0x7fdcb006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:30.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 -- 172.21.15.150:0/2590163013 shutdown_connections 2022-08-10T17:40:30.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.409+0000 7fdcb85fc700 1 -- 172.21.15.150:0/2590163013 wait complete. 2022-08-10T17:40:30.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.411+0000 7fdcb85fc700 1 Processor -- start 2022-08-10T17:40:30.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.412+0000 7fdcb85fc700 1 -- start start 2022-08-10T17:40:30.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdcb006a4c0 0x7fdcb0121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdcb006a890 0x7fdcb00c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 0x7fdcb0123f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0122270 con 0x7fdcb00c3340 2022-08-10T17:40:30.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01fc5a0 con 0x7fdcb006a4c0 2022-08-10T17:40:30.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb85fc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01fc880 con 0x7fdcb006a890 2022-08-10T17:40:30.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb6b99700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 0x7fdcb0123f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb6b99700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 0x7fdcb0123f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33618/0 (socket says 172.21.15.150:33618) 2022-08-10T17:40:30.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.413+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 learned_addr learned my addr 172.21.15.150:0/1755903067 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:30.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdcb006a890 msgr2=0x7fdcb00c1540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:40:30.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdcb006a890 0x7fdcb00c1540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdcb006a4c0 msgr2=0x7fdcb0121be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:40:30.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdcb006a4c0 0x7fdcb0121be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009a70 con 0x7fdcb00c3340 2022-08-10T17:40:30.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.414+0000 7fdcb6b99700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 0x7fdcb0123f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdca8004000 tx=0x7fdca8004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.425+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8012630 con 0x7fdcb00c3340 2022-08-10T17:40:30.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.425+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8012790 con 0x7fdcb00c3340 2022-08-10T17:40:30.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.425+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8012b00 con 0x7fdcb00c3340 2022-08-10T17:40:30.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.426+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb01fcb60 con 0x7fdcb00c3340 2022-08-10T17:40:30.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.426+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00c7a30 con 0x7fdcb00c3340 2022-08-10T17:40:30.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.433+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdca8012c60 con 0x7fdcb00c3340 2022-08-10T17:40:30.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.433+0000 7fdc9effd700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdc90065150 0x7fdc90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.434+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdca8083f80 con 0x7fdcb00c3340 2022-08-10T17:40:30.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.434+0000 7fdcb6398700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdc90065150 0x7fdc90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.440+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 0x7fdc94004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.440+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94007d90 con 0x7fdc94002a40 2022-08-10T17:40:30.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.441+0000 7fdcb6398700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdc90065150 0x7fdc90067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcac004d30 tx=0x7fdcac0079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.442+0000 7fdcb5b97700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 0x7fdc94004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.446+0000 7fdcb5b97700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc94007f50 con 0x7fdc94002a40 2022-08-10T17:40:30.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.447+0000 7fdcb5b97700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 0x7fdc94004ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca000d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0004030 con 0x7fdc94002a40 2022-08-10T17:40:30.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fdca0004190 con 0x7fdc94002a40 2022-08-10T17:40:30.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 msgr2=0x7fdc94004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 0x7fdc94004ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca000d720 comp rx=0 tx=0).stop 2022-08-10T17:40:30.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 msgr2=0x7fdc94004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:30.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.455+0000 7fdc9effd700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94002a40 0x7fdc94004ef0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca000d720 comp rx=0 tx=0).stop 2022-08-10T17:40:30.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.490+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 0x7fdc940072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.490+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94007910 con 0x7fdc94006e30 2022-08-10T17:40:30.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.492+0000 7fdcb5b97700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 0x7fdc940072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.493+0000 7fdcb5b97700 1 -- 172.21.15.150:0/1755903067 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdc94007ad0 con 0x7fdc94006e30 2022-08-10T17:40:30.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.499+0000 7fdcb5b97700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 0x7fdc940072b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca0004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0024670 con 0x7fdc94006e30 2022-08-10T17:40:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7fdca00247d0 con 0x7fdc94006e30 2022-08-10T17:40:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 msgr2=0x7fdc940072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 0x7fdc940072b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca0004640 comp rx=0 tx=0).stop 2022-08-10T17:40:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 msgr2=0x7fdc940072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:30.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.507+0000 7fdc9effd700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdc94006e30 0x7fdc940072b0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00c86b0 tx=0x7fdca0004640 comp rx=0 tx=0).stop 2022-08-10T17:40:30.512 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:30.513 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:30.513 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:30.513 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:40:30.513 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:30.513 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:30.514 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:30.514 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:30.514 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:30.515 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:30.515 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 19, 2022-08-10T17:40:30.515 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:30.515 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:30.515 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:30.516 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:30.516 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:30.516 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:30.516 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:30.517 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:30.517 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:30.517 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:30.517 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:30.518 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:30.518 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:30.518 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:30.519 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:30.519 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:30.519 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:30.519 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:30.519 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:30.520 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:30.520 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:30.520 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:30.520 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:30.521 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:30.521 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.521 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:30.522 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:30.522 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:30.522 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:30.522 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:30.523 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:30.523 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:30.523 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:30.523 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:30.524 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:30.525 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:30.526 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:30.526 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:30.526 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:30.526 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:30.527 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:30.527 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:30.527 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:30.527 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:30.528 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:30.528 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:30.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.528 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:30.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.529 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:30.529 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:30.529 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:30.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:30.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.530 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:30.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:30.531 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.531 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:30.532 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:30.532 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.532 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.532 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.533 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:30.533 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:30.533 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:30.534 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:30.534 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:30.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.535 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:30.535 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:30.535 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:30.536 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:30.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.536 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:30.536 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:30.537 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.537 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:30.537 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:30.538 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.538 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.538 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.539 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:30.539 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:30.539 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:30.539 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:30.540 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:30.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.540 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:30.541 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:30.541 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:30.541 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:30.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.542 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:30.542 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:30.542 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.543 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:30.543 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:30.543 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:30.544 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.544 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.544 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:30.545 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:30.545 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:30.545 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:30.545 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:30.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.546 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.546 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:30.547 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:30.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.547 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:30.548 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:30.548 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:30.548 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.548 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:30.549 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:30.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:30.549 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:30.549 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:30.549 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:30.550 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:30.550 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:30.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:30.550 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:30.551 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdc90065150 msgr2=0x7fdc90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdc90065150 0x7fdc90067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcac004d30 tx=0x7fdcac0079b0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 msgr2=0x7fdcb0123f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb85fc700 1 --2- 172.21.15.150:0/1755903067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c3340 0x7fdcb0123f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdca8004000 tx=0x7fdca8004950 comp rx=0 tx=0).stop 2022-08-10T17:40:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 reap_dead start 2022-08-10T17:40:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.530+0000 7fdcb6b99700 1 -- 172.21.15.150:0/1755903067 reap_dead start 2022-08-10T17:40:30.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.531+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 shutdown_connections 2022-08-10T17:40:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.531+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 >> 172.21.15.150:0/1755903067 conn(0x7fdcb006b500 msgr2=0x7fdcb0063d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.537+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 shutdown_connections 2022-08-10T17:40:30.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.539+0000 7fdcb85fc700 1 -- 172.21.15.150:0/1755903067 wait complete. 2022-08-10T17:40:30.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:40:30.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.966+0000 7f1bf8223700 1 Processor -- start 2022-08-10T17:40:30.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.966+0000 7f1bf8223700 1 -- start start 2022-08-10T17:40:30.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.967+0000 7f1bf8223700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bf00c91d0 0x7f1bf00c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.967+0000 7f1bf8223700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf006a390 0x7f1bf00c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.967+0000 7f1bf8223700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00707d0 con 0x7f1bf00c4100 2022-08-10T17:40:30.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.967+0000 7f1bf8223700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf014d250 con 0x7f1bf00c91d0 2022-08-10T17:40:30.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.967+0000 7f1bf8223700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0153980 con 0x7f1bf006a390 2022-08-10T17:40:30.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.970+0000 7f1bf5fbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bf00c91d0 0x7f1bf00c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.970+0000 7f1bf5fbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bf00c91d0 0x7f1bf00c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33640/0 (socket says 172.21.15.150:33640) 2022-08-10T17:40:30.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.970+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/20102395 learned_addr learned my addr 172.21.15.150:0/20102395 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:30.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.971+0000 7f1bf67c0700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf006a390 0x7f1bf00c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:30.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.972+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/20102395 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf006a390 msgr2=0x7f1bf00c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:30.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.972+0000 7f1bf5fbf700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf006a390 0x7f1bf00c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.973+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/20102395 >> v1:172.21.15.197:6789/0 conn(0x7f1bf00c4100 legacy=0x7f1bf0069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.973+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/20102395 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0152b40 con 0x7f1bf00c91d0 2022-08-10T17:40:30.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.978+0000 7f1bf5fbf700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf00c91d0 0x7f1bf00c3340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1bec006fd0 tx=0x7f1bec00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5175331f850b3fc2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:30.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.985+0000 7f1bf4fbd700 1 -- 172.21.15.150:0/20102395 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec010070 con 0x7f1bf00c91d0 2022-08-10T17:40:30.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.985+0000 7f1bf4fbd700 1 -- 172.21.15.150:0/20102395 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec004030 con 0x7f1bf00c91d0 2022-08-10T17:40:30.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.985+0000 7f1bf4fbd700 1 -- 172.21.15.150:0/20102395 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0043c0 con 0x7f1bf00c91d0 2022-08-10T17:40:30.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.986+0000 7f1bf8223700 1 -- 172.21.15.150:0/20102395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf00c91d0 msgr2=0x7f1bf00c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:30.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.986+0000 7f1bf8223700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf00c91d0 0x7f1bf00c3340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1bec006fd0 tx=0x7f1bec00d330 comp rx=0 tx=0).stop 2022-08-10T17:40:30.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.987+0000 7f1bf8223700 1 -- 172.21.15.150:0/20102395 shutdown_connections 2022-08-10T17:40:30.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.987+0000 7f1bf8223700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf006a390 0x7f1bf00c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.987+0000 7f1bf8223700 1 --2- 172.21.15.150:0/20102395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf00c91d0 0x7f1bf00c3340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:30.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.987+0000 7f1bf8223700 1 -- 172.21.15.150:0/20102395 >> 172.21.15.150:0/20102395 conn(0x7f1bf006b500 msgr2=0x7f1bf006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:30.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.989+0000 7f1bf8223700 1 -- 172.21.15.150:0/20102395 shutdown_connections 2022-08-10T17:40:30.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.990+0000 7f1bf8223700 1 -- 172.21.15.150:0/20102395 wait complete. 2022-08-10T17:40:30.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.991+0000 7f1bf8223700 1 Processor -- start 2022-08-10T17:40:30.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.993+0000 7f1bf8223700 1 -- start start 2022-08-10T17:40:30.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1bf00c4100 0x7f1bf014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf00c91d0 0x7f1bf00c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:30.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf01d9510 con 0x7f1bf006a390 2022-08-10T17:40:30.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf01dbd10 con 0x7f1bf00c4100 2022-08-10T17:40:30.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.994+0000 7f1bf8223700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf01db7c0 con 0x7f1bf00c91d0 2022-08-10T17:40:31.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33650/0 (socket says 172.21.15.150:33650) 2022-08-10T17:40:31.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/1922559452 learned_addr learned my addr 172.21.15.150:0/1922559452 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:31.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf00c91d0 msgr2=0x7f1bf00c7c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:40:31.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bf00c91d0 0x7f1bf00c7c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1bf00c4100 msgr2=0x7f1bf014eff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:40:31.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1bf00c4100 0x7f1bf014eff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.995+0000 7f1bf5fbf700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec008460 con 0x7f1bf006a390 2022-08-10T17:40:31.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:30.996+0000 7f1bf5fbf700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00def0 tx=0x7f1bec0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.009+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec023070 con 0x7f1bf006a390 2022-08-10T17:40:31.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.009+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec009c40 con 0x7f1bf006a390 2022-08-10T17:40:31.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.009+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec003520 con 0x7f1bf006a390 2022-08-10T17:40:31.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.012+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf014f530 con 0x7f1bf006a390 2022-08-10T17:40:31.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.012+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf01d8be0 con 0x7f1bf006a390 2022-08-10T17:40:31.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.015+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1bec014070 con 0x7f1bf006a390 2022-08-10T17:40:31.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.015+0000 7f1bde7fc700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1bd0065130 0x7f1bd00675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.015+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1bec0828b0 con 0x7f1bf006a390 2022-08-10T17:40:31.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.015+0000 7f1bf57be700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1bd0065130 0x7f1bd00675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.019+0000 7f1bf57be700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1bd0065130 0x7f1bd00675e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1be80012e0 tx=0x7f1be8007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.027+0000 7f1bf8223700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 0x7f1bd4004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.027+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4007d90 con 0x7f1bd4002a40 2022-08-10T17:40:31.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.027+0000 7f1bf67c0700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 0x7f1bd4004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.030+0000 7f1bf67c0700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bd4007f50 con 0x7f1bd4002a40 2022-08-10T17:40:31.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.030+0000 7f1bf67c0700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 0x7f1bd4004ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1bf006a7f0 tx=0x7f1be000d720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000de20 con 0x7f1bd4002a40 2022-08-10T17:40:31.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f1be00125f0 con 0x7f1bd4002a40 2022-08-10T17:40:31.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 msgr2=0x7f1bd4004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 0x7f1bd4004ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1bf006a7f0 tx=0x7f1be000d720 comp rx=0 tx=0).stop 2022-08-10T17:40:31.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 msgr2=0x7f1bd4004ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:31.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.039+0000 7f1bde7fc700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4002a40 0x7f1bd4004ef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.053+0000 7f1bf8223700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 0x7f1bd40071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.053+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40078c0 con 0x7f1bd4006d80 2022-08-10T17:40:31.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.053+0000 7f1bf67c0700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 0x7f1bd40071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.055+0000 7f1bf67c0700 1 -- 172.21.15.150:0/1922559452 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1bd4007a80 con 0x7f1bd4006d80 2022-08-10T17:40:31.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.055+0000 7f1bf67c0700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 0x7f1bd40071c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1be0006d90 tx=0x7f1be0004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0003bf0 con 0x7f1bd4006d80 2022-08-10T17:40:31.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f1be0003d50 con 0x7f1bd4006d80 2022-08-10T17:40:31.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 msgr2=0x7f1bd40071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 0x7f1bd40071c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1be0006d90 tx=0x7f1be0004640 comp rx=0 tx=0).stop 2022-08-10T17:40:31.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 msgr2=0x7f1bd40071c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:31.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.056+0000 7f1bde7fc700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1bd4006d80 0x7f1bd40071c0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1be0006d90 tx=0x7f1be0004640 comp rx=0 tx=0).stop 2022-08-10T17:40:31.062 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:31.062 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:31.062 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:31.063 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:40:31.063 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 24, 2022-08-10T17:40:31.063 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:31.063 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:40:31.063 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:31.064 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:31.064 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.064 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 20, 2022-08-10T17:40:31.064 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:31.065 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:31.065 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:31.065 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:31.065 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:31.065 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:31.066 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:31.066 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:31.066 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:31.066 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:31.067 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:31.067 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:31.067 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.067 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:31.067 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:31.068 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:31.068 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:31.068 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:31.068 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:31.069 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:31.069 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:31.069 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:31.069 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:31.069 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:31.070 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.070 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.070 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:31.070 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:31.071 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:31.071 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:31.071 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:31.071 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:31.072 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:31.072 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:31.072 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:31.072 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:31.072 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:31.073 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:31.073 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:31.073 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:31.073 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:31.073 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:31.074 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:31.074 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:31.074 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:31.074 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:31.075 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:31.076 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.076 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:31.076 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.076 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:31.077 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.077 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:31.077 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:31.077 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:31.077 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:31.078 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.078 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:31.078 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:31.078 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.079 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.079 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:31.079 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:31.080 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.080 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.080 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.080 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.080 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:31.081 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:31.081 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:31.081 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:31.081 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:31.082 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.082 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.082 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:31.082 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:31.082 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:31.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:31.083 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.083 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:31.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.086 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:31.086 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:31.086 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:31.087 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:31.087 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:31.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.088 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:31.088 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:31.088 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:31.088 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:31.089 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.089 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:31.089 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:31.089 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.090 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.090 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:31.090 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:31.090 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:31.091 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.091 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.091 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.091 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:31.092 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:31.092 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:31.092 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:31.092 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:31.092 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.093 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.093 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:31.093 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:31.093 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.094 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:31.094 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.094 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:31.094 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.095 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.095 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:40:31.095 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.095 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:31.096 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.096 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:31.096 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.096 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.096 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:31.097 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.097 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:31.097 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.097 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:31.098 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.098 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.098 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:31.098 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.098 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:40:31.099 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.099 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:31.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.099 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.100 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:31.100 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.100 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:31.100 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.100 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:31.101 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:40:31.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:31.101 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:31.101 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:31.101 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:31.102 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:31.102 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:31.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:31.102 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:31.103 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:31.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1bd0065130 msgr2=0x7f1bd00675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1bd0065130 0x7f1bd00675e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1be80012e0 tx=0x7f1be8007c40 comp rx=0 tx=0).stop 2022-08-10T17:40:31.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 msgr2=0x7f1bf01db280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00def0 tx=0x7f1bec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf67c0700 1 -- 172.21.15.150:0/1922559452 reap_dead start 2022-08-10T17:40:31.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 shutdown_connections 2022-08-10T17:40:31.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 --2- 172.21.15.150:0/1922559452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bf006a390 0x7f1bf01db280 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00def0 tx=0x7f1bec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 >> 172.21.15.150:0/1922559452 conn(0x7f1bf006b500 msgr2=0x7f1bf00c2820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:31.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 shutdown_connections 2022-08-10T17:40:31.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.058+0000 7f1bf8223700 1 -- 172.21.15.150:0/1922559452 wait complete. 2022-08-10T17:40:31.107 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:40:31.108 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:40:31.108 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:40:31.108 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:40:31.109 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:40:31.109 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:40:31.129 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:40:31.130 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:40:31.130 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:31.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.635+0000 7fe810b52700 1 Processor -- start 2022-08-10T17:40:31.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.636+0000 7fe810b52700 1 -- start start 2022-08-10T17:40:31.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.637+0000 7fe810b52700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 0x7fe80c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.637+0000 7fe810b52700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe80c0c32f0 0x7fe80c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.637+0000 7fe810b52700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c157190 con 0x7fe80c0c4f10 2022-08-10T17:40:31.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.637+0000 7fe810b52700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c06ba20 con 0x7fe80c150bd0 2022-08-10T17:40:31.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.637+0000 7fe810b52700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c1568c0 con 0x7fe80c0c32f0 2022-08-10T17:40:31.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.638+0000 7fe80a59c700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 msgr2=0x7fe80c159e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:31.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.638+0000 7fe80a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 0x7fe80c159e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:31.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.643+0000 7fe80ad9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe80c0c32f0 0x7fe80c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.644+0000 7fe80ad9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe80c0c32f0 0x7fe80c0c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44302/0 (socket says 172.21.15.150:44302) 2022-08-10T17:40:31.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.644+0000 7fe80ad9d700 1 -- 172.21.15.150:0/4237610090 learned_addr learned my addr 172.21.15.150:0/4237610090 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:31.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.645+0000 7fe80ad9d700 1 -- 172.21.15.150:0/4237610090 >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 msgr2=0x7fe80c159e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:31.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.645+0000 7fe80ad9d700 1 --2- 172.21.15.150:0/4237610090 >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 0x7fe80c159e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.645+0000 7fe80ad9d700 1 -- 172.21.15.150:0/4237610090 >> v1:172.21.15.197:6789/0 conn(0x7fe80c0c4f10 legacy=0x7fe80c06b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:31.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.645+0000 7fe80ad9d700 1 -- 172.21.15.150:0/4237610090 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c06bc30 con 0x7fe80c0c32f0 2022-08-10T17:40:31.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.650+0000 7fe80ad9d700 1 --2- 172.21.15.150:0/4237610090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c0c32f0 0x7fe80c0c3770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe80c066fb0 tx=0x7fe7fc009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d697ef03c73d8fc4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.652+0000 7fe80959a700 1 -- 172.21.15.150:0/4237610090 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011830 con 0x7fe80c0c32f0 2022-08-10T17:40:31.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.652+0000 7fe80959a700 1 -- 172.21.15.150:0/4237610090 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc011990 con 0x7fe80c0c32f0 2022-08-10T17:40:31.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.652+0000 7fe80959a700 1 -- 172.21.15.150:0/4237610090 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc011d40 con 0x7fe80c0c32f0 2022-08-10T17:40:31.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.655+0000 7fe810b52700 1 -- 172.21.15.150:0/4237610090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c0c32f0 msgr2=0x7fe80c0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.655+0000 7fe810b52700 1 --2- 172.21.15.150:0/4237610090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c0c32f0 0x7fe80c0c3770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe80c066fb0 tx=0x7fe7fc009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:31.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 -- 172.21.15.150:0/4237610090 shutdown_connections 2022-08-10T17:40:31.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 --2- 172.21.15.150:0/4237610090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c0c32f0 0x7fe80c0c3770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 --2- 172.21.15.150:0/4237610090 >> v2:172.21.15.150:3300/0 conn(0x7fe80c150bd0 0x7fe80c159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 -- 172.21.15.150:0/4237610090 >> 172.21.15.150:0/4237610090 conn(0x7fe80c0c8a10 msgr2=0x7fe80c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:31.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 -- 172.21.15.150:0/4237610090 shutdown_connections 2022-08-10T17:40:31.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.657+0000 7fe810b52700 1 -- 172.21.15.150:0/4237610090 wait complete. 2022-08-10T17:40:31.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.660+0000 7fe810b52700 1 Processor -- start 2022-08-10T17:40:31.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.660+0000 7fe810b52700 1 -- start start 2022-08-10T17:40:31.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe80c0c32f0 0x7fe80c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 0x7fe80c0bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1517a0 con 0x7fe80c0c4f10 2022-08-10T17:40:31.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1f1080 con 0x7fe80c150bd0 2022-08-10T17:40:31.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.661+0000 7fe810b52700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1f0b10 con 0x7fe80c0c32f0 2022-08-10T17:40:31.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.662+0000 7fe80ad9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.662+0000 7fe80ad9d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44310/0 (socket says 172.21.15.150:44310) 2022-08-10T17:40:31.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.662+0000 7fe80ad9d700 1 -- 172.21.15.150:0/744170030 learned_addr learned my addr 172.21.15.150:0/744170030 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:31.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.663+0000 7fe809d9b700 1 -- 172.21.15.150:0/744170030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 msgr2=0x7fe80c0bdf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:31.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.663+0000 7fe809d9b700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 0x7fe80c0bdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:31.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.664+0000 7fe80ad9d700 1 -- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe80c0c32f0 msgr2=0x7fe80c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:31.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.664+0000 7fe80ad9d700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe80c0c32f0 0x7fe80c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.664+0000 7fe80ad9d700 1 -- 172.21.15.150:0/744170030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 msgr2=0x7fe80c0bdf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:31.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.664+0000 7fe80ad9d700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 0x7fe80c0bdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.664+0000 7fe80ad9d700 1 -- 172.21.15.150:0/744170030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0093e0 con 0x7fe80c150bd0 2022-08-10T17:40:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.668+0000 7fe80ad9d700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006fd0 tx=0x7fe7fc0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.669+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01b5f0 con 0x7fe80c150bd0 2022-08-10T17:40:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.669+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc01b770 con 0x7fe80c150bd0 2022-08-10T17:40:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.669+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01bb20 con 0x7fe80c150bd0 2022-08-10T17:40:31.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.671+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0c30d0 con 0x7fe80c150bd0 2022-08-10T17:40:31.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.671+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c1f0da0 con 0x7fe80c150bd0 2022-08-10T17:40:31.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.672+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c06bf10 con 0x7fe80c150bd0 2022-08-10T17:40:31.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.678+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe7fc00f050 con 0x7fe80c150bd0 2022-08-10T17:40:31.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.679+0000 7fe7faffd700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 0x7fe7f00676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:31.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.679+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe7fc083ac0 con 0x7fe80c150bd0 2022-08-10T17:40:31.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.680+0000 7fe80a59c700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 0x7fe7f00676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:31.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.682+0000 7fe80a59c700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 0x7fe7f00676b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe804003c10 tx=0x7fe804009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:31.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:31.683+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe7fc051a30 con 0x7fe80c150bd0 2022-08-10T17:40:32.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.258+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe7ec005000 con 0x7fe80c150bd0 2022-08-10T17:40:32.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.260+0000 7fe7faffd700 1 -- 172.21.15.150:0/744170030 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fe7fc055050 con 0x7fe80c150bd0 2022-08-10T17:40:32.268 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:32.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.287+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 msgr2=0x7fe7f00676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:32.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.287+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 0x7fe7f00676b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe804003c10 tx=0x7fe804009230 comp rx=0 tx=0).stop 2022-08-10T17:40:32.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.287+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 msgr2=0x7fe80c0c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:32.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.287+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006fd0 tx=0x7fe7fc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:40:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 shutdown_connections 2022-08-10T17:40:32.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe80c150bd0 0x7fe80c0c54a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7f0065200 0x7fe7f00676b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe80c0c32f0 0x7fe80c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:32.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 --2- 172.21.15.150:0/744170030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe80c0c4f10 0x7fe80c0bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:32.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 >> 172.21.15.150:0/744170030 conn(0x7fe80c0c8a10 msgr2=0x7fe80c06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:32.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 shutdown_connections 2022-08-10T17:40:32.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:32.288+0000 7fe810b52700 1 -- 172.21.15.150:0/744170030 wait complete. 2022-08-10T17:40:35.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:35.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.694+0000 7f3c0e106700 1 Processor -- start 2022-08-10T17:40:35.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.694+0000 7f3c0e106700 1 -- start start 2022-08-10T17:40:35.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c0e106700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3c0806ebd0 0x7f3c0806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c077fe700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f3c08068110 legacy=0x7f3c080684e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:40:35.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c0e106700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 0x7f3c0806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c0e106700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0806b620 con 0x7f3c08068110 2022-08-10T17:40:35.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c0e106700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0813c4e0 con 0x7f3c08068fc0 2022-08-10T17:40:35.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c0e106700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c08152b90 con 0x7f3c0806ebd0 2022-08-10T17:40:35.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c06ffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3c0806ebd0 0x7f3c0806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:35.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c06ffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3c0806ebd0 0x7f3c0806bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44454/0 (socket says 172.21.15.150:44454) 2022-08-10T17:40:35.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c06ffd700 1 -- 172.21.15.150:0/2154401577 learned_addr learned my addr 172.21.15.150:0/2154401577 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:35.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c07fff700 1 -- 172.21.15.150:0/2154401577 >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 msgr2=0x7f3c0806bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:35.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.696+0000 7f3c07fff700 1 --2- 172.21.15.150:0/2154401577 >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 0x7f3c0806bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:35.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.697+0000 7f3c06ffd700 1 -- 172.21.15.150:0/2154401577 >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 msgr2=0x7f3c0806bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:35.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.697+0000 7f3c06ffd700 1 --2- 172.21.15.150:0/2154401577 >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 0x7f3c0806bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:35.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.697+0000 7f3c06ffd700 1 -- 172.21.15.150:0/2154401577 >> v1:172.21.15.150:6789/0 conn(0x7f3c08068110 legacy=0x7f3c080684e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:35.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.697+0000 7f3c06ffd700 1 -- 172.21.15.150:0/2154401577 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08152e50 con 0x7f3c0806ebd0 2022-08-10T17:40:35.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.697+0000 7f3c06ffd700 1 --2- 172.21.15.150:0/2154401577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c0806bab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c080ca420 tx=0x7f3bfc009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da24fb107b2d7485 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:35.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.698+0000 7f3c067fc700 1 -- 172.21.15.150:0/2154401577 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011830 con 0x7f3c0806ebd0 2022-08-10T17:40:35.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.698+0000 7f3c067fc700 1 -- 172.21.15.150:0/2154401577 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc011990 con 0x7f3c0806ebd0 2022-08-10T17:40:35.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.698+0000 7f3c067fc700 1 -- 172.21.15.150:0/2154401577 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011d40 con 0x7f3c0806ebd0 2022-08-10T17:40:35.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.699+0000 7f3c0e106700 1 -- 172.21.15.150:0/2154401577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 msgr2=0x7f3c0806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:35.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.699+0000 7f3c0e106700 1 --2- 172.21.15.150:0/2154401577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c0806bab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c080ca420 tx=0x7f3bfc009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:35.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.700+0000 7f3c0e106700 1 -- 172.21.15.150:0/2154401577 shutdown_connections 2022-08-10T17:40:35.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.700+0000 7f3c0e106700 1 --2- 172.21.15.150:0/2154401577 >> v2:172.21.15.150:3300/0 conn(0x7f3c08068fc0 0x7f3c0806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:35.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.700+0000 7f3c0e106700 1 --2- 172.21.15.150:0/2154401577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c0806bab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:35.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.700+0000 7f3c0e106700 1 -- 172.21.15.150:0/2154401577 >> 172.21.15.150:0/2154401577 conn(0x7f3c080c9320 msgr2=0x7f3c080c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:35.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.702+0000 7f3c0e106700 1 -- 172.21.15.150:0/2154401577 shutdown_connections 2022-08-10T17:40:35.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.702+0000 7f3c0e106700 1 -- 172.21.15.150:0/2154401577 wait complete. 2022-08-10T17:40:35.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.704+0000 7f3c0e106700 1 Processor -- start 2022-08-10T17:40:35.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.704+0000 7f3c0e106700 1 -- start start 2022-08-10T17:40:35.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3c08068110 0x7f3c0812cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c08068fc0 0x7f3c0812b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08123390 con 0x7f3c08068fc0 2022-08-10T17:40:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0812d190 con 0x7f3c0806ebd0 2022-08-10T17:40:35.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.705+0000 7f3c0e106700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08123ce0 con 0x7f3c08068110 2022-08-10T17:40:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.706+0000 7f3c07fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.706+0000 7f3c07fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44460/0 (socket says 172.21.15.150:44460) 2022-08-10T17:40:35.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.706+0000 7f3c07fff700 1 -- 172.21.15.150:0/3086654336 learned_addr learned my addr 172.21.15.150:0/3086654336 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 -- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3c08068110 msgr2=0x7f3c0812cc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3c08068110 0x7f3c0812cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 -- 172.21.15.150:0/3086654336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c08068fc0 msgr2=0x7f3c0812b1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:35.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c08068fc0 0x7f3c0812b1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:35.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 -- 172.21.15.150:0/3086654336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0093e0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3c07fff700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800b3e0 tx=0x7f3bf800b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:35.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.708+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8003cd0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.709+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf8003e50 con 0x7f3c0806ebd0 2022-08-10T17:40:35.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.709+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0812c390 con 0x7f3c0806ebd0 2022-08-10T17:40:35.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.709+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8006310 con 0x7f3c0806ebd0 2022-08-10T17:40:35.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.709+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0812bdd0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.710+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c081505e0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.711+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3bf8019030 con 0x7f3c0806ebd0 2022-08-10T17:40:35.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.711+0000 7f3beffff700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 0x7f3be8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:35.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.712+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3bf80813a0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.720+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f3bf8052cc0 con 0x7f3c0806ebd0 2022-08-10T17:40:35.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.720+0000 7f3c077fe700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 0x7f3be8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:35.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:35.724+0000 7f3c077fe700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 0x7f3be8067590 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c00003c10 tx=0x7f3c00009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:36.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.308+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3c080c3e10 con 0x7f3c0806ebd0 2022-08-10T17:40:36.314 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:36.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.310+0000 7f3beffff700 1 -- 172.21.15.150:0/3086654336 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f3bf8017030 con 0x7f3c0806ebd0 2022-08-10T17:40:36.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.319+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 msgr2=0x7f3be8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:36.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.325+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 0x7f3be8067590 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c00003c10 tx=0x7f3c00009230 comp rx=0 tx=0).stop 2022-08-10T17:40:36.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.325+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 msgr2=0x7f3c08129200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:36.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.325+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800b3e0 tx=0x7f3bf800b7a0 comp rx=0 tx=0).stop 2022-08-10T17:40:36.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.328+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 shutdown_connections 2022-08-10T17:40:36.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.329+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3c0806ebd0 0x7f3c08129200 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:36.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.329+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3be80650e0 0x7f3be8067590 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:36.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.329+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3c08068110 0x7f3c0812cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:36.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.329+0000 7f3c0e106700 1 --2- 172.21.15.150:0/3086654336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c08068fc0 0x7f3c0812b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:36.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.329+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 >> 172.21.15.150:0/3086654336 conn(0x7f3c080c9320 msgr2=0x7f3c080c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:36.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.333+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 shutdown_connections 2022-08-10T17:40:36.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:36.333+0000 7f3c0e106700 1 -- 172.21.15.150:0/3086654336 wait complete. 2022-08-10T17:40:38.077 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:40:38.085 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:40:39.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:39.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.651+0000 7f8321434700 1 Processor -- start 2022-08-10T17:40:39.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.651+0000 7f8321434700 1 -- start start 2022-08-10T17:40:39.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 0x7f831c0684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 0x7f831c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c06b620 con 0x7f831c068110 2022-08-10T17:40:39.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c13c4e0 con 0x7f831c06ebd0 2022-08-10T17:40:39.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.652+0000 7f8321434700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c152b90 con 0x7f831c068fc0 2022-08-10T17:40:39.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.653+0000 7f831affd700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 msgr2=0x7f831c0684e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:39.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.653+0000 7f831affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 0x7f831c0684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:39.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.653+0000 7f831a7fc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 0x7f831c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:39.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.653+0000 7f831a7fc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 0x7f831c068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44560/0 (socket says 172.21.15.150:44560) 2022-08-10T17:40:39.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.653+0000 7f831a7fc700 1 -- 172.21.15.150:0/1185873032 learned_addr learned my addr 172.21.15.150:0/1185873032 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:39.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 --2- 172.21.15.150:0/1185873032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:39.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 -- 172.21.15.150:0/1185873032 >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 msgr2=0x7f831c068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:39.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 --2- 172.21.15.150:0/1185873032 >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 0x7f831c068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 -- 172.21.15.150:0/1185873032 >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 msgr2=0x7f831c0684e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:39.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 --2- 172.21.15.150:0/1185873032 >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 0x7f831c0684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 -- 172.21.15.150:0/1185873032 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c152e50 con 0x7f831c068fc0 2022-08-10T17:40:39.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.654+0000 7f831b7fe700 1 --2- 172.21.15.150:0/1185873032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c06bab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ca420 tx=0x7f831400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222487278fb8ee3d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:39.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.655+0000 7f8319ffb700 1 -- 172.21.15.150:0/1185873032 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400b230 con 0x7f831c068fc0 2022-08-10T17:40:39.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.655+0000 7f8319ffb700 1 -- 172.21.15.150:0/1185873032 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400b390 con 0x7f831c068fc0 2022-08-10T17:40:39.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.655+0000 7f8319ffb700 1 -- 172.21.15.150:0/1185873032 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400dc20 con 0x7f831c068fc0 2022-08-10T17:40:39.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.658+0000 7f8321434700 1 -- 172.21.15.150:0/1185873032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 msgr2=0x7f831c06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:39.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.658+0000 7f8321434700 1 --2- 172.21.15.150:0/1185873032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c06bab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ca420 tx=0x7f831400d330 comp rx=0 tx=0).stop 2022-08-10T17:40:39.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 -- 172.21.15.150:0/1185873032 shutdown_connections 2022-08-10T17:40:39.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 --2- 172.21.15.150:0/1185873032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c06bab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 --2- 172.21.15.150:0/1185873032 >> v2:172.21.15.150:3300/0 conn(0x7f831c068110 0x7f831c0684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 --2- 172.21.15.150:0/1185873032 >> v2:172.21.15.197:3300/0 conn(0x7f831c06ebd0 0x7f831c068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 -- 172.21.15.150:0/1185873032 >> 172.21.15.150:0/1185873032 conn(0x7f831c0c9320 msgr2=0x7f831c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:39.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 -- 172.21.15.150:0/1185873032 shutdown_connections 2022-08-10T17:40:39.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.661+0000 7f8321434700 1 -- 172.21.15.150:0/1185873032 wait complete. 2022-08-10T17:40:39.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.663+0000 7f8321434700 1 Processor -- start 2022-08-10T17:40:39.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.663+0000 7f8321434700 1 -- start start 2022-08-10T17:40:39.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 0x7f831c1390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f831c06ebd0 0x7f831c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1fd420 con 0x7f831c068110 2022-08-10T17:40:39.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1fcf90 con 0x7f831c06ebd0 2022-08-10T17:40:39.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f8321434700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c14dd20 con 0x7f831c068fc0 2022-08-10T17:40:39.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f831affd700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 msgr2=0x7f831c1390e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:39.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.664+0000 7f831affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 0x7f831c1390e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:39.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.665+0000 7f831a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:39.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.665+0000 7f831a7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:48196/0 (socket says 172.21.15.150:48196) 2022-08-10T17:40:39.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.665+0000 7f831a7fc700 1 -- 172.21.15.150:0/1344997040 learned_addr learned my addr 172.21.15.150:0/1344997040 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:39.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.667+0000 7f831a7fc700 1 -- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f831c06ebd0 msgr2=0x7f831c14bcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:39.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.667+0000 7f831a7fc700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f831c06ebd0 0x7f831c14bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.667+0000 7f831a7fc700 1 -- 172.21.15.150:0/1344997040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 msgr2=0x7f831c1390e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:39.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.667+0000 7f831a7fc700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 0x7f831c1390e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:39.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.667+0000 7f831a7fc700 1 -- 172.21.15.150:0/1344997040 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831400bc80 con 0x7f831c068fc0 2022-08-10T17:40:39.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.668+0000 7f831a7fc700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f831000d800 tx=0x7f831000dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:39.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.669+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012630 con 0x7f831c068fc0 2022-08-10T17:40:39.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.669+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310012790 con 0x7f831c068fc0 2022-08-10T17:40:39.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.669+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012b20 con 0x7f831c068fc0 2022-08-10T17:40:39.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.669+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c14da40 con 0x7f831c068fc0 2022-08-10T17:40:39.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.669+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1fc940 con 0x7f831c068fc0 2022-08-10T17:40:39.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.672+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8310012c80 con 0x7f831c068fc0 2022-08-10T17:40:39.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.672+0000 7f83037fe700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 0x7f83080676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:39.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.672+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f83100826f0 con 0x7f831c068fc0 2022-08-10T17:40:39.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.672+0000 7f831affd700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 0x7f83080676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:39.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.674+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8005170 con 0x7f831c068fc0 2022-08-10T17:40:39.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.678+0000 7f831affd700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 0x7f83080676d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f830c003890 tx=0x7f830c006c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:39.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:39.683+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8310050660 con 0x7f831c068fc0 2022-08-10T17:40:40.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.431+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f82f80059a0 con 0x7f831c068fc0 2022-08-10T17:40:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.433+0000 7f83037fe700 1 -- 172.21.15.150:0/1344997040 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f8310053c80 con 0x7f831c068fc0 2022-08-10T17:40:40.442 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:40.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 msgr2=0x7f83080676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:40.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 0x7f83080676d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f830c003890 tx=0x7f830c006c40 comp rx=0 tx=0).stop 2022-08-10T17:40:40.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 msgr2=0x7f831c14f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f831000d800 tx=0x7f831000dbc0 comp rx=0 tx=0).stop 2022-08-10T17:40:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 shutdown_connections 2022-08-10T17:40:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f831c06ebd0 0x7f831c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:40.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c068110 0x7f831c1390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:40.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8308065220 0x7f83080676d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:40.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 --2- 172.21.15.150:0/1344997040 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f831c068fc0 0x7f831c14f230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:40.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.440+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 >> 172.21.15.150:0/1344997040 conn(0x7f831c0c9320 msgr2=0x7f831c135cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:40.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.441+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 shutdown_connections 2022-08-10T17:40:40.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:40.441+0000 7f8321434700 1 -- 172.21.15.150:0/1344997040 wait complete. 2022-08-10T17:40:43.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:40:43.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.724+0000 7f66c893f700 1 Processor -- start 2022-08-10T17:40:43.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.724+0000 7f66c893f700 1 -- start start 2022-08-10T17:40:43.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c893f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:43.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c893f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:43.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c893f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0e6180 con 0x7f66bc0e3020 2022-08-10T17:40:43.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c893f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc048810 con 0x7f66bc006790 2022-08-10T17:40:43.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c893f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc04caa0 con 0x7f66bc007bc0 2022-08-10T17:40:43.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c2ffd700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 msgr2=0x7f66bc047a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:43.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.726+0000 7f66c2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:43.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c37fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f66bc0e3020 0x7f66bc00a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:33094/0 (socket says 172.21.15.150:33094) 2022-08-10T17:40:43.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c9ba1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:43.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c37fe700 1 -- 172.21.15.150:0/986376023 learned_addr learned my addr 172.21.15.150:0/986376023 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:43.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:40:43.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:40:43.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:40:43.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.727+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:43.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.927+0000 7f66c2ffd700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 msgr2=0x7f66bc047a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:43.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.927+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:40:43.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.928+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:43.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.928+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:40:43.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.928+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:40:43.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.928+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:40:43.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:43.928+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:40:44.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.328+0000 7f66c2ffd700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 msgr2=0x7f66bc047a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:44.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.328+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:40:44.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.331+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:44.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.331+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:40:44.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.331+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:40:44.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.331+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:40:44.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:44.331+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:40:45.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.129+0000 7f66c2ffd700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 msgr2=0x7f66bc047a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:45.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.129+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:40:45.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.132+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:45.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.133+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:40:45.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.133+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:40:45.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.133+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:40:45.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.133+0000 7f66c9ba1700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:40:45.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.919+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848284304 0 0) 0x7f66bc0e6180 con 0x7f66bc0e3020 2022-08-10T17:40:45.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.919+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a8003430 con 0x7f66bc0e3020 2022-08-10T17:40:45.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134767314 0 0) 0x7f66a8003430 con 0x7f66bc0e3020 2022-08-10T17:40:45.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 msgr2=0x7f66bc008040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:45.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.197:3300/0 conn(0x7f66bc007bc0 0x7f66bc008040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 msgr2=0x7f66bc047a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:45.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 --2- 172.21.15.150:0/986376023 >> v2:172.21.15.150:3300/0 conn(0x7f66bc006790 0x7f66bc047a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc00a790 con 0x7f66bc0e3020 2022-08-10T17:40:45.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f66c4073670 con 0x7f66bc0e3020 2022-08-10T17:40:45.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 >> v1:172.21.15.197:6789/0 conn(0x7f66bc0e3020 legacy=0x7f66bc00a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:45.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 0x7f66a8003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a80046d0 0x7f66a8004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66a8005080 0x7f66a800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc048810 con 0x7f66a80046d0 2022-08-10T17:40:45.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc04caa0 con 0x7f66a8003880 2022-08-10T17:40:45.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a800bf90 con 0x7f66a8005080 2022-08-10T17:40:45.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c2ffd700 1 -- 172.21.15.150:0/986376023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a80046d0 msgr2=0x7f66a8004b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:45.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.923+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a80046d0 0x7f66a8004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:45.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 0x7f66a8003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:45.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 -- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66a8005080 msgr2=0x7f66a800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:45.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66a8005080 0x7f66a800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 -- 172.21.15.150:0/986376023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a80046d0 msgr2=0x7f66a8004b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:45.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a80046d0 0x7f66a8004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 -- 172.21.15.150:0/986376023 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc00a790 con 0x7f66a8003880 2022-08-10T17:40:45.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.924+0000 7f66c37fe700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 0x7f66a8003c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66c404de20 tx=0x7f66a8005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b0ea3234fd4f2b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:45.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.925+0000 7f66c9ba1700 1 -- 172.21.15.150:0/986376023 reap_dead start 2022-08-10T17:40:45.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.926+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c40670f0 con 0x7f66a8003880 2022-08-10T17:40:45.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.926+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4067250 con 0x7f66a8003880 2022-08-10T17:40:45.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.926+0000 7f66c27fc700 1 -- 172.21.15.150:0/986376023 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4070530 con 0x7f66a8003880 2022-08-10T17:40:45.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.927+0000 7f66c893f700 1 -- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 msgr2=0x7f66a8003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:45.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.927+0000 7f66c893f700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 0x7f66a8003c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66c404de20 tx=0x7f66a8005700 comp rx=0 tx=0).stop 2022-08-10T17:40:45.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.927+0000 7f66c893f700 1 -- 172.21.15.150:0/986376023 shutdown_connections 2022-08-10T17:40:45.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.927+0000 7f66c893f700 1 --2- 172.21.15.150:0/986376023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66a8003880 0x7f66a8003c90 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66c404de20 tx=0x7f66a8005700 comp rx=0 tx=0).stop 2022-08-10T17:40:45.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.927+0000 7f66c893f700 1 -- 172.21.15.150:0/986376023 >> 172.21.15.150:0/986376023 conn(0x7f66bc00c6d0 msgr2=0x7f66bc00cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:45.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.930+0000 7f66c893f700 1 -- 172.21.15.150:0/986376023 shutdown_connections 2022-08-10T17:40:45.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.930+0000 7f66c893f700 1 -- 172.21.15.150:0/986376023 wait complete. 2022-08-10T17:40:45.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.932+0000 7f66c893f700 1 Processor -- start 2022-08-10T17:40:45.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.933+0000 7f66c893f700 1 -- start start 2022-08-10T17:40:45.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 0x7f66bc044d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66bc0cdb60 0x7f66bc0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0cf8c0 con 0x7f66bc0caf10 2022-08-10T17:40:45.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0cb2e0 con 0x7f66bc0cdb60 2022-08-10T17:40:45.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c893f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0e5170 con 0x7f66bc0cf450 2022-08-10T17:40:45.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c37fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 msgr2=0x7f66bc044d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:45.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.934+0000 7f66c37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 0x7f66bc044d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:45.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.936+0000 7f66c9ba1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66bc0cdb60 0x7f66bc0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:45.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.936+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:45.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.936+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:48388/0 (socket says 172.21.15.150:48388) 2022-08-10T17:40:45.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.936+0000 7f66c2ffd700 1 -- 172.21.15.150:0/2331943893 learned_addr learned my addr 172.21.15.150:0/2331943893 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:45.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 -- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66bc0cdb60 msgr2=0x7f66bc0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:45.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66bc0cdb60 0x7f66bc0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 -- 172.21.15.150:0/2331943893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 msgr2=0x7f66bc044d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:45.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 0x7f66bc044d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:45.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 -- 172.21.15.150:0/2331943893 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc0ce690 con 0x7f66bc0cf450 2022-08-10T17:40:45.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.938+0000 7f66c2ffd700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ba50 tx=0x7f66b800be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:45.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.947+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800cc40 con 0x7f66bc0cf450 2022-08-10T17:40:45.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.947+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800cda0 con 0x7f66bc0cf450 2022-08-10T17:40:45.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.947+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80062f0 con 0x7f66bc0cf450 2022-08-10T17:40:45.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.948+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0ce970 con 0x7f66bc0cf450 2022-08-10T17:40:45.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.948+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc0cef30 con 0x7f66bc0cf450 2022-08-10T17:40:45.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.951+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f66b801d070 con 0x7f66bc0cf450 2022-08-10T17:40:45.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.951+0000 7f66a7fff700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 0x7f66ac0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:45.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.951+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f66b80823b0 con 0x7f66bc0cf450 2022-08-10T17:40:45.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.953+0000 7f66c37fe700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 0x7f66ac0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:45.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.953+0000 7f66c37fe700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 0x7f66ac0675b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66a800bf60 tx=0x7f66c406c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:45.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.953+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc049b50 con 0x7f66bc0cf450 2022-08-10T17:40:45.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:45.965+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f66b801b030 con 0x7f66bc0cf450 2022-08-10T17:40:46.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.508+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f66bc043980 con 0x7f66bc0cf450 2022-08-10T17:40:46.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.511+0000 7f66a7fff700 1 -- 172.21.15.150:0/2331943893 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f66b8050320 con 0x7f66bc0cf450 2022-08-10T17:40:46.517 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":26,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:40:46.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 msgr2=0x7f66ac0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 0x7f66ac0675b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66a800bf60 tx=0x7f66c406c000 comp rx=0 tx=0).stop 2022-08-10T17:40:46.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 msgr2=0x7f66bc044530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ba50 tx=0x7f66b800be10 comp rx=0 tx=0).stop 2022-08-10T17:40:46.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 shutdown_connections 2022-08-10T17:40:46.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f66bc0cdb60 0x7f66bc0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66bc0caf10 0x7f66bc044d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f66ac065100 0x7f66ac0675b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 --2- 172.21.15.150:0/2331943893 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66bc0cf450 0x7f66bc044530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 >> 172.21.15.150:0/2331943893 conn(0x7f66bc00c6d0 msgr2=0x7f66bc00b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:46.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 shutdown_connections 2022-08-10T17:40:46.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.516+0000 7f66c893f700 1 -- 172.21.15.150:0/2331943893 wait complete. 2022-08-10T17:40:46.543 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:40:46.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:40:46.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.841+0000 7f913332a700 1 Processor -- start 2022-08-10T17:40:46.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.842+0000 7f913332a700 1 -- start start 2022-08-10T17:40:46.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f913332a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f912c0c8af0 0x7f912c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f913332a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 0x7f912c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f913332a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c06e070 con 0x7f912c0c4f10 2022-08-10T17:40:46.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f913332a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c06ec10 con 0x7f912c0c96b0 2022-08-10T17:40:46.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f913332a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0c5390 con 0x7f912c0c8af0 2022-08-10T17:40:46.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f91310c6700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f912c0c8af0 0x7f912c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f91318c7700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f912c0c4f10 0x7f912c06e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:33236/0 (socket says 172.21.15.150:33236) 2022-08-10T17:40:46.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.843+0000 7f91318c7700 1 -- 172.21.15.150:0/2788218087 learned_addr learned my addr 172.21.15.150:0/2788218087 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:40:46.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91308c5700 1 -- 172.21.15.150:0/2788218087 >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 msgr2=0x7f912c0c3340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:46.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91308c5700 1 --2- 172.21.15.150:0/2788218087 >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 0x7f912c0c3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:46.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91310c6700 1 -- 172.21.15.150:0/2788218087 >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 msgr2=0x7f912c0c3340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:46.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91310c6700 1 --2- 172.21.15.150:0/2788218087 >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 0x7f912c0c3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91310c6700 1 -- 172.21.15.150:0/2788218087 >> v1:172.21.15.197:6789/0 conn(0x7f912c0c4f10 legacy=0x7f912c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.845+0000 7f91310c6700 1 -- 172.21.15.150:0/2788218087 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0701c0 con 0x7f912c0c8af0 2022-08-10T17:40:46.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.848+0000 7f91310c6700 1 --2- 172.21.15.150:0/2788218087 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c8af0 0x7f912c0c8ec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f912c06c1e0 tx=0x7f9124009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603d1ac3165e78a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:46.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.850+0000 7f9123fff700 1 -- 172.21.15.150:0/2788218087 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124003aa0 con 0x7f912c0c8af0 2022-08-10T17:40:46.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.851+0000 7f9123fff700 1 -- 172.21.15.150:0/2788218087 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124003c00 con 0x7f912c0c8af0 2022-08-10T17:40:46.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.851+0000 7f9123fff700 1 -- 172.21.15.150:0/2788218087 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400b050 con 0x7f912c0c8af0 2022-08-10T17:40:46.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.852+0000 7f913332a700 1 -- 172.21.15.150:0/2788218087 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c8af0 msgr2=0x7f912c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.852+0000 7f913332a700 1 --2- 172.21.15.150:0/2788218087 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c8af0 0x7f912c0c8ec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f912c06c1e0 tx=0x7f9124009c30 comp rx=0 tx=0).stop 2022-08-10T17:40:46.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 -- 172.21.15.150:0/2788218087 shutdown_connections 2022-08-10T17:40:46.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 --2- 172.21.15.150:0/2788218087 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c8af0 0x7f912c0c8ec0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 --2- 172.21.15.150:0/2788218087 >> v2:172.21.15.150:3300/0 conn(0x7f912c0c96b0 0x7f912c0c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 -- 172.21.15.150:0/2788218087 >> 172.21.15.150:0/2788218087 conn(0x7f912c06b500 msgr2=0x7f912c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:46.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 -- 172.21.15.150:0/2788218087 shutdown_connections 2022-08-10T17:40:46.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.853+0000 7f913332a700 1 -- 172.21.15.150:0/2788218087 wait complete. 2022-08-10T17:40:46.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.855+0000 7f913332a700 1 Processor -- start 2022-08-10T17:40:46.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.866+0000 7f913332a700 1 -- start start 2022-08-10T17:40:46.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f912c0c4f10 0x7f912c0bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 0x7f912c0bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c96b0 0x7f912c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c15f670 con 0x7f912c0c4f10 2022-08-10T17:40:46.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0bea10 con 0x7f912c0c96b0 2022-08-10T17:40:46.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.867+0000 7f913332a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c166760 con 0x7f912c0c8af0 2022-08-10T17:40:46.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.868+0000 7f91318c7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c96b0 0x7f912c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.868+0000 7f91308c5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 0x7f912c0bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.868+0000 7f91308c5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 0x7f912c0bdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:48432/0 (socket says 172.21.15.150:48432) 2022-08-10T17:40:46.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.868+0000 7f91308c5700 1 -- 172.21.15.150:0/3625847750 learned_addr learned my addr 172.21.15.150:0/3625847750 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:46.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c96b0 msgr2=0x7f912c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f912c0c96b0 0x7f912c0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f912c0c4f10 msgr2=0x7f912c0bcd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:46.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f912c0c4f10 0x7f912c0bcd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:46.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912400cb10 con 0x7f912c0c8af0 2022-08-10T17:40:46.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f91308c5700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 0x7f912c0bdd10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9128009fd0 tx=0x7f912800b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:46.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128005480 con 0x7f912c0c8af0 2022-08-10T17:40:46.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91280055e0 con 0x7f912c0c8af0 2022-08-10T17:40:46.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.870+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c15e000 con 0x7f912c0c8af0 2022-08-10T17:40:46.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.871+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c15e5c0 con 0x7f912c0c8af0 2022-08-10T17:40:46.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.871+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128003a30 con 0x7f912c0c8af0 2022-08-10T17:40:46.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.872+0000 7f913332a700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 0x7f9108004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.872+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108007d90 con 0x7f9108002a40 2022-08-10T17:40:46.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.873+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9128018030 con 0x7f912c0c8af0 2022-08-10T17:40:46.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.874+0000 7f9121ffb700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9114065100 0x7f91140675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.874+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f91280812b0 con 0x7f912c0c8af0 2022-08-10T17:40:46.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.875+0000 7f91318c7700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9114065100 0x7f91140675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.877+0000 7f91310c6700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 0x7f9108004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.877+0000 7f91318c7700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9114065100 0x7f91140675b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f911c007500 tx=0x7f911c007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:46.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.877+0000 7f91310c6700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9108007f50 con 0x7f9108002a40 2022-08-10T17:40:46.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f91310c6700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 0x7f9108004ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f912c06c1e0 tx=0x7f9124004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:46.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400c050 con 0x7f9108002a40 2022-08-10T17:40:46.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f912400c1b0 con 0x7f9108002a40 2022-08-10T17:40:46.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 msgr2=0x7f9108004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 0x7f9108004ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f912c06c1e0 tx=0x7f9124004950 comp rx=0 tx=0).stop 2022-08-10T17:40:46.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 msgr2=0x7f9108004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:46.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.878+0000 7f9121ffb700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108002a40 0x7f9108004ef0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f912c06c1e0 tx=0x7f9124004950 comp rx=0 tx=0).stop 2022-08-10T17:40:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.896+0000 7f913332a700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 0x7f9108007150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.896+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108007850 con 0x7f9108006cf0 2022-08-10T17:40:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.896+0000 7f91310c6700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 0x7f9108007150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.897+0000 7f91310c6700 1 -- 172.21.15.150:0/3625847750 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9108007a10 con 0x7f9108006cf0 2022-08-10T17:40:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.897+0000 7f91310c6700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 0x7f9108007150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9124000f80 tx=0x7f9124009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:46.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.897+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400a6d0 con 0x7f9108006cf0 2022-08-10T17:40:46.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.898+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4537 (secure 0 0 0) 0x7f912400c890 con 0x7f9108006cf0 2022-08-10T17:40:46.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.898+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 msgr2=0x7f9108007150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.898+0000 7f9121ffb700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 0x7f9108007150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9124000f80 tx=0x7f9124009750 comp rx=0 tx=0).stop 2022-08-10T17:40:46.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.898+0000 7f9121ffb700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 msgr2=0x7f9108007150 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:46.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.898+0000 7f9121ffb700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9108006cf0 0x7f9108007150 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9124000f80 tx=0x7f9124009750 comp rx=0 tx=0).stop 2022-08-10T17:40:46.904 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:46.904 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:46.905 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:46.905 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:40:46.905 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 26, 2022-08-10T17:40:46.905 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:46.906 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:46.906 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:46.906 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:46.906 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:40:46.906 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:46.907 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:46.907 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:46.907 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:46.907 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:46.908 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:46.908 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:46.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:46.909 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:46.909 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:46.909 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:46.910 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:46.910 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:46.910 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:46.912 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:46.912 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:46.912 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:46.912 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:46.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:46.913 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.913 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:46.913 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:46.914 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:46.914 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:46.914 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:46.914 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:46.915 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:46.915 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:46.915 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:46.915 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:46.915 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:46.916 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:46.916 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:46.916 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:46.916 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:46.917 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:46.917 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:46.918 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:46.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:46.918 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:46.919 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:46.919 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:46.919 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:46.919 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:46.920 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:46.920 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:46.920 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:46.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.921 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:46.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.921 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:46.921 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:46.922 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:46.922 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:46.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.922 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:46.922 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:46.923 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:46.924 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:46.924 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.924 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.924 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.925 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:46.925 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:46.926 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:46.926 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:46.926 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:46.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.927 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:46.927 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:46.928 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:46.928 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:46.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:46.929 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:46.929 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.930 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:46.930 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:46.930 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.931 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.931 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.931 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:46.932 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:46.932 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:46.932 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:46.932 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:46.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.933 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:46.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:46.934 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:46.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:46.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.934 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:46.935 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:46.935 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.936 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:46.936 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:46.936 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:46.937 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.937 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.938 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:46.938 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:46.938 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:46.939 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:46.939 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:46.939 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.939 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.940 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:46.940 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:46.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.940 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:46.941 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:46.941 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:46.941 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.941 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:46.941 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:46.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.942 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:46.942 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:46.943 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:46.943 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.943 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:46.943 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:46.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:46.944 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:46.944 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:46.944 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:46.944 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:46.945 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:46.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:46.945 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:46.945 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9114065100 msgr2=0x7f91140675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f913332a700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9114065100 0x7f91140675b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f911c007500 tx=0x7f911c007b40 comp rx=0 tx=0).stop 2022-08-10T17:40:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 msgr2=0x7f912c0bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f913332a700 1 --2- 172.21.15.150:0/3625847750 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f912c0c8af0 0x7f912c0bdd10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9128009fd0 tx=0x7f912800b770 comp rx=0 tx=0).stop 2022-08-10T17:40:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f91318c7700 1 -- 172.21.15.150:0/3625847750 reap_dead start 2022-08-10T17:40:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f91318c7700 1 -- 172.21.15.150:0/3625847750 reap_dead start 2022-08-10T17:40:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.901+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 shutdown_connections 2022-08-10T17:40:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.902+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 >> 172.21.15.150:0/3625847750 conn(0x7f912c06b500 msgr2=0x7f912c0c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.902+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 shutdown_connections 2022-08-10T17:40:46.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:46.902+0000 7f913332a700 1 -- 172.21.15.150:0/3625847750 wait complete. 2022-08-10T17:40:46.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:40:47.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.223+0000 7f5963c4e700 1 Processor -- start 2022-08-10T17:40:47.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.223+0000 7f5963c4e700 1 -- start start 2022-08-10T17:40:47.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.225+0000 7f5963c4e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f595c0702b0 0x7f595c06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.225+0000 7f5963c4e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0c4d00 con 0x7f595c0c2680 2022-08-10T17:40:47.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.225+0000 7f5963c4e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c070710 con 0x7f595c0c8990 2022-08-10T17:40:47.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.225+0000 7f5963c4e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0c99b0 con 0x7f595c0702b0 2022-08-10T17:40:47.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.227+0000 7f59619ea700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f595c0c2680 legacy=0x7f595c0c3340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:40:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.227+0000 7f59611e9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f595c0702b0 0x7f595c06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.227+0000 7f59611e9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f595c0702b0 0x7f595c06dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44830/0 (socket says 172.21.15.150:44830) 2022-08-10T17:40:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.227+0000 7f59611e9700 1 -- 172.21.15.150:0/1527644019 learned_addr learned my addr 172.21.15.150:0/1527644019 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59611e9700 1 -- 172.21.15.150:0/1527644019 >> v1:172.21.15.197:6789/0 conn(0x7f595c0c8990 legacy=0x7f595c1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:40:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59611e9700 1 -- 172.21.15.150:0/1527644019 >> v1:172.21.15.150:6789/0 conn(0x7f595c0c2680 legacy=0x7f595c0c3340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:40:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59611e9700 1 -- 172.21.15.150:0/1527644019 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0c4f60 con 0x7f595c0702b0 2022-08-10T17:40:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59611e9700 1 --2- 172.21.15.150:0/1527644019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0702b0 0x7f595c06dcf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f595c06d950 tx=0x7f594c009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda2326670b0688c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59609e8700 1 -- 172.21.15.150:0/1527644019 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c011830 con 0x7f595c0702b0 2022-08-10T17:40:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59609e8700 1 -- 172.21.15.150:0/1527644019 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c011990 con 0x7f595c0702b0 2022-08-10T17:40:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.228+0000 7f59609e8700 1 -- 172.21.15.150:0/1527644019 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c011d20 con 0x7f595c0702b0 2022-08-10T17:40:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.229+0000 7f5963c4e700 1 -- 172.21.15.150:0/1527644019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0702b0 msgr2=0x7f595c06dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.229+0000 7f5963c4e700 1 --2- 172.21.15.150:0/1527644019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0702b0 0x7f595c06dcf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f595c06d950 tx=0x7f594c009a60 comp rx=0 tx=0).stop 2022-08-10T17:40:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.231+0000 7f5963c4e700 1 -- 172.21.15.150:0/1527644019 shutdown_connections 2022-08-10T17:40:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.231+0000 7f5963c4e700 1 --2- 172.21.15.150:0/1527644019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0702b0 0x7f595c06dcf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.231+0000 7f5963c4e700 1 -- 172.21.15.150:0/1527644019 >> 172.21.15.150:0/1527644019 conn(0x7f595c06b500 msgr2=0x7f595c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.231+0000 7f5963c4e700 1 -- 172.21.15.150:0/1527644019 shutdown_connections 2022-08-10T17:40:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.231+0000 7f5963c4e700 1 -- 172.21.15.150:0/1527644019 wait complete. 2022-08-10T17:40:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.233+0000 7f5963c4e700 1 Processor -- start 2022-08-10T17:40:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.233+0000 7f5963c4e700 1 -- start start 2022-08-10T17:40:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f595c0702b0 0x7f595c142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f595c0c2680 0x7f595c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 0x7f595c1770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c145670 con 0x7f595c0702b0 2022-08-10T17:40:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c143030 con 0x7f595c0c8990 2022-08-10T17:40:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f5963c4e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0bce70 con 0x7f595c0c2680 2022-08-10T17:40:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f59621eb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 0x7f595c1770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f59621eb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 0x7f595c1770f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:44836/0 (socket says 172.21.15.150:44836) 2022-08-10T17:40:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 learned_addr learned my addr 172.21.15.150:0/4051385116 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:40:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.234+0000 7f59619ea700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f595c0702b0 msgr2=0x7f595c142af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:40:47.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59619ea700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f595c0702b0 0x7f595c142af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:40:47.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59611e9700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f595c0c2680 0x7f595c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f595c0c2680 msgr2=0x7f595c143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f595c0c2680 0x7f595c143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:47.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f595c0702b0 msgr2=0x7f595c142af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:40:47.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f595c0702b0 0x7f595c142af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:40:47.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c0093e0 con 0x7f595c0c8990 2022-08-10T17:40:47.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59611e9700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f595c0c2680 0x7f595c143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:40:47.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59621eb700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 0x7f595c1770f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f595400b780 tx=0x7f595400bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:47.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.235+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011890 con 0x7f595c0c8990 2022-08-10T17:40:47.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.237+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540119f0 con 0x7f595c0c8990 2022-08-10T17:40:47.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.237+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011da0 con 0x7f595c0c8990 2022-08-10T17:40:47.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.237+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c0bd150 con 0x7f595c0c8990 2022-08-10T17:40:47.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.237+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c145bf0 con 0x7f595c0c8990 2022-08-10T17:40:47.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.246+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5954017020 con 0x7f595c0c8990 2022-08-10T17:40:47.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.246+0000 7f5963c4e700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 0x7f5938004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.246+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5938007d90 con 0x7f5938002a40 2022-08-10T17:40:47.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.247+0000 7f59527fc700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5940087190 0x7f5940089640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.247+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5954082520 con 0x7f595c0c8990 2022-08-10T17:40:47.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.248+0000 7f59619ea700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 0x7f5938004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.249+0000 7f59611e9700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5940087190 0x7f5940089640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.249+0000 7f59619ea700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5938007f50 con 0x7f5938002a40 2022-08-10T17:40:47.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.249+0000 7f59619ea700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 0x7f5938004ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f595800b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:47.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.250+0000 7f59611e9700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5940087190 0x7f5940089640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f595c0bc5b0 tx=0x7f594c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:47.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003ac0 con 0x7f5938002a40 2022-08-10T17:40:47.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f5958003c20 con 0x7f5938002a40 2022-08-10T17:40:47.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 msgr2=0x7f5938004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 0x7f5938004ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f595800b6d0 comp rx=0 tx=0).stop 2022-08-10T17:40:47.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 msgr2=0x7f5938004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:47.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.251+0000 7f59527fc700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938002a40 0x7f5938004ef0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f595800b6d0 comp rx=0 tx=0).stop 2022-08-10T17:40:47.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.265+0000 7f5963c4e700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 0x7f59380071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:40:47.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.265+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380078a0 con 0x7f5938006d40 2022-08-10T17:40:47.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.265+0000 7f59619ea700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 0x7f59380071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:40:47.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.265+0000 7f59619ea700 1 -- 172.21.15.150:0/4051385116 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5938007a60 con 0x7f5938006d40 2022-08-10T17:40:47.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59619ea700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 0x7f59380071a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f5958003700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:40:47.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003e70 con 0x7f5938006d40 2022-08-10T17:40:47.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f5958012a70 con 0x7f5938006d40 2022-08-10T17:40:47.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 msgr2=0x7f59380071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 0x7f59380071a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f5958003700 comp rx=0 tx=0).stop 2022-08-10T17:40:47.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 msgr2=0x7f59380071a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:40:47.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.266+0000 7f59527fc700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5938006d40 0x7f59380071a0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f5958003700 comp rx=0 tx=0).stop 2022-08-10T17:40:47.272 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:40:47.273 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:47.273 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:47.273 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:40:47.273 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 26, 2022-08-10T17:40:47.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:40:47.274 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:40:47.274 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:40:47.274 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:40:47.275 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:47.275 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:40:47.275 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:40:47.275 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:47.276 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:47.276 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:47.276 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:47.276 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:47.277 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:47.277 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:47.277 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:47.277 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:47.277 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.278 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:40:47.278 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:40:47.278 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:47.278 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:47.279 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:47.279 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:47.279 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:47.279 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:47.280 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:47.280 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:47.280 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:47.280 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.281 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:40:47.281 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:40:47.281 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:40:47.282 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:40:47.282 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:40:47.282 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:40:47.282 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:47.283 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:40:47.283 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:40:47.283 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:40:47.283 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:40:47.284 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:40:47.284 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:40:47.284 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:40:47.284 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:40:47.285 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:40:47.285 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:40:47.285 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:40:47.285 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:40:47.285 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:40:47.286 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:40:47.286 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:40:47.286 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:40:47.286 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:40:47.287 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:40:47.287 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.287 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:40:47.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.288 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:40:47.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.288 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:40:47.289 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:40:47.289 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:47.289 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:47.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.289 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:47.290 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:40:47.290 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.291 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:47.291 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:40:47.291 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.291 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.292 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.292 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:40:47.292 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:40:47.292 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:47.293 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:47.293 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:47.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.294 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:40:47.294 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:40:47.294 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:47.294 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:47.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.295 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:47.295 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:40:47.295 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.296 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:47.297 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:40:47.297 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.297 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.297 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.298 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:40:47.298 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:40:47.298 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:47.298 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:47.299 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:47.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.299 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:40:47.300 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:40:47.300 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:40:47.300 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:40:47.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.300 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:40:47.301 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:40:47.301 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.302 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:40:47.302 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:40:47.302 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:40:47.302 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.302 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.303 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:40:47.303 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:40:47.303 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:40:47.304 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:40:47.304 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:40:47.304 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.304 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.305 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:40:47.305 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:40:47.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.305 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:47.306 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.306 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:47.306 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.306 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.307 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:40:47.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.307 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:47.307 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.308 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:40:47.308 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.308 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.308 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:40:47.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.309 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:47.309 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.309 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:40:47.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.310 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.310 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:40:47.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.310 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:40:47.311 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.311 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:40:47.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.312 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:47.312 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:40:47.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.313 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:40:47.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:40:47.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:40:47.313 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:40:47.313 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:40:47.314 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:40:47.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:40:47.314 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:40:47.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:40:47.315 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:40:47.315 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:40:47.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5940087190 msgr2=0x7f5940089640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5940087190 0x7f5940089640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f595c0bc5b0 tx=0x7f594c008030 comp rx=0 tx=0).stop 2022-08-10T17:40:47.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 msgr2=0x7f595c1770f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:40:47.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 --2- 172.21.15.150:0/4051385116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f595c0c8990 0x7f595c1770f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f595400b780 tx=0x7f595400bb40 comp rx=0 tx=0).stop 2022-08-10T17:40:47.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 reap_dead start 2022-08-10T17:40:47.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f59621eb700 1 -- 172.21.15.150:0/4051385116 reap_dead start 2022-08-10T17:40:47.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 shutdown_connections 2022-08-10T17:40:47.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.273+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 >> 172.21.15.150:0/4051385116 conn(0x7f595c06b500 msgr2=0x7f595c159010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:40:47.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.275+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 shutdown_connections 2022-08-10T17:40:47.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:40:47.275+0000 7f5963c4e700 1 -- 172.21.15.150:0/4051385116 wait complete. 2022-08-10T17:40:47.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:41:07.320 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:41:07.320 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:41:07.320 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:41:07.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:41:07.327 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:41:07.328 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:41:07.329 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:41:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.659+0000 7fb4bc08d700 1 Processor -- start 2022-08-10T17:41:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.659+0000 7fb4bc08d700 1 -- start start 2022-08-10T17:41:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4bc08d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb4b40896d0 0x7fb4b40c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4bc08d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4bc08d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b406b310 con 0x7fb4b40c5050 2022-08-10T17:41:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4bc08d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b406bf00 con 0x7fb4b4089aa0 2022-08-10T17:41:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4bc08d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b40c3830 con 0x7fb4b40896d0 2022-08-10T17:41:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4b9628700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb4b40c5050 0x7fb4b415d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:47472/0 (socket says 172.21.15.150:47472) 2022-08-10T17:41:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.660+0000 7fb4b9628700 1 -- 172.21.15.150:0/22204266 learned_addr learned my addr 172.21.15.150:0/22204266 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:41:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4ba62a700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4ba62a700 1 -- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 msgr2=0x7fb4b4166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:41:07.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4ba62a700 1 -- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 msgr2=0x7fb4b4166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:07.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4ba62a700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:07.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4ba62a700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.197:3300/0 conn(0x7fb4b40896d0 0x7fb4b40c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4b9e29700 1 -- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 msgr2=0x7fb4b4166c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4b9e29700 1 -- 172.21.15.150:0/22204266 >> v1:172.21.15.150:6789/0 conn(0x7fb4b40c5050 legacy=0x7fb4b415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:07.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.661+0000 7fb4b9e29700 1 -- 172.21.15.150:0/22204266 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40c3aa0 con 0x7fb4b40896d0 2022-08-10T17:41:07.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.663+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/22204266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b40896d0 0x7fb4b40c32f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40c65c0 tx=0x7fb4b0009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=568e71b8695fa837 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.664+0000 7fb4b8e27700 1 -- 172.21.15.150:0/22204266 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011830 con 0x7fb4b40896d0 2022-08-10T17:41:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.664+0000 7fb4b8e27700 1 -- 172.21.15.150:0/22204266 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0011990 con 0x7fb4b40896d0 2022-08-10T17:41:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.664+0000 7fb4b8e27700 1 -- 172.21.15.150:0/22204266 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011d40 con 0x7fb4b40896d0 2022-08-10T17:41:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.665+0000 7fb4bc08d700 1 -- 172.21.15.150:0/22204266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b40896d0 msgr2=0x7fb4b40c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:07.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.665+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/22204266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b40896d0 0x7fb4b40c32f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40c65c0 tx=0x7fb4b0009990 comp rx=0 tx=0).stop 2022-08-10T17:41:07.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.670+0000 7fb4bc08d700 1 -- 172.21.15.150:0/22204266 shutdown_connections 2022-08-10T17:41:07.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.670+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/22204266 >> v2:172.21.15.150:3300/0 conn(0x7fb4b4089aa0 0x7fb4b4166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:07.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.670+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/22204266 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b40896d0 0x7fb4b40c32f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:07.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.670+0000 7fb4bc08d700 1 -- 172.21.15.150:0/22204266 >> 172.21.15.150:0/22204266 conn(0x7fb4b40c8a10 msgr2=0x7fb4b40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:07.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.673+0000 7fb4bc08d700 1 -- 172.21.15.150:0/22204266 shutdown_connections 2022-08-10T17:41:07.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.673+0000 7fb4bc08d700 1 -- 172.21.15.150:0/22204266 wait complete. 2022-08-10T17:41:07.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.675+0000 7fb4bc08d700 1 Processor -- start 2022-08-10T17:41:07.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.676+0000 7fb4bc08d700 1 -- start start 2022-08-10T17:41:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 0x7fb4b4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b4089aa0 0x7fb4b415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b41ec8d0 con 0x7fb4b40c5050 2022-08-10T17:41:07.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b41ebcc0 con 0x7fb4b4089aa0 2022-08-10T17:41:07.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4bc08d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4160020 con 0x7fb4b40896d0 2022-08-10T17:41:07.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4ba62a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4ba62a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34802/0 (socket says 172.21.15.150:34802) 2022-08-10T17:41:07.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.677+0000 7fb4ba62a700 1 -- 172.21.15.150:0/1981735969 learned_addr learned my addr 172.21.15.150:0/1981735969 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:07.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4ba62a700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 msgr2=0x7fb4b415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:41:07.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4ba62a700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 msgr2=0x7fb4b415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:41:07.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4ba62a700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:07.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4ba62a700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:07.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 0x7fb4b4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4b9628700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b4089aa0 0x7fb4b415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4b9e29700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b4089aa0 msgr2=0x7fb4b415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.678+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b4089aa0 0x7fb4b415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.679+0000 7fb4b9e29700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 msgr2=0x7fb4b415da60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.679+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.679+0000 7fb4b9e29700 1 -- 172.21.15.150:0/1981735969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009310 con 0x7fb4b40896d0 2022-08-10T17:41:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.679+0000 7fb4b9e29700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 0x7fb4b4159130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0016000 tx=0x7fb4b00045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.680+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b001a6e0 con 0x7fb4b40896d0 2022-08-10T17:41:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.680+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b415fd40 con 0x7fb4b40896d0 2022-08-10T17:41:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.680+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b415dfa0 con 0x7fb4b40896d0 2022-08-10T17:41:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.681+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b4159670 con 0x7fb4b40896d0 2022-08-10T17:41:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.680+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b001a860 con 0x7fb4b40896d0 2022-08-10T17:41:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.683+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b001ac10 con 0x7fb4b40896d0 2022-08-10T17:41:07.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.684+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb4b002b030 con 0x7fb4b40896d0 2022-08-10T17:41:07.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.684+0000 7fb4aa7fc700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 0x7fb49c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:07.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.685+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb4b00836e0 con 0x7fb4b40896d0 2022-08-10T17:41:07.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.685+0000 7fb4b9628700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 0x7fb49c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:07.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.692+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb4b00516d0 con 0x7fb4b40896d0 2022-08-10T17:41:07.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:07.693+0000 7fb4b9628700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 0x7fb49c067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4159f80 tx=0x7fb4a4009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:08.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:08.357+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb4b4072890 con 0x7fb4b40896d0 2022-08-10T17:41:08.558 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:41:08.568 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:41:13.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.207+0000 7fb4aa7fc700 1 -- 172.21.15.150:0/1981735969 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7fb4b0029080 con 0x7fb4b40896d0 2022-08-10T17:41:13.211 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:41:13.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 msgr2=0x7fb49c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:13.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 0x7fb49c067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4159f80 tx=0x7fb4a4009060 comp rx=0 tx=0).stop 2022-08-10T17:41:13.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 msgr2=0x7fb4b4159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:13.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 0x7fb4b4159130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0016000 tx=0x7fb4b00045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:13.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 shutdown_connections 2022-08-10T17:41:13.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4b40c5050 0x7fb4b415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:13.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb49c065180 0x7fb49c067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:13.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb4b40896d0 0x7fb4b4159130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:13.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 --2- 172.21.15.150:0/1981735969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb4b4089aa0 0x7fb4b415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:13.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 >> 172.21.15.150:0/1981735969 conn(0x7fb4b40c8a10 msgr2=0x7fb4b4160940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:13.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 shutdown_connections 2022-08-10T17:41:13.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:13.211+0000 7fb4bc08d700 1 -- 172.21.15.150:0/1981735969 wait complete. 2022-08-10T17:41:16.236 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:41:16.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.591+0000 7fd70e78f700 1 Processor -- start 2022-08-10T17:41:16.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.591+0000 7fd70e78f700 1 -- start start 2022-08-10T17:41:16.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.592+0000 7fd70e78f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:16.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.592+0000 7fd70e78f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:16.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.592+0000 7fd70e78f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd708157190 con 0x7fd7080c4f10 2022-08-10T17:41:16.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.592+0000 7fd70e78f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd70806b310 2022-08-10T17:41:16.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.592+0000 7fd70e78f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bf10 con 0x7fd708125c10 2022-08-10T17:41:16.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd70cd2c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:16.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd707fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fd7080c4f10 0x7fd708159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:34016/0 (socket says 172.21.15.150:34016) 2022-08-10T17:41:16.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 learned_addr learned my addr 172.21.15.150:0/424161434 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:41:16.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:16.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:41:16.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:16.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:16.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:16.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.602+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:16.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.602+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:16.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.602+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:16.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.602+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.795+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.795+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:16.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.795+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:16.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.795+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:16.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.795+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.805+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.810+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.810+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.810+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:16.810+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:17.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.199+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:17.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.200+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:17.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.200+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:17.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.200+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:17.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.200+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:17.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.214+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:17.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.216+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:17.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.216+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:17.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.216+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:17.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:17.216+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:18.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.001+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:18.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.001+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:18.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.001+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:18.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.001+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:18.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.001+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:18.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.023+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:18.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.023+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:18.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.023+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:18.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.023+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:18.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:18.023+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:19.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 msgr2=0x7fd7080c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:19.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd708125c10 0x7fd7080c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:19.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 msgr2=0x7fd7081509f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:19.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd70806b310 0x7fd7081509f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:19.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.197:6789/0 conn(0x7fd7080c4f10 legacy=0x7fd708159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:19.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:19.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd708156b40 con 0x7fd6e8006090 2022-08-10T17:41:19.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e80035c0 2022-08-10T17:41:19.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.596+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:19.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.597+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:19.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.597+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:19.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.597+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:19.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.597+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:19.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:19.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.802+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.802+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:19.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:19.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:20.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:20.205+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:20.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:20.206+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:20.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:20.206+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:20.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:20.206+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:20.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:20.206+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:21.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:21.008+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:21.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:21.011+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:21.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:21.011+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:21.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:21.011+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:21.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:21.011+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:22.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 msgr2=0x7fd6e8005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:22.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e80035c0 0x7fd6e8005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:22.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.150:6789/0 conn(0x7fd6e8006090 legacy=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:22.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 reap_dead start 2022-08-10T17:41:22.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:22.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:22.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e800aed0 con 0x7fd6e8009ed0 2022-08-10T17:41:22.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e8005a00 2022-08-10T17:41:22.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.593+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70806bf10 con 0x7fd6e8008c70 2022-08-10T17:41:22.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:22.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:22.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:41:22.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:22.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:22.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:22.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:22.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:22.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:22.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.594+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:22.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:22.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:22.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:41:22.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:22.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:22.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.801+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:22.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.805+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:22.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.805+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:22.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.805+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:22.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:22.805+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:23.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.205+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:23.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.205+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:23.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.205+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:23.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.205+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:23.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.205+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:23.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.206+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:23.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.206+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:23.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.206+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:23.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.206+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:23.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:23.206+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:24.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:24.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:41:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:24.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:24.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:24.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:24.007+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:25.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.594+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:25.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.594+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8008c70 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:25.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.594+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 msgr2=0x7fd6e800e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:25.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.594+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8005a00 0x7fd6e800e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:25.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.594+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.150:6789/0 conn(0x7fd6e8009ed0 legacy=0x7fd6e800a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:25.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:25.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e8009070 con 0x7fd6e80093a0 2022-08-10T17:41:25.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e8011e50 2022-08-10T17:41:25.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:25.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:25.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:25.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:25.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.595+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:25.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.796+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:25.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.796+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:25.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.796+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:25.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.796+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:25.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:25.796+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:26.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.197+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:26.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.197+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:26.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.197+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:26.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.197+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:26.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.197+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:27.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.998+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:27.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.999+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:27.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.999+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:27.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.999+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:27.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:26.999+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:28.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:28.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:28.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.197:6789/0 conn(0x7fd6e80093a0 legacy=0x7fd6e8010730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:28.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:28.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e8015780 con 0x7fd6e8009ed0 2022-08-10T17:41:28.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80154b0 con 0x7fd6e8014870 2022-08-10T17:41:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e8011e50 2022-08-10T17:41:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 reap_dead start 2022-08-10T17:41:28.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.595+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:28.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.596+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:28.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.596+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.596+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:28.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.596+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:28.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.798+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:28.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.799+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:28.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.799+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:28.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.799+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:28.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:28.799+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:29.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:29.200+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:29.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:29.200+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:29.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:29.200+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:29.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:29.200+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:29.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:29.200+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:30.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:30.001+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:30.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:30.002+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:30.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:30.002+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:30.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:30.002+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:30.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:30.002+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:31.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 msgr2=0x7fd6e8014230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:31.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.150:3300/0 conn(0x7fd6e8011e50 0x7fd6e8014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:31.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.197:6789/0 conn(0x7fd6e8014870 legacy=0x7fd6e8014ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:31.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.150:6789/0 conn(0x7fd6e8009ed0 legacy=0x7fd6e800a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:31.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:31.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:31.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e8018f10 2022-08-10T17:41:31.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70806bf10 con 0x7fd6e8018a00 2022-08-10T17:41:31.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:31.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:31.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:31.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:31.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:31.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.599+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:31.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.600+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:31.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.600+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:31.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.600+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:31.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.600+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:31.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.800+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:31.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.800+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:31.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.800+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:31.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.800+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:31.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.800+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:31.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:31.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.802+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:31.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.802+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:31.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:31.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:31.802+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:41:32.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:32.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:32.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:32.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:32.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:32.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:32.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:32.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:32.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:32.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:32.203+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:41:33.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:33.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:33.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:41:33.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd707fff700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:33.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:33.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:33.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:41:33.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:41:33.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:41:33.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:33.005+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:41:34.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 msgr2=0x7fd6e8008540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:34.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8018a00 0x7fd6e8008540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 msgr2=0x7fd6e8019360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:34.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e8018f10 0x7fd6e8019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8019b10 0x7fd6e8019ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e801a4c0 0x7fd6e80101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e801a9d0 con 0x7fd6e8014870 2022-08-10T17:41:34.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806bc30 con 0x7fd6e801a4c0 2022-08-10T17:41:34.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd705ffb700 1 -- 172.21.15.150:0/424161434 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70806bf10 con 0x7fd6e8019b10 2022-08-10T17:41:34.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.598+0000 7fd70cd2c700 1 -- 172.21.15.150:0/424161434 reap_dead start 2022-08-10T17:41:34.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.599+0000 7fd707fff700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8019b10 0x7fd6e8019ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.600+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> v2:172.21.15.197:3300/0 conn(0x7fd6e801a4c0 0x7fd6e80101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.600+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8019b10 msgr2=0x7fd6e8019ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:34.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.600+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8019b10 0x7fd6e8019ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.600+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 >> v1:172.21.15.197:6789/0 conn(0x7fd6e8014870 legacy=0x7fd6e8014c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:34.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.600+0000 7fd7077fe700 1 -- 172.21.15.150:0/424161434 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80117c0 con 0x7fd6e801a4c0 2022-08-10T17:41:34.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.601+0000 7fd7077fe700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e801a4c0 0x7fd6e80101f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aab0 tx=0x7fd700003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c85815aefd136f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:34.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.604+0000 7fd706ffd700 1 -- 172.21.15.150:0/424161434 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70001e040 con 0x7fd6e801a4c0 2022-08-10T17:41:34.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.604+0000 7fd706ffd700 1 -- 172.21.15.150:0/424161434 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70001f040 con 0x7fd6e801a4c0 2022-08-10T17:41:34.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.604+0000 7fd706ffd700 1 -- 172.21.15.150:0/424161434 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700009e50 con 0x7fd6e801a4c0 2022-08-10T17:41:34.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 -- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e801a4c0 msgr2=0x7fd6e80101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:34.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e801a4c0 0x7fd6e80101f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aab0 tx=0x7fd700003f10 comp rx=0 tx=0).stop 2022-08-10T17:41:34.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 -- 172.21.15.150:0/424161434 shutdown_connections 2022-08-10T17:41:34.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e801a4c0 0x7fd6e80101f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 --2- 172.21.15.150:0/424161434 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e8019b10 0x7fd6e8019ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 -- 172.21.15.150:0/424161434 >> 172.21.15.150:0/424161434 conn(0x7fd7080c8a10 msgr2=0x7fd7080c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:34.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.605+0000 7fd70e78f700 1 -- 172.21.15.150:0/424161434 shutdown_connections 2022-08-10T17:41:34.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.607+0000 7fd70e78f700 1 -- 172.21.15.150:0/424161434 wait complete. 2022-08-10T17:41:34.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.609+0000 7fd70e78f700 1 Processor -- start 2022-08-10T17:41:34.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.612+0000 7fd70e78f700 1 -- start start 2022-08-10T17:41:34.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 0x7fd7081f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 0x7fd7081f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e801a4c0 0x7fd708148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080c00f0 con 0x7fd6e8014870 2022-08-10T17:41:34.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081f44f0 con 0x7fd6e8019b10 2022-08-10T17:41:34.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.613+0000 7fd70e78f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70814bac0 con 0x7fd6e801a4c0 2022-08-10T17:41:34.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.614+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 0x7fd7081f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.614+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 0x7fd7081f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:46112/0 (socket says 172.21.15.150:46112) 2022-08-10T17:41:34.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.614+0000 7fd7077fe700 1 -- 172.21.15.150:0/3325431125 learned_addr learned my addr 172.21.15.150:0/3325431125 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:34.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 0x7fd7081f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd70cd2c700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e801a4c0 0x7fd708148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 -- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e801a4c0 msgr2=0x7fd708148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:34.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e801a4c0 0x7fd708148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 -- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 msgr2=0x7fd7081f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:34.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 0x7fd7081f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:34.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.616+0000 7fd707fff700 1 -- 172.21.15.150:0/3325431125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8015780 con 0x7fd6e8014870 2022-08-10T17:41:34.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.617+0000 7fd707fff700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 0x7fd7081f3980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aae0 tx=0x7fd6f8005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:34.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.621+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8019be0 con 0x7fd6e8014870 2022-08-10T17:41:34.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.621+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f801f040 con 0x7fd6e8014870 2022-08-10T17:41:34.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.621+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8026460 con 0x7fd6e8014870 2022-08-10T17:41:34.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.621+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70814bda0 con 0x7fd6e8014870 2022-08-10T17:41:34.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.621+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70814c360 con 0x7fd6e8014870 2022-08-10T17:41:34.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.635+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd6f802d030 con 0x7fd6e8014870 2022-08-10T17:41:34.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.635+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4005170 con 0x7fd6e8014870 2022-08-10T17:41:34.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.639+0000 7fd704ff9700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 0x7fd6e806b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:34.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.639+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd6f8083910 con 0x7fd6e8014870 2022-08-10T17:41:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.643+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd6f8051880 con 0x7fd6e8014870 2022-08-10T17:41:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.644+0000 7fd7077fe700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 0x7fd6e806b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:34.645+0000 7fd7077fe700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 0x7fd6e806b910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd700003f50 tx=0x7fd70001b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:35.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.311+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd6e40059a0 con 0x7fd6e8014870 2022-08-10T17:41:35.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.315+0000 7fd704ff9700 1 -- 172.21.15.150:0/3325431125 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7fd6f802b070 con 0x7fd6e8014870 2022-08-10T17:41:35.321 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:41:35.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 msgr2=0x7fd6e806b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:35.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 0x7fd6e806b910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd700003f50 tx=0x7fd70001b000 comp rx=0 tx=0).stop 2022-08-10T17:41:35.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 msgr2=0x7fd7081f3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:35.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 0x7fd7081f3980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aae0 tx=0x7fd6f8005f80 comp rx=0 tx=0).stop 2022-08-10T17:41:35.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 shutdown_connections 2022-08-10T17:41:35.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6e8069460 0x7fd6e806b910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:35.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6e801a4c0 0x7fd708148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:35.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6e8014870 0x7fd7081f3980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:35.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 --2- 172.21.15.150:0/3325431125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6e8019b10 0x7fd7081f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:35.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 >> 172.21.15.150:0/3325431125 conn(0x7fd7080c8a10 msgr2=0x7fd7080c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:35.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 shutdown_connections 2022-08-10T17:41:35.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:35.324+0000 7fd70e78f700 1 -- 172.21.15.150:0/3325431125 wait complete. 2022-08-10T17:41:35.357 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:41:35.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:41:37.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.516+0000 7f729141c700 1 Processor -- start 2022-08-10T17:41:37.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.516+0000 7f729141c700 1 -- start start 2022-08-10T17:41:37.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f729141c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f728c0c9620 0x7f728c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f729141c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f729141c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c06e0b0 con 0x7f728c1678e0 2022-08-10T17:41:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f729141c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c167cb0 con 0x7f728c0c9620 2022-08-10T17:41:37.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f729141c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c06ec50 con 0x7f728c0c3340 2022-08-10T17:41:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f728b7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f7283fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f728c0c9620 0x7f728c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f7283fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f728c0c9620 0x7f728c0c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35596/0 (socket says 172.21.15.150:35596) 2022-08-10T17:41:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f728b7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c0bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:49816/0 (socket says 172.21.15.150:49816) 2022-08-10T17:41:37.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.517+0000 7f7283fff700 1 -- 172.21.15.150:0/2533657223 learned_addr learned my addr 172.21.15.150:0/2533657223 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:37.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f7283fff700 1 -- 172.21.15.150:0/2533657223 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 msgr2=0x7f728c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:37.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f7283fff700 1 --2- 172.21.15.150:0/2533657223 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f7283fff700 1 -- 172.21.15.150:0/2533657223 >> v1:172.21.15.197:6789/0 conn(0x7f728c1678e0 legacy=0x7f728c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:37.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f7283fff700 1 -- 172.21.15.150:0/2533657223 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0c0420 con 0x7f728c0c9620 2022-08-10T17:41:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f7283fff700 1 --2- 172.21.15.150:0/2533657223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0c4f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367803eba8b3a164 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.518+0000 7f728a7fc700 1 -- 172.21.15.150:0/2533657223 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274011830 con 0x7f728c0c9620 2022-08-10T17:41:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.519+0000 7f728a7fc700 1 -- 172.21.15.150:0/2533657223 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72740119b0 con 0x7f728c0c9620 2022-08-10T17:41:37.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.519+0000 7f728a7fc700 1 -- 172.21.15.150:0/2533657223 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274011d60 con 0x7f728c0c9620 2022-08-10T17:41:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.519+0000 7f729141c700 1 -- 172.21.15.150:0/2533657223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 msgr2=0x7f728c0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 --2- 172.21.15.150:0/2533657223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0c4f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274009a60 comp rx=0 tx=0).stop 2022-08-10T17:41:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 -- 172.21.15.150:0/2533657223 shutdown_connections 2022-08-10T17:41:37.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 --2- 172.21.15.150:0/2533657223 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 --2- 172.21.15.150:0/2533657223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0c4f10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 -- 172.21.15.150:0/2533657223 >> 172.21.15.150:0/2533657223 conn(0x7f728c06b500 msgr2=0x7f728c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 -- 172.21.15.150:0/2533657223 shutdown_connections 2022-08-10T17:41:37.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.520+0000 7f729141c700 1 -- 172.21.15.150:0/2533657223 wait complete. 2022-08-10T17:41:37.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.522+0000 7f729141c700 1 Processor -- start 2022-08-10T17:41:37.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.522+0000 7f729141c700 1 -- start start 2022-08-10T17:41:37.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c20ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0885d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f728c1678e0 0x7f728c088b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0bc760 con 0x7f728c0c9620 2022-08-10T17:41:37.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0bcf70 con 0x7f728c1678e0 2022-08-10T17:41:37.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.523+0000 7f729141c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c20d850 con 0x7f728c0c3340 2022-08-10T17:41:37.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.524+0000 7f7283fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.524+0000 7f7283fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0885d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35600/0 (socket says 172.21.15.150:35600) 2022-08-10T17:41:37.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.524+0000 7f7283fff700 1 -- 172.21.15.150:0/2206434011 learned_addr learned my addr 172.21.15.150:0/2206434011 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:37.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.524+0000 7f728affd700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c20ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 msgr2=0x7f728c20ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f728c0c3340 0x7f728c20ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f728c1678e0 msgr2=0x7f728c088b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:37.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f728c1678e0 0x7f728c088b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740093e0 con 0x7f728c0c9620 2022-08-10T17:41:37.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.525+0000 7f7283fff700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0885d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7274000c00 tx=0x7f72740045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.529+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274004450 con 0x7f728c0c9620 2022-08-10T17:41:37.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.529+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274003520 con 0x7f728c0c9620 2022-08-10T17:41:37.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.529+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72740038d0 con 0x7f728c0c9620 2022-08-10T17:41:37.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.529+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c0bc9b0 con 0x7f728c0c9620 2022-08-10T17:41:37.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.529+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c20acc0 con 0x7f728c0c9620 2022-08-10T17:41:37.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.533+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f727402a030 con 0x7f728c0c9620 2022-08-10T17:41:37.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.533+0000 7f72837fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7264065100 0x7f72640675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.533+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7274083000 con 0x7f728c0c9620 2022-08-10T17:41:37.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.534+0000 7f729141c700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 0x7f728c20b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.534+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0673d0 con 0x7f728c0b5f10 2022-08-10T17:41:37.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.539+0000 7f728affd700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7264065100 0x7f72640675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.543+0000 7f728b7fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 0x7f728c20b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.548+0000 7f728b7fe700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f728c072890 con 0x7f728c0b5f10 2022-08-10T17:41:37.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.548+0000 7f728affd700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7264065100 0x7f72640675b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f727c007fd0 tx=0x7f727c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.549+0000 7f728b7fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 0x7f728c20b1e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f7284009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.549+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400ead0 con 0x7f728c0b5f10 2022-08-10T17:41:37.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.550+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f728400ec30 con 0x7f728c0b5f10 2022-08-10T17:41:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.550+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 msgr2=0x7f728c20b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.550+0000 7f72837fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 0x7f728c20b1e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f7284009f30 comp rx=0 tx=0).stop 2022-08-10T17:41:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.550+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 msgr2=0x7f728c20b1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.550+0000 7f72837fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0b5f10 0x7f728c20b1e0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f7284009f30 comp rx=0 tx=0).stop 2022-08-10T17:41:37.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.567+0000 7f729141c700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 0x7f728c20b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.567+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c3a40 con 0x7f728c20d340 2022-08-10T17:41:37.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.567+0000 7f728b7fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 0x7f728c20b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.567+0000 7f728b7fe700 1 -- 172.21.15.150:0/2206434011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f728c20ae80 con 0x7f728c20d340 2022-08-10T17:41:37.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.568+0000 7f728b7fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 0x7f728c20b720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f72840049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284004350 con 0x7f728c20d340 2022-08-10T17:41:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7f72840044b0 con 0x7f728c20d340 2022-08-10T17:41:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 msgr2=0x7f728c20b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 0x7f728c20b720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f72840049c0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 msgr2=0x7f728c20b720 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:37.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.569+0000 7f72837fe700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c20d340 0x7f728c20b720 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7284007c40 tx=0x7f72840049c0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.574 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:37.575 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:37.575 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:37.575 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:41:37.575 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:37.576 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:37.576 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:37.576 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:37.576 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:37.577 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.577 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 4, 2022-08-10T17:41:37.577 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:37.577 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:37.578 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:37.578 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.578 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.578 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.579 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.579 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.580 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.580 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.580 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.581 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.581 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.581 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:37.582 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:37.582 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.582 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.583 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.583 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.583 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.583 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.583 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:37.585 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:37.585 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:37.585 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:37.585 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:37.586 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:37.586 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:37.586 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:37.586 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:37.587 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:37.587 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:37.587 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:37.587 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:37.587 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:37.588 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:37.588 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:37.588 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.588 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.588 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.589 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.589 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.589 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.589 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.590 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.590 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.590 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.590 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:37.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.591 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:37.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.591 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:37.591 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.594 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:37.594 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.594 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.595 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:37.595 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:37.596 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.596 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.596 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.597 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:37.598 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:37.598 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.598 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.599 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.599 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:37.599 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.600 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.600 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:37.601 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.601 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.602 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:37.602 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:37.602 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.603 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.603 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.603 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:37.604 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:37.604 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.604 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.604 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.605 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:37.605 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.606 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.606 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:37.606 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.606 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.607 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:37.607 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:37.607 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.610 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:37.610 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.610 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.610 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:41:37.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.611 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.611 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.611 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:37.612 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.612 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.612 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:37.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.612 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.613 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.613 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:41:37.613 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.613 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.614 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:37.614 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.570+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7264065100 msgr2=0x7f72640675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.570+0000 7f729141c700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7264065100 0x7f72640675b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f727c007fd0 tx=0x7f727c009040 comp rx=0 tx=0).stop 2022-08-10T17:41:37.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.570+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 msgr2=0x7f728c0885d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.570+0000 7f729141c700 1 --2- 172.21.15.150:0/2206434011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728c0c9620 0x7f728c0885d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7274000c00 tx=0x7f72740045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.570+0000 7f728b7fe700 1 -- 172.21.15.150:0/2206434011 reap_dead start 2022-08-10T17:41:37.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.575+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 shutdown_connections 2022-08-10T17:41:37.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.575+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 >> 172.21.15.150:0/2206434011 conn(0x7f728c06b500 msgr2=0x7f728c06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:37.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.577+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 shutdown_connections 2022-08-10T17:41:37.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.582+0000 7f729141c700 1 -- 172.21.15.150:0/2206434011 wait complete. 2022-08-10T17:41:37.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:41:37.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.854+0000 7f243362f700 1 Processor -- start 2022-08-10T17:41:37.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.854+0000 7f243362f700 1 -- start start 2022-08-10T17:41:37.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.855+0000 7f243362f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f242c0c26c0 0x7f242c070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.855+0000 7f243362f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c8990 0x7f242c0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.855+0000 7f243362f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c0c9990 con 0x7f242c0c3340 2022-08-10T17:41:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.855+0000 7f243362f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c15b830 con 0x7f242c0c26c0 2022-08-10T17:41:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.855+0000 7f243362f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15af60 con 0x7f242c0c8990 2022-08-10T17:41:37.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.860+0000 7f2430bca700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f242c0c3340 0x7f242c06dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:34648/0 (socket says 172.21.15.150:34648) 2022-08-10T17:41:37.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.860+0000 7f2430bca700 1 -- 172.21.15.150:0/1335717023 learned_addr learned my addr 172.21.15.150:0/1335717023 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:41:37.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.860+0000 7f24313cb700 1 --2- 172.21.15.150:0/1335717023 >> v2:172.21.15.197:3300/0 conn(0x7f242c0c26c0 0x7f242c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.862+0000 7f2431bcc700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c8990 0x7f242c0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.862+0000 7f24313cb700 1 -- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c8990 msgr2=0x7f242c0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:37.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.862+0000 7f24313cb700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c8990 0x7f242c0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.862+0000 7f24313cb700 1 -- 172.21.15.150:0/1335717023 >> v1:172.21.15.197:6789/0 conn(0x7f242c0c3340 legacy=0x7f242c06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:37.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.863+0000 7f24313cb700 1 -- 172.21.15.150:0/1335717023 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0c4e80 con 0x7f242c0c26c0 2022-08-10T17:41:37.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.863+0000 7f24313cb700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c26c0 0x7f242c070290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24280096b0 tx=0x7f24280099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1fe41e46f396b42 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.863+0000 7f2423fff700 1 -- 172.21.15.150:0/1335717023 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428004230 con 0x7f242c0c26c0 2022-08-10T17:41:37.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.863+0000 7f2423fff700 1 -- 172.21.15.150:0/1335717023 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2428004390 con 0x7f242c0c26c0 2022-08-10T17:41:37.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.864+0000 7f2423fff700 1 -- 172.21.15.150:0/1335717023 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428011850 con 0x7f242c0c26c0 2022-08-10T17:41:37.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.865+0000 7f243362f700 1 -- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c26c0 msgr2=0x7f242c070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.865+0000 7f243362f700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c26c0 0x7f242c070290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24280096b0 tx=0x7f24280099c0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.870+0000 7f243362f700 1 -- 172.21.15.150:0/1335717023 shutdown_connections 2022-08-10T17:41:37.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.870+0000 7f243362f700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c8990 0x7f242c0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.870+0000 7f243362f700 1 --2- 172.21.15.150:0/1335717023 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c26c0 0x7f242c070290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.870+0000 7f243362f700 1 -- 172.21.15.150:0/1335717023 >> 172.21.15.150:0/1335717023 conn(0x7f242c06b500 msgr2=0x7f242c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:37.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.871+0000 7f243362f700 1 -- 172.21.15.150:0/1335717023 shutdown_connections 2022-08-10T17:41:37.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.871+0000 7f243362f700 1 -- 172.21.15.150:0/1335717023 wait complete. 2022-08-10T17:41:37.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.873+0000 7f243362f700 1 Processor -- start 2022-08-10T17:41:37.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.873+0000 7f243362f700 1 -- start start 2022-08-10T17:41:37.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 0x7f242c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c3340 0x7f242c0894f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c8990 0x7f242c089a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15e2b0 con 0x7f242c0c26c0 2022-08-10T17:41:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0c12f0 con 0x7f242c0c8990 2022-08-10T17:41:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f243362f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0c0fa0 con 0x7f242c0c3340 2022-08-10T17:41:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f24313cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 0x7f242c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f24313cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 0x7f242c15cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35622/0 (socket says 172.21.15.150:35622) 2022-08-10T17:41:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.874+0000 7f24313cb700 1 -- 172.21.15.150:0/4180787959 learned_addr learned my addr 172.21.15.150:0/4180787959 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f2430bca700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c3340 0x7f242c0894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c3340 msgr2=0x7f242c0894f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f242c0c3340 0x7f242c0894f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c8990 msgr2=0x7f242c089a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c8990 0x7f242c089a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009310 con 0x7f242c0c26c0 2022-08-10T17:41:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f24313cb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 0x7f242c15cde0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f242c067060 tx=0x7f24280045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428011e80 con 0x7f242c0c26c0 2022-08-10T17:41:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242801e070 con 0x7f242c0c26c0 2022-08-10T17:41:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428003760 con 0x7f242c0c26c0 2022-08-10T17:41:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.875+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c0c0b70 con 0x7f242c0c26c0 2022-08-10T17:41:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.876+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c0c7af0 con 0x7f242c0c26c0 2022-08-10T17:41:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.877+0000 7f243362f700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 0x7f242c0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.877+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0673d0 con 0x7f242c15d320 2022-08-10T17:41:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.877+0000 7f2430bca700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 0x7f242c0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.878+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2428029020 con 0x7f242c0c26c0 2022-08-10T17:41:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.878+0000 7f2421ffb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2410065290 0x7f2410067740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.878+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2428083270 con 0x7f242c0c26c0 2022-08-10T17:41:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.879+0000 7f2430bca700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f242c0c10e0 con 0x7f242c15d320 2022-08-10T17:41:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.879+0000 7f2430bca700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 0x7f242c0c1610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f242c089270 tx=0x7f241c00e670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.880+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0070d0 con 0x7f242c15d320 2022-08-10T17:41:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f241c007230 con 0x7f242c15d320 2022-08-10T17:41:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 msgr2=0x7f242c0c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2421ffb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 0x7f242c0c1610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f242c089270 tx=0x7f241c00e670 comp rx=0 tx=0).stop 2022-08-10T17:41:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 msgr2=0x7f242c0c1610 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2421ffb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c15d320 0x7f242c0c1610 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f242c089270 tx=0x7f241c00e670 comp rx=0 tx=0).stop 2022-08-10T17:41:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.881+0000 7f2431bcc700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2410065290 0x7f2410067740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.886+0000 7f2431bcc700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2410065290 0x7f2410067740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24240070b0 tx=0x7f2424007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.908+0000 7f243362f700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 0x7f242c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:37.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.908+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0707d0 con 0x7f242c0c1b50 2022-08-10T17:41:37.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.909+0000 7f2430bca700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 0x7f242c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:37.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.910+0000 7f2430bca700 1 -- 172.21.15.150:0/4180787959 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f242c0c9990 con 0x7f242c0c1b50 2022-08-10T17:41:37.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.912+0000 7f2430bca700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 0x7f242c149470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f241c013000 tx=0x7f241c004850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:37.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c014680 con 0x7f242c0c1b50 2022-08-10T17:41:37.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4546 (secure 0 0 0) 0x7f241c022420 con 0x7f242c0c1b50 2022-08-10T17:41:37.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 msgr2=0x7f242c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 0x7f242c149470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f241c013000 tx=0x7f241c004850 comp rx=0 tx=0).stop 2022-08-10T17:41:37.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 msgr2=0x7f242c149470 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:37.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.913+0000 7f2421ffb700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f242c0c1b50 0x7f242c149470 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f241c013000 tx=0x7f241c004850 comp rx=0 tx=0).stop 2022-08-10T17:41:37.920 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:41:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 4, 2022-08-10T17:41:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.943 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:37.943 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:37.943 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.943 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.944 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.944 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:37.944 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:37.945 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.945 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.946 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:37.946 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.947 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.947 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:37.947 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.947 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.948 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:37.948 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:37.949 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.949 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.949 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.950 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:37.950 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:37.950 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:37.950 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:37.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:37.951 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:37.951 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.952 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:37.952 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:37.952 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:37.953 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:37.954 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:37.954 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:37.954 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:37.954 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.954 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.955 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:37.955 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:37.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.956 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.956 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.956 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:37.956 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.956 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.957 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:41:37.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.957 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.957 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.957 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:41:37.958 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.958 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:37.958 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:37.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:37.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:37.960 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:37.960 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:37.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.917+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2410065290 msgr2=0x7f2410067740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2410065290 0x7f2410067740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24240070b0 tx=0x7f2424007040 comp rx=0 tx=0).stop 2022-08-10T17:41:37.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 msgr2=0x7f242c15cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:37.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 --2- 172.21.15.150:0/4180787959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f242c0c26c0 0x7f242c15cde0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f242c067060 tx=0x7f24280045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:37.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f2431bcc700 1 -- 172.21.15.150:0/4180787959 reap_dead start 2022-08-10T17:41:37.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f2431bcc700 1 -- 172.21.15.150:0/4180787959 reap_dead start 2022-08-10T17:41:37.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 shutdown_connections 2022-08-10T17:41:37.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 >> 172.21.15.150:0/4180787959 conn(0x7f242c06b500 msgr2=0x7f242c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:37.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 shutdown_connections 2022-08-10T17:41:37.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:37.918+0000 7f243362f700 1 -- 172.21.15.150:0/4180787959 wait complete. 2022-08-10T17:41:37.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:41:38.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.295+0000 7fbe50391700 1 Processor -- start 2022-08-10T17:41:38.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.295+0000 7fbe50391700 1 -- start start 2022-08-10T17:41:38.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.296+0000 7fbe50391700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe480c3340 0x7fbe480c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.296+0000 7fbe50391700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a890 0x7fbe480c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.296+0000 7fbe50391700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe480c4180 con 0x7fbe4806a4c0 2022-08-10T17:41:38.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.296+0000 7fbe50391700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480c5110 con 0x7fbe480c3340 2022-08-10T17:41:38.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.296+0000 7fbe50391700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c37d0 con 0x7fbe4806a890 2022-08-10T17:41:38.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.298+0000 7fbe4d92c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe480c3340 0x7fbe480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.298+0000 7fbe4d92c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe480c3340 0x7fbe480c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35642/0 (socket says 172.21.15.150:35642) 2022-08-10T17:41:38.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.298+0000 7fbe4d92c700 1 -- 172.21.15.150:0/3592117729 learned_addr learned my addr 172.21.15.150:0/3592117729 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:38.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.299+0000 7fbe4d92c700 1 -- 172.21.15.150:0/3592117729 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a890 msgr2=0x7fbe480c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:38.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.299+0000 7fbe4d92c700 1 --2- 172.21.15.150:0/3592117729 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a890 0x7fbe480c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.299+0000 7fbe4d92c700 1 -- 172.21.15.150:0/3592117729 >> v1:172.21.15.150:6789/0 conn(0x7fbe4806a4c0 legacy=0x7fbe4815b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:38.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.299+0000 7fbe4d92c700 1 -- 172.21.15.150:0/3592117729 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48070280 con 0x7fbe480c3340 2022-08-10T17:41:38.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.299+0000 7fbe4d92c700 1 --2- 172.21.15.150:0/3592117729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480c3340 0x7fbe480c4bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c006fd0 tx=0x7fbe3c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04759b4b7c150f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.301+0000 7fbe4d12b700 1 -- 172.21.15.150:0/3592117729 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011830 con 0x7fbe480c3340 2022-08-10T17:41:38.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.301+0000 7fbe4d12b700 1 -- 172.21.15.150:0/3592117729 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c011990 con 0x7fbe480c3340 2022-08-10T17:41:38.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.301+0000 7fbe4d12b700 1 -- 172.21.15.150:0/3592117729 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011d20 con 0x7fbe480c3340 2022-08-10T17:41:38.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.301+0000 7fbe50391700 1 -- 172.21.15.150:0/3592117729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480c3340 msgr2=0x7fbe480c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.301+0000 7fbe50391700 1 --2- 172.21.15.150:0/3592117729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480c3340 0x7fbe480c4bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c006fd0 tx=0x7fbe3c009a60 comp rx=0 tx=0).stop 2022-08-10T17:41:38.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 -- 172.21.15.150:0/3592117729 shutdown_connections 2022-08-10T17:41:38.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 --2- 172.21.15.150:0/3592117729 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a890 0x7fbe480c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 --2- 172.21.15.150:0/3592117729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe480c3340 0x7fbe480c4bd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 -- 172.21.15.150:0/3592117729 >> 172.21.15.150:0/3592117729 conn(0x7fbe4806b500 msgr2=0x7fbe4806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:38.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 -- 172.21.15.150:0/3592117729 shutdown_connections 2022-08-10T17:41:38.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.302+0000 7fbe50391700 1 -- 172.21.15.150:0/3592117729 wait complete. 2022-08-10T17:41:38.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.304+0000 7fbe50391700 1 Processor -- start 2022-08-10T17:41:38.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.304+0000 7fbe50391700 1 -- start start 2022-08-10T17:41:38.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a4c0 0x7fbe481240e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 0x7fbe480c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe480c3340 0x7fbe48147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48123270 con 0x7fbe4806a890 2022-08-10T17:41:38.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c73c0 con 0x7fbe480c3340 2022-08-10T17:41:38.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.305+0000 7fbe50391700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c6810 con 0x7fbe4806a4c0 2022-08-10T17:41:38.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 0x7fbe480c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 0x7fbe480c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35648/0 (socket says 172.21.15.150:35648) 2022-08-10T17:41:38.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 -- 172.21.15.150:0/1593436551 learned_addr learned my addr 172.21.15.150:0/1593436551 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:38.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a4c0 msgr2=0x7fbe481240e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe4806a4c0 0x7fbe481240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe480c3340 msgr2=0x7fbe48147c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:38.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe480c3340 0x7fbe48147c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0093e0 con 0x7fbe4806a890 2022-08-10T17:41:38.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.306+0000 7fbe4d92c700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 0x7fbe480c77e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c014040 tx=0x7fbe3c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.307+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c003720 con 0x7fbe4806a890 2022-08-10T17:41:38.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.307+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c003880 con 0x7fbe4806a890 2022-08-10T17:41:38.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.307+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c003c10 con 0x7fbe4806a890 2022-08-10T17:41:38.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.308+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4806c120 con 0x7fbe4806a890 2022-08-10T17:41:38.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.308+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480c6a20 con 0x7fbe4806a890 2022-08-10T17:41:38.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.309+0000 7fbe50391700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 0x7fbe480c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.309+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480673d0 con 0x7fbe480c1980 2022-08-10T17:41:38.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.309+0000 7fbe4e12d700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 0x7fbe480c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.310+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fbe3c00f050 con 0x7fbe4806a890 2022-08-10T17:41:38.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.310+0000 7fbe3affd700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe280650b0 0x7fbe28067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.310+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fbe3c083500 con 0x7fbe4806a890 2022-08-10T17:41:38.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.310+0000 7fbe4e92e700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe280650b0 0x7fbe28067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.311+0000 7fbe4e12d700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe48146070 con 0x7fbe480c1980 2022-08-10T17:41:38.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.311+0000 7fbe4e92e700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe280650b0 0x7fbe28067560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe4806ac80 tx=0x7fbe44006b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe4e12d700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 0x7fbe480c6c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000bd30 tx=0x7fbe40009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000cb90 con 0x7fbe480c1980 2022-08-10T17:41:38.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fbe4000ccf0 con 0x7fbe480c1980 2022-08-10T17:41:38.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 msgr2=0x7fbe480c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 0x7fbe480c6c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000bd30 tx=0x7fbe40009ed0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 msgr2=0x7fbe480c6c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:38.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.313+0000 7fbe3affd700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe480c1980 0x7fbe480c6c40 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000bd30 tx=0x7fbe40009ed0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.354+0000 7fbe50391700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 0x7fbe48148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.354+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c7180 con 0x7fbe48148920 2022-08-10T17:41:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.355+0000 7fbe4e12d700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 0x7fbe48148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.356+0000 7fbe4e12d700 1 -- 172.21.15.150:0/1593436551 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbe48072890 con 0x7fbe48148920 2022-08-10T17:41:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.357+0000 7fbe4e12d700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 0x7fbe48148d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000bd30 tx=0x7fbe40004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.357+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40012a60 con 0x7fbe48148920 2022-08-10T17:41:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.359+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7fbe40012bc0 con 0x7fbe48148920 2022-08-10T17:41:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.359+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 msgr2=0x7fbe48148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.359+0000 7fbe3affd700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 0x7fbe48148d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000bd30 tx=0x7fbe40004a00 comp rx=0 tx=0).stop 2022-08-10T17:41:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.359+0000 7fbe3affd700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 msgr2=0x7fbe48148d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.359+0000 7fbe3affd700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe48148920 0x7fbe48148d20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.373 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:41:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 5, 2022-08-10T17:41:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:41:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:41:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:41:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:41:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:41:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:41:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:41:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:41:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:38.418 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:38.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe280650b0 msgr2=0x7fbe28067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe50391700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe280650b0 0x7fbe28067560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe4806ac80 tx=0x7fbe44006b30 comp rx=0 tx=0).stop 2022-08-10T17:41:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 msgr2=0x7fbe480c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe50391700 1 --2- 172.21.15.150:0/1593436551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe4806a890 0x7fbe480c77e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c014040 tx=0x7fbe3c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe4e92e700 1 -- 172.21.15.150:0/1593436551 reap_dead start 2022-08-10T17:41:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.371+0000 7fbe4e92e700 1 -- 172.21.15.150:0/1593436551 reap_dead start 2022-08-10T17:41:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.377+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 shutdown_connections 2022-08-10T17:41:38.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.377+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 >> 172.21.15.150:0/1593436551 conn(0x7fbe4806b500 msgr2=0x7fbe4815a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:38.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.378+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 shutdown_connections 2022-08-10T17:41:38.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.378+0000 7fbe50391700 1 -- 172.21.15.150:0/1593436551 wait complete. 2022-08-10T17:41:38.426 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:41:38.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:41:38.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.886+0000 7f0b58307700 1 Processor -- start 2022-08-10T17:41:38.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.887+0000 7f0b58307700 1 -- start start 2022-08-10T17:41:38.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.888+0000 7f0b58307700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0b50070290 0x7f0b5006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.889+0000 7f0b58307700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b500c8990 0x7f0b500c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.889+0000 7f0b58307700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b500c9990 con 0x7f0b500c26c0 2022-08-10T17:41:38.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.889+0000 7f0b58307700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015b830 con 0x7f0b500c8990 2022-08-10T17:41:38.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.889+0000 7f0b58307700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015af60 con 0x7f0b50070290 2022-08-10T17:41:38.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.892+0000 7f0b558a2700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0b50070290 0x7f0b5006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.893+0000 7f0b568a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b500c8990 0x7f0b500c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.893+0000 7f0b568a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b500c8990 0x7f0b500c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35672/0 (socket says 172.21.15.150:35672) 2022-08-10T17:41:38.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.893+0000 7f0b568a4700 1 -- 172.21.15.150:0/571895702 learned_addr learned my addr 172.21.15.150:0/571895702 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:38.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.895+0000 7f0b568a4700 1 -- 172.21.15.150:0/571895702 >> v2:172.21.15.197:3300/0 conn(0x7f0b50070290 msgr2=0x7f0b5006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:38.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.895+0000 7f0b568a4700 1 --2- 172.21.15.150:0/571895702 >> v2:172.21.15.197:3300/0 conn(0x7f0b50070290 0x7f0b5006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.895+0000 7f0b568a4700 1 -- 172.21.15.150:0/571895702 >> v1:172.21.15.197:6789/0 conn(0x7f0b500c26c0 legacy=0x7f0b500c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.895+0000 7f0b568a4700 1 -- 172.21.15.150:0/571895702 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500706f0 con 0x7f0b500c8990 2022-08-10T17:41:38.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.895+0000 7f0b568a4700 1 --2- 172.21.15.150:0/571895702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c8dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b50125fc0 tx=0x7f0b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3350e1673a7ffe server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.928+0000 7f0b550a1700 1 -- 172.21.15.150:0/571895702 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800e070 con 0x7f0b500c8990 2022-08-10T17:41:38.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.928+0000 7f0b550a1700 1 -- 172.21.15.150:0/571895702 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4800b910 con 0x7f0b500c8990 2022-08-10T17:41:38.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.928+0000 7f0b550a1700 1 -- 172.21.15.150:0/571895702 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800bcc0 con 0x7f0b500c8990 2022-08-10T17:41:38.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.929+0000 7f0b58307700 1 -- 172.21.15.150:0/571895702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 msgr2=0x7f0b500c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.929+0000 7f0b58307700 1 --2- 172.21.15.150:0/571895702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c8dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b50125fc0 tx=0x7f0b4800b330 comp rx=0 tx=0).stop 2022-08-10T17:41:38.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.937+0000 7f0b58307700 1 -- 172.21.15.150:0/571895702 shutdown_connections 2022-08-10T17:41:38.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.937+0000 7f0b58307700 1 --2- 172.21.15.150:0/571895702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c8dd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.937+0000 7f0b58307700 1 --2- 172.21.15.150:0/571895702 >> v2:172.21.15.197:3300/0 conn(0x7f0b50070290 0x7f0b5006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.937+0000 7f0b58307700 1 -- 172.21.15.150:0/571895702 >> 172.21.15.150:0/571895702 conn(0x7f0b5006b500 msgr2=0x7f0b5006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:38.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.942+0000 7f0b58307700 1 -- 172.21.15.150:0/571895702 shutdown_connections 2022-08-10T17:41:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.942+0000 7f0b58307700 1 -- 172.21.15.150:0/571895702 wait complete. 2022-08-10T17:41:38.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.943+0000 7f0b58307700 1 Processor -- start 2022-08-10T17:41:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.944+0000 7f0b58307700 1 -- start start 2022-08-10T17:41:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0b50070290 0x7f0b5015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0b500c26c0 0x7f0b50175e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50122f70 con 0x7f0b500c8990 2022-08-10T17:41:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50176cd0 con 0x7f0b500c26c0 2022-08-10T17:41:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b58307700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50176710 con 0x7f0b50070290 2022-08-10T17:41:38.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b568a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b568a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35678/0 (socket says 172.21.15.150:35678) 2022-08-10T17:41:38.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.945+0000 7f0b568a4700 1 -- 172.21.15.150:0/1418314312 learned_addr learned my addr 172.21.15.150:0/1418314312 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:38.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b558a2700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0b500c26c0 0x7f0b50175e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b568a4700 1 -- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0b50070290 msgr2=0x7f0b5015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b568a4700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0b50070290 0x7f0b5015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b568a4700 1 -- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0b500c26c0 msgr2=0x7f0b50175e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:38.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b568a4700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0b500c26c0 0x7f0b50175e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:38.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.946+0000 7f0b568a4700 1 -- 172.21.15.150:0/1418314312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48009b30 con 0x7f0b500c8990 2022-08-10T17:41:38.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.947+0000 7f0b568a4700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800b370 tx=0x7f0b48004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.953+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48004450 con 0x7f0b500c8990 2022-08-10T17:41:38.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.953+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b480045b0 con 0x7f0b500c8990 2022-08-10T17:41:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.953+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480092e0 con 0x7f0b500c8990 2022-08-10T17:41:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.953+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b501769f0 con 0x7f0b500c8990 2022-08-10T17:41:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.953+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5015e2b0 con 0x7f0b500c8990 2022-08-10T17:41:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.957+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0b48022030 con 0x7f0b500c8990 2022-08-10T17:41:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.957+0000 7f0b46ffd700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 0x7f0b34067790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.957+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0b48083a00 con 0x7f0b500c8990 2022-08-10T17:41:38.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.958+0000 7f0b560a3700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 0x7f0b34067790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:38.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.959+0000 7f0b560a3700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 0x7f0b34067790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007fd0 tx=0x7f0b4c0078c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:38.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.959+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c005170 con 0x7f0b500c8990 2022-08-10T17:41:38.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:38.969+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0b48051970 con 0x7f0b500c8990 2022-08-10T17:41:39.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:41:39.141 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:41:39.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.468+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0b2c005c30 con 0x7f0b500c8990 2022-08-10T17:41:39.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.471+0000 7f0b46ffd700 1 -- 172.21.15.150:0/1418314312 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f0b48054f90 con 0x7f0b500c8990 2022-08-10T17:41:39.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 msgr2=0x7f0b34067790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:39.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 0x7f0b34067790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007fd0 tx=0x7f0b4c0078c0 comp rx=0 tx=0).stop 2022-08-10T17:41:39.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 msgr2=0x7f0b500c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:39.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800b370 tx=0x7f0b48004950 comp rx=0 tx=0).stop 2022-08-10T17:41:39.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 shutdown_connections 2022-08-10T17:41:39.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b500c8990 0x7f0b500c11d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:39.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0b340652e0 0x7f0b34067790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:39.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0b50070290 0x7f0b5015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:39.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 --2- 172.21.15.150:0/1418314312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0b500c26c0 0x7f0b50175e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:39.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.475+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 >> 172.21.15.150:0/1418314312 conn(0x7f0b5006b500 msgr2=0x7f0b500c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:39.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.476+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 shutdown_connections 2022-08-10T17:41:39.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:39.476+0000 7f0b58307700 1 -- 172.21.15.150:0/1418314312 wait complete. 2022-08-10T17:41:39.502 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:41:49.502 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:41:49.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:41:50.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.036+0000 7efea0b2e700 1 Processor -- start 2022-08-10T17:41:50.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.036+0000 7efea0b2e700 1 -- start start 2022-08-10T17:41:50.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.037+0000 7efea0b2e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efe9c0c9640 0x7efe9c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.037+0000 7efea0b2e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 0x7efe9c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.037+0000 7efea0b2e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c158720 con 0x7efe9c14e7c0 2022-08-10T17:41:50.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.037+0000 7efea0b2e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c157b50 con 0x7efe9c0c9640 2022-08-10T17:41:50.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.037+0000 7efea0b2e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c155430 con 0x7efe9c068d60 2022-08-10T17:41:50.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 0x7efe9c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:50.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 0x7efe9c070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:50154/0 (socket says 172.21.15.150:50154) 2022-08-10T17:41:50.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe9ad9d700 1 -- 172.21.15.150:0/3127418004 learned_addr learned my addr 172.21.15.150:0/3127418004 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:50.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe93fff700 1 --2- 172.21.15.150:0/3127418004 >> v2:172.21.15.197:3300/0 conn(0x7efe9c0c9640 0x7efe9c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:50.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe93fff700 1 -- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 msgr2=0x7efe9c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:50.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe93fff700 1 --2- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 0x7efe9c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.038+0000 7efe93fff700 1 -- 172.21.15.150:0/3127418004 >> v1:172.21.15.197:6789/0 conn(0x7efe9c14e7c0 legacy=0x7efe9c0c3940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:50.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.039+0000 7efe93fff700 1 -- 172.21.15.150:0/3127418004 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c157df0 con 0x7efe9c0c9640 2022-08-10T17:41:50.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.039+0000 7efe93fff700 1 --2- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c0c9640 0x7efe9c06fb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe840096b0 tx=0x7efe840099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a288e7a90a3a475 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:50.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.040+0000 7efe99d9b700 1 -- 172.21.15.150:0/3127418004 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84004230 con 0x7efe9c0c9640 2022-08-10T17:41:50.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.040+0000 7efe99d9b700 1 -- 172.21.15.150:0/3127418004 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84004390 con 0x7efe9c0c9640 2022-08-10T17:41:50.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.040+0000 7efe99d9b700 1 -- 172.21.15.150:0/3127418004 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011870 con 0x7efe9c0c9640 2022-08-10T17:41:50.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.041+0000 7efea0b2e700 1 -- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c0c9640 msgr2=0x7efe9c06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:50.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.041+0000 7efea0b2e700 1 --2- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c0c9640 0x7efe9c06fb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe840096b0 tx=0x7efe840099c0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 -- 172.21.15.150:0/3127418004 shutdown_connections 2022-08-10T17:41:50.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 --2- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c068d60 0x7efe9c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 --2- 172.21.15.150:0/3127418004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c0c9640 0x7efe9c06fb40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 -- 172.21.15.150:0/3127418004 >> 172.21.15.150:0/3127418004 conn(0x7efe9c0c8a10 msgr2=0x7efe9c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:50.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 -- 172.21.15.150:0/3127418004 shutdown_connections 2022-08-10T17:41:50.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.042+0000 7efea0b2e700 1 -- 172.21.15.150:0/3127418004 wait complete. 2022-08-10T17:41:50.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.044+0000 7efea0b2e700 1 Processor -- start 2022-08-10T17:41:50.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.044+0000 7efea0b2e700 1 -- start start 2022-08-10T17:41:50.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c068d60 0x7efe9c1ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c0c9640 0x7efe9c1dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c1ecae0 con 0x7efe9c14e7c0 2022-08-10T17:41:50.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0b64d0 con 0x7efe9c068d60 2022-08-10T17:41:50.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efea0b2e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0b5f10 con 0x7efe9c0c9640 2022-08-10T17:41:50.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:50.054 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35940/0 (socket says 172.21.15.150:35940) 2022-08-10T17:41:50.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efe9ad9d700 1 -- 172.21.15.150:0/37228319 learned_addr learned my addr 172.21.15.150:0/37228319 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:50.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.045+0000 7efe93fff700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c0c9640 0x7efe9c1dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:50.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 -- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c0c9640 msgr2=0x7efe9c1dd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:50.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c0c9640 0x7efe9c1dd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 -- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c068d60 msgr2=0x7efe9c1ecf00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:50.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c068d60 0x7efe9c1ecf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 -- 172.21.15.150:0/37228319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84009310 con 0x7efe9c14e7c0 2022-08-10T17:41:50.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.046+0000 7efe9ad9d700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe94009fd0 tx=0x7efe94007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:50.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.047+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94003d70 con 0x7efe9c14e7c0 2022-08-10T17:41:50.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.047+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400f040 con 0x7efe9c14e7c0 2022-08-10T17:41:50.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.047+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94004270 con 0x7efe9c14e7c0 2022-08-10T17:41:50.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.047+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c0b61f0 con 0x7efe9c14e7c0 2022-08-10T17:41:50.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.047+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c1ec700 con 0x7efe9c14e7c0 2022-08-10T17:41:50.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.049+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efe9401a030 con 0x7efe9c14e7c0 2022-08-10T17:41:50.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.049+0000 7efe92ffd700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 0x7efe80067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:50.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.049+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efe94081960 con 0x7efe9c14e7c0 2022-08-10T17:41:50.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.050+0000 7efe9a59c700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 0x7efe80067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:50.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.050+0000 7efe9a59c700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 0x7efe80067590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009610 tx=0x7efe8c006ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:50.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.052+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe74005170 con 0x7efe9c14e7c0 2022-08-10T17:41:50.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.061+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7efe94018080 con 0x7efe9c14e7c0 2022-08-10T17:41:50.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.685+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efe740059a0 con 0x7efe9c14e7c0 2022-08-10T17:41:50.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.689+0000 7efe92ffd700 1 -- 172.21.15.150:0/37228319 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7efe9404f940 con 0x7efe9c14e7c0 2022-08-10T17:41:50.699 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:41:50.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.696+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 msgr2=0x7efe80067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:50.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.696+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 0x7efe80067590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009610 tx=0x7efe8c006ae0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.696+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 msgr2=0x7efe9c1f0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:50.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.696+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe94009fd0 tx=0x7efe94007db0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 shutdown_connections 2022-08-10T17:41:50.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe9c14e7c0 0x7efe9c1f0200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe9c068d60 0x7efe9c1ecf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe800650e0 0x7efe80067590 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 --2- 172.21.15.150:0/37228319 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe9c0c9640 0x7efe9c1dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:50.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.697+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 >> 172.21.15.150:0/37228319 conn(0x7efe9c0c8a10 msgr2=0x7efe9c0bed20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:50.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.698+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 shutdown_connections 2022-08-10T17:41:50.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:50.698+0000 7efea0b2e700 1 -- 172.21.15.150:0/37228319 wait complete. 2022-08-10T17:41:50.725 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:41:50.726 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:41:50.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:41:51.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.167+0000 7f72bf7a0700 1 Processor -- start 2022-08-10T17:41:51.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.167+0000 7f72bf7a0700 1 -- start start 2022-08-10T17:41:51.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.168+0000 7f72bf7a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72b8155450 0x7f72b8070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.168+0000 7f72bf7a0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72b80691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.168+0000 7f72bf7a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b815afd0 con 0x7f72b8155080 2022-08-10T17:41:51.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.168+0000 7f72bf7a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b8070690 con 0x7f72b8155450 2022-08-10T17:41:51.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.168+0000 7f72bf7a0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815bea0 con 0x7f72b80cd5b0 2022-08-10T17:41:51.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.170+0000 7f72bdd3d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72b80691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.170+0000 7f72bdd3d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72b80691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:50176/0 (socket says 172.21.15.150:50176) 2022-08-10T17:41:51.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.170+0000 7f72bdd3d700 1 -- 172.21.15.150:0/415160820 learned_addr learned my addr 172.21.15.150:0/415160820 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:51.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888641526 0 0) 0x7f72b815afd0 con 0x7f72b8155080 2022-08-10T17:41:51.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003430 con 0x7f72b8155080 2022-08-10T17:41:51.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 564283714 0 0) 0x7f72a0003430 con 0x7f72b8155080 2022-08-10T17:41:51.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 msgr2=0x7f72b80691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:51.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72b80691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 >> v2:172.21.15.150:3300/0 conn(0x7f72b8155450 msgr2=0x7f72b8070150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:51.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 --2- 172.21.15.150:0/415160820 >> v2:172.21.15.150:3300/0 conn(0x7f72b8155450 0x7f72b8070150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80b2e80 con 0x7f72b8155080 2022-08-10T17:41:51.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.173+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f72b4001670 con 0x7f72b8155080 2022-08-10T17:41:51.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 >> v1:172.21.15.150:6789/0 conn(0x7f72b8155080 legacy=0x7f72b815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72a00038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72a0003df0 0x7f72a00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72a0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8070690 con 0x7f72a0004c10 2022-08-10T17:41:51.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815bea0 con 0x7f72a0003df0 2022-08-10T17:41:51.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a000ba50 con 0x7f72b80cd5b0 2022-08-10T17:41:51.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.174+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72a0005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 -- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 msgr2=0x7f72a00038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:51.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80cd5b0 0x7f72a00038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 -- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72a0003df0 msgr2=0x7f72a00046d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:51.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72a0003df0 0x7f72a00046d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 -- 172.21.15.150:0/415160820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0003430 con 0x7f72a0004c10 2022-08-10T17:41:51.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72a0005080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72b80cd9f0 tx=0x7f72a0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e557ab34a7f7180f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ea50 con 0x7f72a0004c10 2022-08-10T17:41:51.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b000f040 con 0x7f72a0004c10 2022-08-10T17:41:51.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.175+0000 7f72a7fff700 1 -- 172.21.15.150:0/415160820 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000edd0 con 0x7f72a0004c10 2022-08-10T17:41:51.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.176+0000 7f72bf7a0700 1 -- 172.21.15.150:0/415160820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 msgr2=0x7f72a0005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.176+0000 7f72bf7a0700 1 --2- 172.21.15.150:0/415160820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72a0005080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72b80cd9f0 tx=0x7f72a0005700 comp rx=0 tx=0).stop 2022-08-10T17:41:51.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.176+0000 7f72bdd3d700 1 -- 172.21.15.150:0/415160820 reap_dead start 2022-08-10T17:41:51.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.184+0000 7f72bf7a0700 1 -- 172.21.15.150:0/415160820 shutdown_connections 2022-08-10T17:41:51.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.184+0000 7f72bf7a0700 1 -- 172.21.15.150:0/415160820 >> 172.21.15.150:0/415160820 conn(0x7f72b8071e40 msgr2=0x7f72b80cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:51.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.201+0000 7f72bf7a0700 1 -- 172.21.15.150:0/415160820 shutdown_connections 2022-08-10T17:41:51.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.202+0000 7f72bf7a0700 1 -- 172.21.15.150:0/415160820 wait complete. 2022-08-10T17:41:51.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.203+0000 7f72bf7a0700 1 Processor -- start 2022-08-10T17:41:51.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.205+0000 7f72bf7a0700 1 -- start start 2022-08-10T17:41:51.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72b80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80c6d20 0x7f72b80c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72b80c5750 0x7f72b80c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8154160 con 0x7f72a0004c10 2022-08-10T17:41:51.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815a940 con 0x7f72b80c5750 2022-08-10T17:41:51.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.206+0000 7f72bf7a0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8158990 con 0x7f72b80c6d20 2022-08-10T17:41:51.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bd53c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72b80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bd53c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72b80c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35966/0 (socket says 172.21.15.150:35966) 2022-08-10T17:41:51.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bd53c700 1 -- 172.21.15.150:0/3013454013 learned_addr learned my addr 172.21.15.150:0/3013454013 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:51.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80c6d20 0x7f72b80c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72b80c5750 msgr2=0x7f72b80c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72b80c5750 0x7f72b80c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 msgr2=0x7f72b80c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a0004c10 0x7f72b80c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.207+0000 7f72bcd3b700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b815ab70 con 0x7f72b80c6d20 2022-08-10T17:41:51.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.216+0000 7f72bcd3b700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80c6d20 0x7f72b80c28b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009260 tx=0x7f72a8009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.220+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8011620 con 0x7f72b80c6d20 2022-08-10T17:41:51.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.220+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8011780 con 0x7f72b80c6d20 2022-08-10T17:41:51.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.220+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8011b30 con 0x7f72b80c6d20 2022-08-10T17:41:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.220+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b80c3440 con 0x7f72b80c6d20 2022-08-10T17:41:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.220+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b8153c40 con 0x7f72b80c6d20 2022-08-10T17:41:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.242+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f72a800f050 con 0x7f72b80c6d20 2022-08-10T17:41:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.242+0000 7f72bf7a0700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 0x7f72b8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.242+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80673d0 con 0x7f72b8155fc0 2022-08-10T17:41:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.244+0000 7f72a5ffb700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7298065180 0x7f7298067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.244+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f72a8081c00 con 0x7f72b80c6d20 2022-08-10T17:41:51.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.246+0000 7f72bd53c700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 0x7f72b8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.247+0000 7f72bd53c700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b8072890 con 0x7f72b8155fc0 2022-08-10T17:41:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.247+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7298065180 0x7f7298067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.251+0000 7f72bd53c700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 0x7f72b8156390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4005480 con 0x7f72b8155fc0 2022-08-10T17:41:51.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f72b40067a0 con 0x7f72b8155fc0 2022-08-10T17:41:51.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 msgr2=0x7f72b8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 0x7f72b8156390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b400fea0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 msgr2=0x7f72b8156390 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.254+0000 7f72a5ffb700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b8155fc0 0x7f72b8156390 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b400fea0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.260+0000 7f72bdd3d700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7298065180 0x7f7298067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72b80b3200 tx=0x7f72b0022000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.278+0000 7f72bf7a0700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 0x7f72b8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.278+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815ad00 con 0x7f72b81568d0 2022-08-10T17:41:51.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.278+0000 7f72bd53c700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 0x7f72b8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.279+0000 7f72bd53c700 1 -- 172.21.15.150:0/3013454013 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72b815e9d0 con 0x7f72b81568d0 2022-08-10T17:41:51.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.279+0000 7f72bd53c700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 0x7f72b8151f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.279+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4003800 con 0x7f72b81568d0 2022-08-10T17:41:51.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.287+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4549 (secure 0 0 0) 0x7f72b4003960 con 0x7f72b81568d0 2022-08-10T17:41:51.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.287+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 msgr2=0x7f72b8151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.287+0000 7f72a5ffb700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 0x7f72b8151f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b4000f50 comp rx=0 tx=0).stop 2022-08-10T17:41:51.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.287+0000 7f72a5ffb700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 msgr2=0x7f72b8151f90 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:51.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.287+0000 7f72a5ffb700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b81568d0 0x7f72b8151f90 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72b400fae0 tx=0x7f72b4000f50 comp rx=0 tx=0).stop 2022-08-10T17:41:51.309 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:41:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 18, 2022-08-10T17:41:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:51.322 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.322 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.322 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.322 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.323 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.323 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.323 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.323 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.323 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.324 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.324 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:51.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.324 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:51.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.325 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:51.325 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:51.325 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.325 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.326 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.326 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:51.326 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.327 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.327 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:51.328 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.328 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.328 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.328 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:51.329 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:51.329 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.329 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.329 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.330 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:51.330 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:51.330 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.331 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.331 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.331 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:51.332 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.332 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.332 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:51.333 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.333 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.333 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.334 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:51.334 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:51.334 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.334 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.334 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.335 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:51.335 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:51.336 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.336 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.336 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.336 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:51.337 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.337 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.338 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:51.338 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.338 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.338 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.339 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.340 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.340 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.340 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.340 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:51.341 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:51.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.341 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.341 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.342 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.342 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.342 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.342 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:41:51.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.343 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.343 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.343 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.343 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.344 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.344 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:51.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.344 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.345 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.345 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.345 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.345 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.346 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:51.346 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:51.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7298065180 msgr2=0x7f7298067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bf7a0700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7298065180 0x7f7298067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72b80b3200 tx=0x7f72b0022000 comp rx=0 tx=0).stop 2022-08-10T17:41:51.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80c6d20 msgr2=0x7f72b80c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bf7a0700 1 --2- 172.21.15.150:0/3013454013 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72b80c6d20 0x7f72b80c28b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009260 tx=0x7f72a8009570 comp rx=0 tx=0).stop 2022-08-10T17:41:51.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bdd3d700 1 -- 172.21.15.150:0/3013454013 reap_dead start 2022-08-10T17:41:51.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.347+0000 7f72bdd3d700 1 -- 172.21.15.150:0/3013454013 reap_dead start 2022-08-10T17:41:51.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.348+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 shutdown_connections 2022-08-10T17:41:51.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.348+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 >> 172.21.15.150:0/3013454013 conn(0x7f72b8071e40 msgr2=0x7f72b80691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:51.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.348+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 shutdown_connections 2022-08-10T17:41:51.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.348+0000 7f72bf7a0700 1 -- 172.21.15.150:0/3013454013 wait complete. 2022-08-10T17:41:51.402 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:41:51.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.765+0000 7f3178850700 1 Processor -- start 2022-08-10T17:41:51.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.765+0000 7f3178850700 1 -- start start 2022-08-10T17:41:51.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f31740c26c0 0x7f3174070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c3340 0x7f317406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31740c8990 0x7f31740c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31740c9990 con 0x7f31740c8990 2022-08-10T17:41:51.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317415b830 con 0x7f31740c26c0 2022-08-10T17:41:51.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f3178850700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317415af60 con 0x7f31740c3340 2022-08-10T17:41:51.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f31740c26c0 0x7f3174070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f31740c26c0 0x7f3174070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:46578/0 (socket says 172.21.15.150:46578) 2022-08-10T17:41:51.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 -- 172.21.15.150:0/3245710687 learned_addr learned my addr 172.21.15.150:0/3245710687 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:51.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 -- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c3340 msgr2=0x7f317406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:51.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 --2- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c3340 0x7f317406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 -- 172.21.15.150:0/3245710687 >> v2:172.21.15.150:3300/0 conn(0x7f31740c8990 msgr2=0x7f31740c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:51.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 --2- 172.21.15.150:0/3245710687 >> v2:172.21.15.150:3300/0 conn(0x7f31740c8990 0x7f31740c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.767+0000 7f317259c700 1 -- 172.21.15.150:0/3245710687 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740c4e80 con 0x7f31740c26c0 2022-08-10T17:41:51.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.777+0000 7f317259c700 1 --2- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c26c0 0x7f3174070290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f3164009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29709b569a37358 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.783+0000 7f317159a700 1 -- 172.21.15.150:0/3245710687 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164004230 con 0x7f31740c26c0 2022-08-10T17:41:51.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.783+0000 7f317159a700 1 -- 172.21.15.150:0/3245710687 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164004390 con 0x7f31740c26c0 2022-08-10T17:41:51.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.783+0000 7f317159a700 1 -- 172.21.15.150:0/3245710687 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164011830 con 0x7f31740c26c0 2022-08-10T17:41:51.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.784+0000 7f3178850700 1 -- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c26c0 msgr2=0x7f3174070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.784+0000 7f3178850700 1 --2- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c26c0 0x7f3174070290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f3164009a60 comp rx=0 tx=0).stop 2022-08-10T17:41:51.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.785+0000 7f3178850700 1 -- 172.21.15.150:0/3245710687 shutdown_connections 2022-08-10T17:41:51.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.785+0000 7f3178850700 1 --2- 172.21.15.150:0/3245710687 >> v2:172.21.15.150:3300/0 conn(0x7f31740c8990 0x7f31740c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.785+0000 7f3178850700 1 --2- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c26c0 0x7f3174070290 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f3164009a60 comp rx=0 tx=0).stop 2022-08-10T17:41:51.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.785+0000 7f3178850700 1 --2- 172.21.15.150:0/3245710687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c3340 0x7f317406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.785+0000 7f3178850700 1 -- 172.21.15.150:0/3245710687 >> 172.21.15.150:0/3245710687 conn(0x7f317406b500 msgr2=0x7f317406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:51.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.787+0000 7f3178850700 1 -- 172.21.15.150:0/3245710687 shutdown_connections 2022-08-10T17:41:51.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.787+0000 7f3178850700 1 -- 172.21.15.150:0/3245710687 wait complete. 2022-08-10T17:41:51.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.789+0000 7f3178850700 1 Processor -- start 2022-08-10T17:41:51.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.790+0000 7f3178850700 1 -- start start 2022-08-10T17:41:51.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c3340 0x7f31741447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c8990 0x7f317415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 0x7f3174146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317413ec80 con 0x7f31740bf720 2022-08-10T17:41:51.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174143130 con 0x7f31740c3340 2022-08-10T17:41:51.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.791+0000 7f3178850700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31741433f0 con 0x7f31740c8990 2022-08-10T17:41:51.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c8990 0x7f317415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3172d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 0x7f3174146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3172d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 0x7f3174146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35994/0 (socket says 172.21.15.150:35994) 2022-08-10T17:41:51.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3172d9d700 1 -- 172.21.15.150:0/146926135 learned_addr learned my addr 172.21.15.150:0/146926135 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:51.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c3340 msgr2=0x7f31741447a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:51.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31740c3340 0x7f31741447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 msgr2=0x7f3174146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 0x7f3174146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3171d9b700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640093e0 con 0x7f31740c8990 2022-08-10T17:41:51.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.793+0000 7f3172d9d700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31740bf720 0x7f3174146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:41:51.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.794+0000 7f3171d9b700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c8990 0x7f317415ef10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f316800b3e0 tx=0x7f316800b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.800+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168011830 con 0x7f31740c8990 2022-08-10T17:41:51.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.801+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168011990 con 0x7f31740c8990 2022-08-10T17:41:51.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.801+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168011d20 con 0x7f31740c8990 2022-08-10T17:41:51.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.802+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31741439e0 con 0x7f31740c8990 2022-08-10T17:41:51.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.802+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3174143fa0 con 0x7f31740c8990 2022-08-10T17:41:51.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.804+0000 7f3178850700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 0x7f317414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.804+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31740673d0 con 0x7f3174144190 2022-08-10T17:41:51.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.804+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3168021070 con 0x7f31740c8990 2022-08-10T17:41:51.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.805+0000 7f3162ffd700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31580650e0 0x7f3158067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.805+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3168081f40 con 0x7f31740c8990 2022-08-10T17:41:51.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.806+0000 7f317259c700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 0x7f317414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.811+0000 7f3172d9d700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31580650e0 0x7f3158067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.812+0000 7f3172d9d700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31580650e0 0x7f3158067590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c4b0 tx=0x7f316c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.812+0000 7f317259c700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3174072890 con 0x7f3174144190 2022-08-10T17:41:51.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.812+0000 7f317259c700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 0x7f317414a400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f31640045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164011e50 con 0x7f3174144190 2022-08-10T17:41:51.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f316401f070 con 0x7f3174144190 2022-08-10T17:41:51.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 msgr2=0x7f317414a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 0x7f317414a400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f31640045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 msgr2=0x7f317414a400 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:51.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.815+0000 7f3162ffd700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3174144190 0x7f317414a400 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31740c6580 tx=0x7f31640045d0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.856+0000 7f3178850700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 0x7f317414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:51.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.856+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174143b70 con 0x7f317414a940 2022-08-10T17:41:51.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.858+0000 7f317259c700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 0x7f317414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.858+0000 7f317259c700 1 -- 172.21.15.150:0/146926135 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f317414b280 con 0x7f317414a940 2022-08-10T17:41:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.858+0000 7f317259c700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 0x7f317414ad40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3174071160 tx=0x7f3164009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316402e070 con 0x7f317414a940 2022-08-10T17:41:51.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4717 (secure 0 0 0) 0x7f3164026680 con 0x7f317414a940 2022-08-10T17:41:51.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 msgr2=0x7f317414ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 0x7f317414ad40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3174071160 tx=0x7f3164009190 comp rx=0 tx=0).stop 2022-08-10T17:41:51.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 msgr2=0x7f317414ad40 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:51.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.859+0000 7f3162ffd700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f317414a940 0x7f317414ad40 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3174071160 tx=0x7f3164009190 comp rx=0 tx=0).stop 2022-08-10T17:41:51.870 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:51.871 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:51.871 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:51.871 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:41:51.871 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:51.872 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:51.872 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:51.872 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:51.872 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:51.872 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.873 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 18, 2022-08-10T17:41:51.873 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:51.873 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:51.873 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:51.874 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.874 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.874 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.874 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.875 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.875 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.875 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.875 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.876 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.876 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.876 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:51.876 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:51.876 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.877 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.877 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.877 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.877 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.878 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.878 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.879 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.879 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.879 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.880 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:51.880 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:51.880 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:51.881 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:51.881 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:51.881 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:51.882 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:51.882 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:51.882 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:51.883 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:51.883 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:51.883 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:51.883 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:51.884 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:51.884 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:51.885 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:51.885 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:51.886 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:51.886 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:51.887 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:51.887 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:51.887 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:51.888 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:51.888 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:51.889 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:51.889 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.890 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:51.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.891 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:51.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.892 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:51.892 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:51.893 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.893 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.894 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.895 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:51.895 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.896 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.897 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:51.897 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.898 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.898 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.899 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:51.900 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:51.900 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.901 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.901 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.902 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:51.903 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:51.903 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.904 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.905 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.905 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:51.906 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.907 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.908 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:51.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.909 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.909 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.910 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:51.911 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:51.911 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.911 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.912 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.913 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:51.914 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:51.914 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:51.914 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:51.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.915 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:51.915 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:51.916 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:51.917 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:51.918 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:51.918 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.919 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:51.920 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:51.920 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:51.920 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:51.920 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:51.921 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.921 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.921 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:51.921 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:51.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.922 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.922 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.922 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.923 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.923 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:41:51.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.924 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.924 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.924 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.924 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.924 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.925 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:41:51.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.925 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.925 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.926 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:41:51.926 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.926 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:51.927 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:51.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:51.927 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:51.927 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:51.928 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:51.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:51.928 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:51.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:51.928 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:51.929 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:51.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31580650e0 msgr2=0x7f3158067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3178850700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31580650e0 0x7f3158067590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c4b0 tx=0x7f316c00b040 comp rx=0 tx=0).stop 2022-08-10T17:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c8990 msgr2=0x7f317415ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3178850700 1 --2- 172.21.15.150:0/146926135 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31740c8990 0x7f317415ef10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f316800b3e0 tx=0x7f316800b6f0 comp rx=0 tx=0).stop 2022-08-10T17:41:51.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3172d9d700 1 -- 172.21.15.150:0/146926135 reap_dead start 2022-08-10T17:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.869+0000 7f3172d9d700 1 -- 172.21.15.150:0/146926135 reap_dead start 2022-08-10T17:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.877+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 shutdown_connections 2022-08-10T17:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.877+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 >> 172.21.15.150:0/146926135 conn(0x7f317406b500 msgr2=0x7f31740c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:51.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.877+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 shutdown_connections 2022-08-10T17:41:51.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:51.877+0000 7f3178850700 1 -- 172.21.15.150:0/146926135 wait complete. 2022-08-10T17:41:51.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:41:52.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.147+0000 7f24f2896700 1 Processor -- start 2022-08-10T17:41:52.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.148+0000 7f24f2896700 1 -- start start 2022-08-10T17:41:52.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24f2896700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 0x7f24ec068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24f2896700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec1563c0 con 0x7f24ec06c860 2022-08-10T17:41:52.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24f2896700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec150940 con 0x7f24ec0bc830 2022-08-10T17:41:52.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24f2896700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec153590 con 0x7f24ec070040 2022-08-10T17:41:52.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24ebfff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f24ec0bc830 0x7f24ec152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:35038/0 (socket says 172.21.15.150:35038) 2022-08-10T17:41:52.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.149+0000 7f24ebfff700 1 -- 172.21.15.150:0/1046050213 learned_addr learned my addr 172.21.15.150:0/1046050213 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:41:52.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.150+0000 7f24f0e33700 1 --2- 172.21.15.150:0/1046050213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 0x7f24ec068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.150+0000 7f24f0e33700 1 -- 172.21.15.150:0/1046050213 >> v1:172.21.15.197:6789/0 conn(0x7f24ec0bc830 legacy=0x7f24ec152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.151+0000 7f24f0e33700 1 -- 172.21.15.150:0/1046050213 >> v1:172.21.15.150:6789/0 conn(0x7f24ec06c860 legacy=0x7f24ec0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.151+0000 7f24f0e33700 1 -- 172.21.15.150:0/1046050213 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec068870 con 0x7f24ec070040 2022-08-10T17:41:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.159+0000 7f24f0e33700 1 --2- 172.21.15.150:0/1046050213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 0x7f24ec068110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009dc0 tx=0x7f24e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1247a60df3fb96 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.167+0000 7f24eaffd700 1 -- 172.21.15.150:0/1046050213 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400e070 con 0x7f24ec070040 2022-08-10T17:41:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.167+0000 7f24eaffd700 1 -- 172.21.15.150:0/1046050213 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400bb50 con 0x7f24ec070040 2022-08-10T17:41:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.167+0000 7f24eaffd700 1 -- 172.21.15.150:0/1046050213 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40038a0 con 0x7f24ec070040 2022-08-10T17:41:52.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.174+0000 7f24f2896700 1 -- 172.21.15.150:0/1046050213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 msgr2=0x7f24ec068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.174+0000 7f24f2896700 1 --2- 172.21.15.150:0/1046050213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 0x7f24ec068110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009dc0 tx=0x7f24e400b330 comp rx=0 tx=0).stop 2022-08-10T17:41:52.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.182+0000 7f24f2896700 1 -- 172.21.15.150:0/1046050213 shutdown_connections 2022-08-10T17:41:52.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.182+0000 7f24f2896700 1 --2- 172.21.15.150:0/1046050213 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec070040 0x7f24ec068110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.182+0000 7f24f2896700 1 -- 172.21.15.150:0/1046050213 >> 172.21.15.150:0/1046050213 conn(0x7f24ec0c92f0 msgr2=0x7f24ec0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:52.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.182+0000 7f24f2896700 1 -- 172.21.15.150:0/1046050213 shutdown_connections 2022-08-10T17:41:52.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.182+0000 7f24f2896700 1 -- 172.21.15.150:0/1046050213 wait complete. 2022-08-10T17:41:52.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.184+0000 7f24f2896700 1 Processor -- start 2022-08-10T17:41:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.185+0000 7f24f2896700 1 -- start start 2022-08-10T17:41:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24ec06c860 0x7f24ec14afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24ec070040 0x7f24ec1f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec0bc830 0x7f24ec13de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec152470 con 0x7f24ec06c860 2022-08-10T17:41:52.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec146940 con 0x7f24ec070040 2022-08-10T17:41:52.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f2896700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec1f3c90 con 0x7f24ec0bc830 2022-08-10T17:41:52.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24ebfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24ec06c860 0x7f24ec14afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24ebfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24ec06c860 0x7f24ec14afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36014/0 (socket says 172.21.15.150:36014) 2022-08-10T17:41:52.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24ebfff700 1 -- 172.21.15.150:0/3013303847 learned_addr learned my addr 172.21.15.150:0/3013303847 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:52.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24f0e33700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec0bc830 0x7f24ec13de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.186+0000 7f24eb7fe700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24ec070040 0x7f24ec1f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24ec070040 msgr2=0x7f24ec1f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24ec070040 0x7f24ec1f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24ec06c860 msgr2=0x7f24ec14afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24ec06c860 0x7f24ec14afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009a70 con 0x7f24ec0bc830 2022-08-10T17:41:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f0e33700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec0bc830 0x7f24ec13de10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24e4015000 tx=0x7f24e4004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4012630 con 0x7f24ec0bc830 2022-08-10T17:41:52.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e40127b0 con 0x7f24ec0bc830 2022-08-10T17:41:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec1485e0 con 0x7f24ec0bc830 2022-08-10T17:41:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec148f60 con 0x7f24ec0bc830 2022-08-10T17:41:52.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.187+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4012b60 con 0x7f24ec0bc830 2022-08-10T17:41:52.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.188+0000 7f24f2896700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 0x7f24ec149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.188+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec071e00 con 0x7f24ec150410 2022-08-10T17:41:52.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.188+0000 7f24ebfff700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 0x7f24ec149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.189+0000 7f24ebfff700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24ec149780 con 0x7f24ec150410 2022-08-10T17:41:52.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.189+0000 7f24ebfff700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 0x7f24ec149240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e770 tx=0x7f24e000eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.189+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0013680 con 0x7f24ec150410 2022-08-10T17:41:52.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.190+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f24e4012cc0 con 0x7f24ec0bc830 2022-08-10T17:41:52.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f24cc065180 0x7f24cc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f24e00137e0 con 0x7f24ec150410 2022-08-10T17:41:52.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 msgr2=0x7f24ec149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 0x7f24ec149240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e770 tx=0x7f24e000eb30 comp rx=0 tx=0).stop 2022-08-10T17:41:52.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 msgr2=0x7f24ec149240 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:52.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec150410 0x7f24ec149240 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e770 tx=0x7f24e000eb30 comp rx=0 tx=0).stop 2022-08-10T17:41:52.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f24e4084560 con 0x7f24ec0bc830 2022-08-10T17:41:52.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.191+0000 7f24eb7fe700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f24cc065180 0x7f24cc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.192+0000 7f24eb7fe700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f24cc065180 0x7f24cc067630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24ec13f1b0 tx=0x7f24dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.209+0000 7f24f2896700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 0x7f24ec12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.209+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec067100 con 0x7f24ec1f4660 2022-08-10T17:41:52.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.209+0000 7f24ebfff700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 0x7f24ec12a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.212+0000 7f24ebfff700 1 -- 172.21.15.150:0/3013303847 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f24ec1f3a60 con 0x7f24ec1f4660 2022-08-10T17:41:52.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.212+0000 7f24ebfff700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 0x7f24ec12a390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e770 tx=0x7f24e00057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.216 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0023070 con 0x7f24ec1f4660 2022-08-10T17:41:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f24e0006250 con 0x7f24ec1f4660 2022-08-10T17:41:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 msgr2=0x7f24ec12a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 0x7f24ec12a390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e770 tx=0x7f24e00057e0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 msgr2=0x7f24ec12a390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:41:52.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24e8ff9700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec1f4660 0x7f24ec12a390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.218 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:41:52.219 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:52.219 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:52.219 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:41:52.219 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 46, 2022-08-10T17:41:52.220 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:41:52.220 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:41:52.220 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:41:52.220 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:41:52.220 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.221 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 19, 2022-08-10T17:41:52.221 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:52.221 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:41:52.221 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:41:52.222 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:52.222 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:52.222 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:52.222 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:52.223 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:52.223 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:52.223 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:52.223 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:52.224 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:52.224 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.224 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:41:52.224 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:41:52.224 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:52.225 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:52.225 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:52.225 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:52.225 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:52.226 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:52.226 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:52.226 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:52.226 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:52.227 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.227 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.227 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:41:52.227 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:41:52.228 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:41:52.228 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:41:52.228 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:41:52.228 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:41:52.228 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:52.229 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:41:52.229 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:41:52.229 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:41:52.229 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:41:52.230 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:41:52.230 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:41:52.230 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:41:52.230 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:41:52.231 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:41:52.231 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:41:52.231 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:41:52.231 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:41:52.231 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:41:52.232 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:41:52.232 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:41:52.232 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:41:52.232 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:41:52.233 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:41:52.233 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.233 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:41:52.233 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.234 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:41:52.234 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.234 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:41:52.234 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:41:52.234 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:52.235 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:52.235 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.235 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:52.235 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:41:52.236 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.236 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.236 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.236 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:52.237 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:41:52.237 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.237 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.237 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.237 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.238 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:41:52.238 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:41:52.238 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:52.238 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:52.239 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:52.239 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.239 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.239 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:41:52.240 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:41:52.240 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:52.240 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:52.240 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.241 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:52.241 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:41:52.241 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.241 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.241 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.242 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:52.242 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:41:52.242 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.242 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.243 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.243 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.243 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:41:52.243 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:41:52.244 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:52.244 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:52.244 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:52.244 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.244 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.245 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:41:52.245 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:41:52.245 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:41:52.245 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:41:52.246 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.246 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:41:52.246 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:41:52.246 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.247 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.247 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.247 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:41:52.247 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:41:52.247 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:41:52.248 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.248 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.248 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.248 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:41:52.249 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:41:52.249 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:41:52.249 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:41:52.249 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:41:52.249 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.250 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.250 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.250 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:41:52.250 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:41:52.251 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.251 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:52.251 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.251 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:52.252 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.252 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.252 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:41:52.252 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.252 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:52.253 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.253 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:41:52.253 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.253 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.254 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:41:52.254 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.254 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:52.254 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.255 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:41:52.255 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.255 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.255 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:41:52.256 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.256 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:41:52.256 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.256 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:41:52.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.257 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:52.257 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.257 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:41:52.258 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.258 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:41:52.258 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:41:52.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:41:52.258 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:41:52.259 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:41:52.259 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:41:52.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:41:52.260 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:41:52.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:41:52.260 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:41:52.260 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:41:52.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f24cc065180 msgr2=0x7f24cc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f24cc065180 0x7f24cc067630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24ec13f1b0 tx=0x7f24dc008040 comp rx=0 tx=0).stop 2022-08-10T17:41:52.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec0bc830 msgr2=0x7f24ec13de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 --2- 172.21.15.150:0/3013303847 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f24ec0bc830 0x7f24ec13de10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24e4015000 tx=0x7f24e4004950 comp rx=0 tx=0).stop 2022-08-10T17:41:52.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f0e33700 1 -- 172.21.15.150:0/3013303847 reap_dead start 2022-08-10T17:41:52.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f0e33700 1 -- 172.21.15.150:0/3013303847 reap_dead start 2022-08-10T17:41:52.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 shutdown_connections 2022-08-10T17:41:52.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.213+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 >> 172.21.15.150:0/3013303847 conn(0x7f24ec0c92f0 msgr2=0x7f24ec155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:52.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.214+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 shutdown_connections 2022-08-10T17:41:52.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.217+0000 7f24f2896700 1 -- 172.21.15.150:0/3013303847 wait complete. 2022-08-10T17:41:52.265 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:41:52.265 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:41:52.266 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:41:52.266 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:41:52.266 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:41:52.267 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:41:52.292 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:41:52.293 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:41:52.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:41:52.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.596+0000 7f2d5853c700 1 Processor -- start 2022-08-10T17:41:52.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.596+0000 7f2d5853c700 1 -- start start 2022-08-10T17:41:52.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d5853c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d500cd540 0x7f2d500691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d5853c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d5853c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5006fb80 con 0x7f2d50150e10 2022-08-10T17:41:52.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d5853c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d50157950 con 0x7f2d500cd540 2022-08-10T17:41:52.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d5853c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50070720 con 0x7f2d500cd970 2022-08-10T17:41:52.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d56ad9700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 msgr2=0x7f2d500696e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:41:52.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d56ad9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500696e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:52.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d55ad7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d500cd540 0x7f2d500691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d55ad7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d500cd540 0x7f2d500691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36068/0 (socket says 172.21.15.150:36068) 2022-08-10T17:41:52.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d55ad7700 1 -- 172.21.15.150:0/4004756252 learned_addr learned my addr 172.21.15.150:0/4004756252 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:52.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.598+0000 7f2d55ad7700 1 -- 172.21.15.150:0/4004756252 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 msgr2=0x7f2d500696e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:52.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d55ad7700 1 --2- 172.21.15.150:0/4004756252 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500696e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d55ad7700 1 -- 172.21.15.150:0/4004756252 >> v1:172.21.15.197:6789/0 conn(0x7f2d50150e10 legacy=0x7f2d50070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:41:52.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d55ad7700 1 -- 172.21.15.150:0/4004756252 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500c1180 con 0x7f2d500cd540 2022-08-10T17:41:52.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d55ad7700 1 --2- 172.21.15.150:0/4004756252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500691a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009780 tx=0x7f2d40009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4693353bbacc24b0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d552d6700 1 -- 172.21.15.150:0/4004756252 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011830 con 0x7f2d500cd540 2022-08-10T17:41:52.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d552d6700 1 -- 172.21.15.150:0/4004756252 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40011990 con 0x7f2d500cd540 2022-08-10T17:41:52.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.599+0000 7f2d552d6700 1 -- 172.21.15.150:0/4004756252 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011d40 con 0x7f2d500cd540 2022-08-10T17:41:52.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.600+0000 7f2d5853c700 1 -- 172.21.15.150:0/4004756252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 msgr2=0x7f2d500691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.600+0000 7f2d5853c700 1 --2- 172.21.15.150:0/4004756252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500691a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009780 tx=0x7f2d40009a90 comp rx=0 tx=0).stop 2022-08-10T17:41:52.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.602+0000 7f2d5853c700 1 -- 172.21.15.150:0/4004756252 shutdown_connections 2022-08-10T17:41:52.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.603+0000 7f2d5853c700 1 --2- 172.21.15.150:0/4004756252 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.603+0000 7f2d5853c700 1 --2- 172.21.15.150:0/4004756252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500691a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.603+0000 7f2d5853c700 1 -- 172.21.15.150:0/4004756252 >> 172.21.15.150:0/4004756252 conn(0x7f2d50071df0 msgr2=0x7f2d500cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:52.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.603+0000 7f2d5853c700 1 -- 172.21.15.150:0/4004756252 shutdown_connections 2022-08-10T17:41:52.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.603+0000 7f2d5853c700 1 -- 172.21.15.150:0/4004756252 wait complete. 2022-08-10T17:41:52.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.604+0000 7f2d5853c700 1 Processor -- start 2022-08-10T17:41:52.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.605+0000 7f2d5853c700 1 -- start start 2022-08-10T17:41:52.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d50150e10 0x7f2d500b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5014e7c0 con 0x7f2d500cd540 2022-08-10T17:41:52.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5014dc20 con 0x7f2d50150e10 2022-08-10T17:41:52.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.606+0000 7f2d5853c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d501e3800 con 0x7f2d500cd970 2022-08-10T17:41:52.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36072/0 (socket says 172.21.15.150:36072) 2022-08-10T17:41:52.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 -- 172.21.15.150:0/3851243784 learned_addr learned my addr 172.21.15.150:0/3851243784 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d55ad7700 1 -- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 msgr2=0x7f2d500c9f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:41:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d55ad7700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500c9f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:52.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d56ad9700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d50150e10 0x7f2d500b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 -- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 msgr2=0x7f2d500c9f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:52.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500c9f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 -- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d50150e10 msgr2=0x7f2d500b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:52.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d50150e10 0x7f2d500b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:52.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.607+0000 7f2d562d8700 1 -- 172.21.15.150:0/3851243784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400093e0 con 0x7f2d500cd540 2022-08-10T17:41:52.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.608+0000 7f2d562d8700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00b3c0 tx=0x7f2d4c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:52.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.608+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011830 con 0x7f2d500cd540 2022-08-10T17:41:52.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.608+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c011990 con 0x7f2d500cd540 2022-08-10T17:41:52.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.608+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011d40 con 0x7f2d500cd540 2022-08-10T17:41:52.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.609+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d500c5810 con 0x7f2d500cd540 2022-08-10T17:41:52.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.609+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5014deb0 con 0x7f2d500cd540 2022-08-10T17:41:52.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.611+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5014e900 con 0x7f2d500cd540 2022-08-10T17:41:52.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.613+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2d4c021070 con 0x7f2d500cd540 2022-08-10T17:41:52.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.613+0000 7f2d3effd700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 0x7f2d30067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:52.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.613+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2d4c081dd0 con 0x7f2d500cd540 2022-08-10T17:41:52.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.617+0000 7f2d55ad7700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 0x7f2d30067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:52.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.620+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2d5014e900 con 0x7f2d500cd540 2022-08-10T17:41:52.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:52.622+0000 7f2d55ad7700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 0x7f2d30067590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2d500ccba0 tx=0x7f2d40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:53.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.224+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2d500c5810 con 0x7f2d500cd540 2022-08-10T17:41:53.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.225+0000 7f2d3effd700 1 -- 172.21.15.150:0/3851243784 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f2d500c5810 con 0x7f2d500cd540 2022-08-10T17:41:53.229 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:41:53.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.228+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 msgr2=0x7f2d30067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:53.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 0x7f2d30067590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2d500ccba0 tx=0x7f2d40008030 comp rx=0 tx=0).stop 2022-08-10T17:41:53.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 msgr2=0x7f2d500c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:53.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00b3c0 tx=0x7f2d4c00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:41:53.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 shutdown_connections 2022-08-10T17:41:53.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d50150e10 0x7f2d500b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:53.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d500cd540 0x7f2d500c41c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:53.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2d300650e0 0x7f2d30067590 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2d500ccba0 tx=0x7f2d40008030 comp rx=0 tx=0).stop 2022-08-10T17:41:53.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 --2- 172.21.15.150:0/3851243784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d500cd970 0x7f2d500c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.229+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 >> 172.21.15.150:0/3851243784 conn(0x7f2d50071df0 msgr2=0x7f2d500cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:53.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.231+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 shutdown_connections 2022-08-10T17:41:53.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:53.232+0000 7f2d5853c700 1 -- 172.21.15.150:0/3851243784 wait complete. 2022-08-10T17:41:56.277 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:41:56.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.618+0000 7fe76ea68700 1 Processor -- start 2022-08-10T17:41:56.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.618+0000 7fe76ea68700 1 -- start start 2022-08-10T17:41:56.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.619+0000 7fe76ea68700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe7680b26e0 0x7fe7680c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.619+0000 7fe76ea68700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.619+0000 7fe76ea68700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815e2b0 con 0x7fe768154e40 2022-08-10T17:41:56.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.619+0000 7fe76ea68700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768070740 con 0x7fe7680b26e0 2022-08-10T17:41:56.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.619+0000 7fe76ea68700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76815e590 con 0x7fe7680b1790 2022-08-10T17:41:56.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.620+0000 7fe76d005700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 msgr2=0x7fe7680c9da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:41:56.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.620+0000 7fe76d005700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c9da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:56.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.620+0000 7fe767fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe7680b26e0 0x7fe7680c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:56.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.620+0000 7fe767fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe7680b26e0 0x7fe7680c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:46792/0 (socket says 172.21.15.150:46792) 2022-08-10T17:41:56.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.620+0000 7fe767fff700 1 -- 172.21.15.150:0/444495530 learned_addr learned my addr 172.21.15.150:0/444495530 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:56.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.622+0000 7fe767fff700 1 -- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 msgr2=0x7fe7680c9da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:41:56.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.622+0000 7fe767fff700 1 --2- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c9da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:56.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.622+0000 7fe767fff700 1 -- 172.21.15.150:0/444495530 >> v1:172.21.15.197:6789/0 conn(0x7fe768154e40 legacy=0x7fe76806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:56.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.622+0000 7fe767fff700 1 -- 172.21.15.150:0/444495530 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76815e870 con 0x7fe7680b26e0 2022-08-10T17:41:56.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.623+0000 7fe767fff700 1 --2- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe7680c9860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe760009e50 tx=0x7fe76000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f844733bcac4d424 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:56.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.623+0000 7fe7677fe700 1 -- 172.21.15.150:0/444495530 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000e070 con 0x7fe7680b26e0 2022-08-10T17:41:56.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.623+0000 7fe7677fe700 1 -- 172.21.15.150:0/444495530 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000b9c0 con 0x7fe7680b26e0 2022-08-10T17:41:56.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.623+0000 7fe7677fe700 1 -- 172.21.15.150:0/444495530 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000bd70 con 0x7fe7680b26e0 2022-08-10T17:41:56.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 -- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 msgr2=0x7fe7680c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:56.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 --2- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe7680c9860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe760009e50 tx=0x7fe76000b330 comp rx=0 tx=0).stop 2022-08-10T17:41:56.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 -- 172.21.15.150:0/444495530 shutdown_connections 2022-08-10T17:41:56.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 --2- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:56.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 --2- 172.21.15.150:0/444495530 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe7680c9860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:56.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.624+0000 7fe76ea68700 1 -- 172.21.15.150:0/444495530 >> 172.21.15.150:0/444495530 conn(0x7fe768071e40 msgr2=0x7fe76806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:56.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.627+0000 7fe76ea68700 1 -- 172.21.15.150:0/444495530 shutdown_connections 2022-08-10T17:41:56.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.627+0000 7fe76ea68700 1 -- 172.21.15.150:0/444495530 wait complete. 2022-08-10T17:41:56.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.629+0000 7fe76ea68700 1 Processor -- start 2022-08-10T17:41:56.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.630+0000 7fe76ea68700 1 -- start start 2022-08-10T17:41:56.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe768157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768156780 con 0x7fe768154e40 2022-08-10T17:41:56.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c14e0 con 0x7fe7680b26e0 2022-08-10T17:41:56.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76ea68700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768068ac0 con 0x7fe7680b1790 2022-08-10T17:41:56.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76c804700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 msgr2=0x7fe7680c0bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:41:56.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.631+0000 7fe76c804700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c0bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:41:56.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.632+0000 7fe76d005700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:56.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.632+0000 7fe76d005700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36208/0 (socket says 172.21.15.150:36208) 2022-08-10T17:41:56.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.632+0000 7fe76d005700 1 -- 172.21.15.150:0/3492388509 learned_addr learned my addr 172.21.15.150:0/3492388509 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:41:56.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 -- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 msgr2=0x7fe7680c0bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:56.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c0bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:56.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 -- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 msgr2=0x7fe768157c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:41:56.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe768157c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:56.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 -- 172.21.15.150:0/3492388509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009b30 con 0x7fe768154e40 2022-08-10T17:41:56.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.633+0000 7fe76d005700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b390 tx=0x7fe75800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:56.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.653+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800bea0 con 0x7fe768154e40 2022-08-10T17:41:56.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.653+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758003c80 con 0x7fe768154e40 2022-08-10T17:41:56.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.653+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758005070 con 0x7fe768154e40 2022-08-10T17:41:56.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.653+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768068da0 con 0x7fe768154e40 2022-08-10T17:41:56.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.654+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe768069360 con 0x7fe768154e40 2022-08-10T17:41:56.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.657+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe758018030 con 0x7fe768154e40 2022-08-10T17:41:56.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.657+0000 7fe7657fa700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 0x7fe748067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:41:56.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.657+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe7580811e0 con 0x7fe768154e40 2022-08-10T17:41:56.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.658+0000 7fe76c804700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 0x7fe748067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:41:56.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.662+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768158530 con 0x7fe768154e40 2022-08-10T17:41:56.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.670+0000 7fe76c804700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 0x7fe748067660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe75c007fd0 tx=0x7fe75c007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:41:56.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:56.678+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe758086060 con 0x7fe768154e40 2022-08-10T17:41:57.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.395+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe76806e420 con 0x7fe768154e40 2022-08-10T17:41:57.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.397+0000 7fe7657fa700 1 -- 172.21.15.150:0/3492388509 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fe758016070 con 0x7fe768154e40 2022-08-10T17:41:57.400 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:41:57.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 msgr2=0x7fe748067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:57.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 0x7fe748067660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe75c007fd0 tx=0x7fe75c007920 comp rx=0 tx=0).stop 2022-08-10T17:41:57.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 msgr2=0x7fe768156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:41:57.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b390 tx=0x7fe75800b750 comp rx=0 tx=0).stop 2022-08-10T17:41:57.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 shutdown_connections 2022-08-10T17:41:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe768154e40 0x7fe768156c10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7480651b0 0x7fe748067660 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe75c007fd0 tx=0x7fe75c007920 comp rx=0 tx=0).stop 2022-08-10T17:41:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7680b1790 0x7fe7680c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 --2- 172.21.15.150:0/3492388509 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7680b26e0 0x7fe768157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:41:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.421+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 >> 172.21.15.150:0/3492388509 conn(0x7fe768071e40 msgr2=0x7fe768154190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:41:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.424+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 shutdown_connections 2022-08-10T17:41:57.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:41:57.424+0000 7fe76ea68700 1 -- 172.21.15.150:0/3492388509 wait complete. 2022-08-10T17:42:00.456 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:00.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.830+0000 7fc73cc8f700 1 Processor -- start 2022-08-10T17:42:00.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.834+0000 7fc73cc8f700 1 -- start start 2022-08-10T17:42:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.835+0000 7fc73cc8f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7381552d0 0x7fc7380c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.835+0000 7fc73cc8f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc73806b310 0x7fc73806b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.835+0000 7fc73cc8f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73815f250 con 0x7fc7380c4670 2022-08-10T17:42:00.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.835+0000 7fc73cc8f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73815ee30 con 0x7fc7381552d0 2022-08-10T17:42:00.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.835+0000 7fc73cc8f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380c5200 con 0x7fc73806b310 2022-08-10T17:42:00.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.838+0000 7fc736d9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc73806b310 0x7fc73806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:00.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.838+0000 7fc736d9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc73806b310 0x7fc73806b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:46912/0 (socket says 172.21.15.150:46912) 2022-08-10T17:42:00.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.838+0000 7fc736d9d700 1 -- 172.21.15.150:0/2072032178 learned_addr learned my addr 172.21.15.150:0/2072032178 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:00.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.839+0000 7fc736d9d700 1 -- 172.21.15.150:0/2072032178 >> v2:172.21.15.150:3300/0 conn(0x7fc7381552d0 msgr2=0x7fc7380c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:00.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.839+0000 7fc736d9d700 1 --2- 172.21.15.150:0/2072032178 >> v2:172.21.15.150:3300/0 conn(0x7fc7381552d0 0x7fc7380c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:00.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.839+0000 7fc736d9d700 1 -- 172.21.15.150:0/2072032178 >> v1:172.21.15.150:6789/0 conn(0x7fc7380c4670 legacy=0x7fc73815adb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:00.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.839+0000 7fc736d9d700 1 -- 172.21.15.150:0/2072032178 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380c4f20 con 0x7fc73806b310 2022-08-10T17:42:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.843+0000 7fc736d9d700 1 --2- 172.21.15.150:0/2072032178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc73806b310 0x7fc73806b790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7380bfb00 tx=0x7fc73000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df149ece0956ef0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:00.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.844+0000 7fc735d9b700 1 -- 172.21.15.150:0/2072032178 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000e070 con 0x7fc73806b310 2022-08-10T17:42:00.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.844+0000 7fc735d9b700 1 -- 172.21.15.150:0/2072032178 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73000b980 con 0x7fc73806b310 2022-08-10T17:42:00.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.844+0000 7fc735d9b700 1 -- 172.21.15.150:0/2072032178 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000bd30 con 0x7fc73806b310 2022-08-10T17:42:00.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.845+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2072032178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc73806b310 msgr2=0x7fc73806b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:00.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.845+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2072032178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc73806b310 0x7fc73806b790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7380bfb00 tx=0x7fc73000b330 comp rx=0 tx=0).stop 2022-08-10T17:42:00.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2072032178 shutdown_connections 2022-08-10T17:42:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2072032178 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc73806b310 0x7fc73806b790 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2072032178 >> v2:172.21.15.150:3300/0 conn(0x7fc7381552d0 0x7fc7380c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:00.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2072032178 >> 172.21.15.150:0/2072032178 conn(0x7fc7380c8a10 msgr2=0x7fc7380c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:00.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2072032178 shutdown_connections 2022-08-10T17:42:00.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.846+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2072032178 wait complete. 2022-08-10T17:42:00.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.849+0000 7fc73cc8f700 1 Processor -- start 2022-08-10T17:42:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.849+0000 7fc73cc8f700 1 -- start start 2022-08-10T17:42:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc73806b310 0x7fc7380c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc7380c4670 0x7fc7381459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380bfdf0 con 0x7fc7381552d0 2022-08-10T17:42:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380c00d0 con 0x7fc7380c4670 2022-08-10T17:42:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.851+0000 7fc73cc8f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380c03b0 con 0x7fc73806b310 2022-08-10T17:42:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.854+0000 7fc736d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.854+0000 7fc736d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36322/0 (socket says 172.21.15.150:36322) 2022-08-10T17:42:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.854+0000 7fc736d9d700 1 -- 172.21.15.150:0/2409662650 learned_addr learned my addr 172.21.15.150:0/2409662650 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.855+0000 7fc736d9d700 1 -- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc73806b310 msgr2=0x7fc7380c19c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.855+0000 7fc736d9d700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc73806b310 0x7fc7380c19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.855+0000 7fc736d9d700 1 -- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc7380c4670 msgr2=0x7fc7381459e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.855+0000 7fc736d9d700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc7380c4670 0x7fc7381459e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.855+0000 7fc736d9d700 1 -- 172.21.15.150:0/2409662650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009b30 con 0x7fc7381552d0 2022-08-10T17:42:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.857+0000 7fc736d9d700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b370 tx=0x7fc730004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.897+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730004440 con 0x7fc7381552d0 2022-08-10T17:42:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.897+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300045a0 con 0x7fc7381552d0 2022-08-10T17:42:00.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.897+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300092e0 con 0x7fc7381552d0 2022-08-10T17:42:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.904+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7380c0690 con 0x7fc7381552d0 2022-08-10T17:42:00.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.904+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7380c2b30 con 0x7fc7381552d0 2022-08-10T17:42:00.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.907+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7380c2e10 con 0x7fc7381552d0 2022-08-10T17:42:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.908+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc730023030 con 0x7fc7381552d0 2022-08-10T17:42:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.908+0000 7fc72f7fe700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 0x7fc71c067650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:00.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.909+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc730083d20 con 0x7fc7381552d0 2022-08-10T17:42:00.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.915+0000 7fc73659c700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 0x7fc71c067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.916+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc730055660 con 0x7fc7381552d0 2022-08-10T17:42:00.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:00.916+0000 7fc73659c700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 0x7fc71c067650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc7280094f0 tx=0x7fc728006a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:01.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.476+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc7380c0820 con 0x7fc7381552d0 2022-08-10T17:42:01.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.477+0000 7fc72f7fe700 1 -- 172.21.15.150:0/2409662650 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fc730017600 con 0x7fc7381552d0 2022-08-10T17:42:01.480 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":28,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:01.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 msgr2=0x7fc71c067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:01.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 0x7fc71c067650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc7280094f0 tx=0x7fc728006a50 comp rx=0 tx=0).stop 2022-08-10T17:42:01.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 msgr2=0x7fc738145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:01.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b370 tx=0x7fc730004950 comp rx=0 tx=0).stop 2022-08-10T17:42:01.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 shutdown_connections 2022-08-10T17:42:01.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7381552d0 0x7fc738145f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:01.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc71c0651a0 0x7fc71c067650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:01.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc73806b310 0x7fc7380c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:01.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 --2- 172.21.15.150:0/2409662650 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc7380c4670 0x7fc7381459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:01.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 >> 172.21.15.150:0/2409662650 conn(0x7fc7380c8a10 msgr2=0x7fc73806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:01.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 shutdown_connections 2022-08-10T17:42:01.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:01.496+0000 7fc73cc8f700 1 -- 172.21.15.150:0/2409662650 wait complete. 2022-08-10T17:42:04.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:04.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.829+0000 7f73bd075700 1 Processor -- start 2022-08-10T17:42:04.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.829+0000 7f73bd075700 1 -- start start 2022-08-10T17:42:04.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73bd075700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:04.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73bd075700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:04.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73bd075700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b806f410 con 0x7f73b80c5440 2022-08-10T17:42:04.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73bd075700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80c6080 con 0x7f73b80c3290 2022-08-10T17:42:04.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73bd075700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80c9c50 con 0x7f73b806e920 2022-08-10T17:42:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73b6d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73b6d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36404/0 (socket says 172.21.15.150:36404) 2022-08-10T17:42:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 learned_addr learned my addr 172.21.15.150:0/1740205037 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.830+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:42:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:04.831+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:05.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:05.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:05.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:42:05.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:05.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:05.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:42:05.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:05.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:05.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:05.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.031+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:42:05.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.432+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:05.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.432+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:42:05.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.432+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:05.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.432+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:05.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.432+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:42:05.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.433+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:05.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.433+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:05.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.433+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:05.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.433+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:05.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:05.433+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:42:06.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.233+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:06.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.234+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:06.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:06.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:06.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:06.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:42:06.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:42:06.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b6d9d700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:06.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:06.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.236+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:42:06.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.885+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627246564 0 0) 0x7f73b806f410 con 0x7f73b80c5440 2022-08-10T17:42:06.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.885+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a4003430 con 0x7f73b80c5440 2022-08-10T17:42:06.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007752149 0 0) 0x7f73a4003430 con 0x7f73b80c5440 2022-08-10T17:42:06.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 msgr2=0x7f73b80c4f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:06.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.197:3300/0 conn(0x7f73b806e920 0x7f73b80c4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 msgr2=0x7f73b80c6e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:06.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 --2- 172.21.15.150:0/1740205037 >> v2:172.21.15.150:3300/0 conn(0x7f73b80c3290 0x7f73b80c6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80c9f30 con 0x7f73b80c5440 2022-08-10T17:42:06.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.902+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f73b00019f0 con 0x7f73b80c5440 2022-08-10T17:42:06.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 >> v1:172.21.15.197:6789/0 conn(0x7f73b80c5440 legacy=0x7f73b806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:06.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73a4003880 0x7f73a4003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a40046d0 0x7f73a4004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 0x7f73a400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80c6080 con 0x7f73a4003880 2022-08-10T17:42:06.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80c9c50 con 0x7f73a4005080 2022-08-10T17:42:06.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a400bf10 con 0x7f73a40046d0 2022-08-10T17:42:06.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b659c700 1 -- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a40046d0 msgr2=0x7f73a4004b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:42:06.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.903+0000 7f73b659c700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a40046d0 0x7f73a4004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:06.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.904+0000 7f73b759e700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 0x7f73a400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:06.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 -- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a40046d0 msgr2=0x7f73a4004b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:06.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a40046d0 0x7f73a4004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 -- 172.21.15.150:0/1740205037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73a4003880 msgr2=0x7f73a4003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:06.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73a4003880 0x7f73a4003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 -- 172.21.15.150:0/1740205037 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4003430 con 0x7f73a4005080 2022-08-10T17:42:06.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.905+0000 7f73b759e700 1 -- 172.21.15.150:0/1740205037 reap_dead start 2022-08-10T17:42:06.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.906+0000 7f73b759e700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 0x7f73a400b890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73b00041f0 tx=0x7f73a4005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=578f4881218658b3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:06.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.906+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0004ad0 con 0x7f73a4005080 2022-08-10T17:42:06.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.906+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b0004c30 con 0x7f73a4005080 2022-08-10T17:42:06.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.906+0000 7f73b5d9b700 1 -- 172.21.15.150:0/1740205037 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00060d0 con 0x7f73a4005080 2022-08-10T17:42:06.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 -- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 msgr2=0x7f73a400b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:06.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 0x7f73a400b890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73b00041f0 tx=0x7f73a4005700 comp rx=0 tx=0).stop 2022-08-10T17:42:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 -- 172.21.15.150:0/1740205037 shutdown_connections 2022-08-10T17:42:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 --2- 172.21.15.150:0/1740205037 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73a4005080 0x7f73a400b890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 -- 172.21.15.150:0/1740205037 >> 172.21.15.150:0/1740205037 conn(0x7f73b806c5d0 msgr2=0x7f73b806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:06.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 -- 172.21.15.150:0/1740205037 shutdown_connections 2022-08-10T17:42:06.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.909+0000 7f73bd075700 1 -- 172.21.15.150:0/1740205037 wait complete. 2022-08-10T17:42:06.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.912+0000 7f73bd075700 1 Processor -- start 2022-08-10T17:42:06.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.912+0000 7f73bd075700 1 -- start start 2022-08-10T17:42:06.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 0x7f73b81eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b814f480 0x7f73b81ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b81daaf0 con 0x7f73b814af20 2022-08-10T17:42:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b81dc490 con 0x7f73b814f480 2022-08-10T17:42:06.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.913+0000 7f73bd075700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8071f00 con 0x7f73a4005080 2022-08-10T17:42:06.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.914+0000 7f73b6d9d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 msgr2=0x7f73b81eb800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:42:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.915+0000 7f73b6d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 0x7f73b81eb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.915+0000 7f73b759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.915+0000 7f73b759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36464/0 (socket says 172.21.15.150:36464) 2022-08-10T17:42:06.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.915+0000 7f73b759e700 1 -- 172.21.15.150:0/2864152397 learned_addr learned my addr 172.21.15.150:0/2864152397 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.916+0000 7f73b759e700 1 -- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 msgr2=0x7f73b81eb800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.916+0000 7f73b759e700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 0x7f73b81eb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.916+0000 7f73b759e700 1 -- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b814f480 msgr2=0x7f73b81ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:06.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.916+0000 7f73b759e700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b814f480 0x7f73b81ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:06.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.916+0000 7f73b759e700 1 -- 172.21.15.150:0/2864152397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b81dad40 con 0x7f73b814af20 2022-08-10T17:42:06.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f73b759e700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f73b8067190 tx=0x7f73b0003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:06.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0022070 con 0x7f73b814af20 2022-08-10T17:42:06.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b0004890 con 0x7f73b814af20 2022-08-10T17:42:06.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0008c50 con 0x7f73b814af20 2022-08-10T17:42:06.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b81db020 con 0x7f73b814af20 2022-08-10T17:42:06.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.917+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b814b8b0 con 0x7f73b814af20 2022-08-10T17:42:06.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.921+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f73b0011070 con 0x7f73b814af20 2022-08-10T17:42:06.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.921+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b81eb520 con 0x7f73b814af20 2022-08-10T17:42:06.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.921+0000 7f739f7fe700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 0x7f7398067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:06.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.921+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f73b0081f70 con 0x7f73b814af20 2022-08-10T17:42:06.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.926+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 0x7f7398067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:06.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.928+0000 7f73b6d9d700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 0x7f7398067590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f73b8070d70 tx=0x7f73a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:06.930+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f73b81eb520 con 0x7f73b814af20 2022-08-10T17:42:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.538+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f73b81eb520 con 0x7f73b814af20 2022-08-10T17:42:07.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.540+0000 7f739f7fe700 1 -- 172.21.15.150:0/2864152397 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f73b81eb520 con 0x7f73b814af20 2022-08-10T17:42:07.544 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.553+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 msgr2=0x7f7398067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:07.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.553+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 0x7f7398067590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f73b8070d70 tx=0x7f73a8008040 comp rx=0 tx=0).stop 2022-08-10T17:42:07.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.553+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 msgr2=0x7f73b814b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:07.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.553+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f73b8067190 tx=0x7f73b0003980 comp rx=0 tx=0).stop 2022-08-10T17:42:07.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 shutdown_connections 2022-08-10T17:42:07.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b814af20 0x7f73b814b370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f73980650e0 0x7f7398067590 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73a4005080 0x7f73b81eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 --2- 172.21.15.150:0/2864152397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b814f480 0x7f73b81ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.554+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 >> 172.21.15.150:0/2864152397 conn(0x7f73b806c5d0 msgr2=0x7f73b81dcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:07.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.555+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 shutdown_connections 2022-08-10T17:42:07.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.566+0000 7f73bd075700 1 -- 172.21.15.150:0/2864152397 wait complete. 2022-08-10T17:42:07.600 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:42:07.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:42:07.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.919+0000 7f04db155700 1 Processor -- start 2022-08-10T17:42:07.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.919+0000 7f04db155700 1 -- start start 2022-08-10T17:42:07.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04db155700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04d40c96b0 0x7f04d40c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04db155700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f04d40c3340 0x7f04d40c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04db155700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d406e070 con 0x7f04d40c8af0 2022-08-10T17:42:07.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04db155700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d406ec10 con 0x7f04d40c96b0 2022-08-10T17:42:07.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04db155700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40c37c0 con 0x7f04d40c3340 2022-08-10T17:42:07.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04d3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04d40c96b0 0x7f04d40c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04d8ef1700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f04d40c8af0 0x7f04d406e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:49178/0 (socket says 172.21.15.150:49178) 2022-08-10T17:42:07.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.920+0000 7f04d8ef1700 1 -- 172.21.15.150:0/88719908 learned_addr learned my addr 172.21.15.150:0/88719908 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:07.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.922+0000 7f04d96f2700 1 --2- 172.21.15.150:0/88719908 >> v2:172.21.15.197:3300/0 conn(0x7f04d40c3340 0x7f04d40c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.932+0000 7f04d96f2700 1 -- 172.21.15.150:0/88719908 >> v2:172.21.15.150:3300/0 conn(0x7f04d40c96b0 msgr2=0x7f04d40c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:07.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.932+0000 7f04d96f2700 1 --2- 172.21.15.150:0/88719908 >> v2:172.21.15.150:3300/0 conn(0x7f04d40c96b0 0x7f04d40c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.932+0000 7f04d96f2700 1 -- 172.21.15.150:0/88719908 >> v1:172.21.15.150:6789/0 conn(0x7f04d40c8af0 legacy=0x7f04d406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.932+0000 7f04d96f2700 1 -- 172.21.15.150:0/88719908 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40701c0 con 0x7f04d40c3340 2022-08-10T17:42:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.933+0000 7f04d96f2700 1 --2- 172.21.15.150:0/88719908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d40c4f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04d406d760 tx=0x7f04cc007c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a987ffdc99408653 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:07.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.933+0000 7f04d37fe700 1 -- 172.21.15.150:0/88719908 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00daa0 con 0x7f04d40c3340 2022-08-10T17:42:07.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.933+0000 7f04d37fe700 1 -- 172.21.15.150:0/88719908 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00dc00 con 0x7f04d40c3340 2022-08-10T17:42:07.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.933+0000 7f04d37fe700 1 -- 172.21.15.150:0/88719908 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc018480 con 0x7f04d40c3340 2022-08-10T17:42:07.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.942+0000 7f04db155700 1 -- 172.21.15.150:0/88719908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 msgr2=0x7f04d40c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:07.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.942+0000 7f04db155700 1 --2- 172.21.15.150:0/88719908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d40c4f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04d406d760 tx=0x7f04cc007c60 comp rx=0 tx=0).stop 2022-08-10T17:42:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 -- 172.21.15.150:0/88719908 shutdown_connections 2022-08-10T17:42:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 --2- 172.21.15.150:0/88719908 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d40c4f10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 --2- 172.21.15.150:0/88719908 >> v2:172.21.15.150:3300/0 conn(0x7f04d40c96b0 0x7f04d40c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 -- 172.21.15.150:0/88719908 >> 172.21.15.150:0/88719908 conn(0x7f04d406b500 msgr2=0x7f04d406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:07.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 -- 172.21.15.150:0/88719908 shutdown_connections 2022-08-10T17:42:07.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.947+0000 7f04db155700 1 -- 172.21.15.150:0/88719908 wait complete. 2022-08-10T17:42:07.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.949+0000 7f04db155700 1 Processor -- start 2022-08-10T17:42:07.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.950+0000 7f04db155700 1 -- start start 2022-08-10T17:42:07.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d41ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40c8af0 0x7f04d4204650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f04d40c96b0 0x7f04d40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c1e80 con 0x7f04d40c8af0 2022-08-10T17:42:07.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c0950 con 0x7f04d40c3340 2022-08-10T17:42:07.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.951+0000 7f04db155700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c0390 con 0x7f04d40c96b0 2022-08-10T17:42:07.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d96f2700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f04d40c96b0 msgr2=0x7f04d40c4510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:42:07.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d96f2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f04d40c96b0 0x7f04d40c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:07.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d41ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d41ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:47102/0 (socket says 172.21.15.150:47102) 2022-08-10T17:42:07.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 -- 172.21.15.150:0/2391009342 learned_addr learned my addr 172.21.15.150:0/2391009342 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:07.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d3fff700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40c8af0 0x7f04d4204650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f04d40c96b0 msgr2=0x7f04d40c4510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:07.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f04d40c96b0 0x7f04d40c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40c8af0 msgr2=0x7f04d4204650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:07.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40c8af0 0x7f04d4204650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:07.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.952+0000 7f04d8ef1700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc007690 con 0x7f04d40c3340 2022-08-10T17:42:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.955+0000 7f04d8ef1700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d41ed9b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c340 tx=0x7f04c800c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.956+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80072d0 con 0x7f04d40c3340 2022-08-10T17:42:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.956+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8007430 con 0x7f04d40c3340 2022-08-10T17:42:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.956+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80057c0 con 0x7f04d40c3340 2022-08-10T17:42:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.956+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d40c0670 con 0x7f04d40c3340 2022-08-10T17:42:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.957+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40c1aa0 con 0x7f04d40c3340 2022-08-10T17:42:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.959+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f04c8019030 con 0x7f04d40c3340 2022-08-10T17:42:07.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.960+0000 7f04d17fa700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f04bc0650e0 0x7f04bc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.960+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f04c8081340 con 0x7f04d40c3340 2022-08-10T17:42:07.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.961+0000 7f04d3fff700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f04bc0650e0 0x7f04bc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.970+0000 7f04d3fff700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f04bc0650e0 0x7f04bc067590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d4089030 tx=0x7f04c00090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:07.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.990+0000 7f04db155700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 0x7f04d415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:07.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.990+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40673d0 con 0x7f04d40bfdf0 2022-08-10T17:42:07.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.990+0000 7f04d96f2700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 0x7f04d415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:07.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.991+0000 7f04d96f2700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04d4072890 con 0x7f04d40bfdf0 2022-08-10T17:42:07.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.991+0000 7f04d96f2700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 0x7f04d415f0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04d406d760 tx=0x7f04cc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:07.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.994+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc018c20 con 0x7f04d40bfdf0 2022-08-10T17:42:07.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:07.994+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f04cc01d040 con 0x7f04d40bfdf0 2022-08-10T17:42:08.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.001+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 msgr2=0x7f04d415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.001+0000 7f04d17fa700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 0x7f04d415f0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04d406d760 tx=0x7f04cc004950 comp rx=0 tx=0).stop 2022-08-10T17:42:08.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.001+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 msgr2=0x7f04d415f0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:08.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.001+0000 7f04d17fa700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d40bfdf0 0x7f04d415f0f0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04d406d760 tx=0x7f04cc004950 comp rx=0 tx=0).stop 2022-08-10T17:42:08.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.026+0000 7f04db155700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 0x7f04d41621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.026+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c4110 con 0x7f04d4165380 2022-08-10T17:42:08.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.026+0000 7f04d96f2700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 0x7f04d41621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.027+0000 7f04d96f2700 1 -- 172.21.15.150:0/2391009342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f04d40c3a40 con 0x7f04d4165380 2022-08-10T17:42:08.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.027+0000 7f04d96f2700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 0x7f04d41621f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04d4071140 tx=0x7f04cc005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc02f620 con 0x7f04d4165380 2022-08-10T17:42:08.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4850 (secure 0 0 0) 0x7f04cc02f780 con 0x7f04d4165380 2022-08-10T17:42:08.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 msgr2=0x7f04d41621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 0x7f04d41621f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04d4071140 tx=0x7f04cc005ca0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 msgr2=0x7f04d41621f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:08.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.031+0000 7f04d17fa700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d4165380 0x7f04d41621f0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04d4071140 tx=0x7f04cc005ca0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.037 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:08.037 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:08.037 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:08.038 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:42:08.038 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 50, 2022-08-10T17:42:08.038 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:08.038 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:08.039 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:42:08.039 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.039 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:42:08.039 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:08.040 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:08.040 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:08.040 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.040 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.041 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.041 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.041 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.041 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.041 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.042 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.042 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.042 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.042 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:08.043 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:08.043 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.043 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.043 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.044 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.044 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.044 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.044 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.045 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.045 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.045 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.046 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:08.046 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:08.046 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:08.046 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:08.047 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:08.047 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:08.047 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:08.047 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:08.047 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:08.048 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:08.048 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:08.048 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:08.048 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:08.049 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:08.049 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:08.049 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:08.049 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.050 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.050 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.050 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.050 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.050 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.051 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.051 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.051 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.051 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.052 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:08.052 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.052 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:08.052 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.053 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:08.053 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:08.053 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.053 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.053 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.054 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.054 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:08.054 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.054 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.055 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.055 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.055 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:08.055 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.055 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.056 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.056 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.056 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:08.056 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:08.057 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.057 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.057 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.057 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.057 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.058 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:08.058 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:08.058 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.059 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.059 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.059 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.059 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:08.059 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.060 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.060 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.060 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.060 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:08.061 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.061 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.061 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.061 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.062 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:08.062 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:08.062 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.062 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.063 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.063 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:08.063 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:08.064 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.064 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.064 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.065 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:08.065 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.065 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.065 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.066 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.066 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:08.066 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.066 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.067 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.067 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:08.067 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:08.067 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.068 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.068 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.068 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.068 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.069 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:08.069 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:08.069 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.069 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.070 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.070 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.070 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.071 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.071 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:08.071 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.071 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.071 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.072 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.072 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.072 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.072 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:08.073 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.073 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.073 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.073 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.073 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.074 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.074 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:08.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.075 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:42:08.075 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.075 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.075 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.076 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.076 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.076 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.077 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.077 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.077 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:08.078 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:08.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f04bc0650e0 msgr2=0x7f04bc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f04bc0650e0 0x7f04bc067590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d4089030 tx=0x7f04c00090e0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 msgr2=0x7f04d41ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 --2- 172.21.15.150:0/2391009342 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f04d40c3340 0x7f04d41ed9b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c340 tx=0x7f04c800c650 comp rx=0 tx=0).stop 2022-08-10T17:42:08.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04d96f2700 1 -- 172.21.15.150:0/2391009342 reap_dead start 2022-08-10T17:42:08.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 shutdown_connections 2022-08-10T17:42:08.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.032+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 >> 172.21.15.150:0/2391009342 conn(0x7f04d406b500 msgr2=0x7f04d40c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:08.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.033+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 shutdown_connections 2022-08-10T17:42:08.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.033+0000 7f04db155700 1 -- 172.21.15.150:0/2391009342 wait complete. 2022-08-10T17:42:08.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:42:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.375+0000 7f22c44d2700 1 Processor -- start 2022-08-10T17:42:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.378+0000 7f22c44d2700 1 -- start start 2022-08-10T17:42:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.379+0000 7f22c44d2700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f22bc070290 0x7f22bc06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.379+0000 7f22c44d2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0c9990 con 0x7f22bc0c8990 2022-08-10T17:42:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.379+0000 7f22c44d2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc15b830 con 0x7f22bc0c26c0 2022-08-10T17:42:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.379+0000 7f22c44d2700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc15af60 con 0x7f22bc070290 2022-08-10T17:42:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c226e700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f22bc0c26c0 0x7f22bc0c3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:35556/0 (socket says 172.21.15.150:35556) 2022-08-10T17:42:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c226e700 1 -- 172.21.15.150:0/3270207079 learned_addr learned my addr 172.21.15.150:0/3270207079 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c1a6d700 1 --2- 172.21.15.150:0/3270207079 >> v2:172.21.15.197:3300/0 conn(0x7f22bc070290 0x7f22bc06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c1a6d700 1 -- 172.21.15.150:0/3270207079 >> v1:172.21.15.197:6789/0 conn(0x7f22bc0c26c0 legacy=0x7f22bc0c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c1a6d700 1 -- 172.21.15.150:0/3270207079 >> v1:172.21.15.150:6789/0 conn(0x7f22bc0c8990 legacy=0x7f22bc1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.380+0000 7f22c1a6d700 1 -- 172.21.15.150:0/3270207079 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0706f0 con 0x7f22bc070290 2022-08-10T17:42:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.391+0000 7f22c1a6d700 1 --2- 172.21.15.150:0/3270207079 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc070290 0x7f22bc06dcf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22b80096b0 tx=0x7f22b80099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bd0bb929a5438be server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.395+0000 7f22c126c700 1 -- 172.21.15.150:0/3270207079 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8004230 con 0x7f22bc070290 2022-08-10T17:42:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.398+0000 7f22c126c700 1 -- 172.21.15.150:0/3270207079 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8004390 con 0x7f22bc070290 2022-08-10T17:42:08.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.398+0000 7f22c126c700 1 -- 172.21.15.150:0/3270207079 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011870 con 0x7f22bc070290 2022-08-10T17:42:08.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.420+0000 7f22c44d2700 1 -- 172.21.15.150:0/3270207079 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc070290 msgr2=0x7f22bc06dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.420+0000 7f22c44d2700 1 --2- 172.21.15.150:0/3270207079 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc070290 0x7f22bc06dcf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22b80096b0 tx=0x7f22b80099c0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.421+0000 7f22c44d2700 1 -- 172.21.15.150:0/3270207079 shutdown_connections 2022-08-10T17:42:08.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.421+0000 7f22c44d2700 1 --2- 172.21.15.150:0/3270207079 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc070290 0x7f22bc06dcf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.421+0000 7f22c44d2700 1 -- 172.21.15.150:0/3270207079 >> 172.21.15.150:0/3270207079 conn(0x7f22bc06b500 msgr2=0x7f22bc06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:08.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.421+0000 7f22c44d2700 1 -- 172.21.15.150:0/3270207079 shutdown_connections 2022-08-10T17:42:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.427+0000 7f22c44d2700 1 -- 172.21.15.150:0/3270207079 wait complete. 2022-08-10T17:42:08.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.429+0000 7f22c44d2700 1 Processor -- start 2022-08-10T17:42:08.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 -- start start 2022-08-10T17:42:08.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc070290 0x7f22bc0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22bc0c26c0 0x7f22bc1e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c8990 0x7f22bc1e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1e85c0 con 0x7f22bc070290 2022-08-10T17:42:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1eb960 con 0x7f22bc0c8990 2022-08-10T17:42:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.431+0000 7f22c44d2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1ebc00 con 0x7f22bc0c26c0 2022-08-10T17:42:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.432+0000 7f22c1a6d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22bc0c26c0 msgr2=0x7f22bc1e8a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:42:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.432+0000 7f22c1a6d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22bc0c26c0 0x7f22bc1e8a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.432+0000 7f22c226e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc070290 0x7f22bc0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.432+0000 7f22c226e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc070290 0x7f22bc0c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36530/0 (socket says 172.21.15.150:36530) 2022-08-10T17:42:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.432+0000 7f22c226e700 1 -- 172.21.15.150:0/2659000607 learned_addr learned my addr 172.21.15.150:0/2659000607 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.433+0000 7f22c2a6f700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c8990 0x7f22bc1e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.436+0000 7f22c2a6f700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22bc0c26c0 msgr2=0x7f22bc1e8a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.436+0000 7f22c2a6f700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22bc0c26c0 0x7f22bc1e8a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.436+0000 7f22c2a6f700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc070290 msgr2=0x7f22bc0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.436+0000 7f22c2a6f700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc070290 0x7f22bc0c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.436+0000 7f22c2a6f700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009310 con 0x7f22bc0c8990 2022-08-10T17:42:08.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.437+0000 7f22c2a6f700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c8990 0x7f22bc1e8f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22b400b520 tx=0x7f22b400b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.438+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011830 con 0x7f22bc0c8990 2022-08-10T17:42:08.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.438+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4011990 con 0x7f22bc0c8990 2022-08-10T17:42:08.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.438+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011d40 con 0x7f22bc0c8990 2022-08-10T17:42:08.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.441+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc1ebee0 con 0x7f22bc0c8990 2022-08-10T17:42:08.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.441+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1ec4a0 con 0x7f22bc0c8990 2022-08-10T17:42:08.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.442+0000 7f22c44d2700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 0x7f22bc142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.442+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0673d0 con 0x7f22bc1ec660 2022-08-10T17:42:08.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.443+0000 7f22c226e700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 0x7f22bc142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.448+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f22b400f050 con 0x7f22bc0c8990 2022-08-10T17:42:08.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.448+0000 7f22b2ffd700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22a4065060 0x7f22a4067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.448+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f22b4081cf0 con 0x7f22bc0c8990 2022-08-10T17:42:08.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.448+0000 7f22c226e700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22bc1e8420 con 0x7f22bc1ec660 2022-08-10T17:42:08.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.449+0000 7f22c1a6d700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22a4065060 0x7f22a4067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.450+0000 7f22c1a6d700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22a4065060 0x7f22a4067510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009a00 tx=0x7f22b8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.451+0000 7f22c226e700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 0x7f22bc142ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac020b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.458+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0182e0 con 0x7f22bc1ec660 2022-08-10T17:42:08.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.459+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f22ac018440 con 0x7f22bc1ec660 2022-08-10T17:42:08.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.460+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 msgr2=0x7f22bc142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.460+0000 7f22b2ffd700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 0x7f22bc142ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac020b30 comp rx=0 tx=0).stop 2022-08-10T17:42:08.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.460+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 msgr2=0x7f22bc142ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:08.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.460+0000 7f22b2ffd700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc1ec660 0x7f22bc142ec0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac020b30 comp rx=0 tx=0).stop 2022-08-10T17:42:08.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.480+0000 7f22c44d2700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 0x7f22bc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:08.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.480+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc14e850 con 0x7f22bc0c1100 2022-08-10T17:42:08.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.481+0000 7f22c226e700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 0x7f22bc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:08.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.484+0000 7f22c226e700 1 -- 172.21.15.150:0/2659000607 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22bc0c9620 con 0x7f22bc0c1100 2022-08-10T17:42:08.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.484+0000 7f22c226e700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 0x7f22bc143400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac016710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:08.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.488+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac02db40 con 0x7f22bc0c1100 2022-08-10T17:42:08.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.491+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4875 (secure 0 0 0) 0x7f22ac02dca0 con 0x7f22bc0c1100 2022-08-10T17:42:08.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.491+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 msgr2=0x7f22bc143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.491+0000 7f22b2ffd700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 0x7f22bc143400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac016710 comp rx=0 tx=0).stop 2022-08-10T17:42:08.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.491+0000 7f22b2ffd700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 msgr2=0x7f22bc143400 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:08.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.491+0000 7f22b2ffd700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c1100 0x7f22bc143400 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22ac020770 tx=0x7f22ac016710 comp rx=0 tx=0).stop 2022-08-10T17:42:08.499 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:08.500 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:08.500 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:08.500 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:42:08.500 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 50, 2022-08-10T17:42:08.501 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:08.501 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:08.501 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:42:08.501 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.502 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:42:08.502 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:08.502 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:08.502 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:08.503 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.503 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.503 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.504 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.504 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.504 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.505 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.505 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.505 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.505 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.506 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:08.506 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:08.506 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.506 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.507 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.507 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.507 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.507 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.508 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.508 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.508 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.508 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.509 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:08.509 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:08.510 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:08.510 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:08.510 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:08.510 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:08.511 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:08.511 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:08.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:08.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:08.512 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:08.512 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:08.512 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:08.512 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:08.512 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:08.513 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:08.513 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:08.513 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:08.514 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:08.514 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:08.514 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:08.514 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:08.515 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:08.515 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:08.515 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:08.515 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.516 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:08.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.516 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:08.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.517 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:08.517 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:08.517 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.517 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.518 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.518 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:08.518 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.519 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.519 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:08.519 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.520 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.520 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.520 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:08.521 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:08.521 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.521 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.521 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.522 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:08.522 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:08.523 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.523 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.524 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:08.524 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.525 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.525 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:08.525 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.525 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.525 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.526 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:08.526 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:08.526 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.527 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.527 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.528 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:08.528 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:08.528 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:08.528 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:08.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:08.529 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:08.529 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.530 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:08.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:08.531 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:08.531 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.531 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.531 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:08.532 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:08.532 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:08.532 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:08.532 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:08.533 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.533 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.533 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:08.534 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:08.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.534 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.535 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.535 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:08.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.535 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.536 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:08.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.536 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.536 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.537 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:42:08.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.537 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.537 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:08.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.538 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.538 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.538 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:42:08.539 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.539 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.539 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:08.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.540 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.540 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.540 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:42:08.540 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.541 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:08.541 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:42:08.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:08.542 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:08.542 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:08.542 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:42:08.543 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:08.543 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:08.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:08.543 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:08.544 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:08.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.499+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22a4065060 msgr2=0x7f22a4067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.499+0000 7f22c44d2700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22a4065060 0x7f22a4067510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009a00 tx=0x7f22b8008030 comp rx=0 tx=0).stop 2022-08-10T17:42:08.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.499+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c8990 msgr2=0x7f22bc1e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:08.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.499+0000 7f22c44d2700 1 --2- 172.21.15.150:0/2659000607 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22bc0c8990 0x7f22bc1e8f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22b400b520 tx=0x7f22b400b830 comp rx=0 tx=0).stop 2022-08-10T17:42:08.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.501+0000 7f22c2a6f700 1 -- 172.21.15.150:0/2659000607 reap_dead start 2022-08-10T17:42:08.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.501+0000 7f22c2a6f700 1 -- 172.21.15.150:0/2659000607 reap_dead start 2022-08-10T17:42:08.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.503+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 shutdown_connections 2022-08-10T17:42:08.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.503+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 >> 172.21.15.150:0/2659000607 conn(0x7f22bc06b500 msgr2=0x7f22bc14e140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:08.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.517+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 shutdown_connections 2022-08-10T17:42:08.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:08.518+0000 7f22c44d2700 1 -- 172.21.15.150:0/2659000607 wait complete. 2022-08-10T17:42:08.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:42:09.842 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:42:09.845 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:42:28.550 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:42:28.551 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:42:28.552 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:42:28.552 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:42:28.556 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:42:28.557 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:42:28.557 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:28.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.807+0000 7f5210030700 1 Processor -- start 2022-08-10T17:42:28.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.807+0000 7f5210030700 1 -- start start 2022-08-10T17:42:28.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.808+0000 7f5210030700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f520815a950 0x7f52080c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:28.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.808+0000 7f5210030700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080c4930 con 0x7f52081577a0 2022-08-10T17:42:28.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.808+0000 7f5210030700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520815adc0 con 0x7f52081573d0 2022-08-10T17:42:28.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.808+0000 7f5210030700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080c5610 con 0x7f520815a950 2022-08-10T17:42:28.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520ddcc700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f52081573d0 0x7f52080c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:35942/0 (socket says 172.21.15.150:35942) 2022-08-10T17:42:28.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520ddcc700 1 -- 172.21.15.150:0/4158325377 learned_addr learned my addr 172.21.15.150:0/4158325377 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:28.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520d5cb700 1 --2- 172.21.15.150:0/4158325377 >> v2:172.21.15.150:3300/0 conn(0x7f520815a950 0x7f52080c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:28.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520cdca700 1 -- 172.21.15.150:0/4158325377 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069459321 0 0) 0x7f52080c4930 con 0x7f52081577a0 2022-08-10T17:42:28.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520cdca700 1 -- 172.21.15.150:0/4158325377 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f0003430 con 0x7f52081577a0 2022-08-10T17:42:28.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520d5cb700 1 -- 172.21.15.150:0/4158325377 >> v1:172.21.15.197:6789/0 conn(0x7f52081573d0 legacy=0x7f52080c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:28.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520d5cb700 1 -- 172.21.15.150:0/4158325377 >> v1:172.21.15.150:6789/0 conn(0x7f52081577a0 legacy=0x7f52080c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:28.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520d5cb700 1 -- 172.21.15.150:0/4158325377 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080c58f0 con 0x7f520815a950 2022-08-10T17:42:28.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.809+0000 7f520d5cb700 1 --2- 172.21.15.150:0/4158325377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520815a950 0x7f52080c5ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52040096b0 tx=0x7f52040099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6145f4d6eaaec73 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:28.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.810+0000 7f520cdca700 1 -- 172.21.15.150:0/4158325377 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040107b0 con 0x7f520815a950 2022-08-10T17:42:28.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.810+0000 7f520cdca700 1 -- 172.21.15.150:0/4158325377 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204010910 con 0x7f520815a950 2022-08-10T17:42:28.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.810+0000 7f520cdca700 1 -- 172.21.15.150:0/4158325377 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204010cc0 con 0x7f520815a950 2022-08-10T17:42:28.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.811+0000 7f5210030700 1 -- 172.21.15.150:0/4158325377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520815a950 msgr2=0x7f52080c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:28.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.811+0000 7f5210030700 1 --2- 172.21.15.150:0/4158325377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520815a950 0x7f52080c5ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52040096b0 tx=0x7f52040099c0 comp rx=0 tx=0).stop 2022-08-10T17:42:28.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.813+0000 7f5210030700 1 -- 172.21.15.150:0/4158325377 shutdown_connections 2022-08-10T17:42:28.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.813+0000 7f5210030700 1 --2- 172.21.15.150:0/4158325377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520815a950 0x7f52080c5ee0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:28.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.813+0000 7f5210030700 1 -- 172.21.15.150:0/4158325377 >> 172.21.15.150:0/4158325377 conn(0x7f5208070590 msgr2=0x7f5208071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:28.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.818+0000 7f5210030700 1 -- 172.21.15.150:0/4158325377 shutdown_connections 2022-08-10T17:42:28.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.818+0000 7f5210030700 1 -- 172.21.15.150:0/4158325377 wait complete. 2022-08-10T17:42:28.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.820+0000 7f5210030700 1 Processor -- start 2022-08-10T17:42:28.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.820+0000 7f5210030700 1 -- start start 2022-08-10T17:42:28.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52081573d0 0x7f52081ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:28.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 0x7f520814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:28.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:28.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520806b160 con 0x7f52081573d0 2022-08-10T17:42:28.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081ed420 con 0x7f520815a950 2022-08-10T17:42:28.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.821+0000 7f5210030700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080c8fb0 con 0x7f52081577a0 2022-08-10T17:42:28.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520d5cb700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 msgr2=0x7f520814ba60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:42:28.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520d5cb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 0x7f520814ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:28.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:28.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:47510/0 (socket says 172.21.15.150:47510) 2022-08-10T17:42:28.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 -- 172.21.15.150:0/4178548299 learned_addr learned my addr 172.21.15.150:0/4178548299 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:28.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 -- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 msgr2=0x7f520814ba60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:28.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 0x7f520814ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:28.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 -- 172.21.15.150:0/4178548299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52081573d0 msgr2=0x7f52081ecee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:28.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52081573d0 0x7f52081ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:28.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.822+0000 7f520e5cd700 1 -- 172.21.15.150:0/4178548299 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009310 con 0x7f520815a950 2022-08-10T17:42:28.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.823+0000 7f520e5cd700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f520000c760 tx=0x7f520000cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:28.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.823+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200003a80 con 0x7f520815a950 2022-08-10T17:42:28.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.823+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200003be0 con 0x7f520815a950 2022-08-10T17:42:28.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.823+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52000050d0 con 0x7f520815a950 2022-08-10T17:42:28.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.824+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5208155e80 con 0x7f520815a950 2022-08-10T17:42:28.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.824+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208156440 con 0x7f520815a950 2022-08-10T17:42:28.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.825+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52080be5b0 con 0x7f520815a950 2022-08-10T17:42:28.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.826+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5200019030 con 0x7f520815a950 2022-08-10T17:42:28.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.826+0000 7f51f67fc700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 0x7f51e80674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:28.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.827+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5200081770 con 0x7f520815a950 2022-08-10T17:42:28.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.827+0000 7f520ddcc700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 0x7f51e80674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:28.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.827+0000 7f520ddcc700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 0x7f51e80674e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51f8001450 tx=0x7f51f8007950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:28.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:28.834+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f520004f670 con 0x7f520815a950 2022-08-10T17:42:29.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.459+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f52080c6e40 con 0x7f520815a950 2022-08-10T17:42:29.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.464+0000 7f51f67fc700 1 -- 172.21.15.150:0/4178548299 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5200052c90 con 0x7f520815a950 2022-08-10T17:42:29.470 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:29.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 msgr2=0x7f51e80674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:29.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 0x7f51e80674e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51f8001450 tx=0x7f51f8007950 comp rx=0 tx=0).stop 2022-08-10T17:42:29.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 msgr2=0x7f52080c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:29.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f520000c760 tx=0x7f520000cb20 comp rx=0 tx=0).stop 2022-08-10T17:42:29.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 shutdown_connections 2022-08-10T17:42:29.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f520815a950 0x7f52080c9e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:29.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52081573d0 0x7f52081ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:29.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f51e8065030 0x7f51e80674e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:29.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 --2- 172.21.15.150:0/4178548299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f52081577a0 0x7f520814ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:29.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.468+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 >> 172.21.15.150:0/4178548299 conn(0x7f5208070590 msgr2=0x7f52081598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:29.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.469+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 shutdown_connections 2022-08-10T17:42:29.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:29.469+0000 7f5210030700 1 -- 172.21.15.150:0/4178548299 wait complete. 2022-08-10T17:42:32.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:32.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.961+0000 7f1f52ea8700 1 Processor -- start 2022-08-10T17:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.961+0000 7f1f52ea8700 1 -- start start 2022-08-10T17:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f52ea8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f1f4c155190 0x7f1f4c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f52ea8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f52ea8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0c6250 con 0x7f1f4c155560 2022-08-10T17:42:32.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f52ea8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c4530 con 0x7f1f4c155190 2022-08-10T17:42:32.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f52ea8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c47b0 con 0x7f1f4c06f4d0 2022-08-10T17:42:32.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f4bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1f4c155560 0x7f1f4c071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:49664/0 (socket says 172.21.15.150:49664) 2022-08-10T17:42:32.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f4bfff700 1 -- 172.21.15.150:0/875275557 learned_addr learned my addr 172.21.15.150:0/875275557 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:32.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f51445700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:32.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 --2- 172.21.15.150:0/875275557 >> v2:172.21.15.197:3300/0 conn(0x7f1f4c155190 0x7f1f4c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:32.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f51445700 1 -- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 msgr2=0x7f1f4c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:32.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f51445700 1 -- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 msgr2=0x7f1f4c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f51445700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f51445700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f4b7fe700 1 -- 172.21.15.150:0/875275557 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442898474 0 0) 0x7f1f4c0c6250 con 0x7f1f4c155560 2022-08-10T17:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f4b7fe700 1 -- 172.21.15.150:0/875275557 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f30003430 con 0x7f1f4c155560 2022-08-10T17:42:32.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 -- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 msgr2=0x7f1f4c070330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:32.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 -- 172.21.15.150:0/875275557 >> v1:172.21.15.150:6789/0 conn(0x7f1f4c155560 legacy=0x7f1f4c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:32.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 -- 172.21.15.150:0/875275557 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0c6ec0 con 0x7f1f4c155190 2022-08-10T17:42:32.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.962+0000 7f1f50c44700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c155190 0x7f1f4c06eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f400096b0 tx=0x7f1f400099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188bdd9caad5c137 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:32.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f4b7fe700 1 -- 172.21.15.150:0/875275557 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400107b0 con 0x7f1f4c155190 2022-08-10T17:42:32.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f4b7fe700 1 -- 172.21.15.150:0/875275557 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40010910 con 0x7f1f4c155190 2022-08-10T17:42:32.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f4b7fe700 1 -- 172.21.15.150:0/875275557 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40010c80 con 0x7f1f4c155190 2022-08-10T17:42:32.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 -- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c155190 msgr2=0x7f1f4c06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:32.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c155190 0x7f1f4c06eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f400096b0 tx=0x7f1f400099c0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 -- 172.21.15.150:0/875275557 shutdown_connections 2022-08-10T17:42:32.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c06f4d0 0x7f1f4c070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/875275557 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c155190 0x7f1f4c06eed0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 -- 172.21.15.150:0/875275557 >> 172.21.15.150:0/875275557 conn(0x7f1f4c068be0 msgr2=0x7f1f4c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:32.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 -- 172.21.15.150:0/875275557 shutdown_connections 2022-08-10T17:42:32.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.963+0000 7f1f52ea8700 1 -- 172.21.15.150:0/875275557 wait complete. 2022-08-10T17:42:32.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.965+0000 7f1f52ea8700 1 Processor -- start 2022-08-10T17:42:32.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.965+0000 7f1f52ea8700 1 -- start start 2022-08-10T17:42:32.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c06f4d0 0x7f1f4c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c155190 0x7f1f4c0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c8d20 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c87f0 con 0x7f1f4c06f4d0 2022-08-10T17:42:32.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f52ea8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c06ac50 con 0x7f1f4c155190 2022-08-10T17:42:32.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:32.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36994/0 (socket says 172.21.15.150:36994) 2022-08-10T17:42:32.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 -- 172.21.15.150:0/1183936875 learned_addr learned my addr 172.21.15.150:0/1183936875 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:32.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f50c44700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c06f4d0 0x7f1f4c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:32.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 -- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c155190 msgr2=0x7f1f4c0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:32.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c155190 0x7f1f4c0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 -- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c06f4d0 msgr2=0x7f1f4c0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:32.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c06f4d0 0x7f1f4c0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:32.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 -- 172.21.15.150:0/1183936875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009310 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.966+0000 7f1f51445700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007d50 tx=0x7f1f4400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:32.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.967+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44018070 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.967+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4400ebe0 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.967+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44007ea0 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.967+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c0c8a40 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.967+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c06a970 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.968+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c072890 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.969+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1f44012050 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.969+0000 7f1f497fa700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 0x7f1f34067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:32.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.969+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1f44081f60 con 0x7f1f4c15c0d0 2022-08-10T17:42:32.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.971+0000 7f1f50c44700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 0x7f1f34067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:32.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.972+0000 7f1f50c44700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 0x7f1f34067560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:32.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:32.978+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1f4404ff40 con 0x7f1f4c15c0d0 2022-08-10T17:42:33.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.356+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f4c06df70 con 0x7f1f4c15c0d0 2022-08-10T17:42:33.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.358+0000 7f1f497fa700 1 -- 172.21.15.150:0/1183936875 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f1f44053560 con 0x7f1f4c15c0d0 2022-08-10T17:42:33.367 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:33.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.378+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 msgr2=0x7f1f34067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.378+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 0x7f1f34067560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40008030 comp rx=0 tx=0).stop 2022-08-10T17:42:33.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.378+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 msgr2=0x7f1f4c15e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.378+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007d50 tx=0x7f1f4400e3c0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 shutdown_connections 2022-08-10T17:42:33.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f4c15c0d0 0x7f1f4c15e880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f4c06f4d0 0x7f1f4c0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f340650b0 0x7f1f34067560 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 --2- 172.21.15.150:0/1183936875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f4c155190 0x7f1f4c0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.383+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 >> 172.21.15.150:0/1183936875 conn(0x7f1f4c068be0 msgr2=0x7f1f4c154170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:33.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.391+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 shutdown_connections 2022-08-10T17:42:33.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.400+0000 7f1f52ea8700 1 -- 172.21.15.150:0/1183936875 wait complete. 2022-08-10T17:42:33.435 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:42:33.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:42:33.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.642+0000 7f438f6e7700 1 Processor -- start 2022-08-10T17:42:33.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.642+0000 7f438f6e7700 1 -- start start 2022-08-10T17:42:33.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438f6e7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43880c7850 0x7f4388068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438f6e7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880c7cb0 con 0x7f4388151290 2022-08-10T17:42:33.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438f6e7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880c1f40 con 0x7f4388158170 2022-08-10T17:42:33.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438f6e7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4388069130 con 0x7f43880c7850 2022-08-10T17:42:33.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438dc84700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43880c7850 0x7f4388068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438d483700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4388151290 0x7f4388157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:49680/0 (socket says 172.21.15.150:49680) 2022-08-10T17:42:33.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438dc84700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43880c7850 0x7f4388068bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37004/0 (socket says 172.21.15.150:37004) 2022-08-10T17:42:33.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.643+0000 7f438d483700 1 -- 172.21.15.150:0/1191543787 learned_addr learned my addr 172.21.15.150:0/1191543787 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:33.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115896227 0 0) 0x7f43880c7cb0 con 0x7f4388151290 2022-08-10T17:42:33.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4370003430 con 0x7f4388151290 2022-08-10T17:42:33.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400004282 0 0) 0x7f43880c1f40 con 0x7f4388158170 2022-08-10T17:42:33.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f438dc84700 1 -- 172.21.15.150:0/1191543787 >> v1:172.21.15.197:6789/0 conn(0x7f4388158170 legacy=0x7f43880c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f438dc84700 1 -- 172.21.15.150:0/1191543787 >> v1:172.21.15.150:6789/0 conn(0x7f4388151290 legacy=0x7f4388157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f438dc84700 1 -- 172.21.15.150:0/1191543787 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880c2220 con 0x7f43880c7850 2022-08-10T17:42:33.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f438dc84700 1 --2- 172.21.15.150:0/1191543787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c7850 0x7f4388068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4380009d90 tx=0x7f438000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6356b3fe1789a1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000e070 con 0x7f43880c7850 2022-08-10T17:42:33.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000bb20 con 0x7f43880c7850 2022-08-10T17:42:33.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.644+0000 7f4377fff700 1 -- 172.21.15.150:0/1191543787 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000bed0 con 0x7f43880c7850 2022-08-10T17:42:33.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.645+0000 7f438f6e7700 1 -- 172.21.15.150:0/1191543787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c7850 msgr2=0x7f4388068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.645+0000 7f438f6e7700 1 --2- 172.21.15.150:0/1191543787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c7850 0x7f4388068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4380009d90 tx=0x7f438000b330 comp rx=0 tx=0).stop 2022-08-10T17:42:33.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.645+0000 7f438f6e7700 1 -- 172.21.15.150:0/1191543787 shutdown_connections 2022-08-10T17:42:33.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.645+0000 7f438f6e7700 1 --2- 172.21.15.150:0/1191543787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c7850 0x7f4388068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.645+0000 7f438f6e7700 1 -- 172.21.15.150:0/1191543787 >> 172.21.15.150:0/1191543787 conn(0x7f438806f880 msgr2=0x7f438806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:33.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.647+0000 7f438f6e7700 1 -- 172.21.15.150:0/1191543787 shutdown_connections 2022-08-10T17:42:33.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.647+0000 7f438f6e7700 1 -- 172.21.15.150:0/1191543787 wait complete. 2022-08-10T17:42:33.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.649+0000 7f438f6e7700 1 Processor -- start 2022-08-10T17:42:33.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.649+0000 7f438f6e7700 1 -- start start 2022-08-10T17:42:33.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 0x7f43881f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4388158170 0x7f43881f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43881f0e00 con 0x7f4388151290 2022-08-10T17:42:33.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43881f44f0 con 0x7f4388158170 2022-08-10T17:42:33.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438f6e7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438814b490 con 0x7f43880c7850 2022-08-10T17:42:33.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438cc82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 0x7f43881f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438d483700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438cc82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 0x7f43881f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37010/0 (socket says 172.21.15.150:37010) 2022-08-10T17:42:33.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 -- 172.21.15.150:0/2270582740 learned_addr learned my addr 172.21.15.150:0/2270582740 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:33.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438dc84700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4388158170 0x7f43881f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.650+0000 7f438d483700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51228/0 (socket says 172.21.15.150:51228) 2022-08-10T17:42:33.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438d483700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 msgr2=0x7f43881f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:42:33.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438d483700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 msgr2=0x7f43881f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:42:33.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:33.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:33.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 msgr2=0x7f43881f4980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:33.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f43880c7850 0x7f43881f4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4388158170 msgr2=0x7f43881f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4388158170 0x7f43881f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380009a70 con 0x7f4388151290 2022-08-10T17:42:33.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438cc82700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 0x7f43881f1430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f437800c440 tx=0x7f437800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437800ce60 con 0x7f4388151290 2022-08-10T17:42:33.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378003500 con 0x7f4388151290 2022-08-10T17:42:33.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780038b0 con 0x7f4388151290 2022-08-10T17:42:33.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.651+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438814b9e0 con 0x7f4388151290 2022-08-10T17:42:33.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.652+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43881f3ea0 con 0x7f4388151290 2022-08-10T17:42:33.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.653+0000 7f438f6e7700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 0x7f43881e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.653+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880644b0 con 0x7f43881f40c0 2022-08-10T17:42:33.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.654+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 0x7f43881e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.654+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4378019030 con 0x7f4388151290 2022-08-10T17:42:33.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.654+0000 7f438d483700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4388070610 con 0x7f43881f40c0 2022-08-10T17:42:33.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 0x7f43881e3440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4384001000 tx=0x7f438400e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43680650e0 0x7f4368067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4378081440 con 0x7f4388151290 2022-08-10T17:42:33.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43840070d0 con 0x7f43881f40c0 2022-08-10T17:42:33.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f4384007230 con 0x7f43881f40c0 2022-08-10T17:42:33.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 msgr2=0x7f43881e3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 0x7f43881e3440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4384001000 tx=0x7f438400e790 comp rx=0 tx=0).stop 2022-08-10T17:42:33.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 msgr2=0x7f43881e3440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:33.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.655+0000 7f4375ffb700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43881f40c0 0x7f43881e3440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.656+0000 7f438dc84700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43680650e0 0x7f4368067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.657+0000 7f438dc84700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43680650e0 0x7f4368067590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4380014040 tx=0x7f4380011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.664+0000 7f438f6e7700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 0x7f43880b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.664+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388071e10 con 0x7f43880c8e30 2022-08-10T17:42:33.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.664+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 0x7f43880b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f438d483700 1 -- 172.21.15.150:0/2270582740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4388072890 con 0x7f43880c8e30 2022-08-10T17:42:33.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f438d483700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 0x7f43880b0660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4384001000 tx=0x7f4384001050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384027070 con 0x7f43880c8e30 2022-08-10T17:42:33.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4861 (secure 0 0 0) 0x7f4384014690 con 0x7f43880c8e30 2022-08-10T17:42:33.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 msgr2=0x7f43880b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 0x7f43880b0660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4384001000 tx=0x7f4384001050 comp rx=0 tx=0).stop 2022-08-10T17:42:33.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 msgr2=0x7f43880b0660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:33.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.665+0000 7f4375ffb700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43880c8e30 0x7f43880b0660 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.682 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:33.682 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:33.682 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:33.682 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:42:33.683 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:33.683 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:33.683 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:33.683 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:33.683 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:33.684 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.684 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:42:33.684 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:33.684 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:33.685 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:33.685 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:33.685 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:33.685 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:33.685 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:33.686 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:33.686 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:33.686 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:33.687 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:33.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:33.687 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:33.688 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:33.688 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:33.688 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:33.688 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:33.689 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:33.689 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:33.689 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:33.689 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:33.689 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:33.690 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:33.690 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.691 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:33.691 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:33.691 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:33.691 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:33.691 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:33.692 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:33.692 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:33.692 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:33.692 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:33.693 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:33.693 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:33.693 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:33.693 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:33.693 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:33.694 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:33.694 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:33.694 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:33.694 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:33.696 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:33.696 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:33.696 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.696 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:33.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.697 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:33.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.697 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:33.697 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:33.698 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:33.698 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:33.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:33.698 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:33.699 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:33.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:33.700 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.700 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.700 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.701 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:33.701 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:33.701 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:33.701 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:33.701 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:33.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.702 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:33.702 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:33.703 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:33.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:33.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:33.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:33.704 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.704 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:33.704 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:33.705 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.705 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.706 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:33.706 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:33.706 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:33.706 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:33.706 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:33.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.707 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:33.707 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:33.707 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:33.708 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:33.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.708 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:33.708 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:33.709 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.709 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:33.709 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.711 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:33.711 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:33.711 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:33.711 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:33.712 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:33.712 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.712 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.713 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:33.713 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:33.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.713 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:33.714 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:33.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:33.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.714 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.715 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:33.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.715 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:33.715 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:33.716 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:33.716 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.716 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.717 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:33.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.717 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:33.717 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:33.718 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:33.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.718 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:33.718 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:33.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.719 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:42:33.719 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:33.719 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:33.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:33.720 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:33.720 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:33.721 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:42:33.721 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:33.721 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:33.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:33.721 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:33.722 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:33.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43680650e0 msgr2=0x7f4368067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43680650e0 0x7f4368067590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4380014040 tx=0x7f4380011000 comp rx=0 tx=0).stop 2022-08-10T17:42:33.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 msgr2=0x7f43881f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 --2- 172.21.15.150:0/2270582740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4388151290 0x7f43881f1430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f437800c440 tx=0x7f437800c750 comp rx=0 tx=0).stop 2022-08-10T17:42:33.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438dc84700 1 -- 172.21.15.150:0/2270582740 reap_dead start 2022-08-10T17:42:33.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438dc84700 1 -- 172.21.15.150:0/2270582740 reap_dead start 2022-08-10T17:42:33.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 shutdown_connections 2022-08-10T17:42:33.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 >> 172.21.15.150:0/2270582740 conn(0x7f438806f880 msgr2=0x7f43880c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:33.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 shutdown_connections 2022-08-10T17:42:33.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.666+0000 7f438f6e7700 1 -- 172.21.15.150:0/2270582740 wait complete. 2022-08-10T17:42:33.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:42:33.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.938+0000 7fe0bc2a4700 1 Processor -- start 2022-08-10T17:42:33.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.939+0000 7fe0bc2a4700 1 -- start start 2022-08-10T17:42:33.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.940+0000 7fe0bc2a4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe0b40c4100 0x7fe0b4069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.940+0000 7fe0bc2a4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe0b406a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.940+0000 7fe0bc2a4700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40707d0 con 0x7fe0b40c91d0 2022-08-10T17:42:33.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.940+0000 7fe0bc2a4700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b414d250 con 0x7fe0b40c4100 2022-08-10T17:42:33.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.940+0000 7fe0bc2a4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4153980 con 0x7fe0b40c45b0 2022-08-10T17:42:33.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.942+0000 7fe0ba040700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fe0b40c91d0 0x7fe0b40c3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:36050/0 (socket says 172.21.15.150:36050) 2022-08-10T17:42:33.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.942+0000 7fe0ba040700 1 -- 172.21.15.150:0/2836675867 learned_addr learned my addr 172.21.15.150:0/2836675867 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:33.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.942+0000 7fe0b983f700 1 --2- 172.21.15.150:0/2836675867 >> v2:172.21.15.197:3300/0 conn(0x7fe0b40c4100 0x7fe0b4069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443445910 0 0) 0x7fe0b40707d0 con 0x7fe0b40c91d0 2022-08-10T17:42:33.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe09c003430 con 0x7fe0b40c91d0 2022-08-10T17:42:33.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0ba841700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe0b406a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0ba841700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 msgr2=0x7fe0b406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:42:33.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0ba841700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 msgr2=0x7fe0b406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:33.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0ba841700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe0b406a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:33.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.943+0000 7fe0ba841700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe0b406a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:33.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055405921 0 0) 0x7fe09c003430 con 0x7fe0b40c91d0 2022-08-10T17:42:33.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 msgr2=0x7fe0b406a1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:33.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe0b406a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 >> v2:172.21.15.197:3300/0 conn(0x7fe0b40c4100 msgr2=0x7fe0b4069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:33.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 --2- 172.21.15.150:0/2836675867 >> v2:172.21.15.197:3300/0 conn(0x7fe0b40c4100 0x7fe0b4069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.945+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4152b40 con 0x7fe0b40c91d0 2022-08-10T17:42:33.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fe0b0004d70 con 0x7fe0b40c91d0 2022-08-10T17:42:33.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 >> v1:172.21.15.197:6789/0 conn(0x7fe0b40c91d0 legacy=0x7fe0b40c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c003880 0x7fe09c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe09c0046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe09c004c10 0x7fe09c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b414d250 con 0x7fe09c003880 2022-08-10T17:42:33.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4153980 con 0x7fe09c004c10 2022-08-10T17:42:33.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.948+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0140d0 con 0x7fe0b40c45b0 2022-08-10T17:42:33.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.949+0000 7fe0ba040700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c003880 0x7fe09c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 msgr2=0x7fe09c0046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:33.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c45b0 0x7fe09c0046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe09c004c10 msgr2=0x7fe09c005080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:42:33.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe09c004c10 0x7fe09c005080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 -- 172.21.15.150:0/2836675867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c003430 con 0x7fe09c003880 2022-08-10T17:42:33.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0ba040700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c003880 0x7fe09c003cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d1a0 tx=0x7fe09c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ca043e76929530 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000dc20 con 0x7fe09c003880 2022-08-10T17:42:33.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000dd80 con 0x7fe09c003880 2022-08-10T17:42:33.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.950+0000 7fe0b903e700 1 -- 172.21.15.150:0/2836675867 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0012640 con 0x7fe09c003880 2022-08-10T17:42:33.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.953+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/2836675867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c003880 msgr2=0x7fe09c003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.953+0000 7fe0bc2a4700 1 --2- 172.21.15.150:0/2836675867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe09c003880 0x7fe09c003cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d1a0 tx=0x7fe09c005700 comp rx=0 tx=0).stop 2022-08-10T17:42:33.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.957+0000 7fe0ba841700 1 -- 172.21.15.150:0/2836675867 reap_dead start 2022-08-10T17:42:33.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.957+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/2836675867 shutdown_connections 2022-08-10T17:42:33.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.957+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/2836675867 >> 172.21.15.150:0/2836675867 conn(0x7fe0b406b500 msgr2=0x7fe0b406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:33.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.958+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/2836675867 shutdown_connections 2022-08-10T17:42:33.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.960+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/2836675867 wait complete. 2022-08-10T17:42:33.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.962+0000 7fe0bc2a4700 1 Processor -- start 2022-08-10T17:42:33.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.964+0000 7fe0bc2a4700 1 -- start start 2022-08-10T17:42:33.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0b41d9120 0x7fe0b41f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c1520 0x7fe0b41db970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 0x7fe0b414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41da060 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b406da40 con 0x7fe0b41d9120 2022-08-10T17:42:33.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.965+0000 7fe0bc2a4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b406dd20 con 0x7fe0b40c1520 2022-08-10T17:42:33.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 0x7fe0b414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 0x7fe0b414c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37030/0 (socket says 172.21.15.150:37030) 2022-08-10T17:42:33.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 learned_addr learned my addr 172.21.15.150:0/4109807597 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:33.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c1520 msgr2=0x7fe0b41db970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:33.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0b40c1520 0x7fe0b41db970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0b41d9120 msgr2=0x7fe0b41f96e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:33.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0b41d9120 0x7fe0b41f96e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:33.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.966+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b406e000 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.967+0000 7fe0ba841700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 0x7fe0b414c370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c9b00 tx=0x7fe0ac009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.968+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac010070 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.968+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00b400 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.968+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac008940 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.969+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b406e2e0 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.969+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41d96d0 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.972+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe0ac008aa0 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.973+0000 7fe0a2ffd700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe0940651b0 0x7fe094067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.973+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe0ac081aa0 con 0x7fe0b41dbeb0 2022-08-10T17:42:33.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.975+0000 7fe0ba040700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe0940651b0 0x7fe094067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.978+0000 7fe0ba040700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe0940651b0 0x7fe094067660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b000b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.984+0000 7fe0bc2a4700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 0x7fe098004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:33.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.984+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098007d90 con 0x7fe098002a40 2022-08-10T17:42:33.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.988+0000 7fe0b983f700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 0x7fe098004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.988+0000 7fe0b983f700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe098007f50 con 0x7fe098002a40 2022-08-10T17:42:33.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0b983f700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 0x7fe098004ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c7e70 tx=0x7fe0a400e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:33.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4004230 con 0x7fe098002a40 2022-08-10T17:42:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe0a4004390 con 0x7fe098002a40 2022-08-10T17:42:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 msgr2=0x7fe098004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 0x7fe098004ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c7e70 tx=0x7fe0a400e780 comp rx=0 tx=0).stop 2022-08-10T17:42:33.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 msgr2=0x7fe098004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:33.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:33.989+0000 7fe0a2ffd700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098002a40 0x7fe098004ef0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c7e70 tx=0x7fe0a400e780 comp rx=0 tx=0).stop 2022-08-10T17:42:34.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.003+0000 7fe0bc2a4700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 0x7fe0980072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.003+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098007910 con 0x7fe098006e30 2022-08-10T17:42:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.007+0000 7fe0b983f700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 0x7fe0980072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.012+0000 7fe0b983f700 1 -- 172.21.15.150:0/4109807597 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe098007ad0 con 0x7fe098006e30 2022-08-10T17:42:34.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.012+0000 7fe0b983f700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 0x7fe0980072b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4014000 tx=0x7fe0a40045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.018+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a401c8b0 con 0x7fe098006e30 2022-08-10T17:42:34.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.018+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4886 (secure 0 0 0) 0x7fe0a4025070 con 0x7fe098006e30 2022-08-10T17:42:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.018+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 msgr2=0x7fe0980072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.019+0000 7fe0a2ffd700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 0x7fe0980072b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4014000 tx=0x7fe0a40045d0 comp rx=0 tx=0).stop 2022-08-10T17:42:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.019+0000 7fe0a2ffd700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 msgr2=0x7fe0980072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:34.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.019+0000 7fe0a2ffd700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe098006e30 0x7fe0980072b0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4014000 tx=0x7fe0a40045d0 comp rx=0 tx=0).stop 2022-08-10T17:42:34.024 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:34.024 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:34.024 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:34.025 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:42:34.025 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:34.025 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:34.025 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:34.026 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:34.026 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:34.026 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.026 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:42:34.027 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:34.027 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:34.027 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:34.027 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:34.028 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:34.028 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:34.028 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:34.028 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:34.029 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:34.029 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:34.029 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:34.029 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:34.029 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.030 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:34.030 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:34.030 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:34.030 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:34.031 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:34.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:34.031 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:34.031 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:34.032 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:34.032 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:34.032 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:34.032 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.033 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:34.033 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:34.033 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:34.033 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:34.034 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:34.034 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:34.034 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:34.035 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:34.035 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:34.035 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:34.035 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:34.035 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:34.036 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:34.036 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:34.036 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:34.036 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:34.038 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:34.038 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:34.038 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:34.038 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:34.039 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.039 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:34.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.039 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:34.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.040 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:34.040 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:34.040 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:34.041 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:34.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.041 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:34.041 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:34.041 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.042 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:34.042 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:34.043 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.043 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.043 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.044 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:34.044 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:34.044 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:34.044 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:34.045 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:34.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.045 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:34.045 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:34.046 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:34.046 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:34.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.047 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:34.047 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:34.047 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.048 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:34.048 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:34.048 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.048 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.049 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.049 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:34.049 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:34.050 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:34.050 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:34.050 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:34.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.051 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.051 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:34.051 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:34.051 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:34.051 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:34.052 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.052 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:34.052 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:34.052 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.053 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.053 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.053 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:34.053 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:34.053 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:34.054 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.054 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.054 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.054 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:34.055 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:34.055 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:34.055 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:34.055 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:34.056 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.056 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.056 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.056 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:34.057 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:34.057 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.057 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:34.057 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:34.057 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:34.058 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.058 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.058 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:34.058 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.059 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:34.059 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:34.059 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:42:34.059 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.060 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.060 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:34.060 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.060 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:42:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:34.062 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.062 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:34.062 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:34.062 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:42:34.063 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.063 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:34.063 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:42:34.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:34.064 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:34.064 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:34.064 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:42:34.064 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:34.065 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:34.065 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:34.065 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:34.065 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:34.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe0940651b0 msgr2=0x7fe094067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe0940651b0 0x7fe094067660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b000b000 comp rx=0 tx=0).stop 2022-08-10T17:42:34.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 msgr2=0x7fe0b414c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 --2- 172.21.15.150:0/4109807597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b41dbeb0 0x7fe0b414c370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c9b00 tx=0x7fe0ac009e70 comp rx=0 tx=0).stop 2022-08-10T17:42:34.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 reap_dead start 2022-08-10T17:42:34.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0ba841700 1 -- 172.21.15.150:0/4109807597 reap_dead start 2022-08-10T17:42:34.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 shutdown_connections 2022-08-10T17:42:34.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.027+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 >> 172.21.15.150:0/4109807597 conn(0x7fe0b406b500 msgr2=0x7fe0b406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:34.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.030+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 shutdown_connections 2022-08-10T17:42:34.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.030+0000 7fe0bc2a4700 1 -- 172.21.15.150:0/4109807597 wait complete. 2022-08-10T17:42:34.069 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:42:34.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.617+0000 7f2c03cac700 1 Processor -- start 2022-08-10T17:42:34.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.617+0000 7f2c03cac700 1 -- start start 2022-08-10T17:42:34.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.619+0000 7f2c03cac700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.619+0000 7f2c03cac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0c9840 con 0x7f2bfc0c9470 2022-08-10T17:42:34.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.619+0000 7f2c03cac700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc158350 con 0x7f2bfc0c8910 2022-08-10T17:42:34.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.619+0000 7f2c03cac700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0c11f0 con 0x7f2bfc157ca0 2022-08-10T17:42:34.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.621+0000 7f2c02249700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.621+0000 7f2c02249700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:47646/0 (socket says 172.21.15.150:47646) 2022-08-10T17:42:34.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.621+0000 7f2c02249700 1 -- 172.21.15.150:0/830973030 learned_addr learned my addr 172.21.15.150:0/830973030 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:34.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c02249700 1 -- 172.21.15.150:0/830973030 >> v1:172.21.15.197:6789/0 conn(0x7f2bfc0c8910 legacy=0x7f2bfc069ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:34.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c02249700 1 -- 172.21.15.150:0/830973030 >> v1:172.21.15.150:6789/0 conn(0x7f2bfc0c9470 legacy=0x7f2bfc155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c02249700 1 -- 172.21.15.150:0/830973030 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc158630 con 0x7f2bfc157ca0 2022-08-10T17:42:34.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c02249700 1 --2- 172.21.15.150:0/830973030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009e50 tx=0x7f2bf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6584c16c479406a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:34.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c00a46700 1 -- 172.21.15.150:0/830973030 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400e070 con 0x7f2bfc157ca0 2022-08-10T17:42:34.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c00a46700 1 -- 172.21.15.150:0/830973030 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400b980 con 0x7f2bfc157ca0 2022-08-10T17:42:34.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.622+0000 7f2c00a46700 1 -- 172.21.15.150:0/830973030 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400bd30 con 0x7f2bfc157ca0 2022-08-10T17:42:34.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.623+0000 7f2c03cac700 1 -- 172.21.15.150:0/830973030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 msgr2=0x7f2bfc0c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.623+0000 7f2c03cac700 1 --2- 172.21.15.150:0/830973030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009e50 tx=0x7f2bf400b330 comp rx=0 tx=0).stop 2022-08-10T17:42:34.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.629+0000 7f2c03cac700 1 -- 172.21.15.150:0/830973030 shutdown_connections 2022-08-10T17:42:34.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.629+0000 7f2c03cac700 1 --2- 172.21.15.150:0/830973030 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:34.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.629+0000 7f2c03cac700 1 -- 172.21.15.150:0/830973030 >> 172.21.15.150:0/830973030 conn(0x7f2bfc06b500 msgr2=0x7f2bfc06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:34.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.629+0000 7f2c03cac700 1 -- 172.21.15.150:0/830973030 shutdown_connections 2022-08-10T17:42:34.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.629+0000 7f2c03cac700 1 -- 172.21.15.150:0/830973030 wait complete. 2022-08-10T17:42:34.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.631+0000 7f2c03cac700 1 Processor -- start 2022-08-10T17:42:34.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.631+0000 7f2c03cac700 1 -- start start 2022-08-10T17:42:34.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 0x7f2bfc1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc0c9470 0x7f2bfc1ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc158bf0 con 0x7f2bfc0c8910 2022-08-10T17:42:34.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1ea3b0 con 0x7f2bfc157ca0 2022-08-10T17:42:34.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.632+0000 7f2c03cac700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b5f10 con 0x7f2bfc0c9470 2022-08-10T17:42:34.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c02249700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c02249700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:47648/0 (socket says 172.21.15.150:47648) 2022-08-10T17:42:34.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 learned_addr learned my addr 172.21.15.150:0/3296174969 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:34.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 0x7f2bfc1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01247700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc0c9470 0x7f2bfc1ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc0c9470 msgr2=0x7f2bfc1ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc0c9470 0x7f2bfc1ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 msgr2=0x7f2bfc0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2bfc157ca0 0x7f2bfc0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.633+0000 7f2c01a48700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009b30 con 0x7f2bfc0c8910 2022-08-10T17:42:34.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.634+0000 7f2c01a48700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 0x7f2bfc1446a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c3c0 tx=0x7f2bf800c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.634+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8005220 con 0x7f2bfc0c8910 2022-08-10T17:42:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.634+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8005380 con 0x7f2bfc0c8910 2022-08-10T17:42:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.634+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8007230 con 0x7f2bfc0c8910 2022-08-10T17:42:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.635+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc155970 con 0x7f2bfc0c8910 2022-08-10T17:42:34.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.635+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc156410 con 0x7f2bfc0c8910 2022-08-10T17:42:34.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.638+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2bf8010050 con 0x7f2bfc0c8910 2022-08-10T17:42:34.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.639+0000 7f2bea7fc700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bdc065150 0x7f2bdc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.639+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2bf80813b0 con 0x7f2bfc0c8910 2022-08-10T17:42:34.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.639+0000 7f2c03cac700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:34.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.639+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0673d0 con 0x7f2bfc1e9ec0 2022-08-10T17:42:34.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c01247700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bdc065150 0x7f2bdc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:42:34.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:42:34.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:34.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:34.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.640+0000 7f2c01247700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bdc065150 0x7f2bdc067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc14d1d0 tx=0x7f2bec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:34.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.841+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:34.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.841+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:42:34.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.841+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:42:34.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.841+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:34.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:34.841+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:42:35.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.242+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.244+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bfc072890 con 0x7f2bfc1e9ec0 2022-08-10T17:42:35.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.245+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc06d0f0 tx=0x7f2bf4004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:35.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4043070 con 0x7f2bfc1e9ec0 2022-08-10T17:42:35.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f2bf4003e40 con 0x7f2bfc1e9ec0 2022-08-10T17:42:35.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc06d0f0 tx=0x7f2bf4004950 comp rx=0 tx=0).stop 2022-08-10T17:42:35.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 msgr2=0x7f2bfc0c4980 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:35.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.247+0000 7f2bea7fc700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc1e9ec0 0x7f2bfc0c4980 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc06d0f0 tx=0x7f2bf4004950 comp rx=0 tx=0).stop 2022-08-10T17:42:35.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.261+0000 7f2c03cac700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 0x7f2bfc14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.261+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1ea620 con 0x7f2bfc156840 2022-08-10T17:42:35.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.262+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 0x7f2bfc14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.262+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2bfc06f9d0 con 0x7f2bfc156840 2022-08-10T17:42:35.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.262+0000 7f2c02249700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 0x7f2bfc14ca20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4047000 tx=0x7f2bf4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:35.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.262+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf404c050 con 0x7f2bfc156840 2022-08-10T17:42:35.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4376 (secure 0 0 0) 0x7f2bf4012840 con 0x7f2bfc156840 2022-08-10T17:42:35.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 msgr2=0x7f2bfc14ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2bea7fc700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 0x7f2bfc14ca20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4047000 tx=0x7f2bf4011000 comp rx=0 tx=0).stop 2022-08-10T17:42:35.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2bea7fc700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 msgr2=0x7f2bfc14ca20 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:35.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2bea7fc700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2bfc156840 0x7f2bfc14ca20 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4047000 tx=0x7f2bf4011000 comp rx=0 tx=0).stop 2022-08-10T17:42:35.269 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:35.269 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:35.269 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:35.269 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:42:35.270 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:35.270 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:35.270 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:35.270 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:35.271 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:35.271 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:35.271 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:42:35.271 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:35.272 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:35.272 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:35.272 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:35.272 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:35.273 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:35.273 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:35.273 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:35.273 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:35.274 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:35.274 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:35.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:35.274 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:35.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:35.275 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:35.275 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:35.275 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:35.275 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:35.276 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:35.276 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:35.276 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:35.276 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:35.277 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:35.277 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:35.277 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.278 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:35.278 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:35.278 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:35.278 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:35.278 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:35.279 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:35.279 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:35.279 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:35.279 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:35.280 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:35.280 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:35.280 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:35.280 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:35.281 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:35.281 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:35.281 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:35.281 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:35.281 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:35.282 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:35.282 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:35.282 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:35.282 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:35.283 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:35.283 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:35.283 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:35.283 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:35.284 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:35.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.284 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:35.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.285 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:35.285 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:35.285 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:35.285 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:35.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.286 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:35.286 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:35.286 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.287 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:35.287 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:35.287 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.288 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.288 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.288 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:35.289 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:35.289 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:35.289 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:35.289 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:35.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.290 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:35.290 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:35.291 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:35.291 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:35.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.291 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:35.292 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:35.292 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.293 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:35.293 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:35.293 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.294 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.294 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.294 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:35.295 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:35.295 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:35.295 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:35.295 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:35.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.296 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:35.296 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:35.297 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:35.297 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:35.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.297 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:35.298 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:35.298 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.299 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:35.299 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:35.299 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:35.299 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.300 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.300 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:35.300 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:35.301 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:35.301 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:35.301 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:35.301 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.302 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.302 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:35.302 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:35.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.303 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:35.303 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:35.303 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:35.303 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.304 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:35.304 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:35.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:35.304 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:35.305 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:35.305 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:35.305 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:35.305 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:35.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:35.306 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:35.306 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:35.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bdc065150 msgr2=0x7f2bdc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bdc065150 0x7f2bdc067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc14d1d0 tx=0x7f2bec008040 comp rx=0 tx=0).stop 2022-08-10T17:42:35.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 msgr2=0x7f2bfc1446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c02249700 1 -- 172.21.15.150:0/3296174969 reap_dead start 2022-08-10T17:42:35.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 0x7f2bfc1446a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c3c0 tx=0x7f2bf800c6d0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 shutdown_connections 2022-08-10T17:42:35.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 --2- 172.21.15.150:0/3296174969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bfc0c8910 0x7f2bfc1446a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 >> 172.21.15.150:0/3296174969 conn(0x7f2bfc06b500 msgr2=0x7f2bfc152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:35.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 shutdown_connections 2022-08-10T17:42:35.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.263+0000 7f2c03cac700 1 -- 172.21.15.150:0/3296174969 wait complete. 2022-08-10T17:42:35.310 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:42:35.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:42:35.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.465+0000 7f22ed39c700 1 Processor -- start 2022-08-10T17:42:35.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.465+0000 7f22ed39c700 1 -- start start 2022-08-10T17:42:35.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.466+0000 7f22ed39c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22e81544d0 0x7f22e8071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.466+0000 7f22ed39c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f22e806ea90 0x7f22e80718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.466+0000 7f22ed39c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e806a050 con 0x7f22e806eff0 2022-08-10T17:42:35.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.466+0000 7f22ed39c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e80c6220 con 0x7f22e81544d0 2022-08-10T17:42:35.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.466+0000 7f22ed39c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e80c4420 con 0x7f22e806ea90 2022-08-10T17:42:35.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22e81544d0 0x7f22e8071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e77fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f22e806eff0 0x7f22e815a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:49762/0 (socket says 172.21.15.150:49762) 2022-08-10T17:42:35.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22e81544d0 0x7f22e8071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37082/0 (socket says 172.21.15.150:37082) 2022-08-10T17:42:35.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e77fe700 1 -- 172.21.15.150:0/243600838 learned_addr learned my addr 172.21.15.150:0/243600838 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:35.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22dffff700 1 --2- 172.21.15.150:0/243600838 >> v2:172.21.15.197:3300/0 conn(0x7f22e806ea90 0x7f22e80718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 -- 172.21.15.150:0/243600838 >> v2:172.21.15.197:3300/0 conn(0x7f22e806ea90 msgr2=0x7f22e80718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:35.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/243600838 >> v2:172.21.15.197:3300/0 conn(0x7f22e806ea90 0x7f22e80718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 -- 172.21.15.150:0/243600838 >> v1:172.21.15.150:6789/0 conn(0x7f22e806eff0 legacy=0x7f22e815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 -- 172.21.15.150:0/243600838 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80c4700 con 0x7f22e81544d0 2022-08-10T17:42:35.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e67fc700 1 -- 172.21.15.150:0/243600838 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773635619 0 0) 0x7f22e806a050 con 0x7f22e806eff0 2022-08-10T17:42:35.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/243600838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8071370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22e806e780 tx=0x7f22d8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bcd8df57916501 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:35.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e67fc700 1 -- 172.21.15.150:0/243600838 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d80107b0 con 0x7f22e81544d0 2022-08-10T17:42:35.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e67fc700 1 -- 172.21.15.150:0/243600838 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8010910 con 0x7f22e81544d0 2022-08-10T17:42:35.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.467+0000 7f22e67fc700 1 -- 172.21.15.150:0/243600838 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8010cc0 con 0x7f22e81544d0 2022-08-10T17:42:35.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 -- 172.21.15.150:0/243600838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 msgr2=0x7f22e8071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 --2- 172.21.15.150:0/243600838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8071370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22e806e780 tx=0x7f22d8009990 comp rx=0 tx=0).stop 2022-08-10T17:42:35.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 -- 172.21.15.150:0/243600838 shutdown_connections 2022-08-10T17:42:35.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 --2- 172.21.15.150:0/243600838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8071370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 --2- 172.21.15.150:0/243600838 >> v2:172.21.15.197:3300/0 conn(0x7f22e806ea90 0x7f22e80718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 -- 172.21.15.150:0/243600838 >> 172.21.15.150:0/243600838 conn(0x7f22e8068110 msgr2=0x7f22e8068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:35.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 -- 172.21.15.150:0/243600838 shutdown_connections 2022-08-10T17:42:35.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.468+0000 7f22ed39c700 1 -- 172.21.15.150:0/243600838 wait complete. 2022-08-10T17:42:35.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.469+0000 7f22ed39c700 1 Processor -- start 2022-08-10T17:42:35.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.469+0000 7f22ed39c700 1 -- start start 2022-08-10T17:42:35.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 0x7f22e81ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22e806eff0 0x7f22e8159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e8157290 con 0x7f22e81544d0 2022-08-10T17:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80c8ea0 con 0x7f22e806ea90 2022-08-10T17:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22ed39c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81efbe0 con 0x7f22e806eff0 2022-08-10T17:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37090/0 (socket says 172.21.15.150:37090) 2022-08-10T17:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 -- 172.21.15.150:0/1945498820 learned_addr learned my addr 172.21.15.150:0/1945498820 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 0x7f22e81ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22dffff700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22e806eff0 0x7f22e8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 -- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22e806eff0 msgr2=0x7f22e8159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22e806eff0 0x7f22e8159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 -- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 msgr2=0x7f22e81ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 0x7f22e81ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e77fe700 1 -- 172.21.15.150:0/1945498820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8009310 con 0x7f22e81544d0 2022-08-10T17:42:35.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.470+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 0x7f22e81ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:42:35.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22e77fe700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c7b0 tx=0x7f22e000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:35.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0004e80 con 0x7f22e81544d0 2022-08-10T17:42:35.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00070d0 con 0x7f22e81544d0 2022-08-10T17:42:35.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0007480 con 0x7f22e81544d0 2022-08-10T17:42:35.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80c8be0 con 0x7f22e81544d0 2022-08-10T17:42:35.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.471+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e81ef870 con 0x7f22e81544d0 2022-08-10T17:42:35.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.472+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e81ef3f0 con 0x7f22e81544d0 2022-08-10T17:42:35.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.472+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f22e001a020 con 0x7f22e81544d0 2022-08-10T17:42:35.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.473+0000 7f22df7fe700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 0x7f22cc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:35.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.473+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f22e0081f10 con 0x7f22e81544d0 2022-08-10T17:42:35.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.473+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 0x7f22cc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:35.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.473+0000 7f22e6ffd700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 0x7f22cc067560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009fd0 tx=0x7f22d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:35.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.477+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f22e81ef3f0 con 0x7f22e81544d0 2022-08-10T17:42:35.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.961+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f22e81ef3f0 con 0x7f22e81544d0 2022-08-10T17:42:35.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.962+0000 7f22df7fe700 1 -- 172.21.15.150:0/1945498820 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f22e81ef3f0 con 0x7f22e81544d0 2022-08-10T17:42:35.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 msgr2=0x7f22cc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 0x7f22cc067560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009fd0 tx=0x7f22d8008030 comp rx=0 tx=0).stop 2022-08-10T17:42:35.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 msgr2=0x7f22e8147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:35.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c7b0 tx=0x7f22e000cac0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 shutdown_connections 2022-08-10T17:42:35.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22e81544d0 0x7f22e8147bd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f22e806ea90 0x7f22e81ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f22cc0650b0 0x7f22cc067560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 --2- 172.21.15.150:0/1945498820 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f22e806eff0 0x7f22e8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:35.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.966+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 >> 172.21.15.150:0/1945498820 conn(0x7f22e8068110 msgr2=0x7f22e80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:35.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.967+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 shutdown_connections 2022-08-10T17:42:35.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:35.967+0000 7f22ed39c700 1 -- 172.21.15.150:0/1945498820 wait complete. 2022-08-10T17:42:35.989 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:42:40.378 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:42:40.399 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:42:45.991 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:42:45.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:46.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.234+0000 7f3dfee27700 1 Processor -- start 2022-08-10T17:42:46.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.234+0000 7f3dfee27700 1 -- start start 2022-08-10T17:42:46.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfee27700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfee27700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3df8153450 0x7f3df806e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfee27700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df8152fc0 con 0x7f3df80bc590 2022-08-10T17:42:46.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfee27700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df8064bc0 con 0x7f3df8153450 2022-08-10T17:42:46.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfee27700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81561f0 con 0x7f3df806ff60 2022-08-10T17:42:46.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfcbc3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:46.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.236+0000 7f3dfcbc3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51530/0 (socket says 172.21.15.150:51530) 2022-08-10T17:42:46.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.237+0000 7f3dfcbc3700 1 -- 172.21.15.150:0/3607088240 learned_addr learned my addr 172.21.15.150:0/3607088240 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:46.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.237+0000 7f3dfd3c4700 1 --2- 172.21.15.150:0/3607088240 >> v2:172.21.15.150:3300/0 conn(0x7f3df8153450 0x7f3df806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:46.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.238+0000 7f3dfcbc3700 1 -- 172.21.15.150:0/3607088240 >> v2:172.21.15.150:3300/0 conn(0x7f3df8153450 msgr2=0x7f3df806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:46.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.238+0000 7f3dfcbc3700 1 --2- 172.21.15.150:0/3607088240 >> v2:172.21.15.150:3300/0 conn(0x7f3df8153450 0x7f3df806e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.238+0000 7f3dfcbc3700 1 -- 172.21.15.150:0/3607088240 >> v1:172.21.15.150:6789/0 conn(0x7f3df80bc590 legacy=0x7f3df80644b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:46.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.238+0000 7f3dfcbc3700 1 -- 172.21.15.150:0/3607088240 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8152c70 con 0x7f3df806ff60 2022-08-10T17:42:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.238+0000 7f3dfcbc3700 1 --2- 172.21.15.150:0/3607088240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3de400ffb0 tx=0x7f3de4014530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6127488d2f7ccba8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:46.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.241+0000 7f3df77fe700 1 -- 172.21.15.150:0/3607088240 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4014e00 con 0x7f3df806ff60 2022-08-10T17:42:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.241+0000 7f3df77fe700 1 -- 172.21.15.150:0/3607088240 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4010040 con 0x7f3df806ff60 2022-08-10T17:42:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.241+0000 7f3df77fe700 1 -- 172.21.15.150:0/3607088240 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4004230 con 0x7f3df806ff60 2022-08-10T17:42:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.242+0000 7f3dfee27700 1 -- 172.21.15.150:0/3607088240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 msgr2=0x7f3df8156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:46.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.242+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3607088240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3de400ffb0 tx=0x7f3de4014530 comp rx=0 tx=0).stop 2022-08-10T17:42:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 -- 172.21.15.150:0/3607088240 shutdown_connections 2022-08-10T17:42:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3607088240 >> v2:172.21.15.150:3300/0 conn(0x7f3df8153450 0x7f3df806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3607088240 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df806ff60 0x7f3df8156d60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 -- 172.21.15.150:0/3607088240 >> 172.21.15.150:0/3607088240 conn(0x7f3df80c92f0 msgr2=0x7f3df80c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 -- 172.21.15.150:0/3607088240 shutdown_connections 2022-08-10T17:42:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.245+0000 7f3dfee27700 1 -- 172.21.15.150:0/3607088240 wait complete. 2022-08-10T17:42:46.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.247+0000 7f3dfee27700 1 Processor -- start 2022-08-10T17:42:46.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.258+0000 7f3dfee27700 1 -- start start 2022-08-10T17:42:46.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3df806ff60 0x7f3df80c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df80bc590 0x7f3df80c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c2520 con 0x7f3df8153450 2022-08-10T17:42:46.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c0900 con 0x7f3df806ff60 2022-08-10T17:42:46.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.259+0000 7f3dfee27700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80bfa90 con 0x7f3df80bc590 2022-08-10T17:42:46.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.260+0000 7f3df7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df80bc590 0x7f3df80c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.260+0000 7f3dfd3c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.260+0000 7f3dfd3c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37312/0 (socket says 172.21.15.150:37312) 2022-08-10T17:42:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.260+0000 7f3dfd3c4700 1 -- 172.21.15.150:0/3230458321 learned_addr learned my addr 172.21.15.150:0/3230458321 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 -- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df80bc590 msgr2=0x7f3df80c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df80bc590 0x7f3df80c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 -- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3df806ff60 msgr2=0x7f3df80c1fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:46.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3df806ff60 0x7f3df80c1fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 -- 172.21.15.150:0/3230458321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de400fc10 con 0x7f3df8153450 2022-08-10T17:42:46.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.261+0000 7f3dfd3c4700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009d30 tx=0x7f3df001d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:46.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.263+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df001dd50 con 0x7f3df8153450 2022-08-10T17:42:46.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.263+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df001ded0 con 0x7f3df8153450 2022-08-10T17:42:46.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.263+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0024630 con 0x7f3df8153450 2022-08-10T17:42:46.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.263+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8154da0 con 0x7f3df8153450 2022-08-10T17:42:46.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.263+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df80bffc0 con 0x7f3df8153450 2022-08-10T17:42:46.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.267+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3df0024790 con 0x7f3df8153450 2022-08-10T17:42:46.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.268+0000 7f3df57fa700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 0x7f3ddc0677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:46.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.268+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3df00b5f20 con 0x7f3df8153450 2022-08-10T17:42:46.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.269+0000 7f3dfcbc3700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 0x7f3ddc0677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:46.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.272+0000 7f3dfcbc3700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 0x7f3ddc0677c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000c00 tx=0x7f3de4009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:46.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.274+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df80c01e0 con 0x7f3df8153450 2022-08-10T17:42:46.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.304+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f3df0054020 con 0x7f3df8153450 2022-08-10T17:42:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.894+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3df8073340 con 0x7f3df8153450 2022-08-10T17:42:46.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.900+0000 7f3df57fa700 1 -- 172.21.15.150:0/3230458321 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f3df0083e90 con 0x7f3df8153450 2022-08-10T17:42:46.906 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:46.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 msgr2=0x7f3ddc0677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 0x7f3ddc0677c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000c00 tx=0x7f3de4009000 comp rx=0 tx=0).stop 2022-08-10T17:42:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 msgr2=0x7f3df814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009d30 tx=0x7f3df001d3b0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 shutdown_connections 2022-08-10T17:42:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3df8153450 0x7f3df814f190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3df806ff60 0x7f3df80c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ddc065310 0x7f3ddc0677c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 --2- 172.21.15.150:0/3230458321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3df80bc590 0x7f3df80c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:46.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 >> 172.21.15.150:0/3230458321 conn(0x7f3df80c92f0 msgr2=0x7f3df80c42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:46.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 shutdown_connections 2022-08-10T17:42:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:46.910+0000 7f3dfee27700 1 -- 172.21.15.150:0/3230458321 wait complete. 2022-08-10T17:42:46.942 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:42:46.943 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:42:46.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:42:47.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.314+0000 7ff130959700 1 Processor -- start 2022-08-10T17:42:47.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.314+0000 7ff130959700 1 -- start start 2022-08-10T17:42:47.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff130959700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff12c06bfe0 0x7ff12c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff130959700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0707d0 con 0x7ff12c0c91d0 2022-08-10T17:42:47.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff130959700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c14d250 con 0x7ff12c0c4100 2022-08-10T17:42:47.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff130959700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c153980 con 0x7ff12c06bfe0 2022-08-10T17:42:47.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff12a59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff12c0c91d0 0x7ff12c0c3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:50020/0 (socket says 172.21.15.150:50020) 2022-08-10T17:42:47.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.315+0000 7ff12a59c700 1 -- 172.21.15.150:0/2624835881 learned_addr learned my addr 172.21.15.150:0/2624835881 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:47.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191873258 0 0) 0x7ff12c0707d0 con 0x7ff12c0c91d0 2022-08-10T17:42:47.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff110003430 con 0x7ff12c0c91d0 2022-08-10T17:42:47.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098884015 0 0) 0x7ff110003430 con 0x7ff12c0c91d0 2022-08-10T17:42:47.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 >> v2:172.21.15.150:3300/0 conn(0x7ff12c06bfe0 msgr2=0x7ff12c15eb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:47.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 --2- 172.21.15.150:0/2624835881 >> v2:172.21.15.150:3300/0 conn(0x7ff12c06bfe0 0x7ff12c15eb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 >> v1:172.21.15.197:6789/0 conn(0x7ff12c0c4100 legacy=0x7ff12c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:47.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c152b40 con 0x7ff12c0c91d0 2022-08-10T17:42:47.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7ff11c001670 con 0x7ff12c0c91d0 2022-08-10T17:42:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 >> v1:172.21.15.150:6789/0 conn(0x7ff12c0c91d0 legacy=0x7ff12c0c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff110003880 0x7ff110003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff1100046d0 0x7ff110004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1100051a0 0x7ff1100140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c153980 con 0x7ff1100051a0 2022-08-10T17:42:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110014870 con 0x7ff1100046d0 2022-08-10T17:42:47.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.316+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff110014a30 con 0x7ff110003880 2022-08-10T17:42:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff129d9b700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff1100046d0 0x7ff110004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff110003880 0x7ff110003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 -- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff1100046d0 msgr2=0x7ff110004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff1100046d0 0x7ff110004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 -- 172.21.15.150:0/2624835881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1100051a0 msgr2=0x7ff1100140a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1100051a0 0x7ff1100140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 -- 172.21.15.150:0/2624835881 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c152b40 con 0x7ff110003880 2022-08-10T17:42:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff129d9b700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff1100046d0 0x7ff110004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:42:47.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12a59c700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff110003880 0x7ff110003c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c190 tx=0x7ff110005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df4afd09eb6ddc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00ccf0 con 0x7ff110003880 2022-08-10T17:42:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00ce50 con 0x7ff110003880 2022-08-10T17:42:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.317+0000 7ff12959a700 1 -- 172.21.15.150:0/2624835881 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c007310 con 0x7ff110003880 2022-08-10T17:42:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.318+0000 7ff130959700 1 -- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff110003880 msgr2=0x7ff110003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.318+0000 7ff130959700 1 --2- 172.21.15.150:0/2624835881 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff110003880 0x7ff110003c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c190 tx=0x7ff110005700 comp rx=0 tx=0).stop 2022-08-10T17:42:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.321+0000 7ff12ad9d700 1 -- 172.21.15.150:0/2624835881 reap_dead start 2022-08-10T17:42:47.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.321+0000 7ff12ad9d700 1 -- 172.21.15.150:0/2624835881 reap_dead start 2022-08-10T17:42:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.323+0000 7ff130959700 1 -- 172.21.15.150:0/2624835881 shutdown_connections 2022-08-10T17:42:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.323+0000 7ff130959700 1 -- 172.21.15.150:0/2624835881 >> 172.21.15.150:0/2624835881 conn(0x7ff12c06b500 msgr2=0x7ff12c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:47.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.323+0000 7ff130959700 1 -- 172.21.15.150:0/2624835881 shutdown_connections 2022-08-10T17:42:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.323+0000 7ff130959700 1 -- 172.21.15.150:0/2624835881 wait complete. 2022-08-10T17:42:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.324+0000 7ff130959700 1 Processor -- start 2022-08-10T17:42:47.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.325+0000 7ff130959700 1 -- start start 2022-08-10T17:42:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff110003880 0x7ff12c1dc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 0x7ff12c1e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff12c14ba20 0x7ff12c14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c8380 con 0x7ff110003880 2022-08-10T17:42:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c6ba0 con 0x7ff12c14ba20 2022-08-10T17:42:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.326+0000 7ff130959700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c1e8ca0 con 0x7ff12c1475c0 2022-08-10T17:42:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 0x7ff12c1e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 0x7ff12c1e8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51574/0 (socket says 172.21.15.150:51574) 2022-08-10T17:42:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 -- 172.21.15.150:0/4271771898 learned_addr learned my addr 172.21.15.150:0/4271771898 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff12c14ba20 msgr2=0x7ff12c14be90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:42:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff12c14ba20 0x7ff12c14be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff110003880 msgr2=0x7ff12c1dc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff110003880 0x7ff12c1dc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c1482b0 con 0x7ff12c1475c0 2022-08-10T17:42:47.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.327+0000 7ff129d9b700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 0x7ff12c1e8760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff124020810 tx=0x7ff124020bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.328+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124003c90 con 0x7ff12c1475c0 2022-08-10T17:42:47.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.328+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124003df0 con 0x7ff12c1475c0 2022-08-10T17:42:47.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.328+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124005310 con 0x7ff12c1475c0 2022-08-10T17:42:47.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.328+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c148590 con 0x7ff12c1475c0 2022-08-10T17:42:47.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.328+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c148b50 con 0x7ff12c1475c0 2022-08-10T17:42:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.329+0000 7ff130959700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 0x7ff12c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.329+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0673d0 con 0x7ff12c148d10 2022-08-10T17:42:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.329+0000 7ff12a59c700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 0x7ff12c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.329+0000 7ff12a59c700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff12c073340 con 0x7ff12c148d10 2022-08-10T17:42:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.331+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff124005470 con 0x7ff12c1475c0 2022-08-10T17:42:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.331+0000 7ff12a59c700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 0x7ff12c0c7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff11c014000 tx=0x7ff11c007300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.331+0000 7ff11affd700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1080650b0 0x7ff108067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.331+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff124093700 con 0x7ff12c1475c0 2022-08-10T17:42:47.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.331+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c007680 con 0x7ff12c148d10 2022-08-10T17:42:47.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.332+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff11c0046f0 con 0x7ff12c148d10 2022-08-10T17:42:47.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.332+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 msgr2=0x7ff12c0c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.332+0000 7ff11affd700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 0x7ff12c0c7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff11c014000 tx=0x7ff11c007300 comp rx=0 tx=0).stop 2022-08-10T17:42:47.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.332+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 msgr2=0x7ff12c0c7030 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:47.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.332+0000 7ff11affd700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c148d10 0x7ff12c0c7030 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff11c014000 tx=0x7ff11c007300 comp rx=0 tx=0).stop 2022-08-10T17:42:47.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.334+0000 7ff12ad9d700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1080650b0 0x7ff108067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.339+0000 7ff12ad9d700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1080650b0 0x7ff108067560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff12c066f80 tx=0x7ff1200069f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.350+0000 7ff130959700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 0x7ff12c1eb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.350+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c7d30 con 0x7ff12c0c7570 2022-08-10T17:42:47.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.355+0000 7ff12a59c700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 0x7ff12c1eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.355+0000 7ff12a59c700 1 -- 172.21.15.150:0/4271771898 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff12c072890 con 0x7ff12c0c7570 2022-08-10T17:42:47.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.356+0000 7ff12a59c700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 0x7ff12c1eb260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff11c008fd0 tx=0x7ff11c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c028c90 con 0x7ff12c0c7570 2022-08-10T17:42:47.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4862 (secure 0 0 0) 0x7ff11c01e430 con 0x7ff12c0c7570 2022-08-10T17:42:47.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 msgr2=0x7ff12c1eb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 0x7ff12c1eb260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff11c008fd0 tx=0x7ff11c010000 comp rx=0 tx=0).stop 2022-08-10T17:42:47.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 msgr2=0x7ff12c1eb260 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:47.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.357+0000 7ff11affd700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff12c0c7570 0x7ff12c1eb260 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff11c008fd0 tx=0x7ff11c010000 comp rx=0 tx=0).stop 2022-08-10T17:42:47.363 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:42:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:42:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:42:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:47.401 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1080650b0 msgr2=0x7ff108067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff130959700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff1080650b0 0x7ff108067560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff12c066f80 tx=0x7ff1200069f0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 msgr2=0x7ff12c1e8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff130959700 1 --2- 172.21.15.150:0/4271771898 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff12c1475c0 0x7ff12c1e8760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff124020810 tx=0x7ff124020bd0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff12ad9d700 1 -- 172.21.15.150:0/4271771898 reap_dead start 2022-08-10T17:42:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.387+0000 7ff12ad9d700 1 -- 172.21.15.150:0/4271771898 reap_dead start 2022-08-10T17:42:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.392+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 shutdown_connections 2022-08-10T17:42:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.392+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 >> 172.21.15.150:0/4271771898 conn(0x7ff12c06b500 msgr2=0x7ff12c151150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.402+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 shutdown_connections 2022-08-10T17:42:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.403+0000 7ff130959700 1 -- 172.21.15.150:0/4271771898 wait complete. 2022-08-10T17:42:47.432 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:42:47.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.705+0000 7f5a149c3700 1 Processor -- start 2022-08-10T17:42:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.705+0000 7f5a149c3700 1 -- start start 2022-08-10T17:42:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.706+0000 7f5a149c3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a100bc830 0x7f5a10068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.706+0000 7f5a149c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a1006c860 0x7f5a10152e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.706+0000 7f5a149c3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a101563c0 con 0x7f5a10070040 2022-08-10T17:42:47.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.706+0000 7f5a149c3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a10068650 con 0x7f5a100bc830 2022-08-10T17:42:47.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.706+0000 7f5a149c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10150940 con 0x7f5a1006c860 2022-08-10T17:42:47.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.708+0000 7f5a0ed9d700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f5a10070040 0x7f5a100c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:36394/0 (socket says 172.21.15.150:36394) 2022-08-10T17:42:47.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.708+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/2475659887 learned_addr learned my addr 172.21.15.150:0/2475659887 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:47.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/2475659887 >> v2:172.21.15.150:3300/0 conn(0x7f5a100bc830 0x7f5a10068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 -- 172.21.15.150:0/2475659887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a1006c860 msgr2=0x7f5a10152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:47.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/2475659887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a1006c860 0x7f5a10152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 -- 172.21.15.150:0/2475659887 >> v1:172.21.15.197:6789/0 conn(0x7f5a10070040 legacy=0x7f5a100c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 -- 172.21.15.150:0/2475659887 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10068870 con 0x7f5a100bc830 2022-08-10T17:42:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.709+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/2475659887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a100bc830 0x7f5a10068110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009d90 tx=0x7f5a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872804fb8c207961 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.710+0000 7f5a0d59a700 1 -- 172.21.15.150:0/2475659887 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800e070 con 0x7f5a100bc830 2022-08-10T17:42:47.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.710+0000 7f5a0d59a700 1 -- 172.21.15.150:0/2475659887 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800bbd0 con 0x7f5a100bc830 2022-08-10T17:42:47.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.710+0000 7f5a0d59a700 1 -- 172.21.15.150:0/2475659887 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08012430 con 0x7f5a100bc830 2022-08-10T17:42:47.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.711+0000 7f5a149c3700 1 -- 172.21.15.150:0/2475659887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a100bc830 msgr2=0x7f5a10068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.711+0000 7f5a149c3700 1 --2- 172.21.15.150:0/2475659887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a100bc830 0x7f5a10068110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009d90 tx=0x7f5a0800b330 comp rx=0 tx=0).stop 2022-08-10T17:42:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.717+0000 7f5a149c3700 1 -- 172.21.15.150:0/2475659887 shutdown_connections 2022-08-10T17:42:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.717+0000 7f5a149c3700 1 --2- 172.21.15.150:0/2475659887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a100bc830 0x7f5a10068110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.718+0000 7f5a149c3700 1 --2- 172.21.15.150:0/2475659887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a1006c860 0x7f5a10152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.718+0000 7f5a149c3700 1 -- 172.21.15.150:0/2475659887 >> 172.21.15.150:0/2475659887 conn(0x7f5a100c92f0 msgr2=0x7f5a100c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:47.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.720+0000 7f5a149c3700 1 -- 172.21.15.150:0/2475659887 shutdown_connections 2022-08-10T17:42:47.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.720+0000 7f5a149c3700 1 -- 172.21.15.150:0/2475659887 wait complete. 2022-08-10T17:42:47.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.722+0000 7f5a149c3700 1 Processor -- start 2022-08-10T17:42:47.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.722+0000 7f5a149c3700 1 -- start start 2022-08-10T17:42:47.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.723+0000 7f5a149c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1006c860 0x7f5a100c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.723+0000 7f5a149c3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10070040 0x7f5a10148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a149c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a100bc830 0x7f5a10149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a149c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100bee90 con 0x7f5a1006c860 2022-08-10T17:42:47.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a149c3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c01b0 con 0x7f5a10070040 2022-08-10T17:42:47.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a149c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10155b30 con 0x7f5a100bc830 2022-08-10T17:42:47.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a0e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1006c860 0x7f5a100c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a0e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1006c860 0x7f5a100c1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37368/0 (socket says 172.21.15.150:37368) 2022-08-10T17:42:47.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.724+0000 7f5a0e59c700 1 -- 172.21.15.150:0/3095470236 learned_addr learned my addr 172.21.15.150:0/3095470236 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:47.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a100bc830 0x7f5a10149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10070040 msgr2=0x7f5a10148c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:42:47.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10070040 0x7f5a10148c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1006c860 msgr2=0x7f5a100c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1006c860 0x7f5a100c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.725+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009a70 con 0x7f5a100bc830 2022-08-10T17:42:47.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.727+0000 7f5a0ed9d700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a100bc830 0x7f5a10149190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400c420 tx=0x7f5a0400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.728+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040072d0 con 0x7f5a100bc830 2022-08-10T17:42:47.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.728+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04007430 con 0x7f5a100bc830 2022-08-10T17:42:47.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.728+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040057c0 con 0x7f5a100bc830 2022-08-10T17:42:47.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.731+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a100bfa20 con 0x7f5a100bc830 2022-08-10T17:42:47.738 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.732+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10155d80 con 0x7f5a100bc830 2022-08-10T17:42:47.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.733+0000 7f5a149c3700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 0x7f5a100bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.733+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10071e00 con 0x7f5a10155fa0 2022-08-10T17:42:47.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.733+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 0x7f5a100bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.733+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5a04019030 con 0x7f5a100bc830 2022-08-10T17:42:47.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.733+0000 7f5a0e59c700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a10072890 con 0x7f5a10155fa0 2022-08-10T17:42:47.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 0x7f5a100bfbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a08014040 tx=0x7f5a08004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec065130 0x7f59ec0675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5a040810c0 con 0x7f5a100bc830 2022-08-10T17:42:47.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f5a0dd9b700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec065130 0x7f59ec0675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08004410 con 0x7f5a10155fa0 2022-08-10T17:42:47.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f5a08004570 con 0x7f5a10155fa0 2022-08-10T17:42:47.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 msgr2=0x7f5a100bfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 0x7f5a100bfbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a08014040 tx=0x7f5a08004950 comp rx=0 tx=0).stop 2022-08-10T17:42:47.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 msgr2=0x7f5a100bfbb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:47.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f59feffd700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a10155fa0 0x7f5a100bfbb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:47.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.734+0000 7f5a0dd9b700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec065130 0x7f59ec0675e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c4580 tx=0x7f5a00006a90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.746+0000 7f5a149c3700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 0x7f5a1014c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:47.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.746+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10068b50 con 0x7f5a100bb990 2022-08-10T17:42:47.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.751+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 0x7f5a1014c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:47.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.752+0000 7f5a0e59c700 1 -- 172.21.15.150:0/3095470236 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5a1006c580 con 0x7f5a100bb990 2022-08-10T17:42:47.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.753+0000 7f5a0e59c700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 0x7f5a1014c0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a08000f80 tx=0x7f5a08012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:47.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.755+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08025a10 con 0x7f5a100bb990 2022-08-10T17:42:47.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.763+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4887 (secure 0 0 0) 0x7f5a0801c400 con 0x7f5a100bb990 2022-08-10T17:42:47.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.763+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 msgr2=0x7f5a1014c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.763+0000 7f59feffd700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 0x7f5a1014c0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a08000f80 tx=0x7f5a08012000 comp rx=0 tx=0).stop 2022-08-10T17:42:47.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.763+0000 7f59feffd700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 msgr2=0x7f5a1014c0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:47.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.763+0000 7f59feffd700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5a100bb990 0x7f5a1014c0b0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a08000f80 tx=0x7f5a08012000 comp rx=0 tx=0).stop 2022-08-10T17:42:47.769 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:47.769 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:47.770 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:47.770 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:42:47.770 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:47.770 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:47.771 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:47.771 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:47.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:47.771 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.772 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:42:47.772 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:47.772 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:47.772 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:47.773 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.773 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.773 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.773 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.774 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.774 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.774 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.774 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.775 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.775 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.775 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:47.775 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:47.775 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.776 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.776 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.776 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.776 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.777 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.777 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.777 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.777 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.778 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.778 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.778 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:47.778 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:47.779 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:47.779 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:47.779 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:47.779 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:47.780 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:47.780 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:47.780 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:47.781 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:47.781 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:47.781 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:47.781 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:47.781 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:47.782 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:47.782 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:47.782 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:47.783 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:47.784 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:47.784 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:47.784 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:47.785 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.785 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:47.785 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.785 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:47.786 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.786 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:47.786 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:47.786 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.787 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.787 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.787 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.787 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:47.788 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.788 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.788 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.788 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.789 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:47.789 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.789 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.789 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.790 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.790 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:47.790 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:47.790 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.791 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.792 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:47.793 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.794 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.795 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.796 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.797 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:47.798 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.799 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:47.800 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.801 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:47.802 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.803 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.804 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.805 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.806 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:42:47.806 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.806 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.806 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.807 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:42:47.807 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.807 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.807 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:42:47.808 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.808 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.808 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.808 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:42:47.808 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.809 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.809 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:47.809 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.809 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.810 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.810 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:42:47.810 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.810 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:47.811 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:42:47.811 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:47.811 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:47.811 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:47.812 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:42:47.812 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:47.812 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:47.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:47.812 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:47.813 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:47.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec065130 msgr2=0x7f59ec0675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a149c3700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f59ec065130 0x7f59ec0675e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c4580 tx=0x7f5a00006a90 comp rx=0 tx=0).stop 2022-08-10T17:42:47.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a100bc830 msgr2=0x7f5a10149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:47.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a149c3700 1 --2- 172.21.15.150:0/3095470236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5a100bc830 0x7f5a10149190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400c420 tx=0x7f5a0400c730 comp rx=0 tx=0).stop 2022-08-10T17:42:47.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/3095470236 reap_dead start 2022-08-10T17:42:47.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.768+0000 7f5a0ed9d700 1 -- 172.21.15.150:0/3095470236 reap_dead start 2022-08-10T17:42:47.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.772+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 shutdown_connections 2022-08-10T17:42:47.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.772+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 >> 172.21.15.150:0/3095470236 conn(0x7f5a100c92f0 msgr2=0x7f5a10154730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:47.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.778+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 shutdown_connections 2022-08-10T17:42:47.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:47.782+0000 7f5a149c3700 1 -- 172.21.15.150:0/3095470236 wait complete. 2022-08-10T17:42:47.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:42:48.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.016+0000 7fbe54950700 1 Processor -- start 2022-08-10T17:42:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.021+0000 7fbe54950700 1 -- start start 2022-08-10T17:42:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe54950700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fbe500c4100 0x7fbe50069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe54950700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500707d0 con 0x7fbe500c45b0 2022-08-10T17:42:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe54950700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5014d250 con 0x7fbe500c91d0 2022-08-10T17:42:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe54950700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe50153980 con 0x7fbe500c4100 2022-08-10T17:42:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe4ed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbe500c45b0 0x7fbe5015d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:50068/0 (socket says 172.21.15.150:50068) 2022-08-10T17:42:48.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.022+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/1799728510 learned_addr learned my addr 172.21.15.150:0/1799728510 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.023+0000 7fbe4dd9b700 1 --2- 172.21.15.150:0/1799728510 >> v2:172.21.15.197:3300/0 conn(0x7fbe500c4100 0x7fbe50069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.023+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681046398 0 0) 0x7fbe500707d0 con 0x7fbe500c45b0 2022-08-10T17:42:48.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.023+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003430 con 0x7fbe500c45b0 2022-08-10T17:42:48.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1185256445 0 0) 0x7fbe34003430 con 0x7fbe500c45b0 2022-08-10T17:42:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 >> v2:172.21.15.197:3300/0 conn(0x7fbe500c4100 msgr2=0x7fbe50069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 --2- 172.21.15.150:0/1799728510 >> v2:172.21.15.197:3300/0 conn(0x7fbe500c4100 0x7fbe50069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 >> v1:172.21.15.197:6789/0 conn(0x7fbe500c91d0 legacy=0x7fbe500c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50152b40 con 0x7fbe500c45b0 2022-08-10T17:42:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fbe48004f60 con 0x7fbe500c45b0 2022-08-10T17:42:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 >> v1:172.21.15.150:6789/0 conn(0x7fbe500c45b0 legacy=0x7fbe5015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe34003880 0x7fbe34003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.024+0000 7fbe4d59a700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004290 0x7fbe34004750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4d59a700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 0x7fbe3400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50153980 con 0x7fbe34003880 2022-08-10T17:42:48.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340146c0 con 0x7fbe34004290 2022-08-10T17:42:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34014880 con 0x7fbe34004f50 2022-08-10T17:42:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 0x7fbe3400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004290 msgr2=0x7fbe34004750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:48.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004290 0x7fbe34004750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/1799728510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe34003880 msgr2=0x7fbe34003c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe34003880 0x7fbe34003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.025+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/1799728510 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50152b40 con 0x7fbe34004f50 2022-08-10T17:42:48.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.026+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/1799728510 reap_dead start 2022-08-10T17:42:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.026+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 0x7fbe3400b890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001740 tx=0x7fbe34005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130ab2c4fa92d121 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.031+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48008c00 con 0x7fbe34004f50 2022-08-10T17:42:48.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.031+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe480020a0 con 0x7fbe34004f50 2022-08-10T17:42:48.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.031+0000 7fbe4d59a700 1 -- 172.21.15.150:0/1799728510 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48026430 con 0x7fbe34004f50 2022-08-10T17:42:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.032+0000 7fbe54950700 1 -- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 msgr2=0x7fbe3400b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.032+0000 7fbe54950700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 0x7fbe3400b890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001740 tx=0x7fbe34005700 comp rx=0 tx=0).stop 2022-08-10T17:42:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.034+0000 7fbe54950700 1 -- 172.21.15.150:0/1799728510 shutdown_connections 2022-08-10T17:42:48.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.034+0000 7fbe54950700 1 --2- 172.21.15.150:0/1799728510 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe34004f50 0x7fbe3400b890 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.034+0000 7fbe54950700 1 -- 172.21.15.150:0/1799728510 >> 172.21.15.150:0/1799728510 conn(0x7fbe5006b500 msgr2=0x7fbe5006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:48.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.036+0000 7fbe54950700 1 -- 172.21.15.150:0/1799728510 shutdown_connections 2022-08-10T17:42:48.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.037+0000 7fbe54950700 1 -- 172.21.15.150:0/1799728510 wait complete. 2022-08-10T17:42:48.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.039+0000 7fbe54950700 1 Processor -- start 2022-08-10T17:42:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.039+0000 7fbe54950700 1 -- start start 2022-08-10T17:42:48.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 0x7fbe500c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501493f0 0x7fbe501486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe501466e0 0x7fbe501e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50148c30 con 0x7fbe501466e0 2022-08-10T17:42:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50149110 con 0x7fbe34004f50 2022-08-10T17:42:48.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.040+0000 7fbe54950700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501eb320 con 0x7fbe501493f0 2022-08-10T17:42:48.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.041+0000 7fbe4e59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 0x7fbe500c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.041+0000 7fbe4e59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 0x7fbe500c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:47988/0 (socket says 172.21.15.150:47988) 2022-08-10T17:42:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.041+0000 7fbe4e59c700 1 -- 172.21.15.150:0/2948279927 learned_addr learned my addr 172.21.15.150:0/2948279927 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.041+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe501466e0 0x7fbe501e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501493f0 msgr2=0x7fbe501486f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:42:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501493f0 0x7fbe501486f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe501466e0 msgr2=0x7fbe501e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe501466e0 0x7fbe501e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe501eb7b0 con 0x7fbe34004f50 2022-08-10T17:42:48.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.042+0000 7fbe4e59c700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 0x7fbe500c8630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c1c0 tx=0x7fbe4000c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.060+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400052d0 con 0x7fbe34004f50 2022-08-10T17:42:48.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.060+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40003500 con 0x7fbe34004f50 2022-08-10T17:42:48.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.060+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400038b0 con 0x7fbe34004f50 2022-08-10T17:42:48.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.060+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50148e30 con 0x7fbe34004f50 2022-08-10T17:42:48.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.060+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501eacd0 con 0x7fbe34004f50 2022-08-10T17:42:48.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.061+0000 7fbe54950700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 0x7fbe50142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.061+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500673d0 con 0x7fbe501eaec0 2022-08-10T17:42:48.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.063+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fbe40019030 con 0x7fbe34004f50 2022-08-10T17:42:48.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.064+0000 7fbe3effd700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe2c0651b0 0x7fbe2c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.064+0000 7fbe4dd9b700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 0x7fbe50142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.064+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fbe40081420 con 0x7fbe34004f50 2022-08-10T17:42:48.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.064+0000 7fbe4dd9b700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe50072890 con 0x7fbe501eaec0 2022-08-10T17:42:48.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe4dd9b700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 0x7fbe50142230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe500c7c10 tx=0x7fbe4400e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44011800 con 0x7fbe501eaec0 2022-08-10T17:42:48.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fbe44011960 con 0x7fbe501eaec0 2022-08-10T17:42:48.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 msgr2=0x7fbe50142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 0x7fbe50142230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe500c7c10 tx=0x7fbe4400e970 comp rx=0 tx=0).stop 2022-08-10T17:42:48.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 msgr2=0x7fbe50142230 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:48.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.065+0000 7fbe3effd700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501eaec0 0x7fbe50142230 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe500c7c10 tx=0x7fbe4400e970 comp rx=0 tx=0).stop 2022-08-10T17:42:48.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.066+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe2c0651b0 0x7fbe2c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.068+0000 7fbe4ed9d700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe2c0651b0 0x7fbe2c067660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe34014a10 tx=0x7fbe48007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.082+0000 7fbe54950700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 0x7fbe50142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.082+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50142cb0 con 0x7fbe501e78c0 2022-08-10T17:42:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.083+0000 7fbe4dd9b700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 0x7fbe50142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.083+0000 7fbe4dd9b700 1 -- 172.21.15.150:0/2948279927 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbe501eb460 con 0x7fbe501e78c0 2022-08-10T17:42:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.084+0000 7fbe4dd9b700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 0x7fbe50142770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400cfd0 tx=0x7fbe44004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44022070 con 0x7fbe501e78c0 2022-08-10T17:42:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7fbe440062d0 con 0x7fbe501e78c0 2022-08-10T17:42:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 msgr2=0x7fbe50142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 0x7fbe50142770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400cfd0 tx=0x7fbe44004640 comp rx=0 tx=0).stop 2022-08-10T17:42:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 msgr2=0x7fbe50142770 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:42:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.085+0000 7fbe3effd700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbe501e78c0 0x7fbe50142770 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400cfd0 tx=0x7fbe44004640 comp rx=0 tx=0).stop 2022-08-10T17:42:48.091 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:42:48.091 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:48.091 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:48.092 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:42:48.092 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 52, 2022-08-10T17:42:48.092 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:42:48.092 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:42:48.093 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:42:48.093 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:42:48.093 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:48.093 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 15, 2022-08-10T17:42:48.094 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:48.094 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:42:48.094 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:42:48.094 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:48.095 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:48.095 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:48.095 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:48.095 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:48.096 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:48.096 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:48.096 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:48.096 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:48.096 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:48.097 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:42:48.097 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:42:48.097 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:48.097 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:48.098 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:48.098 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:48.098 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:48.098 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:48.099 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:48.099 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:48.099 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:48.099 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.100 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:42:48.100 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:42:48.100 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:42:48.100 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:42:48.101 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:42:48.101 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:42:48.101 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:48.101 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:42:48.102 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:42:48.102 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:42:48.102 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:42:48.103 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:42:48.103 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:42:48.103 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:42:48.103 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:42:48.103 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:42:48.104 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:42:48.104 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:42:48.104 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:42:48.104 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:42:48.105 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:42:48.105 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:42:48.105 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:42:48.105 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:42:48.106 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:42:48.106 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:48.106 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:42:48.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.107 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:42:48.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.107 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:42:48.107 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:42:48.108 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:48.108 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:48.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.108 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:48.108 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:42:48.109 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.109 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:48.110 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:42:48.110 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.110 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.110 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.111 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:42:48.111 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:42:48.111 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:48.111 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:48.112 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:48.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.112 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:42:48.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:42:48.113 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:48.113 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:48.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.114 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:48.114 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:42:48.114 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.115 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:48.115 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:42:48.115 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.115 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.116 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.116 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:42:48.116 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:42:48.117 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:48.117 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:48.117 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:48.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.118 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:42:48.118 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:42:48.118 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:42:48.118 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:42:48.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.119 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:42:48.119 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:42:48.119 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.120 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:42:48.120 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:42:48.120 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:42:48.121 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.121 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.121 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:42:48.121 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:42:48.122 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:42:48.122 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:42:48.122 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:42:48.122 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.123 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.123 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:42:48.123 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:42:48.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.124 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:48.124 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:48.124 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:48.125 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.125 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:42:48.125 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:42:48.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:42:48.125 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:42:48.126 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:42:48.126 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:42:48.126 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:42:48.126 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:42:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:42:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:42:48.127 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:42:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe2c0651b0 msgr2=0x7fbe2c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe54950700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbe2c0651b0 0x7fbe2c067660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe34014a10 tx=0x7fbe48007000 comp rx=0 tx=0).stop 2022-08-10T17:42:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 msgr2=0x7fbe500c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe54950700 1 --2- 172.21.15.150:0/2948279927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbe34004f50 0x7fbe500c8630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c1c0 tx=0x7fbe4000c580 comp rx=0 tx=0).stop 2022-08-10T17:42:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/2948279927 reap_dead start 2022-08-10T17:42:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.089+0000 7fbe4ed9d700 1 -- 172.21.15.150:0/2948279927 reap_dead start 2022-08-10T17:42:48.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.095+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 shutdown_connections 2022-08-10T17:42:48.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.095+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 >> 172.21.15.150:0/2948279927 conn(0x7fbe5006b500 msgr2=0x7fbe5006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:48.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.109+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 shutdown_connections 2022-08-10T17:42:48.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.109+0000 7fbe54950700 1 -- 172.21.15.150:0/2948279927 wait complete. 2022-08-10T17:42:48.145 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:42:48.146 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:42:48.146 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:42:48.146 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:42:48.147 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:42:48.147 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:42:48.177 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:42:48.177 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:42:48.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:48.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.633+0000 7f7682e90700 1 Processor -- start 2022-08-10T17:42:48.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.633+0000 7f7682e90700 1 -- start start 2022-08-10T17:42:48.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7682e90700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 0x7f767c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7682e90700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 0x7f767c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7682e90700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c06b490 con 0x7f767c06d930 2022-08-10T17:42:48.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f768142d700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 msgr2=0x7f767c154ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:42:48.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7682e90700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c06bd30 con 0x7f767c06bec0 2022-08-10T17:42:48.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7682e90700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c15adb0 con 0x7f767c0700a0 2022-08-10T17:42:48.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f768142d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 0x7f767c154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:48.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f7680c2c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 0x7f767c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f767bfff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f767c06d930 0x7f767c15b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:36460/0 (socket says 172.21.15.150:36460) 2022-08-10T17:42:48.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.634+0000 7f767bfff700 1 -- 172.21.15.150:0/72458411 learned_addr learned my addr 172.21.15.150:0/72458411 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:48.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f7680c2c700 1 -- 172.21.15.150:0/72458411 >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 msgr2=0x7f767c154ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:48.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f7680c2c700 1 --2- 172.21.15.150:0/72458411 >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 0x7f767c154ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f7680c2c700 1 -- 172.21.15.150:0/72458411 >> v1:172.21.15.197:6789/0 conn(0x7f767c06d930 legacy=0x7f767c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f7680c2c700 1 -- 172.21.15.150:0/72458411 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c06b770 con 0x7f767c0700a0 2022-08-10T17:42:48.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f7680c2c700 1 --2- 172.21.15.150:0/72458411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 0x7f767c0c36c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7674009dc0 tx=0x7f767400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1cfd6dae10941f3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f767b7fe700 1 -- 172.21.15.150:0/72458411 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400e070 con 0x7f767c0700a0 2022-08-10T17:42:48.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f767b7fe700 1 -- 172.21.15.150:0/72458411 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400bb90 con 0x7f767c0700a0 2022-08-10T17:42:48.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.635+0000 7f767b7fe700 1 -- 172.21.15.150:0/72458411 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674012430 con 0x7f767c0700a0 2022-08-10T17:42:48.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.636+0000 7f7682e90700 1 -- 172.21.15.150:0/72458411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 msgr2=0x7f767c0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.636+0000 7f7682e90700 1 --2- 172.21.15.150:0/72458411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 0x7f767c0c36c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7674009dc0 tx=0x7f767400b330 comp rx=0 tx=0).stop 2022-08-10T17:42:48.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.648+0000 7f7682e90700 1 -- 172.21.15.150:0/72458411 shutdown_connections 2022-08-10T17:42:48.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.648+0000 7f7682e90700 1 --2- 172.21.15.150:0/72458411 >> v2:172.21.15.150:3300/0 conn(0x7f767c06bec0 0x7f767c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.648+0000 7f7682e90700 1 --2- 172.21.15.150:0/72458411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c0700a0 0x7f767c0c36c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.648+0000 7f7682e90700 1 -- 172.21.15.150:0/72458411 >> 172.21.15.150:0/72458411 conn(0x7f767c0c8a10 msgr2=0x7f767c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:48.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.678+0000 7f7682e90700 1 -- 172.21.15.150:0/72458411 shutdown_connections 2022-08-10T17:42:48.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.678+0000 7f7682e90700 1 -- 172.21.15.150:0/72458411 wait complete. 2022-08-10T17:42:48.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.680+0000 7f7682e90700 1 Processor -- start 2022-08-10T17:42:48.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.680+0000 7f7682e90700 1 -- start start 2022-08-10T17:42:48.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 0x7f767c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 0x7f767c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 0x7f767c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c123420 con 0x7f767c06d930 2022-08-10T17:42:48.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c122ae0 con 0x7f767c0700a0 2022-08-10T17:42:48.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f7682e90700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1f4640 con 0x7f767c06bec0 2022-08-10T17:42:48.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f767bfff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 msgr2=0x7f767c1f36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:42:48.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.681+0000 7f767bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 0x7f767c1f36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:48.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f7680c2c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 0x7f767c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f7680c2c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 0x7f767c1561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51660/0 (socket says 172.21.15.150:51660) 2022-08-10T17:42:48.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f7680c2c700 1 -- 172.21.15.150:0/1026893393 learned_addr learned my addr 172.21.15.150:0/1026893393 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:48.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 0x7f767c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 -- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 msgr2=0x7f767c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:48.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 0x7f767c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 -- 172.21.15.150:0/1026893393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 msgr2=0x7f767c1f36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:48.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 0x7f767c1f36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:48.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 -- 172.21.15.150:0/1026893393 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674009a70 con 0x7f767c0700a0 2022-08-10T17:42:48.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.682+0000 7f768142d700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 0x7f767c1225a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f766c00b440 tx=0x7f766c00b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.683+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c003ac0 con 0x7f767c0700a0 2022-08-10T17:42:48.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.683+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c003c20 con 0x7f767c0700a0 2022-08-10T17:42:48.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.683+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c157fa0 con 0x7f767c0700a0 2022-08-10T17:42:48.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.683+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0060d0 con 0x7f767c0700a0 2022-08-10T17:42:48.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.683+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c156e10 con 0x7f767c0700a0 2022-08-10T17:42:48.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.685+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f766c00f070 con 0x7f767c0700a0 2022-08-10T17:42:48.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.686+0000 7f76797fa700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 0x7f7668067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:48.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.686+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f766c080ce0 con 0x7f767c0700a0 2022-08-10T17:42:48.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.687+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c0051a0 con 0x7f767c0700a0 2022-08-10T17:42:48.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.690+0000 7f7680c2c700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 0x7f7668067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:48.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.690+0000 7f7680c2c700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 0x7f7668067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7674009d90 tx=0x7f7674011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:48.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:48.694+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f766c0496b0 con 0x7f767c0700a0 2022-08-10T17:42:49.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.237+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7658005000 con 0x7f767c0700a0 2022-08-10T17:42:49.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.240+0000 7f76797fa700 1 -- 172.21.15.150:0/1026893393 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f766c017030 con 0x7f767c0700a0 2022-08-10T17:42:49.242 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:49.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 msgr2=0x7f7668067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:49.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 0x7f7668067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7674009d90 tx=0x7f7674011000 comp rx=0 tx=0).stop 2022-08-10T17:42:49.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 msgr2=0x7f767c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:49.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 0x7f767c1225a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f766c00b440 tx=0x7f766c00b750 comp rx=0 tx=0).stop 2022-08-10T17:42:49.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 shutdown_connections 2022-08-10T17:42:49.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f767c0700a0 0x7f767c1225a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:49.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7668065150 0x7f7668067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:49.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f767c06bec0 0x7f767c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:49.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 --2- 172.21.15.150:0/1026893393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f767c06d930 0x7f767c1f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:49.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 >> 172.21.15.150:0/1026893393 conn(0x7f767c0c8a10 msgr2=0x7f767c159470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:49.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 shutdown_connections 2022-08-10T17:42:49.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:49.243+0000 7f7682e90700 1 -- 172.21.15.150:0/1026893393 wait complete. 2022-08-10T17:42:52.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:52.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.453+0000 7f135faf3700 1 Processor -- start 2022-08-10T17:42:52.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.453+0000 7f135faf3700 1 -- start start 2022-08-10T17:42:52.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.454+0000 7f135faf3700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f13580c3d30 0x7f135806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.454+0000 7f135faf3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f135806ff00 0x7f135806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.454+0000 7f135faf3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580644b0 con 0x7f1358154fe0 2022-08-10T17:42:52.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.454+0000 7f135faf3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1358070560 con 0x7f135806ff00 2022-08-10T17:42:52.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.454+0000 7f135faf3700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1358070380 con 0x7f13580c3d30 2022-08-10T17:42:52.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f13580c3d30 0x7f135806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:52.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f13580c3d30 0x7f135806bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48104/0 (socket says 172.21.15.150:48104) 2022-08-10T17:42:52.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 -- 172.21.15.150:0/149854038 learned_addr learned my addr 172.21.15.150:0/149854038 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:52.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 -- 172.21.15.150:0/149854038 >> v2:172.21.15.150:3300/0 conn(0x7f135806ff00 msgr2=0x7f135806e460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:52.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 --2- 172.21.15.150:0/149854038 >> v2:172.21.15.150:3300/0 conn(0x7f135806ff00 0x7f135806e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 -- 172.21.15.150:0/149854038 >> v1:172.21.15.197:6789/0 conn(0x7f1358154fe0 legacy=0x7f135815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:42:52.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 -- 172.21.15.150:0/149854038 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358068cc0 con 0x7f13580c3d30 2022-08-10T17:42:52.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.455+0000 7f135d08e700 1 --2- 172.21.15.150:0/149854038 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f135806bbb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f135806d7b0 tx=0x7f1348009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10b4204700c2598 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:52.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.456+0000 7f135c88d700 1 -- 172.21.15.150:0/149854038 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348011830 con 0x7f13580c3d30 2022-08-10T17:42:52.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.457+0000 7f135c88d700 1 -- 172.21.15.150:0/149854038 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348011990 con 0x7f13580c3d30 2022-08-10T17:42:52.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.457+0000 7f135c88d700 1 -- 172.21.15.150:0/149854038 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348011d40 con 0x7f13580c3d30 2022-08-10T17:42:52.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.457+0000 7f135faf3700 1 -- 172.21.15.150:0/149854038 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 msgr2=0x7f135806bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:52.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.457+0000 7f135faf3700 1 --2- 172.21.15.150:0/149854038 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f135806bbb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f135806d7b0 tx=0x7f1348009a60 comp rx=0 tx=0).stop 2022-08-10T17:42:52.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 -- 172.21.15.150:0/149854038 shutdown_connections 2022-08-10T17:42:52.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 --2- 172.21.15.150:0/149854038 >> v2:172.21.15.150:3300/0 conn(0x7f135806ff00 0x7f135806e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 --2- 172.21.15.150:0/149854038 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f135806bbb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 -- 172.21.15.150:0/149854038 >> 172.21.15.150:0/149854038 conn(0x7f13580c9350 msgr2=0x7f13580c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:52.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 -- 172.21.15.150:0/149854038 shutdown_connections 2022-08-10T17:42:52.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.458+0000 7f135faf3700 1 -- 172.21.15.150:0/149854038 wait complete. 2022-08-10T17:42:52.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 Processor -- start 2022-08-10T17:42:52.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 -- start start 2022-08-10T17:42:52.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 0x7f135812fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f1358130430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 0x7f13581339b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358064ae0 con 0x7f1358154fe0 2022-08-10T17:42:52.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135815b8e0 con 0x7f13580c3d30 2022-08-10T17:42:52.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135faf3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135815a3b0 con 0x7f135806ff00 2022-08-10T17:42:52.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135e090700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 msgr2=0x7f13581339b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:42:52.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.460+0000 7f135e090700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 0x7f13581339b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:52.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.461+0000 7f135d88f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 0x7f135812fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:52.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.461+0000 7f135d88f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 0x7f135812fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51736/0 (socket says 172.21.15.150:51736) 2022-08-10T17:42:52.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.461+0000 7f135d88f700 1 -- 172.21.15.150:0/186277547 learned_addr learned my addr 172.21.15.150:0/186277547 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:52.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f1358130430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:52.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 -- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 msgr2=0x7f135812fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:52.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 0x7f135812fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 -- 172.21.15.150:0/186277547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 msgr2=0x7f13581339b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:52.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 0x7f13581339b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 -- 172.21.15.150:0/186277547 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480093e0 con 0x7f13580c3d30 2022-08-10T17:42:52.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.464+0000 7f135d08e700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f1358130430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1348016000 tx=0x7f13480045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:52.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.465+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348003520 con 0x7f13580c3d30 2022-08-10T17:42:52.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.465+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480036a0 con 0x7f13580c3d30 2022-08-10T17:42:52.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.465+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348003a50 con 0x7f13580c3d30 2022-08-10T17:42:52.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.465+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135815b350 con 0x7f13580c3d30 2022-08-10T17:42:52.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.465+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135815b600 con 0x7f13580c3d30 2022-08-10T17:42:52.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.467+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f134800f050 con 0x7f13580c3d30 2022-08-10T17:42:52.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.467+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135806e5e0 con 0x7f13580c3d30 2022-08-10T17:42:52.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.467+0000 7f13467fc700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 0x7f1338067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:52.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.467+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1348083470 con 0x7f13580c3d30 2022-08-10T17:42:52.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.468+0000 7f135d88f700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 0x7f1338067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:52.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.468+0000 7f135d88f700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 0x7f1338067560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:52.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.474+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1348051450 con 0x7f13580c3d30 2022-08-10T17:42:52.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.885+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f13580c8a30 con 0x7f13580c3d30 2022-08-10T17:42:52.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.885+0000 7f13467fc700 1 -- 172.21.15.150:0/186277547 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f1348054a70 con 0x7f13580c3d30 2022-08-10T17:42:52.889 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:52.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 msgr2=0x7f1338067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:52.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 0x7f1338067560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354009040 comp rx=0 tx=0).stop 2022-08-10T17:42:52.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 msgr2=0x7f1358130430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:52.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f1358130430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1348016000 tx=0x7f13480045d0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 shutdown_connections 2022-08-10T17:42:52.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1358154fe0 0x7f13581339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f13380650b0 0x7f1338067560 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f135806ff00 0x7f135812fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 --2- 172.21.15.150:0/186277547 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f13580c3d30 0x7f1358130430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:52.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.887+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 >> 172.21.15.150:0/186277547 conn(0x7f13580c9350 msgr2=0x7f13580c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:52.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.888+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 shutdown_connections 2022-08-10T17:42:52.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:52.888+0000 7f135faf3700 1 -- 172.21.15.150:0/186277547 wait complete. 2022-08-10T17:42:55.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:56.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.071+0000 7fceb469c700 1 Processor -- start 2022-08-10T17:42:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.071+0000 7fceb469c700 1 -- start start 2022-08-10T17:42:56.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb469c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 0x7fceac156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb469c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac157200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb469c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac070620 con 0x7fceac150b80 2022-08-10T17:42:56.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb469c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0c5ac0 con 0x7fceac150f50 2022-08-10T17:42:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb469c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15a860 con 0x7fceac0c7d80 2022-08-10T17:42:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb1c37700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 msgr2=0x7fceac156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:42:56.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.072+0000 7fceb1c37700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 0x7fceac156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:56.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.076+0000 7fceb2438700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fceac150b80 0x7fceac0c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:36598/0 (socket says 172.21.15.150:36598) 2022-08-10T17:42:56.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.076+0000 7fceb2438700 1 -- 172.21.15.150:0/3564947960 learned_addr learned my addr 172.21.15.150:0/3564947960 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:42:56.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.080+0000 7fceb2c39700 1 --2- 172.21.15.150:0/3564947960 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:56.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.081+0000 7fceb2c39700 1 -- 172.21.15.150:0/3564947960 >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 msgr2=0x7fceac156cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:42:56.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.081+0000 7fceb2c39700 1 --2- 172.21.15.150:0/3564947960 >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 0x7fceac156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.081+0000 7fceb2c39700 1 -- 172.21.15.150:0/3564947960 >> v1:172.21.15.197:6789/0 conn(0x7fceac150b80 legacy=0x7fceac0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:56.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.081+0000 7fceb2c39700 1 -- 172.21.15.150:0/3564947960 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0ca810 con 0x7fceac0c7d80 2022-08-10T17:42:56.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.087+0000 7fceb2c39700 1 --2- 172.21.15.150:0/3564947960 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac157200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009d90 tx=0x7fcea400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d6cf7d5c48af06 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.087+0000 7fceb1436700 1 -- 172.21.15.150:0/3564947960 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400e070 con 0x7fceac0c7d80 2022-08-10T17:42:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.087+0000 7fceb1436700 1 -- 172.21.15.150:0/3564947960 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400bbd0 con 0x7fceac0c7d80 2022-08-10T17:42:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.087+0000 7fceb1436700 1 -- 172.21.15.150:0/3564947960 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4012430 con 0x7fceac0c7d80 2022-08-10T17:42:56.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.088+0000 7fceb469c700 1 -- 172.21.15.150:0/3564947960 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 msgr2=0x7fceac157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:56.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.088+0000 7fceb469c700 1 --2- 172.21.15.150:0/3564947960 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac157200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009d90 tx=0x7fcea400b330 comp rx=0 tx=0).stop 2022-08-10T17:42:56.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.089+0000 7fceb469c700 1 -- 172.21.15.150:0/3564947960 shutdown_connections 2022-08-10T17:42:56.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.089+0000 7fceb469c700 1 --2- 172.21.15.150:0/3564947960 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac157200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.089+0000 7fceb469c700 1 --2- 172.21.15.150:0/3564947960 >> v2:172.21.15.150:3300/0 conn(0x7fceac150f50 0x7fceac156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.089+0000 7fceb469c700 1 -- 172.21.15.150:0/3564947960 >> 172.21.15.150:0/3564947960 conn(0x7fceac071e40 msgr2=0x7fceac06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:56.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.091+0000 7fceb469c700 1 -- 172.21.15.150:0/3564947960 shutdown_connections 2022-08-10T17:42:56.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.091+0000 7fceb469c700 1 -- 172.21.15.150:0/3564947960 wait complete. 2022-08-10T17:42:56.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.093+0000 7fceb469c700 1 Processor -- start 2022-08-10T17:42:56.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.093+0000 7fceb469c700 1 -- start start 2022-08-10T17:42:56.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fceac150b80 0x7fceac0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 0x7fceac146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1f02e0 con 0x7fceac150f50 2022-08-10T17:42:56.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac14af50 con 0x7fceac150b80 2022-08-10T17:42:56.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb469c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac157e10 con 0x7fceac0c7d80 2022-08-10T17:42:56.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb2c39700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 msgr2=0x7fceac146090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:42:56.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb2c39700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 0x7fceac146090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:56.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb2438700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:56.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb2438700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51794/0 (socket says 172.21.15.150:51794) 2022-08-10T17:42:56.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.094+0000 7fceb2438700 1 -- 172.21.15.150:0/3034643034 learned_addr learned my addr 172.21.15.150:0/3034643034 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:56.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.095+0000 7fceb2438700 1 -- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fceac150b80 msgr2=0x7fceac0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:56.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.095+0000 7fceb2438700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fceac150b80 0x7fceac0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.095+0000 7fceb2438700 1 -- 172.21.15.150:0/3034643034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 msgr2=0x7fceac146090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:42:56.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.095+0000 7fceb2438700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 0x7fceac146090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.095+0000 7fceb2438700 1 -- 172.21.15.150:0/3034643034 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009a70 con 0x7fceac0c7d80 2022-08-10T17:42:56.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.096+0000 7fceb2438700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcea800c3a0 tx=0x7fcea800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:56.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.097+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80074e0 con 0x7fceac0c7d80 2022-08-10T17:42:56.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.097+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8007640 con 0x7fceac0c7d80 2022-08-10T17:42:56.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.097+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80059e0 con 0x7fceac0c7d80 2022-08-10T17:42:56.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.097+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac14b1f0 con 0x7fceac0c7d80 2022-08-10T17:42:56.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.097+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac157ad0 con 0x7fceac0c7d80 2022-08-10T17:42:56.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.098+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac14b710 con 0x7fceac0c7d80 2022-08-10T17:42:56.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.100+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcea8019030 con 0x7fceac0c7d80 2022-08-10T17:42:56.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.100+0000 7fce9affd700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 0x7fce8c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:56.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.100+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcea8081750 con 0x7fceac0c7d80 2022-08-10T17:42:56.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.100+0000 7fceb1c37700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 0x7fce8c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:56.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.105+0000 7fceb1c37700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 0x7fce8c067540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceac0c7950 tx=0x7fce9c006c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:42:56.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.111+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcea804f7d0 con 0x7fceac0c7d80 2022-08-10T17:42:56.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.542+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fceac14b710 con 0x7fceac0c7d80 2022-08-10T17:42:56.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.543+0000 7fce9affd700 1 -- 172.21.15.150:0/3034643034 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fceac14b710 con 0x7fceac0c7d80 2022-08-10T17:42:56.546 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:42:56.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 msgr2=0x7fce8c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:56.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 0x7fce8c067540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceac0c7950 tx=0x7fce9c006c00 comp rx=0 tx=0).stop 2022-08-10T17:42:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 msgr2=0x7fceac156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:42:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcea800c3a0 tx=0x7fcea800c760 comp rx=0 tx=0).stop 2022-08-10T17:42:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 shutdown_connections 2022-08-10T17:42:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fceac150f50 0x7fceac146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fce8c065090 0x7fce8c067540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fceac0c7d80 0x7fceac156280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 --2- 172.21.15.150:0/3034643034 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fceac150b80 0x7fceac0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:42:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 >> 172.21.15.150:0/3034643034 conn(0x7fceac071e40 msgr2=0x7fceac149280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:42:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 shutdown_connections 2022-08-10T17:42:56.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:56.545+0000 7fceb469c700 1 -- 172.21.15.150:0/3034643034 wait complete. 2022-08-10T17:42:59.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:42:59.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.890+0000 7f3fe50f1700 1 Processor -- start 2022-08-10T17:42:59.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.893+0000 7f3fe50f1700 1 -- start start 2022-08-10T17:42:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fe50f1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fe50f1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:42:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fe50f1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe006b620 con 0x7f3fe006ebd0 2022-08-10T17:42:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fe50f1700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0064bc0 con 0x7f3fe0068110 2022-08-10T17:42:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fe50f1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe013c4e0 con 0x7f3fe0068fc0 2022-08-10T17:42:59.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51864/0 (socket says 172.21.15.150:51864) 2022-08-10T17:42:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 learned_addr learned my addr 172.21.15.150:0/3835628004 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:42:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:42:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.894+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:42:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.895+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:42:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.895+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:42:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.895+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:42:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.895+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:42:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:42:59.895+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:00.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:00.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:00.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:00.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:00.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:43:00.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.096+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:00.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.097+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:00.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.097+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:00.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.097+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:00.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.097+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:43:00.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.497+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:00.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.497+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:00.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.497+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:00.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.497+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:00.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.497+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:43:00.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.499+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:00.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.499+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:00.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.499+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:00.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.499+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:00.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:00.499+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:43:01.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:01.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:01.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:01.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:01.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:01.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:43:01.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:01.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:01.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:01.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:01.302+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:43:02.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.678+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053517181 0 0) 0x7f3fe006b620 con 0x7f3fe006ebd0 2022-08-10T17:43:02.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.678+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fcc003430 con 0x7f3fe006ebd0 2022-08-10T17:43:02.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693597312 0 0) 0x7f3fcc003430 con 0x7f3fe006ebd0 2022-08-10T17:43:02.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 msgr2=0x7f3fe0068a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:02.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe0068fc0 0x7f3fe0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 msgr2=0x7f3fe00684e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:02.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 --2- 172.21.15.150:0/3835628004 >> v2:172.21.15.197:3300/0 conn(0x7f3fe0068110 0x7f3fe00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0152b90 con 0x7f3fe006ebd0 2022-08-10T17:43:02.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f3fd0001670 con 0x7f3fe006ebd0 2022-08-10T17:43:02.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 >> v1:172.21.15.197:6789/0 conn(0x7f3fe006ebd0 legacy=0x7f3fe00644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:02.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fcc003880 0x7f3fcc003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fcc0046d0 0x7f3fcc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fcc005080 0x7f3fcc00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0064bc0 con 0x7f3fcc0046d0 2022-08-10T17:43:02.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe013c4e0 con 0x7f3fcc005080 2022-08-10T17:43:02.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc00be80 con 0x7f3fcc003880 2022-08-10T17:43:02.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fde59c700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fcc0046d0 msgr2=0x7f3fcc004b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:43:02.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.683+0000 7f3fde59c700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fcc0046d0 0x7f3fcc004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:02.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fcc003880 0x7f3fcc003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:02.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fcc005080 msgr2=0x7f3fcc00b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:02.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fcc005080 0x7f3fcc00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fcc0046d0 msgr2=0x7f3fcc004b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:02.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fcc0046d0 0x7f3fcc004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.684+0000 7f3fded9d700 1 -- 172.21.15.150:0/3835628004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0152b90 con 0x7f3fcc003880 2022-08-10T17:43:02.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.685+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fcc003880 0x7f3fcc003c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4006ee0 tx=0x7f3fcc005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32c10d7d75f3202 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:02.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.685+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4011eb0 con 0x7f3fcc003880 2022-08-10T17:43:02.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.685+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4004020 con 0x7f3fcc003880 2022-08-10T17:43:02.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.685+0000 7f3fddd9b700 1 -- 172.21.15.150:0/3835628004 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40043b0 con 0x7f3fcc003880 2022-08-10T17:43:02.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fcc003880 msgr2=0x7f3fcc003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:02.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3835628004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fcc003880 0x7f3fcc003c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4006ee0 tx=0x7f3fcc005700 comp rx=0 tx=0).stop 2022-08-10T17:43:02.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3835628004 reap_dead start 2022-08-10T17:43:02.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3835628004 shutdown_connections 2022-08-10T17:43:02.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3835628004 >> 172.21.15.150:0/3835628004 conn(0x7f3fe00c9320 msgr2=0x7f3fe00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:02.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3835628004 shutdown_connections 2022-08-10T17:43:02.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.686+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3835628004 wait complete. 2022-08-10T17:43:02.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.688+0000 7f3fe50f1700 1 Processor -- start 2022-08-10T17:43:02.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.688+0000 7f3fe50f1700 1 -- start start 2022-08-10T17:43:02.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 0x7f3fe012d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fe014e630 0x7f3fe012d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe014fff0 con 0x7f3fe013b5d0 2022-08-10T17:43:02.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0152380 con 0x7f3fe014e630 2022-08-10T17:43:02.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fe50f1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe012cd40 con 0x7f3fe013b9a0 2022-08-10T17:43:02.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fded9d700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 msgr2=0x7f3fe012d1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:43:02.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.689+0000 7f3fded9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 0x7f3fe012d1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:02.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:02.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51936/0 (socket says 172.21.15.150:51936) 2022-08-10T17:43:02.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3207213014 learned_addr learned my addr 172.21.15.150:0/3207213014 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:02.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fde59c700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fe014e630 0x7f3fe012d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:02.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fe014e630 msgr2=0x7f3fe012d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:02.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fe014e630 0x7f3fe012d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3207213014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 msgr2=0x7f3fe012d1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:02.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 0x7f3fe012d1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:02.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.690+0000 7f3fdf59e700 1 -- 172.21.15.150:0/3207213014 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe014ec00 con 0x7f3fe013b9a0 2022-08-10T17:43:02.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.692+0000 7f3fdf59e700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006dbd0 tx=0x7f3fd8007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:02.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.693+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8003ab0 con 0x7f3fe013b9a0 2022-08-10T17:43:02.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.693+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800f040 con 0x7f3fe013b9a0 2022-08-10T17:43:02.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.693+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8003e70 con 0x7f3fe013b9a0 2022-08-10T17:43:02.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.696+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0150220 con 0x7f3fe013b9a0 2022-08-10T17:43:02.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.696+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe01528b0 con 0x7f3fe013b9a0 2022-08-10T17:43:02.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.698+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3fd801f030 con 0x7f3fe013b9a0 2022-08-10T17:43:02.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.698+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe012d020 con 0x7f3fe013b9a0 2022-08-10T17:43:02.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.698+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 0x7f3fc0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:02.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.699+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3fd8081d20 con 0x7f3fe013b9a0 2022-08-10T17:43:02.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.700+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 0x7f3fc0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:02.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.700+0000 7f3fded9d700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 0x7f3fc0067510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3fe013c620 tx=0x7f3fd4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:02.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:02.707+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f3fd804fca0 con 0x7f3fe013b9a0 2022-08-10T17:43:03.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.242+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3fe0128860 con 0x7f3fe013b9a0 2022-08-10T17:43:03.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.245+0000 7f3fc77fe700 1 -- 172.21.15.150:0/3207213014 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f3fd801d080 con 0x7f3fe013b9a0 2022-08-10T17:43:03.250 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:43:03.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.249+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 msgr2=0x7f3fc0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.249+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 0x7f3fc0067510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3fe013c620 tx=0x7f3fd4018000 comp rx=0 tx=0).stop 2022-08-10T17:43:03.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.249+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 msgr2=0x7f3fe014bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.249+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006dbd0 tx=0x7f3fd8007d20 comp rx=0 tx=0).stop 2022-08-10T17:43:03.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 shutdown_connections 2022-08-10T17:43:03.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fc0065060 0x7f3fc0067510 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fe013b9a0 0x7f3fe014bac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe013b5d0 0x7f3fe012d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 --2- 172.21.15.150:0/3207213014 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fe014e630 0x7f3fe012d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.250+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 >> 172.21.15.150:0/3207213014 conn(0x7f3fe00c9320 msgr2=0x7f3fe006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:03.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.251+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 shutdown_connections 2022-08-10T17:43:03.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.251+0000 7f3fe50f1700 1 -- 172.21.15.150:0/3207213014 wait complete. 2022-08-10T17:43:03.298 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:43:03.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:43:03.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.560+0000 7efbf5b7b700 1 Processor -- start 2022-08-10T17:43:03.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.560+0000 7efbf5b7b700 1 -- start start 2022-08-10T17:43:03.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.561+0000 7efbf5b7b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efbf01509c0 0x7efbf00c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.561+0000 7efbf5b7b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf006ffd0 con 0x7efbf006bbe0 2022-08-10T17:43:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.561+0000 7efbf5b7b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf01569e0 con 0x7efbf00c3380 2022-08-10T17:43:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.561+0000 7efbf5b7b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf0068110 con 0x7efbf01509c0 2022-08-10T17:43:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbeffff700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7efbf006bbe0 legacy=0x7efbf0160fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:43:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbef7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efbf01509c0 0x7efbf00c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbef7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efbf01509c0 0x7efbf00c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48340/0 (socket says 172.21.15.150:48340) 2022-08-10T17:43:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbeeffd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7efbf00c3380 0x7efbf0156e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:36776/0 (socket says 172.21.15.150:36776) 2022-08-10T17:43:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbef7fe700 1 -- 172.21.15.150:0/982922254 learned_addr learned my addr 172.21.15.150:0/982922254 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:03.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbee7fc700 1 -- 172.21.15.150:0/982922254 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380366223 0 0) 0x7efbf01569e0 con 0x7efbf00c3380 2022-08-10T17:43:03.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.562+0000 7efbee7fc700 1 -- 172.21.15.150:0/982922254 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbdc003430 con 0x7efbf00c3380 2022-08-10T17:43:03.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbef7fe700 1 -- 172.21.15.150:0/982922254 >> v1:172.21.15.197:6789/0 conn(0x7efbf00c3380 legacy=0x7efbf0156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbef7fe700 1 -- 172.21.15.150:0/982922254 >> v1:172.21.15.150:6789/0 conn(0x7efbf006bbe0 legacy=0x7efbf0160fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:03.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbef7fe700 1 -- 172.21.15.150:0/982922254 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0156690 con 0x7efbf01509c0 2022-08-10T17:43:03.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbef7fe700 1 --2- 172.21.15.150:0/982922254 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf00c9a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009e50 tx=0x7efbe800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c06561fd7f2ec3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbee7fc700 1 -- 172.21.15.150:0/982922254 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800e070 con 0x7efbf01509c0 2022-08-10T17:43:03.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbee7fc700 1 -- 172.21.15.150:0/982922254 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe800b8d0 con 0x7efbf01509c0 2022-08-10T17:43:03.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.563+0000 7efbee7fc700 1 -- 172.21.15.150:0/982922254 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800bc80 con 0x7efbf01509c0 2022-08-10T17:43:03.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.565+0000 7efbf5b7b700 1 -- 172.21.15.150:0/982922254 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 msgr2=0x7efbf00c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.565+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/982922254 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf00c9a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009e50 tx=0x7efbe800b330 comp rx=0 tx=0).stop 2022-08-10T17:43:03.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.567+0000 7efbf5b7b700 1 -- 172.21.15.150:0/982922254 shutdown_connections 2022-08-10T17:43:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.567+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/982922254 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf00c9a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.567+0000 7efbf5b7b700 1 -- 172.21.15.150:0/982922254 >> 172.21.15.150:0/982922254 conn(0x7efbf006aac0 msgr2=0x7efbf00c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.567+0000 7efbf5b7b700 1 -- 172.21.15.150:0/982922254 shutdown_connections 2022-08-10T17:43:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.567+0000 7efbf5b7b700 1 -- 172.21.15.150:0/982922254 wait complete. 2022-08-10T17:43:03.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.568+0000 7efbf5b7b700 1 Processor -- start 2022-08-10T17:43:03.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.568+0000 7efbf5b7b700 1 -- start start 2022-08-10T17:43:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbf00c3380 0x7efbf014b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf01ebf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 0x7efbf00c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01dfa90 con 0x7efbf00c3380 2022-08-10T17:43:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01eb7e0 con 0x7efbf01509c0 2022-08-10T17:43:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbf5b7b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01ef210 con 0x7efbf01eed20 2022-08-10T17:43:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbef7fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbf00c3380 msgr2=0x7efbf014b340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:43:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbef7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbf00c3380 0x7efbf014b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf01ebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 0x7efbf00c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf01ebf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48344/0 (socket says 172.21.15.150:48344) 2022-08-10T17:43:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 0x7efbf00c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51976/0 (socket says 172.21.15.150:51976) 2022-08-10T17:43:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeeffd700 1 -- 172.21.15.150:0/1917072312 learned_addr learned my addr 172.21.15.150:0/1917072312 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 msgr2=0x7efbf01ebf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf01ebf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbf00c3380 msgr2=0x7efbf014b340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbf00c3380 0x7efbf014b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeffff700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009b30 con 0x7efbf01eed20 2022-08-10T17:43:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.569+0000 7efbeeffd700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01509c0 0x7efbf01ebf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbeffff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 0x7efbf00c0b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efbe000b3e0 tx=0x7efbe000b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0003ac0 con 0x7efbf01eed20 2022-08-10T17:43:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0003c20 con 0x7efbf01eed20 2022-08-10T17:43:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf01ef4f0 con 0x7efbf01eed20 2022-08-10T17:43:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe00060d0 con 0x7efbf01eed20 2022-08-10T17:43:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.570+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf01efab0 con 0x7efbf01eed20 2022-08-10T17:43:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 0x7efbf00c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf0071e00 con 0x7efbf006aac0 2022-08-10T17:43:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbef7fe700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 0x7efbf00c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbef7fe700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbf01efc70 con 0x7efbf006aac0 2022-08-10T17:43:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbef7fe700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 0x7efbf00c1060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009e50 tx=0x7efbe8004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.571+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efbe0019030 con 0x7efbf01eed20 2022-08-10T17:43:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbd0065090 0x7efbd0067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efbe0081120 con 0x7efbf01eed20 2022-08-10T17:43:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8004440 con 0x7efbf006aac0 2022-08-10T17:43:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7efbe80092e0 con 0x7efbf006aac0 2022-08-10T17:43:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 msgr2=0x7efbf00c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 0x7efbf00c1060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009e50 tx=0x7efbe8004950 comp rx=0 tx=0).stop 2022-08-10T17:43:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 msgr2=0x7efbf00c1060 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.572+0000 7efbd7fff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf006aac0 0x7efbf00c1060 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009e50 tx=0x7efbe8004950 comp rx=0 tx=0).stop 2022-08-10T17:43:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.573+0000 7efbeeffd700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbd0065090 0x7efbd0067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.574+0000 7efbeeffd700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbd0065090 0x7efbd0067540 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efbe4007fd0 tx=0x7efbe4007d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.587+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 0x7efbf00c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.587+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c5c00 con 0x7efbf01ec4c0 2022-08-10T17:43:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.588+0000 7efbef7fe700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 0x7efbf00c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.588+0000 7efbef7fe700 1 -- 172.21.15.150:0/1917072312 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efbf0156320 con 0x7efbf01ec4c0 2022-08-10T17:43:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.588+0000 7efbef7fe700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 0x7efbf00c4d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbe8015040 tx=0x7efbe8009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.588+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8029070 con 0x7efbf01ec4c0 2022-08-10T17:43:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.590+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5020 (secure 0 0 0) 0x7efbe802e470 con 0x7efbf01ec4c0 2022-08-10T17:43:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.590+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 msgr2=0x7efbf00c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.590+0000 7efbd7fff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 0x7efbf00c4d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbe8015040 tx=0x7efbe8009810 comp rx=0 tx=0).stop 2022-08-10T17:43:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.590+0000 7efbd7fff700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 msgr2=0x7efbf00c4d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.590+0000 7efbd7fff700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efbf01ec4c0 0x7efbf00c4d40 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbe8015040 tx=0x7efbe8009810 comp rx=0 tx=0).stop 2022-08-10T17:43:03.595 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:43:03.596 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:03.596 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:03.596 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:43:03.596 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 54, 2022-08-10T17:43:03.597 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:43:03.597 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:43:03.597 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:43:03.597 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.598 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:43:03.598 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:03.598 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:43:03.598 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:43:03.599 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.599 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.599 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.599 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.599 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.600 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.600 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.600 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.600 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.601 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.601 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:43:03.601 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:43:03.601 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.601 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:43:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:43:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:43:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:43:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:43:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:43:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:43:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:43:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:43:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:43:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:43:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:43:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:43:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:43:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:43:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:43:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:43:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:43:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:43:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:43:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:43:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:43:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:43:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:43:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:43:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:43:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:43:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:43:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:43:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:43:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:43:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:43:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:43:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:43:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:43:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:43:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:43:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:43:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:43:03.639 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:43:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbd0065090 msgr2=0x7efbd0067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbd0065090 0x7efbd0067540 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efbe4007fd0 tx=0x7efbe4007d00 comp rx=0 tx=0).stop 2022-08-10T17:43:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 msgr2=0x7efbf00c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 --2- 172.21.15.150:0/1917072312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efbf01eed20 0x7efbf00c0b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efbe000b3e0 tx=0x7efbe000b6f0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbeffff700 1 -- 172.21.15.150:0/1917072312 reap_dead start 2022-08-10T17:43:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbeffff700 1 -- 172.21.15.150:0/1917072312 reap_dead start 2022-08-10T17:43:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 shutdown_connections 2022-08-10T17:43:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 >> 172.21.15.150:0/1917072312 conn(0x7efbf006bbe0 msgr2=0x7efbf00c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 shutdown_connections 2022-08-10T17:43:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.591+0000 7efbf5b7b700 1 -- 172.21.15.150:0/1917072312 wait complete. 2022-08-10T17:43:03.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:43:03.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.794+0000 7f3ec6521700 1 Processor -- start 2022-08-10T17:43:03.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.794+0000 7f3ec6521700 1 -- start start 2022-08-10T17:43:03.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.795+0000 7f3ec6521700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.795+0000 7f3ec6521700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3ec00c3340 0x7f3ec00c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.795+0000 7f3ec6521700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec006e070 con 0x7f3ec00c96b0 2022-08-10T17:43:03.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.795+0000 7f3ec6521700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec00c37e0 con 0x7f3ec00c3340 2022-08-10T17:43:03.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.795+0000 7f3ec6521700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec006ec10 con 0x7f3ec00c8af0 2022-08-10T17:43:03.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.796+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.796+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:51984/0 (socket says 172.21.15.150:51984) 2022-08-10T17:43:03.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.796+0000 7f3ebffff700 1 -- 172.21.15.150:0/2653824985 learned_addr learned my addr 172.21.15.150:0/2653824985 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:03.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.796+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2653824985 >> v2:172.21.15.197:3300/0 conn(0x7f3ec00c3340 0x7f3ec00c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.797+0000 7f3ebeffd700 1 -- 172.21.15.150:0/2653824985 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145224834 0 0) 0x7f3ec006e070 con 0x7f3ec00c96b0 2022-08-10T17:43:03.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.815+0000 7f3ebeffd700 1 -- 172.21.15.150:0/2653824985 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eac003410 con 0x7f3ec00c96b0 2022-08-10T17:43:03.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 msgr2=0x7f3ec00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:03.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2653824985 >> v1:172.21.15.197:6789/0 conn(0x7f3ec00c96b0 legacy=0x7f3ec006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2653824985 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00701c0 con 0x7f3ec00c3340 2022-08-10T17:43:03.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00c3340 0x7f3ec00c4f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006040 tx=0x7f3eb8007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed73739cb78c4670 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ebeffd700 1 -- 172.21.15.150:0/2653824985 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800c990 con 0x7f3ec00c3340 2022-08-10T17:43:03.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ebeffd700 1 -- 172.21.15.150:0/2653824985 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800caf0 con 0x7f3ec00c3340 2022-08-10T17:43:03.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.818+0000 7f3ebeffd700 1 -- 172.21.15.150:0/2653824985 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800ce60 con 0x7f3ec00c3340 2022-08-10T17:43:03.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.819+0000 7f3ec6521700 1 -- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00c3340 msgr2=0x7f3ec00c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.819+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00c3340 0x7f3ec00c4f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006040 tx=0x7f3eb8007d50 comp rx=0 tx=0).stop 2022-08-10T17:43:03.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.821+0000 7f3ebffff700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:03.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.826+0000 7f3ec6521700 1 -- 172.21.15.150:0/2653824985 shutdown_connections 2022-08-10T17:43:03.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.826+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00c3340 0x7f3ec00c4f10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.826+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2653824985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.826+0000 7f3ec6521700 1 -- 172.21.15.150:0/2653824985 >> 172.21.15.150:0/2653824985 conn(0x7f3ec006b500 msgr2=0x7f3ec006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:03.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.831+0000 7f3ec6521700 1 -- 172.21.15.150:0/2653824985 shutdown_connections 2022-08-10T17:43:03.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.831+0000 7f3ec6521700 1 -- 172.21.15.150:0/2653824985 wait complete. 2022-08-10T17:43:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.833+0000 7f3ec6521700 1 Processor -- start 2022-08-10T17:43:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.836+0000 7f3ec6521700 1 -- start start 2022-08-10T17:43:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ec00c3340 0x7f3ec01ec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 0x7f3ec0204ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00b9080 con 0x7f3ec00c3340 2022-08-10T17:43:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01ecb40 con 0x7f3ec00899c0 2022-08-10T17:43:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ec6521700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00b8400 con 0x7f3ec00c8af0 2022-08-10T17:43:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ebffff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ec00c3340 msgr2=0x7f3ec01ec550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:43:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.838+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ec00c3340 0x7f3ec01ec550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:03.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.842+0000 7f3ec4abe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 0x7f3ec0204ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.842+0000 7f3ec4abe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 0x7f3ec0204ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48362/0 (socket says 172.21.15.150:48362) 2022-08-10T17:43:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.842+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 learned_addr learned my addr 172.21.15.150:0/2757585912 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.847+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 msgr2=0x7f3ec00c11d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:43:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.847+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3ec00c8af0 0x7f3ec00c11d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.847+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ec00c3340 msgr2=0x7f3ec01ec550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.847+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ec00c3340 0x7f3ec01ec550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.847+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0009340 con 0x7f3ec00899c0 2022-08-10T17:43:03.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.852+0000 7f3ec4abe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 0x7f3ec0204ba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005fe0 tx=0x7f3eb8004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.856+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8004440 con 0x7f3ec00899c0 2022-08-10T17:43:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.856+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb80045a0 con 0x7f3ec00899c0 2022-08-10T17:43:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.856+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8007100 con 0x7f3ec00899c0 2022-08-10T17:43:03.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.861+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb80076d0 con 0x7f3ec00899c0 2022-08-10T17:43:03.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.861+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec00b89c0 con 0x7f3ec00899c0 2022-08-10T17:43:03.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.865+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3eb802a030 con 0x7f3ec00899c0 2022-08-10T17:43:03.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.866+0000 7f3ebcff9700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ea40650a0 0x7f3ea4067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.866+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3eb800b040 con 0x7f3ec00899c0 2022-08-10T17:43:03.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.867+0000 7f3ebffff700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ea40650a0 0x7f3ea4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.868+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 0x7f3e98004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.868+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98007d90 con 0x7f3e98002a40 2022-08-10T17:43:03.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.873+0000 7f3ebf7fe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 0x7f3e98004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.876+0000 7f3ebffff700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ea40650a0 0x7f3ea4067550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0006fd0 tx=0x7f3eb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.876+0000 7f3ebf7fe700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e98007f50 con 0x7f3e98002a40 2022-08-10T17:43:03.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.876+0000 7f3ebf7fe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 0x7f3e98004ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01ed070 tx=0x7f3ea800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.877+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80052d0 con 0x7f3e98002a40 2022-08-10T17:43:03.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.881+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3ea8003500 con 0x7f3e98002a40 2022-08-10T17:43:03.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.881+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 msgr2=0x7f3e98004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.881+0000 7f3ebcff9700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 0x7f3e98004ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01ed070 tx=0x7f3ea800c6a0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.881+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 msgr2=0x7f3e98004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:03.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.881+0000 7f3ebcff9700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98002a40 0x7f3e98004ef0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01ed070 tx=0x7f3ea800c6a0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.900+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 0x7f3e980072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:03.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.900+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98007910 con 0x7f3e98006e30 2022-08-10T17:43:03.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.901+0000 7f3ebf7fe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 0x7f3e980072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:03.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.902+0000 7f3ebf7fe700 1 -- 172.21.15.150:0/2757585912 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3e98007ad0 con 0x7f3e98006e30 2022-08-10T17:43:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.903+0000 7f3ebf7fe700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 0x7f3e980072b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80011e0 tx=0x7f3ea8000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8004e60 con 0x7f3e98006e30 2022-08-10T17:43:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4535 (secure 0 0 0) 0x7f3ea8012630 con 0x7f3e98006e30 2022-08-10T17:43:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 msgr2=0x7f3e980072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 0x7f3e980072b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80011e0 tx=0x7f3ea8000ed0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 msgr2=0x7f3e980072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:03.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.904+0000 7f3ebcff9700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3e98006e30 0x7f3e980072b0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80011e0 tx=0x7f3ea8000ed0 comp rx=0 tx=0).stop 2022-08-10T17:43:03.910 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:43:03.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:03.911 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:03.911 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:43:03.911 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 54, 2022-08-10T17:43:03.912 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:43:03.912 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:43:03.912 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:43:03.912 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:43:03.913 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:03.913 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:43:03.913 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:43:03.914 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.914 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.914 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.915 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.915 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.915 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.915 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.916 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.916 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.916 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:43:03.916 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:43:03.917 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.917 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.917 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.917 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.917 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.918 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.918 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.918 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.918 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.919 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.919 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:43:03.919 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:43:03.920 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:43:03.920 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:43:03.920 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:43:03.920 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:43:03.921 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:03.921 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:03.921 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:43:03.921 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:43:03.921 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:43:03.922 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:43:03.922 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:43:03.922 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:43:03.922 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:03.923 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:43:03.923 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:03.923 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:03.923 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:03.924 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:03.924 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:03.924 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:03.924 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:03.925 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:03.925 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:03.925 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.925 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:43:03.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.926 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:43:03.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.926 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:03.926 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:03.927 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.927 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.927 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.928 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:43:03.928 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.929 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:43:03.929 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.930 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.930 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:43:03.930 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:43:03.930 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.931 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.931 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.932 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:03.932 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:03.932 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.932 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.933 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:43:03.933 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.934 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:43:03.934 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.935 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.935 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:43:03.936 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:43:03.936 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.936 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.936 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.937 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:03.937 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:03.937 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:03.938 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:03.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.938 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:03.938 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:43:03.939 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:03.940 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:43:03.940 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:03.940 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.940 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.941 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:43:03.941 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:43:03.941 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:03.942 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:03.942 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:03.942 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.942 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.943 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:43:03.943 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:43:03.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.943 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.944 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.944 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:03.944 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.944 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:43:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.945 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:03.946 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:43:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:03.947 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:03.948 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:43:03.949 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:43:03.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.914+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ea40650a0 msgr2=0x7f3ea4067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.914+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3ea40650a0 0x7f3ea4067550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0006fd0 tx=0x7f3eb0008040 comp rx=0 tx=0).stop 2022-08-10T17:43:03.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.914+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 msgr2=0x7f3ec0204ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:03.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.914+0000 7f3ec6521700 1 --2- 172.21.15.150:0/2757585912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3ec00899c0 0x7f3ec0204ba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005fe0 tx=0x7f3eb8004950 comp rx=0 tx=0).stop 2022-08-10T17:43:03.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.914+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 reap_dead start 2022-08-10T17:43:03.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.915+0000 7f3ec4abe700 1 -- 172.21.15.150:0/2757585912 reap_dead start 2022-08-10T17:43:03.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.915+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 shutdown_connections 2022-08-10T17:43:03.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.915+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 >> 172.21.15.150:0/2757585912 conn(0x7f3ec006b500 msgr2=0x7f3ec01644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:03.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.915+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 shutdown_connections 2022-08-10T17:43:03.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:03.915+0000 7f3ec6521700 1 -- 172.21.15.150:0/2757585912 wait complete. 2022-08-10T17:43:03.953 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:43:11.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:43:11.180 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:43:11.321 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:43:11.315+0000 7f2f8be56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114902) UID: 0 2022-08-10T17:43:11.322 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:43:11.311+0000 7f9620e5c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114902) UID: 0 2022-08-10T17:43:11.329 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:43:11.315+0000 7f8e6e7bc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114902) UID: 0 2022-08-10T17:43:11.339 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:43:11.311+0000 7f3f08bb6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114902) UID: 0 2022-08-10T17:43:11.844 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:43:11.839+0000 7f43e3cf3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102861) UID: 0 2022-08-10T17:43:11.846 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:43:11.839+0000 7f684d85b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102861) UID: 0 2022-08-10T17:43:11.856 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:43:11.840+0000 7fc11ed04700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102861) UID: 0 2022-08-10T17:43:11.863 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:43:11.839+0000 7fea9347d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102861) UID: 0 2022-08-10T17:43:23.954 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:43:23.955 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:43:23.955 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:43:23.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:43:23.963 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:43:23.963 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:43:23.963 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:43:24.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.335+0000 7f561c7f8700 1 Processor -- start 2022-08-10T17:43:24.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.335+0000 7f561c7f8700 1 -- start start 2022-08-10T17:43:24.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561c7f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561c7f8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561c7f8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140bf640 con 0x7f561414d080 2022-08-10T17:43:24.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561c7f8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561406c2b0 con 0x7f56140c4d30 2022-08-10T17:43:24.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561c7f8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5614156400 con 0x7f56140705d0 2022-08-10T17:43:24.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561a594700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f561414d080 legacy=0x7f561406bba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:43:24.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f5619d93700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:24.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561ad95700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:24.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561ad95700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48618/0 (socket says 172.21.15.150:48618) 2022-08-10T17:43:24.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f5619d93700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:52246/0 (socket says 172.21.15.150:52246) 2022-08-10T17:43:24.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.336+0000 7f561ad95700 1 -- 172.21.15.150:0/3896133784 learned_addr learned my addr 172.21.15.150:0/3896133784 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:24.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619d93700 1 -- 172.21.15.150:0/3896133784 >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 msgr2=0x7f56140c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:24.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619d93700 1 --2- 172.21.15.150:0/3896133784 >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619d93700 1 -- 172.21.15.150:0/3896133784 >> v1:172.21.15.150:6789/0 conn(0x7f561414d080 legacy=0x7f561406bba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:24.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619d93700 1 -- 172.21.15.150:0/3896133784 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56141566e0 con 0x7f56140705d0 2022-08-10T17:43:24.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f561ad95700 1 --2- 172.21.15.150:0/3896133784 >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:24.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619d93700 1 --2- 172.21.15.150:0/3896133784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f561000b950 tx=0x7f561000bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df0d763e5d7d5dd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:24.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619592700 1 -- 172.21.15.150:0/3896133784 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610004230 con 0x7f56140705d0 2022-08-10T17:43:24.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619592700 1 -- 172.21.15.150:0/3896133784 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610004390 con 0x7f56140705d0 2022-08-10T17:43:24.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.337+0000 7f5619592700 1 -- 172.21.15.150:0/3896133784 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000da80 con 0x7f56140705d0 2022-08-10T17:43:24.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 -- 172.21.15.150:0/3896133784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 msgr2=0x7f56140c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:24.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 --2- 172.21.15.150:0/3896133784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f561000b950 tx=0x7f561000bc60 comp rx=0 tx=0).stop 2022-08-10T17:43:24.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 -- 172.21.15.150:0/3896133784 shutdown_connections 2022-08-10T17:43:24.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 --2- 172.21.15.150:0/3896133784 >> v2:172.21.15.197:3300/0 conn(0x7f56140c4d30 0x7f56140c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 --2- 172.21.15.150:0/3896133784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140705d0 0x7f56140c47f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 -- 172.21.15.150:0/3896133784 >> 172.21.15.150:0/3896133784 conn(0x7f56140c8a10 msgr2=0x7f56140c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:24.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 -- 172.21.15.150:0/3896133784 shutdown_connections 2022-08-10T17:43:24.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.338+0000 7f561c7f8700 1 -- 172.21.15.150:0/3896133784 wait complete. 2022-08-10T17:43:24.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.339+0000 7f561c7f8700 1 Processor -- start 2022-08-10T17:43:24.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.339+0000 7f561c7f8700 1 -- start start 2022-08-10T17:43:24.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140c4d30 0x7f56141de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f561414d080 0x7f5614155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141e7e60 con 0x7f561414d080 2022-08-10T17:43:24.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614069cc0 con 0x7f56140705d0 2022-08-10T17:43:24.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.340+0000 7f561c7f8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56141ebab0 con 0x7f56140c4d30 2022-08-10T17:43:24.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.341+0000 7f561a594700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:24.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.341+0000 7f561a594700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48620/0 (socket says 172.21.15.150:48620) 2022-08-10T17:43:24.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.341+0000 7f561a594700 1 -- 172.21.15.150:0/1375768355 learned_addr learned my addr 172.21.15.150:0/1375768355 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:24.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.341+0000 7f5619d93700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140c4d30 0x7f56141de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:24.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 -- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140c4d30 msgr2=0x7f56141de8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:24.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140c4d30 0x7f56141de8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 -- 172.21.15.150:0/1375768355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f561414d080 msgr2=0x7f5614155100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:24.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f561414d080 0x7f5614155100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 -- 172.21.15.150:0/1375768355 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c00ab50 con 0x7f56140705d0 2022-08-10T17:43:24.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.342+0000 7f561a594700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5604013f40 tx=0x7f5604007320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:24.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.343+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604007bb0 con 0x7f56140705d0 2022-08-10T17:43:24.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.343+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604007d10 con 0x7f56140705d0 2022-08-10T17:43:24.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.343+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561000b5b0 con 0x7f56140705d0 2022-08-10T17:43:24.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.343+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604003b00 con 0x7f56140705d0 2022-08-10T17:43:24.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.343+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56141e7af0 con 0x7f56140705d0 2022-08-10T17:43:24.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.346+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614072890 con 0x7f56140705d0 2022-08-10T17:43:24.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.347+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5604003c60 con 0x7f56140705d0 2022-08-10T17:43:24.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.347+0000 7f5602ffd700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 0x7f55f4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:24.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.347+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5604092730 con 0x7f56140705d0 2022-08-10T17:43:24.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.349+0000 7f5619d93700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 0x7f55f4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:24.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.349+0000 7f5619d93700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 0x7f55f4067590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f561000b2c0 tx=0x7f5610008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:24.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.355+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f560405a6b0 con 0x7f56140705d0 2022-08-10T17:43:24.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.786+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f56140c4570 con 0x7f56140705d0 2022-08-10T17:43:24.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.787+0000 7f5602ffd700 1 -- 172.21.15.150:0/1375768355 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5604060710 con 0x7f56140705d0 2022-08-10T17:43:24.791 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:43:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 msgr2=0x7f55f4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:24.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 0x7f55f4067590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f561000b2c0 tx=0x7f5610008040 comp rx=0 tx=0).stop 2022-08-10T17:43:24.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 msgr2=0x7f56141e82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:24.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5604013f40 tx=0x7f5604007320 comp rx=0 tx=0).stop 2022-08-10T17:43:24.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 shutdown_connections 2022-08-10T17:43:24.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f561414d080 0x7f5614155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f56140705d0 0x7f56141e82f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f55f40650e0 0x7f55f4067590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 --2- 172.21.15.150:0/1375768355 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f56140c4d30 0x7f56141de8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:24.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 >> 172.21.15.150:0/1375768355 conn(0x7f56140c8a10 msgr2=0x7f56140c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 shutdown_connections 2022-08-10T17:43:24.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:24.789+0000 7f561c7f8700 1 -- 172.21.15.150:0/1375768355 wait complete. 2022-08-10T17:43:27.808 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:43:27.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.955+0000 7f447ab71700 1 Processor -- start 2022-08-10T17:43:27.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.955+0000 7f447ab71700 1 -- start start 2022-08-10T17:43:27.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447ab71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:27.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447ab71700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:27.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447ab71700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447406a3d0 con 0x7f44740c3060 2022-08-10T17:43:27.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447ab71700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4474070810 con 0x7f447406af70 2022-08-10T17:43:27.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447ab71700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c5fb0 con 0x7f44740c7170 2022-08-10T17:43:27.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f4473fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:27.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447890d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f44740c3060 0x7f447406a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:50764/0 (socket says 172.21.15.150:50764) 2022-08-10T17:43:27.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447890d700 1 -- 172.21.15.150:0/3291991764 learned_addr learned my addr 172.21.15.150:0/3291991764 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:43:27.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:27.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:27.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:27.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:27.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:27.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:27.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:27.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:27.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:27.956+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:28.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:28.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:28.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:28.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:28.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:28.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:43:28.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:28.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:28.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:28.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.157+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:43:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:28.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:28.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:28.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:28.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:43:28.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:28.558+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:43:29.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.359+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:29.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.359+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:43:29.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.359+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:29.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.359+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:29.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.359+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:43:29.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.360+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:29.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.360+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:43:29.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.360+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:29.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.360+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:29.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:29.360+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:43:30.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 msgr2=0x7f44740c4cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:30.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44740c7170 0x7f44740c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:30.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 msgr2=0x7f447406ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:30.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.150:3300/0 conn(0x7f447406af70 0x7f447406ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:30.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 -- 172.21.15.150:0/3291991764 >> v1:172.21.15.150:6789/0 conn(0x7f44740c3060 legacy=0x7f447406a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:30.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 0x7f445c0097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:30.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 -- 172.21.15.150:0/3291991764 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447406fc90 con 0x7f445c003600 2022-08-10T17:43:30.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f44727fc700 1 -- 172.21.15.150:0/3291991764 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4474070810 con 0x7f445c007330 2022-08-10T17:43:30.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 0x7f445c0097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:30.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 msgr2=0x7f445c0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:43:30.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f4473fff700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 msgr2=0x7f445c0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:43:30.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 0x7f445c0097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:30.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:30.956+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 0x7f445c0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:31.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.153+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026511491 0 0) 0x7f447406fc90 con 0x7f445c003600 2022-08-10T17:43:31.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.153+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4458003430 con 0x7f445c003600 2022-08-10T17:43:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.155+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566094714 0 0) 0x7f4458003430 con 0x7f445c003600 2022-08-10T17:43:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 msgr2=0x7f445c0097c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:43:31.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 --2- 172.21.15.150:0/3291991764 >> v2:172.21.15.197:3300/0 conn(0x7f445c007330 0x7f445c0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c00ae80 con 0x7f445c003600 2022-08-10T17:43:31.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f44680016f0 con 0x7f445c003600 2022-08-10T17:43:31.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 >> v1:172.21.15.197:6789/0 conn(0x7f445c003600 legacy=0x7f445c005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:31.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447910e700 1 -- 172.21.15.150:0/3291991764 reap_dead start 2022-08-10T17:43:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 0x7f4458003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 0x7f4458004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 0x7f445800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4474070810 con 0x7f44580046d0 2022-08-10T17:43:31.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445800c0d0 con 0x7f44580051a0 2022-08-10T17:43:31.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445800c290 con 0x7f4458003880 2022-08-10T17:43:31.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 0x7f4458003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 0x7f4458004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 0x7f445800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 msgr2=0x7f445800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:31.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 0x7f445800b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 msgr2=0x7f4458004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:31.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 0x7f4458004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.156+0000 7f447890d700 1 -- 172.21.15.150:0/3291991764 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c00ae80 con 0x7f4458003880 2022-08-10T17:43:31.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.157+0000 7f4473fff700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 0x7f4458004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:31.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.157+0000 7f447910e700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 0x7f445800b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:31.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.157+0000 7f447890d700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 0x7f4458003c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f446800c0e0 tx=0x7f4458005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44435d9db461f4a5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:31.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.159+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468007a90 con 0x7f4458003880 2022-08-10T17:43:31.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.160+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800cca0 con 0x7f4458003880 2022-08-10T17:43:31.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.160+0000 7f44737fe700 1 -- 172.21.15.150:0/3291991764 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468007310 con 0x7f4458003880 2022-08-10T17:43:31.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 -- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 msgr2=0x7f4458003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 0x7f4458003c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f446800c0e0 tx=0x7f4458005700 comp rx=0 tx=0).stop 2022-08-10T17:43:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 -- 172.21.15.150:0/3291991764 shutdown_connections 2022-08-10T17:43:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580051a0 0x7f445800b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44580046d0 0x7f4458004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 --2- 172.21.15.150:0/3291991764 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4458003880 0x7f4458003c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.163+0000 7f447ab71700 1 -- 172.21.15.150:0/3291991764 >> 172.21.15.150:0/3291991764 conn(0x7f4474068be0 msgr2=0x7f44740c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:31.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.165+0000 7f447ab71700 1 -- 172.21.15.150:0/3291991764 shutdown_connections 2022-08-10T17:43:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.166+0000 7f447ab71700 1 -- 172.21.15.150:0/3291991764 wait complete. 2022-08-10T17:43:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.168+0000 7f447ab71700 1 Processor -- start 2022-08-10T17:43:31.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.171+0000 7f447ab71700 1 -- start start 2022-08-10T17:43:31.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 0x7f44741fc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741f8a00 con 0x7f4458003880 2022-08-10T17:43:31.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741fc9b0 con 0x7f44580046d0 2022-08-10T17:43:31.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.172+0000 7f447ab71700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c0a60 con 0x7f44580051a0 2022-08-10T17:43:31.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 0x7f44741fc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38132/0 (socket says 172.21.15.150:38132) 2022-08-10T17:43:31.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 -- 172.21.15.150:0/496396055 learned_addr learned my addr 172.21.15.150:0/496396055 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:31.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447910e700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 msgr2=0x7f44741ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:43:31.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 msgr2=0x7f44741ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:43:31.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:31.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447890d700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:31.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447910e700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 msgr2=0x7f44741f8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:43:31.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447910e700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 msgr2=0x7f44741f8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:43:31.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447910e700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:43:31.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f447910e700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:43:31.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 msgr2=0x7f44741f8e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:31.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 msgr2=0x7f44741ef810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:31.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:31.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 -- 172.21.15.150:0/496396055 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447414b8a0 con 0x7f44580046d0 2022-08-10T17:43:31.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.173+0000 7f4473fff700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 0x7f44741fc470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f445c009d50 tx=0x7f4460010d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:31.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.175+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460018040 con 0x7f44580046d0 2022-08-10T17:43:31.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.175+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460004030 con 0x7f44580046d0 2022-08-10T17:43:31.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.175+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44600043e0 con 0x7f44580046d0 2022-08-10T17:43:31.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.176+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447414bb80 con 0x7f44580046d0 2022-08-10T17:43:31.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.176+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44741f8690 con 0x7f44580046d0 2022-08-10T17:43:31.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.177+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44741f8ce0 con 0x7f44580046d0 2022-08-10T17:43:31.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.177+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4460024030 con 0x7f44580046d0 2022-08-10T17:43:31.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.178+0000 7f44717fa700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 0x7f445c067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.178+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4460081db0 con 0x7f44580046d0 2022-08-10T17:43:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.178+0000 7f447890d700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 0x7f445c067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.178+0000 7f447890d700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 0x7f445c067eb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4468001050 tx=0x7f4468007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:31.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.182+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f446004fe40 con 0x7f44580046d0 2022-08-10T17:43:31.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:31.518+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4474072890 con 0x7f44580046d0 2022-08-10T17:43:36.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.175+0000 7f44717fa700 1 -- 172.21.15.150:0/496396055 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f4460022020 con 0x7f44580046d0 2022-08-10T17:43:36.180 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:43:36.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.178+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 msgr2=0x7f445c067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:36.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.178+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 0x7f445c067eb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4468001050 tx=0x7f4468007000 comp rx=0 tx=0).stop 2022-08-10T17:43:36.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.178+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 msgr2=0x7f44741fc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:36.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.178+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 0x7f44741fc470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f445c009d50 tx=0x7f4460010d20 comp rx=0 tx=0).stop 2022-08-10T17:43:36.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 shutdown_connections 2022-08-10T17:43:36.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f445c065a00 0x7f445c067eb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:36.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44580051a0 0x7f44741f8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:36.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458003880 0x7f44741ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:36.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 --2- 172.21.15.150:0/496396055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44580046d0 0x7f44741fc470 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:36.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 >> 172.21.15.150:0/496396055 conn(0x7f4474068be0 msgr2=0x7f447406f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:36.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 shutdown_connections 2022-08-10T17:43:36.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:36.179+0000 7f447ab71700 1 -- 172.21.15.150:0/496396055 wait complete. 2022-08-10T17:43:39.197 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:43:43.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.958+0000 7f38b5a4a700 1 Processor -- start 2022-08-10T17:43:43.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38b5a4a700 1 -- start start 2022-08-10T17:43:43.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38b5a4a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f38b015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38b5a4a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b00692f0 con 0x7f38b006c980 2022-08-10T17:43:43.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38b5a4a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b00c6450 con 0x7f38b00bc580 2022-08-10T17:43:43.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38b5a4a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00c4f10 con 0x7f38b00bc950 2022-08-10T17:43:43.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38ae7fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f38b006c980 0x7f38b014cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:50906/0 (socket says 172.21.15.150:50906) 2022-08-10T17:43:43.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.959+0000 7f38ae7fc700 1 -- 172.21.15.150:0/3637797905 learned_addr learned my addr 172.21.15.150:0/3637797905 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:43:43.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38af7fe700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f38b015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208136635 0 0) 0x7f38b00692f0 con 0x7f38b006c980 2022-08-10T17:43:43.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f389c003430 con 0x7f38b006c980 2022-08-10T17:43:43.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471495057 0 0) 0x7f38b00c6450 con 0x7f38b00bc580 2022-08-10T17:43:43.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b00692f0 con 0x7f38b00bc580 2022-08-10T17:43:43.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978763210 0 0) 0x7f389c003430 con 0x7f38b006c980 2022-08-10T17:43:43.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 msgr2=0x7f38b015e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:43.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f38b015e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 >> v1:172.21.15.197:6789/0 conn(0x7f38b00bc580 legacy=0x7f38b0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0156620 con 0x7f38b006c980 2022-08-10T17:43:43.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f38a4001670 con 0x7f38b006c980 2022-08-10T17:43:43.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 >> v1:172.21.15.150:6789/0 conn(0x7f38b006c980 legacy=0x7f38b014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f389c003a40 0x7f389c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f389c0046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c004c10 0x7f389c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00c4f10 con 0x7f389c004c10 2022-08-10T17:43:43.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c00b940 con 0x7f389c003a40 2022-08-10T17:43:43.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c00bab0 con 0x7f38b00bc950 2022-08-10T17:43:43.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38aeffd700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f389c003a40 0x7f389c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38ae7fc700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f389c0046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.960+0000 7f38af7fe700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c004c10 0x7f389c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 -- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 msgr2=0x7f389c0046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:43.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f389c0046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 -- 172.21.15.150:0/3637797905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c004c10 msgr2=0x7f389c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c004c10 0x7f389c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 -- 172.21.15.150:0/3637797905 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c003430 con 0x7f389c003a40 2022-08-10T17:43:43.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38af7fe700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c004c10 0x7f389c005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38ae7fc700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00bc950 0x7f389c0046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38aeffd700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f389c003a40 0x7f389c003e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38a0001860 tx=0x7f389c005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f0b3a64d858e98 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00052d0 con 0x7f389c003a40 2022-08-10T17:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0003500 con 0x7f389c003a40 2022-08-10T17:43:43.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.961+0000 7f38adffb700 1 -- 172.21.15.150:0/3637797905 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00038b0 con 0x7f389c003a40 2022-08-10T17:43:43.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 -- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f389c003a40 msgr2=0x7f389c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/3637797905 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f389c003a40 0x7f389c003e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38a0001860 tx=0x7f389c005700 comp rx=0 tx=0).stop 2022-08-10T17:43:43.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38af7fe700 1 -- 172.21.15.150:0/3637797905 reap_dead start 2022-08-10T17:43:43.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 -- 172.21.15.150:0/3637797905 shutdown_connections 2022-08-10T17:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 -- 172.21.15.150:0/3637797905 >> 172.21.15.150:0/3637797905 conn(0x7f38b00c9d60 msgr2=0x7f38b00c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 -- 172.21.15.150:0/3637797905 shutdown_connections 2022-08-10T17:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.962+0000 7f38b5a4a700 1 -- 172.21.15.150:0/3637797905 wait complete. 2022-08-10T17:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.963+0000 7f38b5a4a700 1 Processor -- start 2022-08-10T17:43:43.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.963+0000 7f38b5a4a700 1 -- start start 2022-08-10T17:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00c8c50 0x7f38b00bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38b01eb270 0x7f38b01eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0152e60 con 0x7f389c003a40 2022-08-10T17:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b014d4a0 con 0x7f38b01eb270 2022-08-10T17:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38b5a4a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b01ede40 con 0x7f38b00c8c50 2022-08-10T17:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38236/0 (socket says 172.21.15.150:38236) 2022-08-10T17:43:43.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 -- 172.21.15.150:0/1540647645 learned_addr learned my addr 172.21.15.150:0/1540647645 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38ae7fc700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00c8c50 0x7f38b00bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38af7fe700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38b01eb270 0x7f38b01eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 -- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00c8c50 msgr2=0x7f38b00bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00c8c50 0x7f38b00bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 -- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38b01eb270 msgr2=0x7f38b01eb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38b01eb270 0x7f38b01eb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 -- 172.21.15.150:0/1540647645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b01ebc20 con 0x7f389c003a40 2022-08-10T17:43:43.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f38aeffd700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007ed0 tx=0x7f38a0001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:43.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.964+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0007450 con 0x7f389c003a40 2022-08-10T17:43:43.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.965+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a00075d0 con 0x7f389c003a40 2022-08-10T17:43:43.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.965+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0006920 con 0x7f389c003a40 2022-08-10T17:43:43.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.965+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b01528a0 con 0x7f389c003a40 2022-08-10T17:43:43.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.965+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b0151e90 con 0x7f389c003a40 2022-08-10T17:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.966+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b0151cf0 con 0x7f389c003a40 2022-08-10T17:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.966+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f38a002d070 con 0x7f389c003a40 2022-08-10T17:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.967+0000 7f3897fff700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 0x7f3890067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.967+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f38a0082dc0 con 0x7f389c003a40 2022-08-10T17:43:43.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.967+0000 7f38ae7fc700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 0x7f3890067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:43.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.967+0000 7f38ae7fc700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 0x7f3890067590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38a4000c00 tx=0x7f38a4001e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:43.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:42.971+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f38b0151cf0 con 0x7f389c003a40 2022-08-10T17:43:43.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.331+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f38b0151cf0 con 0x7f389c003a40 2022-08-10T17:43:43.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.331+0000 7f3897fff700 1 -- 172.21.15.150:0/1540647645 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f38a0017600 con 0x7f389c003a40 2022-08-10T17:43:43.335 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:43:43.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 msgr2=0x7f3890067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 0x7f3890067590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38a4000c00 tx=0x7f38a4001e00 comp rx=0 tx=0).stop 2022-08-10T17:43:43.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 msgr2=0x7f38b01ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:43.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007ed0 tx=0x7f38a0001310 comp rx=0 tx=0).stop 2022-08-10T17:43:43.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 shutdown_connections 2022-08-10T17:43:43.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f38b01eb270 0x7f38b01eb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f389c003a40 0x7f38b01ed900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f38900650e0 0x7f3890067590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 --2- 172.21.15.150:0/1540647645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f38b00c8c50 0x7f38b00bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:43.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 >> 172.21.15.150:0/1540647645 conn(0x7f38b00c9d60 msgr2=0x7f38b00644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:43.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 shutdown_connections 2022-08-10T17:43:43.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:43.334+0000 7f38b5a4a700 1 -- 172.21.15.150:0/1540647645 wait complete. 2022-08-10T17:43:43.589 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:43:43.590 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:43:51.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.221+0000 7f4859aa8700 1 Processor -- start 2022-08-10T17:43:51.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.221+0000 7f4859aa8700 1 -- start start 2022-08-10T17:43:51.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f485406d750 0x7f4854157730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48540c7f20 0x7f4854154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4854068110 0x7f4854154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485406a1c0 con 0x7f48540c7f20 2022-08-10T17:43:51.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540699b0 con 0x7f4854068110 2022-08-10T17:43:51.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4859aa8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485406b2f0 con 0x7f485406d750 2022-08-10T17:43:51.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48540c7f20 0x7f4854154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48540c7f20 0x7f4854154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38298/0 (socket says 172.21.15.150:38298) 2022-08-10T17:43:51.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 -- 172.21.15.150:0/1243641124 learned_addr learned my addr 172.21.15.150:0/1243641124 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4853fff700 1 --2- 172.21.15.150:0/1243641124 >> v2:172.21.15.197:3300/0 conn(0x7f4854068110 0x7f4854154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f48537fe700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f485406d750 0x7f4854157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 -- 172.21.15.150:0/1243641124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f485406d750 msgr2=0x7f4854157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f485406d750 0x7f4854157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 -- 172.21.15.150:0/1243641124 >> v2:172.21.15.197:3300/0 conn(0x7f4854068110 msgr2=0x7f4854154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.222+0000 7f4852ffd700 1 --2- 172.21.15.150:0/1243641124 >> v2:172.21.15.197:3300/0 conn(0x7f4854068110 0x7f4854154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f4852ffd700 1 -- 172.21.15.150:0/1243641124 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854157c70 con 0x7f48540c7f20 2022-08-10T17:43:51.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f4852ffd700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540c7f20 0x7f4854154000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f485415b2c0 tx=0x7f4848009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d589d47343fd3d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f48527fc700 1 -- 172.21.15.150:0/1243641124 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848004230 con 0x7f48540c7f20 2022-08-10T17:43:51.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f48527fc700 1 -- 172.21.15.150:0/1243641124 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848004390 con 0x7f48540c7f20 2022-08-10T17:43:51.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f48527fc700 1 -- 172.21.15.150:0/1243641124 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848011830 con 0x7f48540c7f20 2022-08-10T17:43:51.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f4859aa8700 1 -- 172.21.15.150:0/1243641124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540c7f20 msgr2=0x7f4854154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.223+0000 7f4859aa8700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540c7f20 0x7f4854154000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f485415b2c0 tx=0x7f4848009a60 comp rx=0 tx=0).stop 2022-08-10T17:43:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 -- 172.21.15.150:0/1243641124 shutdown_connections 2022-08-10T17:43:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 --2- 172.21.15.150:0/1243641124 >> v2:172.21.15.197:3300/0 conn(0x7f4854068110 0x7f4854154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f485406d750 0x7f4854157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 --2- 172.21.15.150:0/1243641124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540c7f20 0x7f4854154000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 -- 172.21.15.150:0/1243641124 >> 172.21.15.150:0/1243641124 conn(0x7f4854071e40 msgr2=0x7f48540c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 -- 172.21.15.150:0/1243641124 shutdown_connections 2022-08-10T17:43:51.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.224+0000 7f4859aa8700 1 -- 172.21.15.150:0/1243641124 wait complete. 2022-08-10T17:43:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.225+0000 7f4859aa8700 1 Processor -- start 2022-08-10T17:43:51.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.225+0000 7f4859aa8700 1 -- start start 2022-08-10T17:43:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4854068110 0x7f48540c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 0x7f48541596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 0x7f4854159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854158650 con 0x7f4854068110 2022-08-10T17:43:51.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854157e40 con 0x7f485406d750 2022-08-10T17:43:51.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.226+0000 7f4859aa8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48541f0e50 con 0x7f48540c7f20 2022-08-10T17:43:51.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4852ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 0x7f48541596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 0x7f4854159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 0x7f4854159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:52528/0 (socket says 172.21.15.150:52528) 2022-08-10T17:43:51.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4852ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 0x7f48541596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48896/0 (socket says 172.21.15.150:48896) 2022-08-10T17:43:51.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 learned_addr learned my addr 172.21.15.150:0/3042955681 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 msgr2=0x7f48541596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 0x7f48541596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4854068110 msgr2=0x7f48540c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4854068110 0x7f48540c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480093e0 con 0x7f48540c7f20 2022-08-10T17:43:51.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4852ffd700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f485406d750 0x7f48541596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:43:51.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4853fff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 0x7f4854159be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f484c007e90 tx=0x7f484c00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00ede0 con 0x7f48540c7f20 2022-08-10T17:43:51.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c014420 con 0x7f48540c7f20 2022-08-10T17:43:51.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0147d0 con 0x7f48540c7f20 2022-08-10T17:43:51.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48541f10c0 con 0x7f48540c7f20 2022-08-10T17:43:51.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.227+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4854158370 con 0x7f48540c7f20 2022-08-10T17:43:51.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.228+0000 7f4859aa8700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 0x7f48541f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.228+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540b0f00 con 0x7f48540b0b30 2022-08-10T17:43:51.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.229+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f484c012050 con 0x7f48540c7f20 2022-08-10T17:43:51.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.229+0000 7f483bfff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48340650b0 0x7f4834067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.229+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f484c082850 con 0x7f48540c7f20 2022-08-10T17:43:51.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.229+0000 7f4852ffd700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48340650b0 0x7f4834067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.230+0000 7f48537fe700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 0x7f48541f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.230+0000 7f4852ffd700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48340650b0 0x7f4834067560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48540737b0 tx=0x7f4848008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.230+0000 7f48537fe700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4854072890 con 0x7f48540b0b30 2022-08-10T17:43:51.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.230+0000 7f48537fe700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 0x7f48541f3870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f484400d500 tx=0x7f484400d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.230+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440125f0 con 0x7f48540b0b30 2022-08-10T17:43:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.231+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f4844012750 con 0x7f48540b0b30 2022-08-10T17:43:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.231+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 msgr2=0x7f48541f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.231+0000 7f483bfff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 0x7f48541f3870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f484400d500 tx=0x7f484400d8c0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.231+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 msgr2=0x7f48541f3870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.231+0000 7f483bfff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540b0b30 0x7f48541f3870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.239+0000 7f4859aa8700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 0x7f48540b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.239+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854158500 con 0x7f48541587b0 2022-08-10T17:43:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.239+0000 7f48537fe700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 0x7f48540b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f48537fe700 1 -- 172.21.15.150:0/3042955681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f48540c83b0 con 0x7f48541587b0 2022-08-10T17:43:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f48537fe700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 0x7f48540b9310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4844018000 tx=0x7f48440045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484401dcd0 con 0x7f48541587b0 2022-08-10T17:43:51.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7f4844004030 con 0x7f48541587b0 2022-08-10T17:43:51.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 msgr2=0x7f48540b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 0x7f48540b9310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4844018000 tx=0x7f48440045d0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 msgr2=0x7f48540b9310 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.240+0000 7f483bfff700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48541587b0 0x7f48540b9310 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4844018000 tx=0x7f48440045d0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.252 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:43:51.252 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:51.253 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:51.253 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:43:51.253 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:43:51.253 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:43:51.253 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:43:51.254 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:43:51.254 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:43:51.254 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.254 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 13, 2022-08-10T17:43:51.255 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.255 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:43:51.255 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:43:51.255 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.255 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.256 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.256 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.256 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.256 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.257 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.257 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.257 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.257 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.258 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:43:51.258 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:43:51.258 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.258 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.258 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.259 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.259 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.259 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.259 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.260 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.260 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.260 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.260 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:43:51.261 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:43:51.261 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:43:51.261 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:43:51.261 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:43:51.262 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:43:51.262 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.262 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.262 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:43:51.262 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:43:51.263 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:43:51.263 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:43:51.263 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:43:51.263 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:43:51.264 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.264 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:43:51.264 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.264 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.264 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.265 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.265 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.265 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.265 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.266 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.266 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.266 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.266 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:43:51.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.267 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:43:51.267 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.267 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:51.267 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:51.268 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.268 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.268 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.268 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.268 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:43:51.269 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.269 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.269 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.269 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:43:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.271 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.271 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.271 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.271 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.272 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.272 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.272 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:51.272 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:51.273 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.273 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.273 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.273 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.273 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:43:51.274 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.274 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.274 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.274 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.275 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:43:51.275 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.275 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.275 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.276 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.276 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.276 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.276 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.277 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.277 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:51.278 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:51.278 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.278 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.278 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.279 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:43:51.279 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.279 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.280 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:43:51.280 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.280 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.280 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.281 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.281 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.281 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.281 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:43:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:43:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:43:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:43:51.286 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:43:51.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48340650b0 msgr2=0x7f4834067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48340650b0 0x7f4834067560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48540737b0 tx=0x7f4848008030 comp rx=0 tx=0).stop 2022-08-10T17:43:51.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 msgr2=0x7f4854159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 --2- 172.21.15.150:0/3042955681 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f48540c7f20 0x7f4854159be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f484c007e90 tx=0x7f484c00e3c0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 reap_dead start 2022-08-10T17:43:51.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4853fff700 1 -- 172.21.15.150:0/3042955681 reap_dead start 2022-08-10T17:43:51.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 shutdown_connections 2022-08-10T17:43:51.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 >> 172.21.15.150:0/3042955681 conn(0x7f4854071e40 msgr2=0x7f48541525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 shutdown_connections 2022-08-10T17:43:51.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.241+0000 7f4859aa8700 1 -- 172.21.15.150:0/3042955681 wait complete. 2022-08-10T17:43:51.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:43:51.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.443+0000 7f0caf59e700 1 Processor -- start 2022-08-10T17:43:51.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.443+0000 7f0caf59e700 1 -- start start 2022-08-10T17:43:51.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caf59e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0cb0155190 0x7f0cb00c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caf59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cb00c2030 0x7f0cb00c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caf59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00c7390 con 0x7f0cb0071a80 2022-08-10T17:43:51.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caf59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00c2cf0 con 0x7f0cb00c2030 2022-08-10T17:43:51.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caf59e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00c5970 con 0x7f0cb0155190 2022-08-10T17:43:51.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0caed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cb00c2030 0x7f0cb00c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.444+0000 7f0cadd9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0cb0071a80 0x7f0cb00b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:50996/0 (socket says 172.21.15.150:50996) 2022-08-10T17:43:51.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cadd9b700 1 -- 172.21.15.150:0/1869651079 learned_addr learned my addr 172.21.15.150:0/1869651079 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:43:51.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cae59c700 1 --2- 172.21.15.150:0/1869651079 >> v2:172.21.15.197:3300/0 conn(0x7f0cb0155190 0x7f0cb00c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0caed9d700 1 -- 172.21.15.150:0/1869651079 >> v2:172.21.15.197:3300/0 conn(0x7f0cb0155190 msgr2=0x7f0cb00c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0caed9d700 1 --2- 172.21.15.150:0/1869651079 >> v2:172.21.15.197:3300/0 conn(0x7f0cb0155190 0x7f0cb00c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0caed9d700 1 -- 172.21.15.150:0/1869651079 >> v1:172.21.15.150:6789/0 conn(0x7f0cb0071a80 legacy=0x7f0cb00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0caed9d700 1 -- 172.21.15.150:0/1869651079 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00c6830 con 0x7f0cb00c2030 2022-08-10T17:43:51.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cad59a700 1 -- 172.21.15.150:0/1869651079 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729266642 0 0) 0x7f0cb00c7390 con 0x7f0cb0071a80 2022-08-10T17:43:51.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0caed9d700 1 --2- 172.21.15.150:0/1869651079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 0x7f0cb00c3ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cb006f810 tx=0x7f0ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ff32a0e0af13c1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cad59a700 1 -- 172.21.15.150:0/1869651079 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800e070 con 0x7f0cb00c2030 2022-08-10T17:43:51.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cad59a700 1 -- 172.21.15.150:0/1869651079 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800bb20 con 0x7f0cb00c2030 2022-08-10T17:43:51.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.445+0000 7f0cad59a700 1 -- 172.21.15.150:0/1869651079 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8012430 con 0x7f0cb00c2030 2022-08-10T17:43:51.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 -- 172.21.15.150:0/1869651079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 msgr2=0x7f0cb00c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 --2- 172.21.15.150:0/1869651079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 0x7f0cb00c3ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cb006f810 tx=0x7f0ca800b330 comp rx=0 tx=0).stop 2022-08-10T17:43:51.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 -- 172.21.15.150:0/1869651079 shutdown_connections 2022-08-10T17:43:51.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 --2- 172.21.15.150:0/1869651079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 0x7f0cb00c3ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 --2- 172.21.15.150:0/1869651079 >> v2:172.21.15.197:3300/0 conn(0x7f0cb0155190 0x7f0cb00c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 -- 172.21.15.150:0/1869651079 >> 172.21.15.150:0/1869651079 conn(0x7f0cb006e0d0 msgr2=0x7f0cb0071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 -- 172.21.15.150:0/1869651079 shutdown_connections 2022-08-10T17:43:51.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.446+0000 7f0caf59e700 1 -- 172.21.15.150:0/1869651079 wait complete. 2022-08-10T17:43:51.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.447+0000 7f0caf59e700 1 Processor -- start 2022-08-10T17:43:51.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.448+0000 7f0caf59e700 1 -- start start 2022-08-10T17:43:51.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 0x7f0cb01584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 0x7f0cb0069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0cb0155190 0x7f0cb0155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01f8cc0 con 0x7f0cb00c2030 2022-08-10T17:43:51.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01f8fa0 con 0x7f0cb0071a80 2022-08-10T17:43:51.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0caf59e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01f9280 con 0x7f0cb0155190 2022-08-10T17:43:51.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.449+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 0x7f0cb01584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 0x7f0cb01584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:48912/0 (socket says 172.21.15.150:48912) 2022-08-10T17:43:51.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 -- 172.21.15.150:0/921003942 learned_addr learned my addr 172.21.15.150:0/921003942 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0cb0155190 msgr2=0x7f0cb0155a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:51.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0cb0155190 0x7f0cb0155a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 msgr2=0x7f0cb0069340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:43:51.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cb00c2030 0x7f0cb0069340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009a70 con 0x7f0cb0071a80 2022-08-10T17:43:51.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0cae59c700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 0x7f0cb01584a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000e870 tx=0x7f0ca000ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000c640 con 0x7f0cb0071a80 2022-08-10T17:43:51.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000c7a0 con 0x7f0cb0071a80 2022-08-10T17:43:51.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.450+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000cb10 con 0x7f0cb0071a80 2022-08-10T17:43:51.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.453+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb01f9560 con 0x7f0cb0071a80 2022-08-10T17:43:51.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.453+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0155560 con 0x7f0cb0071a80 2022-08-10T17:43:51.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.453+0000 7f0caf59e700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 0x7f0cb0155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.453+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01f96f0 con 0x7f0cb0069c30 2022-08-10T17:43:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.454+0000 7f0cadd9b700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 0x7f0cb0155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.454+0000 7f0cadd9b700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cb0155780 con 0x7f0cb0069c30 2022-08-10T17:43:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.454+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0ca0019030 con 0x7f0cb0071a80 2022-08-10T17:43:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.454+0000 7f0cadd9b700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 0x7f0cb0155fc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00c5630 tx=0x7f0ca400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.454+0000 7f0c9effd700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c8c0650e0 0x7f0c8c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0ca0081f80 con 0x7f0cb0071a80 2022-08-10T17:43:51.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0caed9d700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c8c0650e0 0x7f0c8c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40072d0 con 0x7f0cb0069c30 2022-08-10T17:43:51.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f0ca400ce90 con 0x7f0cb0069c30 2022-08-10T17:43:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 msgr2=0x7f0cb0155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 0x7f0cb0155fc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00c5630 tx=0x7f0ca400c6a0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 msgr2=0x7f0cb0155fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0c9effd700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0069c30 0x7f0cb0155fc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.455+0000 7f0caed9d700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c8c0650e0 0x7f0c8c067590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800b370 tx=0x7f0ca8011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.463+0000 7f0caf59e700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 0x7f0cb01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.463+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0155920 con 0x7f0cb01f2710 2022-08-10T17:43:51.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.463+0000 7f0cadd9b700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 0x7f0cb01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.464+0000 7f0cadd9b700 1 -- 172.21.15.150:0/921003942 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0cb004cf10 con 0x7f0cb01f2710 2022-08-10T17:43:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.464+0000 7f0cadd9b700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 0x7f0cb01f2b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4013000 tx=0x7f0ca4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.464+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4013570 con 0x7f0cb01f2710 2022-08-10T17:43:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.465+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f0ca401b070 con 0x7f0cb01f2710 2022-08-10T17:43:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.465+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 msgr2=0x7f0cb01f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.465+0000 7f0c9effd700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 0x7f0cb01f2b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4013000 tx=0x7f0ca4000ed0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.465+0000 7f0c9effd700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 msgr2=0x7f0cb01f2b10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.465+0000 7f0c9effd700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb01f2710 0x7f0cb01f2b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.472 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:43:51.472 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:51.472 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:51.473 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:43:51.473 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:43:51.473 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:43:51.473 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:43:51.473 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:43:51.474 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:43:51.474 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.474 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:43:51.474 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.475 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:43:51.475 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:43:51.475 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.475 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.476 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.476 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.476 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.476 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.476 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.477 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.477 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.477 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.477 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:43:51.477 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:43:51.478 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.478 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.478 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.478 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.479 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.479 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.479 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.479 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.480 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.480 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.480 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:43:51.480 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:43:51.481 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:43:51.481 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:43:51.481 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:43:51.481 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:43:51.481 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.482 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.482 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:43:51.482 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:43:51.482 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:43:51.483 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:43:51.483 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:43:51.483 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:43:51.483 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.484 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:43:51.484 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.484 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.484 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.484 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.485 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.485 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.485 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.485 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.485 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.486 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.486 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:43:51.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.486 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:43:51.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.487 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:51.487 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:51.487 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.487 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.488 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.488 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:43:51.488 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.489 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.489 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:43:51.489 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.490 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.490 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.490 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.491 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.491 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.491 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.491 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.492 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:51.492 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:51.492 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.493 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.493 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.493 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:43:51.493 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.494 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:43:51.495 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.495 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.495 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:43:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:43:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:43:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:43:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:43:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:43:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:43:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:43:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:43:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:43:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:43:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:43:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:43:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:43:51.512 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:43:51.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c8c0650e0 msgr2=0x7f0c8c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caf59e700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c8c0650e0 0x7f0c8c067590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800b370 tx=0x7f0ca8011000 comp rx=0 tx=0).stop 2022-08-10T17:43:51.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 msgr2=0x7f0cb01584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caf59e700 1 --2- 172.21.15.150:0/921003942 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0cb0071a80 0x7f0cb01584a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000e870 tx=0x7f0ca000ec30 comp rx=0 tx=0).stop 2022-08-10T17:43:51.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caed9d700 1 -- 172.21.15.150:0/921003942 reap_dead start 2022-08-10T17:43:51.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.466+0000 7f0caed9d700 1 -- 172.21.15.150:0/921003942 reap_dead start 2022-08-10T17:43:51.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.467+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 shutdown_connections 2022-08-10T17:43:51.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.467+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 >> 172.21.15.150:0/921003942 conn(0x7f0cb006e0d0 msgr2=0x7f0cb00bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.467+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 shutdown_connections 2022-08-10T17:43:51.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.467+0000 7f0caf59e700 1 -- 172.21.15.150:0/921003942 wait complete. 2022-08-10T17:43:51.516 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:43:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.650+0000 7f403f160700 1 Processor -- start 2022-08-10T17:43:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.650+0000 7f403f160700 1 -- start start 2022-08-10T17:43:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4038150e60 0x7f4038069840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4038156950 0x7f4038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40380c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4038157940 con 0x7f4038156950 2022-08-10T17:43:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4038156de0 con 0x7f4038150e60 2022-08-10T17:43:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403f160700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40381570a0 con 0x7f403806b430 2022-08-10T17:43:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f4037fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4038156950 0x7f4038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f4037fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4038156950 0x7f4038069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38328/0 (socket says 172.21.15.150:38328) 2022-08-10T17:43:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f4037fff700 1 -- 172.21.15.150:0/1827367981 learned_addr learned my addr 172.21.15.150:0/1827367981 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403cefc700 1 --2- 172.21.15.150:0/1827367981 >> v2:172.21.15.197:3300/0 conn(0x7f4038150e60 0x7f4038069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.651+0000 7f403d6fd700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40380c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 -- 172.21.15.150:0/1827367981 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 msgr2=0x7f40380c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40380c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 -- 172.21.15.150:0/1827367981 >> v2:172.21.15.197:3300/0 conn(0x7f4038150e60 msgr2=0x7f4038069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 --2- 172.21.15.150:0/1827367981 >> v2:172.21.15.197:3300/0 conn(0x7f4038150e60 0x7f4038069840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 -- 172.21.15.150:0/1827367981 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038157380 con 0x7f4038156950 2022-08-10T17:43:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403d6fd700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40380c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:43:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f4037fff700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038156950 0x7f4038069d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f403806d410 tx=0x7f4024009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b2640730c1da72 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f40377fe700 1 -- 172.21.15.150:0/1827367981 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024004230 con 0x7f4038156950 2022-08-10T17:43:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f40377fe700 1 -- 172.21.15.150:0/1827367981 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024004390 con 0x7f4038156950 2022-08-10T17:43:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f40377fe700 1 -- 172.21.15.150:0/1827367981 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024011850 con 0x7f4038156950 2022-08-10T17:43:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 -- 172.21.15.150:0/1827367981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038156950 msgr2=0x7f4038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038156950 0x7f4038069d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f403806d410 tx=0x7f4024009a60 comp rx=0 tx=0).stop 2022-08-10T17:43:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 -- 172.21.15.150:0/1827367981 shutdown_connections 2022-08-10T17:43:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40380c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 --2- 172.21.15.150:0/1827367981 >> v2:172.21.15.197:3300/0 conn(0x7f4038150e60 0x7f4038069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 --2- 172.21.15.150:0/1827367981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038156950 0x7f4038069d80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.652+0000 7f403f160700 1 -- 172.21.15.150:0/1827367981 >> 172.21.15.150:0/1827367981 conn(0x7f403806d730 msgr2=0x7f403806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.653+0000 7f403f160700 1 -- 172.21.15.150:0/1827367981 shutdown_connections 2022-08-10T17:43:51.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.653+0000 7f403f160700 1 -- 172.21.15.150:0/1827367981 wait complete. 2022-08-10T17:43:51.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.654+0000 7f403f160700 1 Processor -- start 2022-08-10T17:43:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.654+0000 7f403f160700 1 -- start start 2022-08-10T17:43:51.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40381ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4038156950 0x7f40381dff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038151320 con 0x7f4038150e60 2022-08-10T17:43:51.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40381518e0 con 0x7f4038156950 2022-08-10T17:43:51.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40381e0c50 con 0x7f403806b430 2022-08-10T17:43:51.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403cefc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40381ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403cefc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40381ebcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:52556/0 (socket says 172.21.15.150:52556) 2022-08-10T17:43:51.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38336/0 (socket says 172.21.15.150:38336) 2022-08-10T17:43:51.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403cefc700 1 -- 172.21.15.150:0/3261513184 learned_addr learned my addr 172.21.15.150:0/3261513184 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403d6fd700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4038156950 0x7f40381dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 msgr2=0x7f40381ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f403806b430 0x7f40381ebcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4038156950 msgr2=0x7f40381dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4038156950 0x7f40381dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240093e0 con 0x7f4038150e60 2022-08-10T17:43:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f4037fff700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f403806f570 tx=0x7f40240045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024011c60 con 0x7f4038150e60 2022-08-10T17:43:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024020070 con 0x7f4038150e60 2022-08-10T17:43:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40381ec200 con 0x7f4038150e60 2022-08-10T17:43:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024003520 con 0x7f4038150e60 2022-08-10T17:43:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.655+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40381ec770 con 0x7f4038150e60 2022-08-10T17:43:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.656+0000 7f403f160700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 0x7f403814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.656+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380673d0 con 0x7f40381eca50 2022-08-10T17:43:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.656+0000 7f403cefc700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 0x7f403814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f403cefc700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40380c52e0 con 0x7f40381eca50 2022-08-10T17:43:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f403cefc700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 0x7f403814edf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f402c0118b0 tx=0x7f402c011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f402402b020 con 0x7f4038150e60 2022-08-10T17:43:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40200650e0 0x7f4020067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f40240838d0 con 0x7f4038150e60 2022-08-10T17:43:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f403d6fd700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40200650e0 0x7f4020067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c004240 con 0x7f40381eca50 2022-08-10T17:43:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f402c0043a0 con 0x7f40381eca50 2022-08-10T17:43:51.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 msgr2=0x7f403814edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 0x7f403814edf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f402c0118b0 tx=0x7f402c011c70 comp rx=0 tx=0).stop 2022-08-10T17:43:51.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 msgr2=0x7f403814edf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.657+0000 7f40357fa700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381eca50 0x7f403814edf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.658+0000 7f403d6fd700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40200650e0 0x7f4020067590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4030009f80 tx=0x7f40300096b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.664+0000 7f403f160700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 0x7f403814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.664+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403814f870 con 0x7f40381514d0 2022-08-10T17:43:51.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.664+0000 7f403cefc700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 0x7f403814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.665+0000 7f403cefc700 1 -- 172.21.15.150:0/3261513184 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4038072890 con 0x7f40381514d0 2022-08-10T17:43:51.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.665+0000 7f403cefc700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 0x7f403814f330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f402c0118b0 tx=0x7f402c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c02c070 con 0x7f40381514d0 2022-08-10T17:43:51.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4547 (secure 0 0 0) 0x7f402c024040 con 0x7f40381514d0 2022-08-10T17:43:51.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 msgr2=0x7f403814f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 0x7f403814f330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f402c0118b0 tx=0x7f402c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 msgr2=0x7f403814f330 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:43:51.681 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f40357fa700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f40381514d0 0x7f403814f330 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f402c0118b0 tx=0x7f402c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.682 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:43:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:43:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:43:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:43:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:43:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:43:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:43:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:43:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:43:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:43:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:43:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:43:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:43:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:43:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:43:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:43:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:43:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:43:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:43:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:43:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:43:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:43:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:43:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:43:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:43:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:43:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:43:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:43:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:43:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:43:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:43:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:43:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:43:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:43:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:43:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:43:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:43:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:43:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:43:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:43:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:43:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:43:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:43:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:43:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:43:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:43:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:43:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:43:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:43:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:43:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:43:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:43:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:43:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:43:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:43:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:43:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:43:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:43:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:43:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:43:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:43:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:43:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:43:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:43:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:43:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:43:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:43:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:43:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:43:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:43:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:43:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:43:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:43:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:43:51.718 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:43:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40200650e0 msgr2=0x7f4020067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f40200650e0 0x7f4020067590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4030009f80 tx=0x7f40300096b0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 msgr2=0x7f4038151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f403806f570 tx=0x7f40240045d0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403d6fd700 1 -- 172.21.15.150:0/3261513184 reap_dead start 2022-08-10T17:43:51.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 shutdown_connections 2022-08-10T17:43:51.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 --2- 172.21.15.150:0/3261513184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4038150e60 0x7f4038151d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 >> 172.21.15.150:0/3261513184 conn(0x7f403806d730 msgr2=0x7f40381552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 shutdown_connections 2022-08-10T17:43:51.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.666+0000 7f403f160700 1 -- 172.21.15.150:0/3261513184 wait complete. 2022-08-10T17:43:51.722 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:43:51.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:43:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.859+0000 7faa95893700 1 Processor -- start 2022-08-10T17:43:51.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.859+0000 7faa95893700 1 -- start start 2022-08-10T17:43:51.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7faa900c3410 0x7faa90154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa900ca840 0x7faa901551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c37e0 0x7faa90153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa90157f30 con 0x7faa900ca840 2022-08-10T17:43:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa901581d0 con 0x7faa900c3410 2022-08-10T17:43:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa95893700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa901584b0 con 0x7faa900c37e0 2022-08-10T17:43:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa900ca840 0x7faa901551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa900ca840 0x7faa901551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38348/0 (socket says 172.21.15.150:38348) 2022-08-10T17:43:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 -- 172.21.15.150:0/385119784 learned_addr learned my addr 172.21.15.150:0/385119784 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8f7fe700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c37e0 0x7faa90153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8effd700 1 --2- 172.21.15.150:0/385119784 >> v2:172.21.15.197:3300/0 conn(0x7faa900c3410 0x7faa90154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 -- 172.21.15.150:0/385119784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c37e0 msgr2=0x7faa90153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c37e0 0x7faa90153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 -- 172.21.15.150:0/385119784 >> v2:172.21.15.197:3300/0 conn(0x7faa900c3410 msgr2=0x7faa90154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:43:51.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 --2- 172.21.15.150:0/385119784 >> v2:172.21.15.197:3300/0 conn(0x7faa900c3410 0x7faa90154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 -- 172.21.15.150:0/385119784 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90158790 con 0x7faa900ca840 2022-08-10T17:43:51.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8e7fc700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa901551e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa900c41e0 tx=0x7faa80009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172cdd6d28476394 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.860+0000 7faa8dffb700 1 -- 172.21.15.150:0/385119784 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80004230 con 0x7faa900ca840 2022-08-10T17:43:51.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa8dffb700 1 -- 172.21.15.150:0/385119784 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80004390 con 0x7faa900ca840 2022-08-10T17:43:51.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa8dffb700 1 -- 172.21.15.150:0/385119784 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011850 con 0x7faa900ca840 2022-08-10T17:43:51.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 -- 172.21.15.150:0/385119784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 msgr2=0x7faa901551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa901551e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa900c41e0 tx=0x7faa80009a60 comp rx=0 tx=0).stop 2022-08-10T17:43:51.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 -- 172.21.15.150:0/385119784 shutdown_connections 2022-08-10T17:43:51.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c37e0 0x7faa90153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 --2- 172.21.15.150:0/385119784 >> v2:172.21.15.197:3300/0 conn(0x7faa900c3410 0x7faa90154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 --2- 172.21.15.150:0/385119784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa901551e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 -- 172.21.15.150:0/385119784 >> 172.21.15.150:0/385119784 conn(0x7faa90068110 msgr2=0x7faa90068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:51.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 -- 172.21.15.150:0/385119784 shutdown_connections 2022-08-10T17:43:51.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.861+0000 7faa95893700 1 -- 172.21.15.150:0/385119784 wait complete. 2022-08-10T17:43:51.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.862+0000 7faa95893700 1 Processor -- start 2022-08-10T17:43:51.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.862+0000 7faa95893700 1 -- start start 2022-08-10T17:43:51.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c3410 0x7faa900be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faa900c37e0 0x7faa901eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa901ea600 con 0x7faa900ca840 2022-08-10T17:43:51.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900bddc0 con 0x7faa900c37e0 2022-08-10T17:43:51.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa95893700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9014d590 con 0x7faa900c3410 2022-08-10T17:43:51.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38356/0 (socket says 172.21.15.150:38356) 2022-08-10T17:43:51.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 -- 172.21.15.150:0/3591781736 learned_addr learned my addr 172.21.15.150:0/3591781736 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:43:51.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8e7fc700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faa900c37e0 0x7faa901eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8effd700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c3410 0x7faa900be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 -- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c3410 msgr2=0x7faa900be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c3410 0x7faa900be890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 -- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faa900c37e0 msgr2=0x7faa901eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:51.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faa900c37e0 0x7faa901eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:51.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 -- 172.21.15.150:0/3591781736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800093e0 con 0x7faa900ca840 2022-08-10T17:43:51.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.863+0000 7faa8f7fe700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa8800efc0 tx=0x7faa8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.864+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88009ea0 con 0x7faa900ca840 2022-08-10T17:43:51.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.864+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8800f040 con 0x7faa900ca840 2022-08-10T17:43:51.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.864+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9014d870 con 0x7faa900ca840 2022-08-10T17:43:51.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.864+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800ced0 con 0x7faa900ca840 2022-08-10T17:43:51.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.864+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa901ea220 con 0x7faa900ca840 2022-08-10T17:43:51.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.865+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa901ea740 con 0x7faa900ca840 2022-08-10T17:43:51.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.865+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7faa88014480 con 0x7faa900ca840 2022-08-10T17:43:51.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.865+0000 7faa77fff700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 0x7faa70067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:43:51.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.865+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7faa88082e60 con 0x7faa900ca840 2022-08-10T17:43:51.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.866+0000 7faa8effd700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 0x7faa70067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:43:51.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.866+0000 7faa8effd700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 0x7faa70067560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa840099d0 tx=0x7faa840090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:43:51.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:51.870+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7faa901ea740 con 0x7faa900ca840 2022-08-10T17:43:52.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.149+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7faa901ea740 con 0x7faa900ca840 2022-08-10T17:43:52.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.150+0000 7faa77fff700 1 -- 172.21.15.150:0/3591781736 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7faa901ea740 con 0x7faa900ca840 2022-08-10T17:43:52.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 msgr2=0x7faa70067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:52.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 0x7faa70067560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa840099d0 tx=0x7faa840090e0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 msgr2=0x7faa9014e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:43:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa8800efc0 tx=0x7faa8800c3a0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 shutdown_connections 2022-08-10T17:43:52.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa900ca840 0x7faa9014e800 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa700650b0 0x7faa70067560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faa900c3410 0x7faa900be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 --2- 172.21.15.150:0/3591781736 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faa900c37e0 0x7faa901eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:43:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 >> 172.21.15.150:0/3591781736 conn(0x7faa90068110 msgr2=0x7faa90153040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:43:52.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 shutdown_connections 2022-08-10T17:43:52.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:43:52.152+0000 7faa95893700 1 -- 172.21.15.150:0/3591781736 wait complete. 2022-08-10T17:43:52.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:44:02.174 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:44:02.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:02.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.980+0000 7fd4c5a3d700 1 Processor -- start 2022-08-10T17:44:02.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.980+0000 7fd4c5a3d700 1 -- start start 2022-08-10T17:44:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4c5a3d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 0x7fd4c0069960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4c5a3d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00cb830 con 0x7fd4c00b0cb0 2022-08-10T17:44:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4c5a3d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00cacf0 con 0x7fd4c006d860 2022-08-10T17:44:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4c5a3d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0069ea0 con 0x7fd4c0150f10 2022-08-10T17:44:02.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4bf7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd4c00b0cb0 0x7fd4c015a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51100/0 (socket says 172.21.15.150:51100) 2022-08-10T17:44:02.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4bf7fe700 1 -- 172.21.15.150:0/3532557044 learned_addr learned my addr 172.21.15.150:0/3532557044 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:02.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4be7fc700 1 --2- 172.21.15.150:0/3532557044 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 0x7fd4c0069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:02.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4bdffb700 1 -- 172.21.15.150:0/3532557044 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805351300 0 0) 0x7fd4c00cb830 con 0x7fd4c00b0cb0 2022-08-10T17:44:02.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4bdffb700 1 -- 172.21.15.150:0/3532557044 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ac003430 con 0x7fd4c00b0cb0 2022-08-10T17:44:02.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4be7fc700 1 -- 172.21.15.150:0/3532557044 >> v1:172.21.15.197:6789/0 conn(0x7fd4c006d860 legacy=0x7fd4c0150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:02.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4be7fc700 1 -- 172.21.15.150:0/3532557044 >> v1:172.21.15.150:6789/0 conn(0x7fd4c00b0cb0 legacy=0x7fd4c015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:02.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4be7fc700 1 -- 172.21.15.150:0/3532557044 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00caf90 con 0x7fd4c0150f10 2022-08-10T17:44:02.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.981+0000 7fd4be7fc700 1 --2- 172.21.15.150:0/3532557044 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 0x7fd4c0069960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40096e0 tx=0x7fd4b40099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce796e11d3769 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:02.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4bdffb700 1 -- 172.21.15.150:0/3532557044 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40107b0 con 0x7fd4c0150f10 2022-08-10T17:44:02.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4bdffb700 1 -- 172.21.15.150:0/3532557044 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4010910 con 0x7fd4c0150f10 2022-08-10T17:44:02.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4bdffb700 1 -- 172.21.15.150:0/3532557044 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4010cc0 con 0x7fd4c0150f10 2022-08-10T17:44:02.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/3532557044 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 msgr2=0x7fd4c0069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:02.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/3532557044 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 0x7fd4c0069960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40096e0 tx=0x7fd4b40099f0 comp rx=0 tx=0).stop 2022-08-10T17:44:02.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/3532557044 shutdown_connections 2022-08-10T17:44:02.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/3532557044 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c0150f10 0x7fd4c0069960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:02.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/3532557044 >> 172.21.15.150:0/3532557044 conn(0x7fd4c006b0c0 msgr2=0x7fd4c006b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:02.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/3532557044 shutdown_connections 2022-08-10T17:44:02.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.982+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/3532557044 wait complete. 2022-08-10T17:44:02.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 Processor -- start 2022-08-10T17:44:02.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 -- start start 2022-08-10T17:44:02.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 0x7fd4c00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:02.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:02.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4c0150f10 0x7fd4c01ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:02.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01595f0 con 0x7fd4c00b0cb0 2022-08-10T17:44:02.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01599d0 con 0x7fd4c0150f10 2022-08-10T17:44:02.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4c5a3d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0152820 con 0x7fd4c006d860 2022-08-10T17:44:02.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.984+0000 7fd4be7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:02.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38424/0 (socket says 172.21.15.150:38424) 2022-08-10T17:44:02.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 -- 172.21.15.150:0/246352701 learned_addr learned my addr 172.21.15.150:0/246352701 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:02.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4beffd700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 0x7fd4c00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:02.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4bf7fe700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4c0150f10 0x7fd4c01ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:02.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 -- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 msgr2=0x7fd4c00c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:02.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 0x7fd4c00c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:02.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 -- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4c0150f10 msgr2=0x7fd4c01ec3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:02.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4c0150f10 0x7fd4c01ec3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:02.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 -- 172.21.15.150:0/246352701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009310 con 0x7fd4c00b0cb0 2022-08-10T17:44:02.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4beffd700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 0x7fd4c00c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:44:03.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4be7fc700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004230 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40043b0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0159be0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4003760 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.985+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c01efda0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.986+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c01f02f0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.987+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd4b402b020 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.988+0000 7fd4a7fff700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 0x7fd4a0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.988+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd4b4083820 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.988+0000 7fd4beffd700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 0x7fd4a0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.988+0000 7fd4beffd700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 0x7fd4a0067560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007fd0 tx=0x7fd4b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:02.991+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd4b40518a0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.324+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd4c00cb270 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.324+0000 7fd4a7fff700 1 -- 172.21.15.150:0/246352701 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fd4b4054ec0 con 0x7fd4c00b0cb0 2022-08-10T17:44:03.329 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:03.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 msgr2=0x7fd4a0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 0x7fd4a0067560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007fd0 tx=0x7fd4b0009040 comp rx=0 tx=0).stop 2022-08-10T17:44:03.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 msgr2=0x7fd4c01ebe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b40045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 shutdown_connections 2022-08-10T17:44:03.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd4c0150f10 0x7fd4c01ec3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd4a00650b0 0x7fd4a0067560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd4c006d860 0x7fd4c00c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 --2- 172.21.15.150:0/246352701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4c00b0cb0 0x7fd4c01ebe80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 >> 172.21.15.150:0/246352701 conn(0x7fd4c006b0c0 msgr2=0x7fd4c014aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:03.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 shutdown_connections 2022-08-10T17:44:03.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.327+0000 7fd4c5a3d700 1 -- 172.21.15.150:0/246352701 wait complete. 2022-08-10T17:44:03.346 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:44:03.346 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:44:03.346 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:44:03.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.621+0000 7fd6e471a700 1 Processor -- start 2022-08-10T17:44:03.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.621+0000 7fd6e471a700 1 -- start start 2022-08-10T17:44:03.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.621+0000 7fd6e471a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd6dc151290 0x7fd6dc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.621+0000 7fd6e471a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6dc158170 0x7fd6dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e471a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc0c1f40 con 0x7fd6dc157780 2022-08-10T17:44:03.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e471a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c7d90 con 0x7fd6dc158170 2022-08-10T17:44:03.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e471a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc069130 con 0x7fd6dc151290 2022-08-10T17:44:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6dc158170 0x7fd6dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6dc158170 0x7fd6dc068bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38438/0 (socket says 172.21.15.150:38438) 2022-08-10T17:44:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/3914440139 learned_addr learned my addr 172.21.15.150:0/3914440139 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/3914440139 >> v2:172.21.15.197:3300/0 conn(0x7fd6dc151290 0x7fd6dc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/3914440139 >> v2:172.21.15.197:3300/0 conn(0x7fd6dc151290 msgr2=0x7fd6dc0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 --2- 172.21.15.150:0/3914440139 >> v2:172.21.15.197:3300/0 conn(0x7fd6dc151290 0x7fd6dc0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/3914440139 >> v1:172.21.15.197:6789/0 conn(0x7fd6dc157780 legacy=0x7fd6dc0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/3914440139 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0c2220 con 0x7fd6dc158170 2022-08-10T17:44:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e1cb5700 1 --2- 172.21.15.150:0/3914440139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc158170 0x7fd6dc068bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cdeb0 tx=0x7fd6cc009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9762bad6c8286dfa server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e14b4700 1 -- 172.21.15.150:0/3914440139 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004230 con 0x7fd6dc158170 2022-08-10T17:44:03.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e14b4700 1 -- 172.21.15.150:0/3914440139 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc004390 con 0x7fd6dc158170 2022-08-10T17:44:03.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.622+0000 7fd6e14b4700 1 -- 172.21.15.150:0/3914440139 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0107f0 con 0x7fd6dc158170 2022-08-10T17:44:03.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 -- 172.21.15.150:0/3914440139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc158170 msgr2=0x7fd6dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 --2- 172.21.15.150:0/3914440139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc158170 0x7fd6dc068bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cdeb0 tx=0x7fd6cc009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 -- 172.21.15.150:0/3914440139 shutdown_connections 2022-08-10T17:44:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 --2- 172.21.15.150:0/3914440139 >> v2:172.21.15.197:3300/0 conn(0x7fd6dc151290 0x7fd6dc0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 --2- 172.21.15.150:0/3914440139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc158170 0x7fd6dc068bf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 -- 172.21.15.150:0/3914440139 >> 172.21.15.150:0/3914440139 conn(0x7fd6dc06f880 msgr2=0x7fd6dc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:03.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 -- 172.21.15.150:0/3914440139 shutdown_connections 2022-08-10T17:44:03.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.623+0000 7fd6e471a700 1 -- 172.21.15.150:0/3914440139 wait complete. 2022-08-10T17:44:03.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.624+0000 7fd6e471a700 1 Processor -- start 2022-08-10T17:44:03.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 -- start start 2022-08-10T17:44:03.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6dc151290 0x7fd6dc156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 0x7fd6dc0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6dc158170 0x7fd6dc0c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1550b0 con 0x7fd6dc157780 2022-08-10T17:44:03.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc15a650 con 0x7fd6dc151290 2022-08-10T17:44:03.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.625+0000 7fd6e471a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c68a0 con 0x7fd6dc158170 2022-08-10T17:44:03.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 0x7fd6dc0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 0x7fd6dc0c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38444/0 (socket says 172.21.15.150:38444) 2022-08-10T17:44:03.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/2952793857 learned_addr learned my addr 172.21.15.150:0/2952793857 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:03.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6dc151290 0x7fd6dc156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e2cb7700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6dc158170 0x7fd6dc0c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6dc158170 msgr2=0x7fd6dc0c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6dc158170 0x7fd6dc0c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6dc151290 msgr2=0x7fd6dc156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6dc151290 0x7fd6dc156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0093e0 con 0x7fd6dc157780 2022-08-10T17:44:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e2cb7700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6dc158170 0x7fd6dc0c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:44:03.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e1cb5700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 0x7fd6dc0c8480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000c00 tx=0x7fd6cc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc003520 con 0x7fd6dc157780 2022-08-10T17:44:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0036a0 con 0x7fd6dc157780 2022-08-10T17:44:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc155540 con 0x7fd6dc157780 2022-08-10T17:44:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc003a50 con 0x7fd6dc157780 2022-08-10T17:44:03.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.626+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc154a60 con 0x7fd6dc157780 2022-08-10T17:44:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.627+0000 7fd6e471a700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 0x7fd6dc1efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.627+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0644b0 con 0x7fd6dc0c2f60 2022-08-10T17:44:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.627+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 0x7fd6dc1efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.627+0000 7fd6e24b6700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6dc070610 con 0x7fd6dc0c2f60 2022-08-10T17:44:03.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 0x7fd6dc1efda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011890 tx=0x7fd6d8011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011e80 con 0x7fd6dc0c2f60 2022-08-10T17:44:03.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd6cc02c070 con 0x7fd6dc157780 2022-08-10T17:44:03.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6bc065150 0x7fd6bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd6cc083220 con 0x7fd6dc157780 2022-08-10T17:44:03.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd6d8004240 con 0x7fd6dc0c2f60 2022-08-10T17:44:03.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 msgr2=0x7fd6dc1efda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 0x7fd6dc1efda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011890 tx=0x7fd6d8011c50 comp rx=0 tx=0).stop 2022-08-10T17:44:03.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 msgr2=0x7fd6dc1efda0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:03.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6caffd700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc0c2f60 0x7fd6dc1efda0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.628+0000 7fd6e2cb7700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6bc065150 0x7fd6bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.629+0000 7fd6e2cb7700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6bc065150 0x7fd6bc067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cde80 tx=0x7fd6d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.635+0000 7fd6e471a700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 0x7fd6dc149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.635+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc155260 con 0x7fd6dc1f02e0 2022-08-10T17:44:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 0x7fd6dc149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6e24b6700 1 -- 172.21.15.150:0/2952793857 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6dc150280 con 0x7fd6dc1f02e0 2022-08-10T17:44:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6e24b6700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 0x7fd6dc149000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011890 tx=0x7fd6d80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d802c070 con 0x7fd6dc1f02e0 2022-08-10T17:44:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7fd6d8024040 con 0x7fd6dc1f02e0 2022-08-10T17:44:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 msgr2=0x7fd6dc149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 0x7fd6dc149000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011890 tx=0x7fd6d80045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 msgr2=0x7fd6dc149000 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:03.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.636+0000 7fd6caffd700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc1f02e0 0x7fd6dc149000 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8011890 tx=0x7fd6d80045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.650 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:03.651 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:03.651 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:03.651 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:44:03.651 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:44:03.651 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:03.652 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:03.652 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:03.652 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:03.652 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.653 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 26, 2022-08-10T17:44:03.653 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:03.653 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:03.653 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:03.654 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.654 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.654 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.654 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.654 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.655 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.655 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.655 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.655 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.656 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.656 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:03.656 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:03.656 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.656 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.657 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.657 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.657 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.657 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.657 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.658 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.658 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.658 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.659 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:03.659 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:03.659 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:03.659 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:03.660 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:03.660 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:03.660 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:03.660 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:03.660 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:03.661 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:03.661 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:03.661 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:03.661 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.663 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.663 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.663 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.663 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.664 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:03.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.665 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:03.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.665 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:03.666 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:03.666 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.666 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.667 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.667 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:03.667 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.668 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.668 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:03.669 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.669 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.669 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.670 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:03.670 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:03.670 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.670 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.671 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.671 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:03.671 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:03.672 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.672 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.672 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.673 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:03.673 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.673 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.674 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:03.674 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.674 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.674 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.675 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:03.675 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:03.675 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.675 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.676 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.676 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:03.677 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:03.677 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.677 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.678 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.678 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:03.678 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:03.681 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.681 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.681 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.681 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.682 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.682 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:03.682 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:03.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.683 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.683 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.683 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:03.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.684 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.684 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:03.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.685 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.685 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.685 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:03.685 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.686 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.686 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:03.686 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:03.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6bc065150 msgr2=0x7fd6bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6bc065150 0x7fd6bc067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cde80 tx=0x7fd6d4009040 comp rx=0 tx=0).stop 2022-08-10T17:44:03.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 msgr2=0x7fd6dc0c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 --2- 172.21.15.150:0/2952793857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc157780 0x7fd6dc0c8480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000c00 tx=0x7fd6cc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e2cb7700 1 -- 172.21.15.150:0/2952793857 reap_dead start 2022-08-10T17:44:03.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e2cb7700 1 -- 172.21.15.150:0/2952793857 reap_dead start 2022-08-10T17:44:03.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 shutdown_connections 2022-08-10T17:44:03.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 >> 172.21.15.150:0/2952793857 conn(0x7fd6dc06f880 msgr2=0x7fd6dc0c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:03.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 shutdown_connections 2022-08-10T17:44:03.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.637+0000 7fd6e471a700 1 -- 172.21.15.150:0/2952793857 wait complete. 2022-08-10T17:44:03.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:44:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.833+0000 7efc9a93c700 1 Processor -- start 2022-08-10T17:44:03.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.833+0000 7efc9a93c700 1 -- start start 2022-08-10T17:44:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc9a93c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efc940c3230 0x7efc940ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc9a93c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940c3600 con 0x7efc9406ea90 2022-08-10T17:44:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc9a93c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940c5900 con 0x7efc9406b1b0 2022-08-10T17:44:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc9a93c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940c6080 con 0x7efc940c3230 2022-08-10T17:44:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc98ed9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7efc9406ea90 0x7efc9406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51138/0 (socket says 172.21.15.150:51138) 2022-08-10T17:44:03.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc98ed9700 1 -- 172.21.15.150:0/735293371 learned_addr learned my addr 172.21.15.150:0/735293371 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc93fff700 1 --2- 172.21.15.150:0/735293371 >> v2:172.21.15.197:3300/0 conn(0x7efc940c3230 0x7efc940ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc92ffd700 1 -- 172.21.15.150:0/735293371 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018578446 0 0) 0x7efc940c3600 con 0x7efc9406ea90 2022-08-10T17:44:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc92ffd700 1 -- 172.21.15.150:0/735293371 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc80003430 con 0x7efc9406ea90 2022-08-10T17:44:03.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc93fff700 1 -- 172.21.15.150:0/735293371 >> v1:172.21.15.197:6789/0 conn(0x7efc9406b1b0 legacy=0x7efc940c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc93fff700 1 -- 172.21.15.150:0/735293371 >> v1:172.21.15.150:6789/0 conn(0x7efc9406ea90 legacy=0x7efc9406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.834+0000 7efc93fff700 1 -- 172.21.15.150:0/735293371 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94069f60 con 0x7efc940c3230 2022-08-10T17:44:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc93fff700 1 --2- 172.21.15.150:0/735293371 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940c3230 0x7efc940ca420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc840096b0 tx=0x7efc840099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e5eb76aff56692 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc92ffd700 1 -- 172.21.15.150:0/735293371 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840107b0 con 0x7efc940c3230 2022-08-10T17:44:03.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc92ffd700 1 -- 172.21.15.150:0/735293371 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84010910 con 0x7efc940c3230 2022-08-10T17:44:03.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc92ffd700 1 -- 172.21.15.150:0/735293371 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84010cc0 con 0x7efc940c3230 2022-08-10T17:44:03.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 -- 172.21.15.150:0/735293371 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940c3230 msgr2=0x7efc940ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 --2- 172.21.15.150:0/735293371 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940c3230 0x7efc940ca420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc840096b0 tx=0x7efc840099c0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 -- 172.21.15.150:0/735293371 shutdown_connections 2022-08-10T17:44:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 --2- 172.21.15.150:0/735293371 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940c3230 0x7efc940ca420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 -- 172.21.15.150:0/735293371 >> 172.21.15.150:0/735293371 conn(0x7efc94068110 msgr2=0x7efc94068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 -- 172.21.15.150:0/735293371 shutdown_connections 2022-08-10T17:44:03.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.835+0000 7efc9a93c700 1 -- 172.21.15.150:0/735293371 wait complete. 2022-08-10T17:44:03.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 Processor -- start 2022-08-10T17:44:03.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 -- start start 2022-08-10T17:44:03.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 0x7efc94156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc9406ea90 0x7efc94156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc940c3230 0x7efc94145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9406ae80 con 0x7efc9406b1b0 2022-08-10T17:44:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941471d0 con 0x7efc9406ea90 2022-08-10T17:44:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc9a93c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940be060 con 0x7efc940c3230 2022-08-10T17:44:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc93fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 0x7efc94156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc93fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 0x7efc94156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38460/0 (socket says 172.21.15.150:38460) 2022-08-10T17:44:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.837+0000 7efc93fff700 1 -- 172.21.15.150:0/2128406398 learned_addr learned my addr 172.21.15.150:0/2128406398 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc98ed9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc940c3230 0x7efc94145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc937fe700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc9406ea90 0x7efc94156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc940c3230 msgr2=0x7efc94145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc940c3230 0x7efc94145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc9406ea90 msgr2=0x7efc94156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc9406ea90 0x7efc94156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009310 con 0x7efc9406b1b0 2022-08-10T17:44:03.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc93fff700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 0x7efc94156680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc840090b0 tx=0x7efc840045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84010a80 con 0x7efc9406b1b0 2022-08-10T17:44:03.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84010c00 con 0x7efc9406b1b0 2022-08-10T17:44:03.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94154020 con 0x7efc9406b1b0 2022-08-10T17:44:03.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004270 con 0x7efc9406b1b0 2022-08-10T17:44:03.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.838+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc941545e0 con 0x7efc9406b1b0 2022-08-10T17:44:03.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.839+0000 7efc9a93c700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 0x7efc941560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.839+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940aff70 con 0x7efc94154770 2022-08-10T17:44:03.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.839+0000 7efc937fe700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 0x7efc941560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efc8402d020 con 0x7efc9406b1b0 2022-08-10T17:44:03.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc937fe700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc94072890 con 0x7efc94154770 2022-08-10T17:44:03.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc937fe700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 0x7efc941560c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc940c0940 tx=0x7efc8800f800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efc740650e0 0x7efc74067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efc84021030 con 0x7efc9406b1b0 2022-08-10T17:44:03.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc98ed9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efc740650e0 0x7efc74067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800fe80 con 0x7efc94154770 2022-08-10T17:44:03.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7efc880052e0 con 0x7efc94154770 2022-08-10T17:44:03.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 msgr2=0x7efc941560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 0x7efc941560c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc940c0940 tx=0x7efc8800f800 comp rx=0 tx=0).stop 2022-08-10T17:44:03.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 msgr2=0x7efc941560c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:03.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc90ff9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc94154770 0x7efc941560c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.840+0000 7efc98ed9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efc740650e0 0x7efc74067590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc8c001560 tx=0x7efc8c007f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.849+0000 7efc9a93c700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 0x7efc94146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.849+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9406a200 con 0x7efc940be3a0 2022-08-10T17:44:03.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.849+0000 7efc937fe700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 0x7efc94146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:03.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.849+0000 7efc937fe700 1 -- 172.21.15.150:0/2128406398 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efc940c4880 con 0x7efc940be3a0 2022-08-10T17:44:03.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc937fe700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 0x7efc94146160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc94157740 tx=0x7efc88001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:03.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8801ca70 con 0x7efc940be3a0 2022-08-10T17:44:03.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7efc8801cbd0 con 0x7efc940be3a0 2022-08-10T17:44:03.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 msgr2=0x7efc94146160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 0x7efc94146160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc94157740 tx=0x7efc88001080 comp rx=0 tx=0).stop 2022-08-10T17:44:03.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 msgr2=0x7efc94146160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:03.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc90ff9700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc940be3a0 0x7efc94146160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.863 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:44:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 26, 2022-08-10T17:44:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:03.872 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:03.872 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:03.872 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:03.872 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:03.873 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:03.873 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:03.873 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:03.873 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:03.873 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:03.874 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:03.874 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:03.874 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:03.874 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:03.875 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:03.875 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:03.875 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:03.875 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:03.876 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:03.877 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:03.877 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.877 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:03.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.878 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:03.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.878 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:03.878 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:03.880 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.880 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.881 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:03.881 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.881 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.883 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.883 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:03.884 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:03.884 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.884 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.884 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.885 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:03.885 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.886 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.886 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:03.886 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.887 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.887 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:03.887 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.889 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:03.889 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:03.889 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:03.889 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:03.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.890 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:03.890 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:03.890 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.891 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:03.891 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:03.891 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:03.892 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.892 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:03.893 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:03.894 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:03.894 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.894 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.894 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:03.895 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:03.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.895 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.895 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.896 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:03.896 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.896 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.896 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:44:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:44:03.897 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.898 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.898 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:44:03.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.898 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.899 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.899 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:44:03.899 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.899 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.899 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:03.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.900 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:44:03.900 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.900 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:03.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.901 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.901 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.901 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:44:03.902 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.902 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:03.902 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:44:03.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:03.903 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:03.903 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:03.903 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:03.903 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:03.904 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:03.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:03.904 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:03.904 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:03.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efc740650e0 msgr2=0x7efc74067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc9a93c700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efc740650e0 0x7efc74067590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc8c001560 tx=0x7efc8c007f40 comp rx=0 tx=0).stop 2022-08-10T17:44:03.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 msgr2=0x7efc94156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc9a93c700 1 --2- 172.21.15.150:0/2128406398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc9406b1b0 0x7efc94156680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc840090b0 tx=0x7efc840045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc98ed9700 1 -- 172.21.15.150:0/2128406398 reap_dead start 2022-08-10T17:44:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.850+0000 7efc98ed9700 1 -- 172.21.15.150:0/2128406398 reap_dead start 2022-08-10T17:44:03.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.851+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 shutdown_connections 2022-08-10T17:44:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.851+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 >> 172.21.15.150:0/2128406398 conn(0x7efc94068110 msgr2=0x7efc940c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.851+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 shutdown_connections 2022-08-10T17:44:03.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:03.851+0000 7efc9a93c700 1 -- 172.21.15.150:0/2128406398 wait complete. 2022-08-10T17:44:03.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:44:04.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.049+0000 7f3054f3b700 1 Processor -- start 2022-08-10T17:44:04.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.049+0000 7f3054f3b700 1 -- start start 2022-08-10T17:44:04.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f3054f3b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f30500c7220 0x7f30500c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f3054f3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30500c25c0 0x7f305006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f3054f3b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500c2a60 con 0x7f30500c4d90 2022-08-10T17:44:04.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f3054f3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500c5e10 con 0x7f30500c25c0 2022-08-10T17:44:04.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f3054f3b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500c1c30 con 0x7f30500c7220 2022-08-10T17:44:04.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30500c25c0 0x7f305006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304e59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f30500c4d90 0x7f30500c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51152/0 (socket says 172.21.15.150:51152) 2022-08-10T17:44:04.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304e59c700 1 -- 172.21.15.150:0/969567354 learned_addr learned my addr 172.21.15.150:0/969567354 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:04.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304dd9b700 1 --2- 172.21.15.150:0/969567354 >> v2:172.21.15.197:3300/0 conn(0x7f30500c7220 0x7f30500c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 -- 172.21.15.150:0/969567354 >> v2:172.21.15.197:3300/0 conn(0x7f30500c7220 msgr2=0x7f30500c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:04.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 --2- 172.21.15.150:0/969567354 >> v2:172.21.15.197:3300/0 conn(0x7f30500c7220 0x7f30500c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 -- 172.21.15.150:0/969567354 >> v1:172.21.15.150:6789/0 conn(0x7f30500c4d90 legacy=0x7f30500c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 -- 172.21.15.150:0/969567354 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500699c0 con 0x7f30500c25c0 2022-08-10T17:44:04.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.050+0000 7f304ed9d700 1 --2- 172.21.15.150:0/969567354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c25c0 0x7f305006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30500afcf0 tx=0x7f304800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1675e108d065505 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f304d59a700 1 -- 172.21.15.150:0/969567354 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800e070 con 0x7f30500c25c0 2022-08-10T17:44:04.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f304d59a700 1 -- 172.21.15.150:0/969567354 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800bb20 con 0x7f30500c25c0 2022-08-10T17:44:04.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f304d59a700 1 -- 172.21.15.150:0/969567354 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048012430 con 0x7f30500c25c0 2022-08-10T17:44:04.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 -- 172.21.15.150:0/969567354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c25c0 msgr2=0x7f305006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 --2- 172.21.15.150:0/969567354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c25c0 0x7f305006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30500afcf0 tx=0x7f304800b330 comp rx=0 tx=0).stop 2022-08-10T17:44:04.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 -- 172.21.15.150:0/969567354 shutdown_connections 2022-08-10T17:44:04.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 --2- 172.21.15.150:0/969567354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c25c0 0x7f305006fca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 --2- 172.21.15.150:0/969567354 >> v2:172.21.15.197:3300/0 conn(0x7f30500c7220 0x7f30500c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 -- 172.21.15.150:0/969567354 >> 172.21.15.150:0/969567354 conn(0x7f305006d0d0 msgr2=0x7f30500c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:04.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 -- 172.21.15.150:0/969567354 shutdown_connections 2022-08-10T17:44:04.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.051+0000 7f3054f3b700 1 -- 172.21.15.150:0/969567354 wait complete. 2022-08-10T17:44:04.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.052+0000 7f3054f3b700 1 Processor -- start 2022-08-10T17:44:04.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 -- start start 2022-08-10T17:44:04.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500c25c0 0x7f30501e9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30500c4d90 0x7f3050071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 0x7f3050151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501ecd90 con 0x7f30500c7220 2022-08-10T17:44:04.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501ed030 con 0x7f30500c4d90 2022-08-10T17:44:04.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f3054f3b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501ed2f0 con 0x7f30500c25c0 2022-08-10T17:44:04.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500c25c0 0x7f30501e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.053+0000 7f304ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 0x7f3050151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304dd9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30500c4d90 0x7f3050071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 0x7f3050151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38482/0 (socket says 172.21.15.150:38482) 2022-08-10T17:44:04.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500c25c0 0x7f30501e9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:52700/0 (socket says 172.21.15.150:52700) 2022-08-10T17:44:04.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 learned_addr learned my addr 172.21.15.150:0/2953485610 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:04.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500c25c0 msgr2=0x7f30501e9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500c25c0 0x7f30501e9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30500c4d90 msgr2=0x7f3050071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f30500c4d90 0x7f3050071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.054+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048009a70 con 0x7f30500c7220 2022-08-10T17:44:04.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f304ed9d700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 0x7f3050151ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3048014040 tx=0x7f3048004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048004450 con 0x7f30500c7220 2022-08-10T17:44:04.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048020070 con 0x7f30500c7220 2022-08-10T17:44:04.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30501ed5d0 con 0x7f30500c7220 2022-08-10T17:44:04.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480098f0 con 0x7f30500c7220 2022-08-10T17:44:04.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.056+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30501edb90 con 0x7f30500c7220 2022-08-10T17:44:04.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.060+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f304802e070 con 0x7f30500c7220 2022-08-10T17:44:04.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.061+0000 7f303effd700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f302c0650e0 0x7f302c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.061+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3048022070 con 0x7f30500c7220 2022-08-10T17:44:04.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.061+0000 7f304e59c700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f302c0650e0 0x7f302c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.061+0000 7f304e59c700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f302c0650e0 0x7f302c067590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3040005790 tx=0x7f3040007dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.065+0000 7f3054f3b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 0x7f3050152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.065+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500672f0 con 0x7f30501eac90 2022-08-10T17:44:04.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.065+0000 7f304dd9b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 0x7f3050152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.065+0000 7f304dd9b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3050072890 con 0x7f30501eac90 2022-08-10T17:44:04.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.066+0000 7f304dd9b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 0x7f3050152430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f3044011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.066+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440043a0 con 0x7f30501eac90 2022-08-10T17:44:04.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.068+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3044003520 con 0x7f30501eac90 2022-08-10T17:44:04.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.068+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 msgr2=0x7f3050152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.068+0000 7f303effd700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 0x7f3050152430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f3044011bf0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.068+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 msgr2=0x7f3050152430 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:04.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.068+0000 7f303effd700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30501eac90 0x7f3050152430 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f3044011bf0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.078+0000 7f3054f3b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 0x7f30501eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.078+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3050068e40 con 0x7f30500af410 2022-08-10T17:44:04.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.078+0000 7f304dd9b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 0x7f30501eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f304dd9b700 1 -- 172.21.15.150:0/2953485610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f30500ca3d0 con 0x7f30500af410 2022-08-10T17:44:04.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f304dd9b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 0x7f30501eb1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f30440045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304401e450 con 0x7f30500af410 2022-08-10T17:44:04.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4547 (secure 0 0 0) 0x7f3044024040 con 0x7f30500af410 2022-08-10T17:44:04.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 msgr2=0x7f30501eb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 0x7f30501eb1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f30440045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 msgr2=0x7f30501eb1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:04.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.079+0000 7f303effd700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f30500af410 0x7f30501eb1b0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30500af3c0 tx=0x7f30440045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:04.086 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:04.086 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:04.087 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:04.087 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 66, 2022-08-10T17:44:04.087 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:04.087 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:04.088 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:04.088 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:04.088 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:04.088 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 26, 2022-08-10T17:44:04.089 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:04.089 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:04.089 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:04.089 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:04.090 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:04.090 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:04.090 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:04.090 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:04.091 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:04.091 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:04.091 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:04.091 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:04.092 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:04.092 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:04.092 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:04.092 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:04.092 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:04.093 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:04.093 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:04.093 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:04.093 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:04.094 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:04.094 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:04.094 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:04.094 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.095 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.095 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:04.095 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:04.095 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:04.095 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:04.096 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:04.096 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:04.096 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:04.096 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:04.097 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:04.097 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:04.097 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:04.097 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:04.097 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:04.098 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:04.098 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:04.098 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:04.098 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:04.099 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:04.099 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:04.099 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:04.099 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:04.100 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:04.100 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:04.100 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:04.100 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:04.100 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:04.101 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:04.101 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.101 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:04.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.102 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:04.102 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:04.102 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:04.102 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:04.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.103 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:04.103 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:04.103 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.104 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:04.104 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:04.104 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.104 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.105 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.105 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:04.105 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:04.106 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:04.106 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:04.106 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:04.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.107 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:04.107 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:04.107 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:04.107 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:04.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.108 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:04.108 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:04.108 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.109 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:04.109 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:04.109 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.110 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.110 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.110 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:04.111 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:04.111 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:04.111 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:04.111 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:04.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.112 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:04.112 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:04.112 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:04.113 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:04.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.113 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:04.113 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:04.113 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.114 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:04.114 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:04.115 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:04.115 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.115 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.116 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:04.116 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:04.116 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:04.116 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:04.116 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:04.117 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.117 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.117 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:04.118 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:04.118 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.118 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:04.118 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:04.118 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:04.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.119 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:04.119 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:44:04.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.120 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:04.120 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:04.120 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:04.120 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.120 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:04.121 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:04.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:04.121 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:04.121 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:04.122 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:04.122 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:04.122 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:04.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:04.122 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:04.123 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:04.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f302c0650e0 msgr2=0x7f302c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f302c0650e0 0x7f302c067590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3040005790 tx=0x7f3040007dd0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 msgr2=0x7f3050151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 --2- 172.21.15.150:0/2953485610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30500c7220 0x7f3050151ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3048014040 tx=0x7f3048004950 comp rx=0 tx=0).stop 2022-08-10T17:44:04.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 reap_dead start 2022-08-10T17:44:04.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f304ed9d700 1 -- 172.21.15.150:0/2953485610 reap_dead start 2022-08-10T17:44:04.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 shutdown_connections 2022-08-10T17:44:04.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.080+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 >> 172.21.15.150:0/2953485610 conn(0x7f305006d0d0 msgr2=0x7f30500c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:04.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.081+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 shutdown_connections 2022-08-10T17:44:04.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.081+0000 7f3054f3b700 1 -- 172.21.15.150:0/2953485610 wait complete. 2022-08-10T17:44:04.127 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:44:04.127 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:44:04.128 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:44:04.128 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:44:04.128 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:44:04.129 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:44:04.138 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:44:04.139 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:44:04.139 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.277+0000 7ffa8dec1700 1 Processor -- start 2022-08-10T17:44:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.277+0000 7ffa8dec1700 1 -- start start 2022-08-10T17:44:04.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa8dec1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffa8806c730 0x7ffa8814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa8dec1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8806cbb0 con 0x7ffa88068110 2022-08-10T17:44:04.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa8dec1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880644b0 con 0x7ffa8814e7b0 2022-08-10T17:44:04.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa8dec1700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa88064790 con 0x7ffa8806c730 2022-08-10T17:44:04.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa877fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7ffa8814e7b0 0x7ffa88155230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:37526/0 (socket says 172.21.15.150:37526) 2022-08-10T17:44:04.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa877fe700 1 -- 172.21.15.150:0/1197564560 learned_addr learned my addr 172.21.15.150:0/1197564560 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:04.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa7effd700 1 --1- 172.21.15.150:0/1197564560 >> v1:172.21.15.150:6789/0 conn(0x7ffa88068110 0x7ffa880c0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51176/0 (socket says 172.21.15.150:51176) 2022-08-10T17:44:04.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.278+0000 7ffa87fff700 1 --2- 172.21.15.150:0/1197564560 >> v2:172.21.15.197:3300/0 conn(0x7ffa8806c730 0x7ffa8814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa86ffd700 1 -- 172.21.15.150:0/1197564560 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878952909 0 0) 0x7ffa70001040 con 0x7ffa88068110 2022-08-10T17:44:04.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa86ffd700 1 -- 172.21.15.150:0/1197564560 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa68003430 con 0x7ffa88068110 2022-08-10T17:44:04.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa87fff700 1 -- 172.21.15.150:0/1197564560 >> v1:172.21.15.197:6789/0 conn(0x7ffa8814e7b0 legacy=0x7ffa88155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa87fff700 1 -- 172.21.15.150:0/1197564560 >> v1:172.21.15.150:6789/0 conn(0x7ffa88068110 legacy=0x7ffa880c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa87fff700 1 -- 172.21.15.150:0/1197564560 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88064a70 con 0x7ffa8806c730 2022-08-10T17:44:04.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa87fff700 1 --2- 172.21.15.150:0/1197564560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8806c730 0x7ffa8814eb80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feaf8afe72e24072 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa86ffd700 1 -- 172.21.15.150:0/1197564560 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e070 con 0x7ffa8806c730 2022-08-10T17:44:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa86ffd700 1 -- 172.21.15.150:0/1197564560 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000bb20 con 0x7ffa8806c730 2022-08-10T17:44:04.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.279+0000 7ffa86ffd700 1 -- 172.21.15.150:0/1197564560 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80012430 con 0x7ffa8806c730 2022-08-10T17:44:04.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.280+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1197564560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8806c730 msgr2=0x7ffa8814eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.280+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1197564560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8806c730 0x7ffa8814eb80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8000b330 comp rx=0 tx=0).stop 2022-08-10T17:44:04.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.280+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1197564560 shutdown_connections 2022-08-10T17:44:04.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.280+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1197564560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8806c730 0x7ffa8814eb80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.280+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1197564560 >> 172.21.15.150:0/1197564560 conn(0x7ffa880c9310 msgr2=0x7ffa880c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:04.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.281+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1197564560 shutdown_connections 2022-08-10T17:44:04.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.281+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1197564560 wait complete. 2022-08-10T17:44:04.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.282+0000 7ffa8dec1700 1 Processor -- start 2022-08-10T17:44:04.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.283+0000 7ffa8dec1700 1 -- start start 2022-08-10T17:44:04.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 0x7ffa88157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8814e7b0 0x7ffa881ec060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880b6ee0 con 0x7ffa8806c730 2022-08-10T17:44:04.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881eb2c0 con 0x7ffa8814e7b0 2022-08-10T17:44:04.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa8dec1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88158310 con 0x7ffa88068110 2022-08-10T17:44:04.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa877fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 msgr2=0x7ffa88157aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:04.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa877fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 0x7ffa88157aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:04.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38504/0 (socket says 172.21.15.150:38504) 2022-08-10T17:44:04.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 -- 172.21.15.150:0/1877058279 learned_addr learned my addr 172.21.15.150:0/1877058279 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:04.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa87fff700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8814e7b0 0x7ffa881ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 -- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 msgr2=0x7ffa88157aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:04.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 0x7ffa88157aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 -- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8814e7b0 msgr2=0x7ffa881ec060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8814e7b0 0x7ffa881ec060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.284+0000 7ffa7effd700 1 -- 172.21.15.150:0/1877058279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009a70 con 0x7ffa8806c730 2022-08-10T17:44:04.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa7effd700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c3c0 tx=0x7ffa7000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700074e0 con 0x7ffa8806c730 2022-08-10T17:44:04.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000ce80 con 0x7ffa8806c730 2022-08-10T17:44:04.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70004910 con 0x7ffa8806c730 2022-08-10T17:44:04.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa881585f0 con 0x7ffa8806c730 2022-08-10T17:44:04.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.285+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881eb860 con 0x7ffa8806c730 2022-08-10T17:44:04.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.286+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ffa70010070 con 0x7ffa8806c730 2022-08-10T17:44:04.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.287+0000 7ffa84ff9700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 0x7ffa6c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:04.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.287+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ffa70081700 con 0x7ffa8806c730 2022-08-10T17:44:04.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.287+0000 7ffa877fe700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 0x7ffa6c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:04.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.288+0000 7ffa877fe700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 0x7ffa6c067540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004720 tx=0x7ffa780079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:04.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.288+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8806cbb0 con 0x7ffa8806c730 2022-08-10T17:44:04.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.293+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ffa8806cbb0 con 0x7ffa8806c730 2022-08-10T17:44:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.598+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffa8806cbb0 con 0x7ffa8806c730 2022-08-10T17:44:04.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.598+0000 7ffa84ff9700 1 -- 172.21.15.150:0/1877058279 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7ffa8806cbb0 con 0x7ffa8806c730 2022-08-10T17:44:04.603 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 msgr2=0x7ffa6c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 0x7ffa6c067540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004720 tx=0x7ffa780079f0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 msgr2=0x7ffa8814eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:04.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c3c0 tx=0x7ffa7000c6d0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 shutdown_connections 2022-08-10T17:44:04.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffa8814e7b0 0x7ffa881ec060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffa6c065090 0x7ffa6c067540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffa88068110 0x7ffa88157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 --2- 172.21.15.150:0/1877058279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa8806c730 0x7ffa8814eef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:04.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 >> 172.21.15.150:0/1877058279 conn(0x7ffa880c9310 msgr2=0x7ffa88152630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:04.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 shutdown_connections 2022-08-10T17:44:04.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:04.601+0000 7ffa8dec1700 1 -- 172.21.15.150:0/1877058279 wait complete. 2022-08-10T17:44:07.622 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:07.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.953+0000 7f6d97e8b700 1 Processor -- start 2022-08-10T17:44:07.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.953+0000 7f6d97e8b700 1 -- start start 2022-08-10T17:44:07.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d97e8b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6d9006d850 0x7f6d900c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d97e8b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d900c39a0 con 0x7f6d9006d480 2022-08-10T17:44:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d97e8b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d900b0ff0 con 0x7f6d900c4410 2022-08-10T17:44:07.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d97e8b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9006e120 con 0x7f6d9006d850 2022-08-10T17:44:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95c27700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6d9006d480 0x7f6d900b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51218/0 (socket says 172.21.15.150:51218) 2022-08-10T17:44:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95c27700 1 -- 172.21.15.150:0/648559549 learned_addr learned my addr 172.21.15.150:0/648559549 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:07.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95426700 1 --2- 172.21.15.150:0/648559549 >> v2:172.21.15.197:3300/0 conn(0x7f6d9006d850 0x7f6d900c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d94c25700 1 -- 172.21.15.150:0/648559549 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072929202 0 0) 0x7f6d900c39a0 con 0x7f6d9006d480 2022-08-10T17:44:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d94c25700 1 -- 172.21.15.150:0/648559549 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d78003430 con 0x7f6d9006d480 2022-08-10T17:44:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95426700 1 -- 172.21.15.150:0/648559549 >> v1:172.21.15.197:6789/0 conn(0x7f6d900c4410 legacy=0x7f6d900c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:07.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95426700 1 -- 172.21.15.150:0/648559549 >> v1:172.21.15.150:6789/0 conn(0x7f6d9006d480 legacy=0x7f6d900b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.954+0000 7f6d95426700 1 -- 172.21.15.150:0/648559549 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900c5620 con 0x7f6d9006d850 2022-08-10T17:44:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d95426700 1 --2- 172.21.15.150:0/648559549 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d9006d850 0x7f6d900c1f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d800096b0 tx=0x7f6d800099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da8fad9eb386dde server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d94c25700 1 -- 172.21.15.150:0/648559549 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800107b0 con 0x7f6d9006d850 2022-08-10T17:44:07.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d94c25700 1 -- 172.21.15.150:0/648559549 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80010910 con 0x7f6d9006d850 2022-08-10T17:44:07.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d94c25700 1 -- 172.21.15.150:0/648559549 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80010c80 con 0x7f6d9006d850 2022-08-10T17:44:07.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 -- 172.21.15.150:0/648559549 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d9006d850 msgr2=0x7f6d900c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:07.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/648559549 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d9006d850 0x7f6d900c1f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d800096b0 tx=0x7f6d800099c0 comp rx=0 tx=0).stop 2022-08-10T17:44:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 -- 172.21.15.150:0/648559549 shutdown_connections 2022-08-10T17:44:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/648559549 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d9006d850 0x7f6d900c1f60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 -- 172.21.15.150:0/648559549 >> 172.21.15.150:0/648559549 conn(0x7f6d9006b3b0 msgr2=0x7f6d9006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:07.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.955+0000 7f6d97e8b700 1 -- 172.21.15.150:0/648559549 shutdown_connections 2022-08-10T17:44:07.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.956+0000 7f6d97e8b700 1 -- 172.21.15.150:0/648559549 wait complete. 2022-08-10T17:44:07.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.957+0000 7f6d97e8b700 1 Processor -- start 2022-08-10T17:44:07.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.957+0000 7f6d97e8b700 1 -- start start 2022-08-10T17:44:07.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 0x7f6d9014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:07.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:07.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d900c4410 0x7f6d9014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:07.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90150590 con 0x7f6d9006d850 2022-08-10T17:44:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9014db60 con 0x7f6d900c4410 2022-08-10T17:44:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.958+0000 7f6d97e8b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9014e060 con 0x7f6d9006d480 2022-08-10T17:44:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95c27700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 msgr2=0x7f6d9014e950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:07.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95c27700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 0x7f6d9014e950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:07.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:07.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38544/0 (socket says 172.21.15.150:38544) 2022-08-10T17:44:07.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 -- 172.21.15.150:0/3593066338 learned_addr learned my addr 172.21.15.150:0/3593066338 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d96428700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d900c4410 0x7f6d9014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 -- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 msgr2=0x7f6d9014e950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 0x7f6d9014e950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 -- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d900c4410 msgr2=0x7f6d9014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d900c4410 0x7f6d9014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 -- 172.21.15.150:0/3593066338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80009310 con 0x7f6d9006d850 2022-08-10T17:44:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d95426700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009a00 tx=0x7f6d800045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80010c80 con 0x7f6d9006d850 2022-08-10T17:44:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8001f070 con 0x7f6d9006d850 2022-08-10T17:44:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9014ddc0 con 0x7f6d9006d850 2022-08-10T17:44:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80004020 con 0x7f6d9006d850 2022-08-10T17:44:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.959+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9006a000 con 0x7f6d9006d850 2022-08-10T17:44:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.960+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d90154590 con 0x7f6d9006d850 2022-08-10T17:44:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.961+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6d8002c070 con 0x7f6d9006d850 2022-08-10T17:44:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.961+0000 7f6d7e7fc700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 0x7f6d70067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.961+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6d80021070 con 0x7f6d9006d850 2022-08-10T17:44:07.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.961+0000 7f6d95c27700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 0x7f6d70067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:07.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.962+0000 7f6d95c27700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 0x7f6d70067540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c007fd0 tx=0x7f6d8c007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:07.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:07.966+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6d80051550 con 0x7f6d9006d850 2022-08-10T17:44:08.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.281+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d901542b0 con 0x7f6d9006d850 2022-08-10T17:44:08.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.281+0000 7f6d7e7fc700 1 -- 172.21.15.150:0/3593066338 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f6d8002a080 con 0x7f6d9006d850 2022-08-10T17:44:08.285 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":30,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.284+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 msgr2=0x7f6d70067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.284+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 0x7f6d70067540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c007fd0 tx=0x7f6d8c007940 comp rx=0 tx=0).stop 2022-08-10T17:44:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.284+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 msgr2=0x7f6d9014cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.284+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009a00 tx=0x7f6d800045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 shutdown_connections 2022-08-10T17:44:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6d900c4410 0x7f6d9014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d70065090 0x7f6d70067540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6d9006d480 0x7f6d9014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:08.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 --2- 172.21.15.150:0/3593066338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d9006d850 0x7f6d9014cf10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:08.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 >> 172.21.15.150:0/3593066338 conn(0x7f6d9006b3b0 msgr2=0x7f6d900c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:08.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 shutdown_connections 2022-08-10T17:44:08.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:08.285+0000 7f6d97e8b700 1 -- 172.21.15.150:0/3593066338 wait complete. 2022-08-10T17:44:11.304 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:11.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.730+0000 7f95252db700 1 Processor -- start 2022-08-10T17:44:11.739 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 -- start start 2022-08-10T17:44:11.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 0x7f95200c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95200c5050 0x7f952015d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.740 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 0x7f952015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952006bf00 con 0x7f95200c5050 2022-08-10T17:44:11.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952006b310 con 0x7f95200896d0 2022-08-10T17:44:11.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95252db700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200c3830 con 0x7f9520089aa0 2022-08-10T17:44:11.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95167fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95200c5050 0x7f952015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:11.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f951f7fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 msgr2=0x7f952015dab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:11.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f951f7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 0x7f952015dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:11.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95167fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95200c5050 0x7f952015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38576/0 (socket says 172.21.15.150:38576) 2022-08-10T17:44:11.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.731+0000 7f95167fc700 1 -- 172.21.15.150:0/2315503371 learned_addr learned my addr 172.21.15.150:0/2315503371 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:11.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.732+0000 7f951effd700 1 --2- 172.21.15.150:0/2315503371 >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 0x7f95200c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:11.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.738+0000 7f95167fc700 1 -- 172.21.15.150:0/2315503371 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 msgr2=0x7f952015dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:11.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.738+0000 7f95167fc700 1 --2- 172.21.15.150:0/2315503371 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 0x7f952015dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.738+0000 7f95167fc700 1 -- 172.21.15.150:0/2315503371 >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 msgr2=0x7f95200c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:11.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.739+0000 7f95167fc700 1 --2- 172.21.15.150:0/2315503371 >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 0x7f95200c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.739+0000 7f95167fc700 1 -- 172.21.15.150:0/2315503371 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200c3aa0 con 0x7f95200c5050 2022-08-10T17:44:11.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.739+0000 7f951effd700 1 --2- 172.21.15.150:0/2315503371 >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 0x7f95200c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:44:11.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.740+0000 7f95167fc700 1 --2- 172.21.15.150:0/2315503371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95200c5050 0x7f952015d570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95200c65c0 tx=0x7f9508008180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e1f737ead6eb83 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:11.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.740+0000 7f951e7fc700 1 -- 172.21.15.150:0/2315503371 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508004030 con 0x7f95200c5050 2022-08-10T17:44:11.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.740+0000 7f951e7fc700 1 -- 172.21.15.150:0/2315503371 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508004190 con 0x7f95200c5050 2022-08-10T17:44:11.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.740+0000 7f951e7fc700 1 -- 172.21.15.150:0/2315503371 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950800b590 con 0x7f95200c5050 2022-08-10T17:44:11.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 -- 172.21.15.150:0/2315503371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95200c5050 msgr2=0x7f952015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:11.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 --2- 172.21.15.150:0/2315503371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95200c5050 0x7f952015d570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95200c65c0 tx=0x7f9508008180 comp rx=0 tx=0).stop 2022-08-10T17:44:11.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 -- 172.21.15.150:0/2315503371 shutdown_connections 2022-08-10T17:44:11.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 --2- 172.21.15.150:0/2315503371 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9520089aa0 0x7f952015dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 --2- 172.21.15.150:0/2315503371 >> v2:172.21.15.197:3300/0 conn(0x7f95200896d0 0x7f95200c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 --2- 172.21.15.150:0/2315503371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95200c5050 0x7f952015d570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 -- 172.21.15.150:0/2315503371 >> 172.21.15.150:0/2315503371 conn(0x7f95200c8a10 msgr2=0x7f95200c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:11.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.742+0000 7f95252db700 1 -- 172.21.15.150:0/2315503371 shutdown_connections 2022-08-10T17:44:11.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.743+0000 7f95252db700 1 -- 172.21.15.150:0/2315503371 wait complete. 2022-08-10T17:44:11.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.744+0000 7f95252db700 1 Processor -- start 2022-08-10T17:44:11.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.744+0000 7f95252db700 1 -- start start 2022-08-10T17:44:11.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 0x7f9520205320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f95200c5050 0x7f9520201990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95201f84b0 con 0x7f9520089aa0 2022-08-10T17:44:11.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9520205860 con 0x7f95200c5050 2022-08-10T17:44:11.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.745+0000 7f95252db700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200bf340 con 0x7f95200896d0 2022-08-10T17:44:11.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:11.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38582/0 (socket says 172.21.15.150:38582) 2022-08-10T17:44:11.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 -- 172.21.15.150:0/235506055 learned_addr learned my addr 172.21.15.150:0/235506055 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:11.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f951f7fe700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f95200c5050 0x7f9520201990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:11.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f951effd700 1 -- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 msgr2=0x7f9520205320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:11.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f951effd700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 0x7f9520205320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:11.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 -- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 msgr2=0x7f9520205320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:11.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 0x7f9520205320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 -- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f95200c5050 msgr2=0x7f9520201990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:11.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f95200c5050 0x7f9520201990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:11.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 -- 172.21.15.150:0/235506055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951000b520 con 0x7f9520089aa0 2022-08-10T17:44:11.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f95167fc700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9508004530 tx=0x7f95080045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:11.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.746+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950800bc30 con 0x7f9520089aa0 2022-08-10T17:44:11.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.747+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9508008460 con 0x7f9520089aa0 2022-08-10T17:44:11.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.747+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950800bd90 con 0x7f9520089aa0 2022-08-10T17:44:11.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.747+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508003760 con 0x7f9520089aa0 2022-08-10T17:44:11.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.747+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95201f8720 con 0x7f9520089aa0 2022-08-10T17:44:11.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.748+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9520072890 con 0x7f9520089aa0 2022-08-10T17:44:11.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.748+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f95080038c0 con 0x7f9520089aa0 2022-08-10T17:44:11.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.749+0000 7f9517fff700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 0x7f9504067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:11.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.749+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9508083670 con 0x7f9520089aa0 2022-08-10T17:44:11.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.749+0000 7f951effd700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 0x7f9504067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:11.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.749+0000 7f951effd700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 0x7f9504067540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f951000b750 tx=0x7f951000a040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:11.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:11.756+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f95080515d0 con 0x7f9520089aa0 2022-08-10T17:44:12.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.078+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f952006b560 con 0x7f9520089aa0 2022-08-10T17:44:12.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.079+0000 7f9517fff700 1 -- 172.21.15.150:0/235506055 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f9508017020 con 0x7f9520089aa0 2022-08-10T17:44:12.083 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":34,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:12.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 msgr2=0x7f9504067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:12.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 0x7f9504067540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f951000b750 tx=0x7f951000a040 comp rx=0 tx=0).stop 2022-08-10T17:44:12.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 msgr2=0x7f9520165b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:12.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9508004530 tx=0x7f95080045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:12.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 shutdown_connections 2022-08-10T17:44:12.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f95200c5050 0x7f9520201990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:12.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9504065090 0x7f9504067540 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:12.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f95200896d0 0x7f9520205320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:12.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 --2- 172.21.15.150:0/235506055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520089aa0 0x7f9520165b10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:12.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 >> 172.21.15.150:0/235506055 conn(0x7f95200c8a10 msgr2=0x7f952015c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:12.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 shutdown_connections 2022-08-10T17:44:12.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:12.081+0000 7f95252db700 1 -- 172.21.15.150:0/235506055 wait complete. 2022-08-10T17:44:15.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:15.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.253+0000 7f4be301c700 1 Processor -- start 2022-08-10T17:44:15.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.253+0000 7f4be301c700 1 -- start start 2022-08-10T17:44:15.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be301c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:15.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be301c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc157090 con 0x7f4bdc0c8240 2022-08-10T17:44:15.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be301c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc0c86c0 con 0x7f4bdc071c80 2022-08-10T17:44:15.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be301c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0c6090 con 0x7f4bdc150be0 2022-08-10T17:44:15.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be0db8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:15.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be15b9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4bdc0c8240 0x7f4bdc0ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51300/0 (socket says 172.21.15.150:51300) 2022-08-10T17:44:15.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be15b9700 1 -- 172.21.15.150:0/2666953585 learned_addr learned my addr 172.21.15.150:0/2666953585 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:15.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:44:15.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:15.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.254+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:15.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.255+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:15.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.456+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:15.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.456+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:44:15.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.456+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:15.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.456+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:15.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.456+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:44:15.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.857+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:15.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.857+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:44:15.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.857+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.857+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:15.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:15.857+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:44:16.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:16.658+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:16.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:16.658+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:44:16.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:16.658+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:16.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:16.658+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:16.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:16.658+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:44:18.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 msgr2=0x7f4bdc157520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:18.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.150:3300/0 conn(0x7f4bdc150be0 0x7f4bdc157520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:18.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 -- 172.21.15.150:0/2666953585 >> v1:172.21.15.197:6789/0 conn(0x7f4bdc071c80 legacy=0x7f4bdc0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:18.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 -- 172.21.15.150:0/2666953585 >> v1:172.21.15.150:6789/0 conn(0x7f4bdc0c8240 legacy=0x7f4bdc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:18.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 0x7f4bc4005a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 -- 172.21.15.150:0/2666953585 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0c6090 con 0x7f4bc40060f0 2022-08-10T17:44:18.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4bda7fc700 1 -- 172.21.15.150:0/2666953585 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4008c10 con 0x7f4bc4003620 2022-08-10T17:44:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 msgr2=0x7f4bc4005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.254+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 0x7f4bc4005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:18.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.255+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.255+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 msgr2=0x7f4bc4008560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:44:18.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.255+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 msgr2=0x7f4bc4008560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:18.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.255+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:18.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.255+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:18.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.455+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 msgr2=0x7f4bc4005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:18.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.455+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 0x7f4bc4005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:44:18.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.456+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.456+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 msgr2=0x7f4bc4008560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:44:18.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.456+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 msgr2=0x7f4bc4008560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:18.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.456+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:18.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.456+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:44:18.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.856+0000 7f4be0db8700 1 -- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 msgr2=0x7f4bc4005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:18.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.856+0000 7f4be0db8700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 0x7f4bc4005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:44:18.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> v2:172.21.15.197:3300/0 conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 msgr2=0x7f4bc4005a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:18.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bc4003620 0x7f4bc4005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:18.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdbfff700 1 -- 172.21.15.150:0/2666953585 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0c9e00 con 0x7f4bc40060f0 2022-08-10T17:44:18.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bc40060f0 0x7f4bc4008560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8007fd0 tx=0x7f4bc8005490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c66a6b6bd38fb6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:18.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdb7fe700 1 -- 172.21.15.150:0/2666953585 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8019070 con 0x7f4bc40060f0 2022-08-10T17:44:18.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdb7fe700 1 -- 172.21.15.150:0/2666953585 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8003b30 con 0x7f4bc40060f0 2022-08-10T17:44:18.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.857+0000 7f4bdb7fe700 1 -- 172.21.15.150:0/2666953585 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8003ca0 con 0x7f4bc40060f0 2022-08-10T17:44:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 -- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bc40060f0 msgr2=0x7f4bc4008560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bc40060f0 0x7f4bc4008560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8007fd0 tx=0x7f4bc8005490 comp rx=0 tx=0).stop 2022-08-10T17:44:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be15b9700 1 -- 172.21.15.150:0/2666953585 reap_dead start 2022-08-10T17:44:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 -- 172.21.15.150:0/2666953585 shutdown_connections 2022-08-10T17:44:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 --2- 172.21.15.150:0/2666953585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bc40060f0 0x7f4bc4008560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 -- 172.21.15.150:0/2666953585 >> 172.21.15.150:0/2666953585 conn(0x7f4bdc068d60 msgr2=0x7f4bdc071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 -- 172.21.15.150:0/2666953585 shutdown_connections 2022-08-10T17:44:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.858+0000 7f4be301c700 1 -- 172.21.15.150:0/2666953585 wait complete. 2022-08-10T17:44:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.860+0000 7f4be301c700 1 Processor -- start 2022-08-10T17:44:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.860+0000 7f4be301c700 1 -- start start 2022-08-10T17:44:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bdc1527c0 0x7f4bdc1e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 0x7f4bdc14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1e1d70 con 0x7f4bc40060f0 2022-08-10T17:44:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc154090 con 0x7f4bdc1527c0 2022-08-10T17:44:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be301c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1e2b40 con 0x7f4bdc1e26d0 2022-08-10T17:44:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be15b9700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 msgr2=0x7f4bdc14b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be15b9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 0x7f4bdc14b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38666/0 (socket says 172.21.15.150:38666) 2022-08-10T17:44:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 -- 172.21.15.150:0/845515807 learned_addr learned my addr 172.21.15.150:0/845515807 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bdc1527c0 0x7f4bdc1e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 -- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 msgr2=0x7f4bdc14b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 0x7f4bdc14b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 -- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bdc1527c0 msgr2=0x7f4bdc1e2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bdc1527c0 0x7f4bdc1e2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.861+0000 7f4be0db8700 1 -- 172.21.15.150:0/845515807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc800f040 con 0x7f4bc40060f0 2022-08-10T17:44:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4be0db8700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0012640 tx=0x7f4bd0012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0014680 con 0x7f4bc40060f0 2022-08-10T17:44:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00147e0 con 0x7f4bc40060f0 2022-08-10T17:44:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc1537f0 con 0x7f4bc40060f0 2022-08-10T17:44:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0014990 con 0x7f4bc40060f0 2022-08-10T17:44:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.862+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc153db0 con 0x7f4bc40060f0 2022-08-10T17:44:18.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.863+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc0ca670 con 0x7f4bc40060f0 2022-08-10T17:44:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.864+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4bd0025070 con 0x7f4bc40060f0 2022-08-10T17:44:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.864+0000 7f4bd97fa700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 0x7f4bc40682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.864+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4bd0082620 con 0x7f4bc40060f0 2022-08-10T17:44:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.864+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 0x7f4bc40682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.865+0000 7f4bdbfff700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 0x7f4bc40682f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000c00 tx=0x7f4bc800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:18.872+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4bd0050600 con 0x7f4bc40060f0 2022-08-10T17:44:19.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.196+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4bdc0ca360 con 0x7f4bc40060f0 2022-08-10T17:44:19.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.196+0000 7f4bd97fa700 1 -- 172.21.15.150:0/845515807 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f4bd0023080 con 0x7f4bc40060f0 2022-08-10T17:44:19.201 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":70,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:19.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.203+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 msgr2=0x7f4bc40682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.203+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 0x7f4bc40682f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000c00 tx=0x7f4bc800a000 comp rx=0 tx=0).stop 2022-08-10T17:44:19.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.203+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 msgr2=0x7f4bdc1dcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.203+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0012640 tx=0x7f4bd0012950 comp rx=0 tx=0).stop 2022-08-10T17:44:19.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 shutdown_connections 2022-08-10T17:44:19.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4bc4065e40 0x7f4bc40682f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4bdc1e26d0 0x7f4bdc14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40060f0 0x7f4bdc1dcc40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 --2- 172.21.15.150:0/845515807 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4bdc1527c0 0x7f4bdc1e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.206+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 >> 172.21.15.150:0/845515807 conn(0x7f4bdc068d60 msgr2=0x7f4bdc1547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:19.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.208+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 shutdown_connections 2022-08-10T17:44:19.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.209+0000 7f4be301c700 1 -- 172.21.15.150:0/845515807 wait complete. 2022-08-10T17:44:19.230 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:44:19.230 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:44:19.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.379+0000 7ff7464a9700 1 Processor -- start 2022-08-10T17:44:19.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.379+0000 7ff7464a9700 1 -- start start 2022-08-10T17:44:19.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff7464a9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff7400c7220 0x7ff7400c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff7464a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400c2a60 con 0x7ff7400c25c0 2022-08-10T17:44:19.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff7464a9700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400699c0 con 0x7ff7400c4d90 2022-08-10T17:44:19.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff7464a9700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400c5e10 con 0x7ff7400c7220 2022-08-10T17:44:19.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff744a46700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff7400c25c0 0x7ff74006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51360/0 (socket says 172.21.15.150:51360) 2022-08-10T17:44:19.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff744a46700 1 -- 172.21.15.150:0/311425326 learned_addr learned my addr 172.21.15.150:0/311425326 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:19.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/311425326 >> v2:172.21.15.197:3300/0 conn(0x7ff7400c7220 0x7ff7400c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628760370 0 0) 0x7ff7400c2a60 con 0x7ff7400c25c0 2022-08-10T17:44:19.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff72c003430 con 0x7ff7400c25c0 2022-08-10T17:44:19.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73f7fe700 1 -- 172.21.15.150:0/311425326 >> v1:172.21.15.197:6789/0 conn(0x7ff7400c4d90 legacy=0x7ff7400c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127228626 0 0) 0x7ff7400699c0 con 0x7ff7400c4d90 2022-08-10T17:44:19.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73f7fe700 1 -- 172.21.15.150:0/311425326 >> v1:172.21.15.150:6789/0 conn(0x7ff7400c25c0 legacy=0x7ff74006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.380+0000 7ff73f7fe700 1 -- 172.21.15.150:0/311425326 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740068e40 con 0x7ff7400c7220 2022-08-10T17:44:19.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/311425326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c7220 0x7ff7400c2080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7340096b0 tx=0x7ff7340099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef04bce6840c5570 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340107b0 con 0x7ff7400c7220 2022-08-10T17:44:19.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734010910 con 0x7ff7400c7220 2022-08-10T17:44:19.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff73effd700 1 -- 172.21.15.150:0/311425326 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734010cc0 con 0x7ff7400c7220 2022-08-10T17:44:19.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 -- 172.21.15.150:0/311425326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c7220 msgr2=0x7ff7400c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 --2- 172.21.15.150:0/311425326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c7220 0x7ff7400c2080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7340096b0 tx=0x7ff7340099c0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 -- 172.21.15.150:0/311425326 shutdown_connections 2022-08-10T17:44:19.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 --2- 172.21.15.150:0/311425326 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c7220 0x7ff7400c2080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 -- 172.21.15.150:0/311425326 >> 172.21.15.150:0/311425326 conn(0x7ff74006d0d0 msgr2=0x7ff7400c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:19.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 -- 172.21.15.150:0/311425326 shutdown_connections 2022-08-10T17:44:19.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.381+0000 7ff7464a9700 1 -- 172.21.15.150:0/311425326 wait complete. 2022-08-10T17:44:19.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 Processor -- start 2022-08-10T17:44:19.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 -- start start 2022-08-10T17:44:19.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 0x7ff74014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c4d90 0x7ff740149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff7400c7220 0x7ff74014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400be0b0 con 0x7ff7400c25c0 2022-08-10T17:44:19.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7401f3ff0 con 0x7ff7400c4d90 2022-08-10T17:44:19.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.383+0000 7ff7464a9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff740071410 con 0x7ff7400c7220 2022-08-10T17:44:19.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 0x7ff74014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 0x7ff74014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38682/0 (socket says 172.21.15.150:38682) 2022-08-10T17:44:19.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 -- 172.21.15.150:0/2717708907 learned_addr learned my addr 172.21.15.150:0/2717708907 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:19.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff744a46700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff7400c7220 msgr2=0x7ff74014a2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:19.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff744a46700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff7400c7220 0x7ff74014a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:19.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff7400c7220 msgr2=0x7ff74014a2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:19.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff7400c7220 0x7ff74014a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c4d90 msgr2=0x7ff740149da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:19.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff7400c4d90 0x7ff740149da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff734009310 con 0x7ff7400c25c0 2022-08-10T17:44:19.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73ffff700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 0x7ff74014e100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c410 tx=0x7ff73000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730003500 con 0x7ff7400c25c0 2022-08-10T17:44:19.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730003660 con 0x7ff7400c25c0 2022-08-10T17:44:19.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730003a10 con 0x7ff7400c25c0 2022-08-10T17:44:19.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.384+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7400716f0 con 0x7ff7400c25c0 2022-08-10T17:44:19.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.385+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74014cfc0 con 0x7ff7400c25c0 2022-08-10T17:44:19.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.385+0000 7ff7464a9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 0x7ff7401560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.385+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400672f0 con 0x7ff7400ca440 2022-08-10T17:44:19.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.386+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 0x7ff7401560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.386+0000 7ff73f7fe700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff740072890 con 0x7ff7400ca440 2022-08-10T17:44:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.386+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 0x7ff7401560f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7340096b0 tx=0x7ff7340045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.386+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734011440 con 0x7ff7400ca440 2022-08-10T17:44:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.386+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff730019030 con 0x7ff7400c25c0 2022-08-10T17:44:19.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff7200650f0 0x7ff7200675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff7300815a0 con 0x7ff7400c25c0 2022-08-10T17:44:19.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff744a46700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff7200650f0 0x7ff7200675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff7340115a0 con 0x7ff7400ca440 2022-08-10T17:44:19.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 msgr2=0x7ff7401560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 0x7ff7401560f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7340096b0 tx=0x7ff7340045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 msgr2=0x7ff7401560f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:19.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff73cff9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400ca440 0x7ff7401560f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.387+0000 7ff744a46700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff7200650f0 0x7ff7200675a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7401f3f20 tx=0x7ff738007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.396+0000 7ff7464a9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 0x7ff740156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.396+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff740072260 con 0x7ff7400bcd20 2022-08-10T17:44:19.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.396+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 0x7ff740156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.397+0000 7ff73f7fe700 1 -- 172.21.15.150:0/2717708907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff7400c8120 con 0x7ff7400bcd20 2022-08-10T17:44:19.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.397+0000 7ff73f7fe700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 0x7ff740156630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff734000c00 tx=0x7ff7340090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734003930 con 0x7ff7400bcd20 2022-08-10T17:44:19.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4367 (secure 0 0 0) 0x7ff73402c030 con 0x7ff7400bcd20 2022-08-10T17:44:19.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 msgr2=0x7ff740156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 0x7ff740156630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff734000c00 tx=0x7ff7340090e0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 msgr2=0x7ff740156630 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:19.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.398+0000 7ff73cff9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400bcd20 0x7ff740156630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.408 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:19.408 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:19.408 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:19.409 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:44:19.409 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 70, 2022-08-10T17:44:19.409 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:19.409 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:19.410 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:44:19.410 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.410 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:44:19.410 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:19.411 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:19.411 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:19.411 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.411 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.411 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.412 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.412 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.412 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.412 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.413 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.413 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.413 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.413 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:19.414 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:19.414 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.414 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.414 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.415 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.415 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.415 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.415 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.415 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.416 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.416 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.416 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:19.417 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:19.417 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:19.417 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:19.417 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:19.417 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:19.418 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:19.418 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:19.418 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:19.418 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:19.419 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:19.419 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:19.419 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:19.419 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:19.420 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:19.420 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:19.420 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.420 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.420 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.421 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.421 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.421 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.421 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.422 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.422 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.422 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.422 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:19.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.423 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:19.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.423 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:19.423 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:19.424 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.424 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.424 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.425 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:19.425 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.426 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:19.426 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.426 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.426 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.427 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:19.427 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:19.427 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.427 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.428 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.428 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:19.429 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:19.429 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.430 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.430 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:19.430 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.431 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.431 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:19.431 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.431 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.432 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.432 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:19.432 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:19.432 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.433 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.433 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.434 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:19.434 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:19.434 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.434 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.435 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.435 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:19.435 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.436 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.436 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:19.436 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.437 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.437 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:19.437 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:19.438 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.438 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.438 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.438 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.439 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.439 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:19.439 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:19.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.440 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.440 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.440 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:19.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.441 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.441 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:19.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.442 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.442 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.442 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:19.442 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.442 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.443 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:19.443 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:19.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff7200650f0 msgr2=0x7ff7200675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff7200650f0 0x7ff7200675a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7401f3f20 tx=0x7ff738007be0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 msgr2=0x7ff74014e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 --2- 172.21.15.150:0/2717708907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7400c25c0 0x7ff74014e100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c410 tx=0x7ff73000c7d0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff744a46700 1 -- 172.21.15.150:0/2717708907 reap_dead start 2022-08-10T17:44:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff744a46700 1 -- 172.21.15.150:0/2717708907 reap_dead start 2022-08-10T17:44:19.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 shutdown_connections 2022-08-10T17:44:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 >> 172.21.15.150:0/2717708907 conn(0x7ff74006d0d0 msgr2=0x7ff74014f430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.399+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 shutdown_connections 2022-08-10T17:44:19.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.400+0000 7ff7464a9700 1 -- 172.21.15.150:0/2717708907 wait complete. 2022-08-10T17:44:19.448 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:44:19.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.594+0000 7f01100ec700 1 Processor -- start 2022-08-10T17:44:19.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.595+0000 7f01100ec700 1 -- start start 2022-08-10T17:44:19.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0108150af0 0x7f0108159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f010806c860 0x7f010815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f01080647d0 0x7f01080c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080c4dc0 con 0x7f010806c860 2022-08-10T17:44:19.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080c5940 con 0x7f01080647d0 2022-08-10T17:44:19.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f01100ec700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c9fc0 con 0x7f0108150af0 2022-08-10T17:44:19.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f010806c860 0x7f010815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f010806c860 0x7f010815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38698/0 (socket says 172.21.15.150:38698) 2022-08-10T17:44:19.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 -- 172.21.15.150:0/205874171 learned_addr learned my addr 172.21.15.150:0/205874171 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:19.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010e689700 1 --2- 172.21.15.150:0/205874171 >> v2:172.21.15.197:3300/0 conn(0x7f01080647d0 0x7f01080c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 -- 172.21.15.150:0/205874171 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0108150af0 msgr2=0x7f0108159e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:44:19.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 --2- 172.21.15.150:0/205874171 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0108150af0 0x7f0108159e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 -- 172.21.15.150:0/205874171 >> v2:172.21.15.197:3300/0 conn(0x7f01080647d0 msgr2=0x7f01080c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:19.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 --2- 172.21.15.150:0/205874171 >> v2:172.21.15.197:3300/0 conn(0x7f01080647d0 0x7f01080c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.596+0000 7f010d687700 1 -- 172.21.15.150:0/205874171 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010806f9a0 con 0x7f010806c860 2022-08-10T17:44:19.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.597+0000 7f010d687700 1 --2- 172.21.15.150:0/205874171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f010806c860 0x7f010815a3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01080c0350 tx=0x7f00f8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d333916c7055f7fe server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.597+0000 7f010ce86700 1 -- 172.21.15.150:0/205874171 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8004230 con 0x7f010806c860 2022-08-10T17:44:19.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.597+0000 7f010ce86700 1 -- 172.21.15.150:0/205874171 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8004390 con 0x7f010806c860 2022-08-10T17:44:19.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.597+0000 7f010ce86700 1 -- 172.21.15.150:0/205874171 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011870 con 0x7f010806c860 2022-08-10T17:44:19.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 -- 172.21.15.150:0/205874171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f010806c860 msgr2=0x7f010815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 --2- 172.21.15.150:0/205874171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f010806c860 0x7f010815a3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01080c0350 tx=0x7f00f8009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:19.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 -- 172.21.15.150:0/205874171 shutdown_connections 2022-08-10T17:44:19.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 --2- 172.21.15.150:0/205874171 >> v2:172.21.15.197:3300/0 conn(0x7f01080647d0 0x7f01080c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 --2- 172.21.15.150:0/205874171 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0108150af0 0x7f0108159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 --2- 172.21.15.150:0/205874171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f010806c860 0x7f010815a3a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.598+0000 7f01100ec700 1 -- 172.21.15.150:0/205874171 >> 172.21.15.150:0/205874171 conn(0x7f01080c92f0 msgr2=0x7f01080c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:19.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.599+0000 7f01100ec700 1 -- 172.21.15.150:0/205874171 shutdown_connections 2022-08-10T17:44:19.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.599+0000 7f01100ec700 1 -- 172.21.15.150:0/205874171 wait complete. 2022-08-10T17:44:19.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.600+0000 7f01100ec700 1 Processor -- start 2022-08-10T17:44:19.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.600+0000 7f01100ec700 1 -- start start 2022-08-10T17:44:19.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f01080647d0 0x7f01080ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 0x7f01080c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01081f01f0 0x7f01080bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080baf90 con 0x7f0108150af0 2022-08-10T17:44:19.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081efdd0 con 0x7f01081f01f0 2022-08-10T17:44:19.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f01100ec700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080bc260 con 0x7f01080647d0 2022-08-10T17:44:19.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010de88700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f01080647d0 msgr2=0x7f01080ba320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:19.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010de88700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f01080647d0 0x7f01080ba320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:19.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 0x7f01080c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010e689700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01081f01f0 0x7f01080bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 0x7f01080c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38704/0 (socket says 172.21.15.150:38704) 2022-08-10T17:44:19.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 -- 172.21.15.150:0/1142598215 learned_addr learned my addr 172.21.15.150:0/1142598215 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:19.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f01080647d0 msgr2=0x7f01080ba320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:19.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f01080647d0 0x7f01080ba320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01081f01f0 msgr2=0x7f01080bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01081f01f0 0x7f01080bf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.601+0000 7f010d687700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80093e0 con 0x7f0108150af0 2022-08-10T17:44:19.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f010d687700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 0x7f01080c8000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f010806de70 tx=0x7f00f80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003520 con 0x7f0108150af0 2022-08-10T17:44:19.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f801f070 con 0x7f0108150af0 2022-08-10T17:44:19.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01080c7340 con 0x7f0108150af0 2022-08-10T17:44:19.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f80038e0 con 0x7f0108150af0 2022-08-10T17:44:19.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.602+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01080bacb0 con 0x7f0108150af0 2022-08-10T17:44:19.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f01100ec700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 0x7f01081ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108071e00 con 0x7f01080c7780 2022-08-10T17:44:19.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f010de88700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 0x7f01081ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f010de88700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f010806e290 con 0x7f01080c7780 2022-08-10T17:44:19.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f00f8017020 con 0x7f0108150af0 2022-08-10T17:44:19.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f010de88700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 0x7f01081ef570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f010400b310 tx=0x7f010400b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.603+0000 7f00f67fc700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f00e8065090 0x7f00e8067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f00f8021070 con 0x7f0108150af0 2022-08-10T17:44:19.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f010e689700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f00e8065090 0x7f00e8067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104005270 con 0x7f01080c7780 2022-08-10T17:44:19.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f01040053d0 con 0x7f01080c7780 2022-08-10T17:44:19.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 msgr2=0x7f01081ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 0x7f01081ef570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f010400b310 tx=0x7f010400b6d0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 msgr2=0x7f01081ef570 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:19.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f00f67fc700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f01080c7780 0x7f01081ef570 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.604+0000 7f010e689700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f00e8065090 0x7f00e8067540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01081f05e0 tx=0x7f010000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f01100ec700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 0x7f010814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:19.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081eff10 con 0x7f010814ae80 2022-08-10T17:44:19.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f010de88700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 0x7f010814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:19.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f010de88700 1 -- 172.21.15.150:0/1142598215 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0108072890 con 0x7f010814ae80 2022-08-10T17:44:19.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f010de88700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 0x7f010814b280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0104013000 tx=0x7f0104005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:19.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.611+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040119d0 con 0x7f010814ae80 2022-08-10T17:44:19.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f0104011b30 con 0x7f010814ae80 2022-08-10T17:44:19.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 msgr2=0x7f010814b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f00f67fc700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 0x7f010814b280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0104013000 tx=0x7f0104005860 comp rx=0 tx=0).stop 2022-08-10T17:44:19.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f00f67fc700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 msgr2=0x7f010814b280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:19.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f00f67fc700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f010814ae80 0x7f010814b280 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.632 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:19.632 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:19.633 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:19.633 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:19.634 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 70, 2022-08-10T17:44:19.634 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:19.634 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:19.634 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:44:19.634 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.635 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:44:19.635 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:19.635 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:19.635 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:19.636 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.636 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.636 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.636 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.637 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.637 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.637 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.637 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.637 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.638 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.638 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:19.638 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:19.638 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.639 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.639 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.639 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.639 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.640 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.640 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.640 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.640 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.641 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.641 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:19.641 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:19.642 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:19.642 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:19.642 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:19.642 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:19.643 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:19.643 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:19.643 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:19.643 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:19.644 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:19.644 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:19.644 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:19.644 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:19.645 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:19.645 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:19.645 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:19.645 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:19.645 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:19.646 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:19.646 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:19.646 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:19.646 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:19.647 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:19.647 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:19.647 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.647 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:19.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.648 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:19.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.648 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:19.648 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:19.649 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.649 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.650 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.650 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:19.650 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.651 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.651 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:19.651 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.651 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.652 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.652 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:19.652 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:19.653 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.653 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.653 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.654 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:19.654 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:19.654 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.655 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.655 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.655 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:19.656 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.656 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.657 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:19.657 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.657 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.657 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:19.660 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:19.660 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:19.660 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:19.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.661 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:19.661 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:19.661 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.662 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:19.662 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:19.662 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:19.663 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.663 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.663 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:19.664 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:19.664 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:19.664 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:19.664 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:19.665 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.665 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.665 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:19.665 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:19.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.666 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.666 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.666 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:19.667 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.667 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.667 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:44:19.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.668 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.668 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.668 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:44:19.668 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.669 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.669 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:44:19.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.669 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.670 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.670 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:44:19.670 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.670 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.671 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:19.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.671 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:44:19.671 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.671 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:19.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.672 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.672 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.673 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:44:19.673 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.673 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:19.673 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:44:19.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:19.674 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:19.674 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:19.674 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:19.675 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:19.675 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:19.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:19.675 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:19.675 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:19.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f00e8065090 msgr2=0x7f00e8067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f00e8065090 0x7f00e8067540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01081f05e0 tx=0x7f010000b040 comp rx=0 tx=0).stop 2022-08-10T17:44:19.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 msgr2=0x7f01080c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:19.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 --2- 172.21.15.150:0/1142598215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0108150af0 0x7f01080c8000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f010806de70 tx=0x7f00f80045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:19.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f010e689700 1 -- 172.21.15.150:0/1142598215 reap_dead start 2022-08-10T17:44:19.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f010e689700 1 -- 172.21.15.150:0/1142598215 reap_dead start 2022-08-10T17:44:19.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 shutdown_connections 2022-08-10T17:44:19.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 >> 172.21.15.150:0/1142598215 conn(0x7f01080c92f0 msgr2=0x7f010814d470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:19.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 shutdown_connections 2022-08-10T17:44:19.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:19.612+0000 7f01100ec700 1 -- 172.21.15.150:0/1142598215 wait complete. 2022-08-10T17:44:19.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:44:39.682 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:44:39.682 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:44:39.682 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:44:39.683 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:44:39.686 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:44:39.686 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:44:39.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:39.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.839+0000 7fcdb4382700 1 Processor -- start 2022-08-10T17:44:39.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.839+0000 7fcdb4382700 1 -- start start 2022-08-10T17:44:39.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb4382700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcdac1541e0 0x7fcdac06ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb4382700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 0x7fcdac0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb4382700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac06b960 con 0x7fcdac071370 2022-08-10T17:44:39.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb4382700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0c7280 con 0x7fcdac1541e0 2022-08-10T17:44:39.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb4382700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c5f50 con 0x7fcdac06f0f0 2022-08-10T17:44:39.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb191d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 msgr2=0x7fcdac0c4420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:39.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb191d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 0x7fcdac0c4420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:39.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb211e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcdac1541e0 0x7fcdac06ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:39.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb291f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcdac071370 0x7fcdac156b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51558/0 (socket says 172.21.15.150:51558) 2022-08-10T17:44:39.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb291f700 1 -- 172.21.15.150:0/3556165954 learned_addr learned my addr 172.21.15.150:0/3556165954 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:39.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb211e700 1 -- 172.21.15.150:0/3556165954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 msgr2=0x7fcdac0c4420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:39.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.840+0000 7fcdb211e700 1 --2- 172.21.15.150:0/3556165954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 0x7fcdac0c4420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb211e700 1 -- 172.21.15.150:0/3556165954 >> v1:172.21.15.150:6789/0 conn(0x7fcdac071370 legacy=0x7fcdac156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:39.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb211e700 1 -- 172.21.15.150:0/3556165954 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0c6fa0 con 0x7fcdac1541e0 2022-08-10T17:44:39.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb111c700 1 -- 172.21.15.150:0/3556165954 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197737445 0 0) 0x7fcdac06b960 con 0x7fcdac071370 2022-08-10T17:44:39.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb211e700 1 --2- 172.21.15.150:0/3556165954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac1541e0 0x7fcdac06ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcda80096b0 tx=0x7fcda80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8c4baeab4aea1f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:39.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb111c700 1 -- 172.21.15.150:0/3556165954 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011830 con 0x7fcdac1541e0 2022-08-10T17:44:39.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb111c700 1 -- 172.21.15.150:0/3556165954 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8011990 con 0x7fcdac1541e0 2022-08-10T17:44:39.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb111c700 1 -- 172.21.15.150:0/3556165954 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011d20 con 0x7fcdac1541e0 2022-08-10T17:44:39.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb4382700 1 -- 172.21.15.150:0/3556165954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac1541e0 msgr2=0x7fcdac06ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:39.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.841+0000 7fcdb4382700 1 --2- 172.21.15.150:0/3556165954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac1541e0 0x7fcdac06ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcda80096b0 tx=0x7fcda80099c0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 -- 172.21.15.150:0/3556165954 shutdown_connections 2022-08-10T17:44:39.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 --2- 172.21.15.150:0/3556165954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac1541e0 0x7fcdac06ea50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 --2- 172.21.15.150:0/3556165954 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac06f0f0 0x7fcdac0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 -- 172.21.15.150:0/3556165954 >> 172.21.15.150:0/3556165954 conn(0x7fcdac068be0 msgr2=0x7fcdac0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:39.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 -- 172.21.15.150:0/3556165954 shutdown_connections 2022-08-10T17:44:39.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.842+0000 7fcdb4382700 1 -- 172.21.15.150:0/3556165954 wait complete. 2022-08-10T17:44:39.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.843+0000 7fcdb4382700 1 Processor -- start 2022-08-10T17:44:39.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.843+0000 7fcdb4382700 1 -- start start 2022-08-10T17:44:39.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.843+0000 7fcdb4382700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.843+0000 7fcdb4382700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 0x7fcdac1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 0x7fcdac1f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c1920 con 0x7fcdac06f0f0 2022-08-10T17:44:39.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c2170 con 0x7fcdac071370 2022-08-10T17:44:39.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac155030 con 0x7fcdac1541e0 2022-08-10T17:44:39.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:39.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb291f700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 msgr2=0x7fcdac1f3b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:44:39.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38880/0 (socket says 172.21.15.150:38880) 2022-08-10T17:44:39.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 -- 172.21.15.150:0/2398949435 learned_addr learned my addr 172.21.15.150:0/2398949435 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:39.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb291f700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 0x7fcdac1f3b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:39.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb191d700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 0x7fcdac1f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:39.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 -- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 msgr2=0x7fcdac1f3b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:39.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 0x7fcdac1f3b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 -- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 msgr2=0x7fcdac1f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:39.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 0x7fcdac1f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:39.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 -- 172.21.15.150:0/2398949435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8009310 con 0x7fcdac06f0f0 2022-08-10T17:44:39.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb191d700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 0x7fcdac1f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:44:39.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb211e700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:39.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda801a900 con 0x7fcdac06f0f0 2022-08-10T17:44:39.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda801aa80 con 0x7fcdac06f0f0 2022-08-10T17:44:39.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda801ae30 con 0x7fcdac06f0f0 2022-08-10T17:44:39.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac155310 con 0x7fcdac06f0f0 2022-08-10T17:44:39.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.844+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0c1e90 con 0x7fcdac06f0f0 2022-08-10T17:44:39.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.845+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0c61f0 con 0x7fcdac06f0f0 2022-08-10T17:44:39.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.846+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcda802b030 con 0x7fcdac06f0f0 2022-08-10T17:44:39.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.846+0000 7fcd9affd700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 0x7fcd8c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:39.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.846+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcda8083650 con 0x7fcdac06f0f0 2022-08-10T17:44:39.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.846+0000 7fcdb191d700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 0x7fcd8c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:39.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.847+0000 7fcdb191d700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 0x7fcd8c067540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0caa30 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:39.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:39.851+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcda8051630 con 0x7fcdac06f0f0 2022-08-10T17:44:40.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.180+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcdac0c7470 con 0x7fcdac06f0f0 2022-08-10T17:44:40.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.180+0000 7fcd9affd700 1 -- 172.21.15.150:0/2398949435 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7fcda8029020 con 0x7fcdac06f0f0 2022-08-10T17:44:40.184 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":70,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:40.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 msgr2=0x7fcd8c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:40.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 0x7fcd8c067540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0caa30 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2022-08-10T17:44:40.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 msgr2=0x7fcdac0ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:40.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda80045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:40.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 shutdown_connections 2022-08-10T17:44:40.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd8c065090 0x7fcd8c067540 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:40.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcdac1541e0 0x7fcdac1f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:40.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdac06f0f0 0x7fcdac0ca4f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 --2- 172.21.15.150:0/2398949435 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcdac071370 0x7fcdac1f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 >> 172.21.15.150:0/2398949435 conn(0x7fcdac068be0 msgr2=0x7fcdac14fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 shutdown_connections 2022-08-10T17:44:40.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:40.182+0000 7fcdb4382700 1 -- 172.21.15.150:0/2398949435 wait complete. 2022-08-10T17:44:43.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:43.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.338+0000 7efee4918700 1 Processor -- start 2022-08-10T17:44:43.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.339+0000 7efee4918700 1 -- start start 2022-08-10T17:44:43.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efee4918700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efee0150b40 0x7efee0068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:43.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efee0150b40 0x7efee0068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:43.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efee4918700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00bcfe0 con 0x7efee0068650 2022-08-10T17:44:43.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efee4918700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00c48f0 con 0x7efee00644b0 2022-08-10T17:44:43.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efee4918700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee006f3e0 con 0x7efee0150b40 2022-08-10T17:44:43.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efee0150b40 0x7efee0068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38906/0 (socket says 172.21.15.150:38906) 2022-08-10T17:44:43.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 -- 172.21.15.150:0/267752879 learned_addr learned my addr 172.21.15.150:0/267752879 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:43.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 -- 172.21.15.150:0/267752879 >> v1:172.21.15.197:6789/0 conn(0x7efee00644b0 legacy=0x7efee01610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:43.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 -- 172.21.15.150:0/267752879 >> v1:172.21.15.150:6789/0 conn(0x7efee0068650 legacy=0x7efee006fc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:43.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.340+0000 7efede59c700 1 -- 172.21.15.150:0/267752879 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee0069160 con 0x7efee0150b40 2022-08-10T17:44:43.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efede59c700 1 --2- 172.21.15.150:0/267752879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee0068110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efed0006fd0 tx=0x7efed0009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8d1f550bd536cd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:43.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efedd59a700 1 -- 172.21.15.150:0/267752879 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011830 con 0x7efee0150b40 2022-08-10T17:44:43.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efedd59a700 1 -- 172.21.15.150:0/267752879 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0011990 con 0x7efee0150b40 2022-08-10T17:44:43.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efedd59a700 1 -- 172.21.15.150:0/267752879 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011d40 con 0x7efee0150b40 2022-08-10T17:44:43.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efee4918700 1 -- 172.21.15.150:0/267752879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 msgr2=0x7efee0068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:43.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.341+0000 7efee4918700 1 --2- 172.21.15.150:0/267752879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee0068110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efed0006fd0 tx=0x7efed0009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:43.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.342+0000 7efee4918700 1 -- 172.21.15.150:0/267752879 shutdown_connections 2022-08-10T17:44:43.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.342+0000 7efee4918700 1 --2- 172.21.15.150:0/267752879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee0068110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.342+0000 7efee4918700 1 -- 172.21.15.150:0/267752879 >> 172.21.15.150:0/267752879 conn(0x7efee00c9320 msgr2=0x7efee00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:43.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.342+0000 7efee4918700 1 -- 172.21.15.150:0/267752879 shutdown_connections 2022-08-10T17:44:43.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.342+0000 7efee4918700 1 -- 172.21.15.150:0/267752879 wait complete. 2022-08-10T17:44:43.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.343+0000 7efee4918700 1 Processor -- start 2022-08-10T17:44:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.343+0000 7efee4918700 1 -- start start 2022-08-10T17:44:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:43.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0069440 con 0x7efee0150b40 2022-08-10T17:44:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0154970 con 0x7efee00644b0 2022-08-10T17:44:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efee4918700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee01f0830 con 0x7efee0068650 2022-08-10T17:44:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:43.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:49502/0 (socket says 172.21.15.150:49502) 2022-08-10T17:44:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 -- 172.21.15.150:0/1395515248 learned_addr learned my addr 172.21.15.150:0/1395515248 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeded9d700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeddd9b700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:43.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeddd9b700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 msgr2=0x7efee0144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:44:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeddd9b700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 msgr2=0x7efee0144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:44:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeddd9b700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efeddd9b700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 msgr2=0x7efee0144fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:43.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 msgr2=0x7efee00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:43.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.344+0000 7efede59c700 1 -- 172.21.15.150:0/1395515248 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00093e0 con 0x7efee00644b0 2022-08-10T17:44:43.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efede59c700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efee006db10 tx=0x7efed00045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:43.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0003720 con 0x7efee00644b0 2022-08-10T17:44:43.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00038a0 con 0x7efee00644b0 2022-08-10T17:44:43.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0003c50 con 0x7efee00644b0 2022-08-10T17:44:43.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee01462a0 con 0x7efee00644b0 2022-08-10T17:44:43.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.345+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee01f02b0 con 0x7efee00644b0 2022-08-10T17:44:43.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.346+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0068ed0 con 0x7efee00644b0 2022-08-10T17:44:43.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.347+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efed000f050 con 0x7efee00644b0 2022-08-10T17:44:43.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.347+0000 7efeceffd700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 0x7efebc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:43.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.347+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efed00835f0 con 0x7efee00644b0 2022-08-10T17:44:43.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.347+0000 7efeddd9b700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 0x7efebc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:43.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.348+0000 7efeddd9b700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 0x7efebc067560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efee00c92f0 tx=0x7efed4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:43.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.352+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7efed00515d0 con 0x7efee00644b0 2022-08-10T17:44:43.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.711+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efee00bc180 con 0x7efee00644b0 2022-08-10T17:44:43.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.712+0000 7efeceffd700 1 -- 172.21.15.150:0/1395515248 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7efed0015020 con 0x7efee00644b0 2022-08-10T17:44:43.716 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":70,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:43.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 msgr2=0x7efebc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:43.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 0x7efebc067560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efee00c92f0 tx=0x7efed4008040 comp rx=0 tx=0).stop 2022-08-10T17:44:43.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 msgr2=0x7efee01441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:43.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efee006db10 tx=0x7efed00045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 shutdown_connections 2022-08-10T17:44:43.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efee0150b40 0x7efee00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efee00644b0 0x7efee01441c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efebc0650b0 0x7efebc067560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 --2- 172.21.15.150:0/1395515248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efee0068650 0x7efee0144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:43.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 >> 172.21.15.150:0/1395515248 conn(0x7efee00c9320 msgr2=0x7efee014ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:43.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 shutdown_connections 2022-08-10T17:44:43.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:43.714+0000 7efee4918700 1 -- 172.21.15.150:0/1395515248 wait complete. 2022-08-10T17:44:46.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.893+0000 7f1862703700 1 Processor -- start 2022-08-10T17:44:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.893+0000 7f1862703700 1 -- start start 2022-08-10T17:44:46.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1862703700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f185c157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1862703700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c1578c0 con 0x7f185c06bfc0 2022-08-10T17:44:46.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1862703700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0c6780 con 0x7f185c0644b0 2022-08-10T17:44:46.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1862703700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0c6a60 con 0x7f185c150e70 2022-08-10T17:44:46.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1860ca0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f185c06bfc0 0x7f185c161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51624/0 (socket says 172.21.15.150:51624) 2022-08-10T17:44:46.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f1860ca0700 1 -- 172.21.15.150:0/1533656012 learned_addr learned my addr 172.21.15.150:0/1533656012 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:46.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.894+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f185c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185bfff700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 msgr2=0x7f185c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:44:46.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185bfff700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 msgr2=0x7f185c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:44:46.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f185c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:46.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f185c157380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:46.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575415989 0 0) 0x7f185c1578c0 con 0x7f185c06bfc0 2022-08-10T17:44:46.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1848003430 con 0x7f185c06bfc0 2022-08-10T17:44:46.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1597615137 0 0) 0x7f1848003430 con 0x7f185c06bfc0 2022-08-10T17:44:46.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 msgr2=0x7f185c157380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:46.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f185c157380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:46.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 >> v1:172.21.15.197:6789/0 conn(0x7f185c0644b0 legacy=0x7f185c06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:46.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c06b4e0 con 0x7f185c06bfc0 2022-08-10T17:44:46.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f18540019f0 con 0x7f185c06bfc0 2022-08-10T17:44:46.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 >> v1:172.21.15.150:6789/0 conn(0x7f185c06bfc0 legacy=0x7f185c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:46.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f1848003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18480046d0 0x7f1848004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f18480050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0c6a60 con 0x7f18480038b0 2022-08-10T17:44:46.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184800b9c0 con 0x7f18480046d0 2022-08-10T17:44:46.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184800bb80 con 0x7f185c150e70 2022-08-10T17:44:46.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f1860ca0700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f18480050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.895+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f1848003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 msgr2=0x7f18480050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:46.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c150e70 0x7f18480050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:46.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18480046d0 msgr2=0x7f1848004b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:44:46.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f18480046d0 0x7f1848004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:46.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 -- 172.21.15.150:0/1533656012 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848003430 con 0x7f18480038b0 2022-08-10T17:44:46.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185bfff700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f1848003cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b8f0 tx=0x7f1848005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d195619606355f7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c018070 con 0x7f18480038b0 2022-08-10T17:44:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c004020 con 0x7f18480038b0 2022-08-10T17:44:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.896+0000 7f185affd700 1 -- 172.21.15.150:0/1533656012 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0041d0 con 0x7f18480038b0 2022-08-10T17:44:46.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.897+0000 7f1862703700 1 -- 172.21.15.150:0/1533656012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 msgr2=0x7f1848003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.897+0000 7f1862703700 1 --2- 172.21.15.150:0/1533656012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f1848003cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b8f0 tx=0x7f1848005700 comp rx=0 tx=0).stop 2022-08-10T17:44:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.897+0000 7f1860ca0700 1 -- 172.21.15.150:0/1533656012 reap_dead start 2022-08-10T17:44:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.898+0000 7f1862703700 1 -- 172.21.15.150:0/1533656012 shutdown_connections 2022-08-10T17:44:46.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.898+0000 7f1862703700 1 -- 172.21.15.150:0/1533656012 >> 172.21.15.150:0/1533656012 conn(0x7f185c0c9d60 msgr2=0x7f185c0c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.898+0000 7f1862703700 1 -- 172.21.15.150:0/1533656012 shutdown_connections 2022-08-10T17:44:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.898+0000 7f1862703700 1 -- 172.21.15.150:0/1533656012 wait complete. 2022-08-10T17:44:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.900+0000 7f1862703700 1 Processor -- start 2022-08-10T17:44:46.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.900+0000 7f1862703700 1 -- start start 2022-08-10T17:44:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f185c1e0660 0x7f185c146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c14c710 con 0x7f18480038b0 2022-08-10T17:44:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c1505b0 con 0x7f185c1e0660 2022-08-10T17:44:46.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1862703700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c1edea0 con 0x7f185c0c5ec0 2022-08-10T17:44:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38952/0 (socket says 172.21.15.150:38952) 2022-08-10T17:44:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185bfff700 1 -- 172.21.15.150:0/3376701359 learned_addr learned my addr 172.21.15.150:0/3376701359 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:46.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185b7fe700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f1860ca0700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f185c1e0660 0x7f185c146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185b7fe700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 msgr2=0x7f185c0bb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:44:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185b7fe700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 msgr2=0x7f185c0bb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:44:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185b7fe700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:44:46.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.901+0000 7f185b7fe700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:44:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 msgr2=0x7f185c0bb650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:44:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f185c1e0660 msgr2=0x7f185c146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:46.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f185c1e0660 0x7f185c146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 -- 172.21.15.150:0/3376701359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c1ed000 con 0x7f18480038b0 2022-08-10T17:44:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.902+0000 7f185bfff700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f184800b990 tx=0x7f184c004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.904+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c018050 con 0x7f18480038b0 2022-08-10T17:44:46.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.904+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c006ce0 con 0x7f18480038b0 2022-08-10T17:44:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.904+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c1ed2e0 con 0x7f18480038b0 2022-08-10T17:44:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.904+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c01d680 con 0x7f18480038b0 2022-08-10T17:44:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.904+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c1ee140 con 0x7f18480038b0 2022-08-10T17:44:46.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.905+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c06b7c0 con 0x7f18480038b0 2022-08-10T17:44:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.906+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f184c01d7e0 con 0x7f18480038b0 2022-08-10T17:44:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.907+0000 7f1858ff9700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 0x7f183c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:46.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.907+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f184c083820 con 0x7f18480038b0 2022-08-10T17:44:46.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.907+0000 7f185b7fe700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 0x7f183c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:46.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.907+0000 7f185b7fe700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 0x7f183c0675b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f185c1dfbd0 tx=0x7f1850009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:46.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:46.912+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f184c0518a0 con 0x7f18480038b0 2022-08-10T17:44:47.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.239+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f185c156760 con 0x7f18480038b0 2022-08-10T17:44:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.240+0000 7f1858ff9700 1 -- 172.21.15.150:0/3376701359 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f184c054ec0 con 0x7f18480038b0 2022-08-10T17:44:47.244 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.242+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 msgr2=0x7f183c0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.242+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 0x7f183c0675b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f185c1dfbd0 tx=0x7f1850009040 comp rx=0 tx=0).stop 2022-08-10T17:44:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 msgr2=0x7f185c1ec9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f184800b990 tx=0x7f184c004640 comp rx=0 tx=0).stop 2022-08-10T17:44:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 shutdown_connections 2022-08-10T17:44:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f185c1e0660 0x7f185c146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18480038b0 0x7f185c1ec9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f183c065100 0x7f183c0675b0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f185c1dfbd0 tx=0x7f1850009040 comp rx=0 tx=0).stop 2022-08-10T17:44:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 --2- 172.21.15.150:0/3376701359 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f185c0c5ec0 0x7f185c0bb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 >> 172.21.15.150:0/3376701359 conn(0x7f185c0c9d60 msgr2=0x7f185c06f940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 shutdown_connections 2022-08-10T17:44:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.243+0000 7f1862703700 1 -- 172.21.15.150:0/3376701359 wait complete. 2022-08-10T17:44:47.259 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:44:47.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:44:47.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.391+0000 7f1a10d09700 1 Processor -- start 2022-08-10T17:44:47.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.391+0000 7f1a10d09700 1 -- start start 2022-08-10T17:44:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.391+0000 7f1a10d09700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f1a0c1540f0 0x7f1a0c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a10d09700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a0c068820 0x7f1a0c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a10d09700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0c6100 con 0x7f1a0c1544c0 2022-08-10T17:44:47.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a10d09700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c5270 con 0x7f1a0c068820 2022-08-10T17:44:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a10d09700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c5e00 con 0x7f1a0c1540f0 2022-08-10T17:44:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a0c068820 0x7f1a0c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a0c068820 0x7f1a0c0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38964/0 (socket says 172.21.15.150:38964) 2022-08-10T17:44:47.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/3187808147 learned_addr learned my addr 172.21.15.150:0/3187808147 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:47.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0a59c700 1 --2- 172.21.15.150:0/3187808147 >> v2:172.21.15.197:3300/0 conn(0x7f1a0c1540f0 0x7f1a0c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/3187808147 >> v2:172.21.15.197:3300/0 conn(0x7f1a0c1540f0 msgr2=0x7f1a0c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:47.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 --2- 172.21.15.150:0/3187808147 >> v2:172.21.15.197:3300/0 conn(0x7f1a0c1540f0 0x7f1a0c071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/3187808147 >> v1:172.21.15.197:6789/0 conn(0x7f1a0c1544c0 legacy=0x7f1a0c068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:47.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/3187808147 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c06eb00 con 0x7f1a0c068820 2022-08-10T17:44:47.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0ad9d700 1 --2- 172.21.15.150:0/3187808147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c0718b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c064cd0 tx=0x7f1a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae52fe98dc6c06c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0959a700 1 -- 172.21.15.150:0/3187808147 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400e070 con 0x7f1a0c068820 2022-08-10T17:44:47.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0959a700 1 -- 172.21.15.150:0/3187808147 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0400b980 con 0x7f1a0c068820 2022-08-10T17:44:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.392+0000 7f1a0959a700 1 -- 172.21.15.150:0/3187808147 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400bd30 con 0x7f1a0c068820 2022-08-10T17:44:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 -- 172.21.15.150:0/3187808147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 msgr2=0x7f1a0c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 --2- 172.21.15.150:0/3187808147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c0718b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c064cd0 tx=0x7f1a0400b330 comp rx=0 tx=0).stop 2022-08-10T17:44:47.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 -- 172.21.15.150:0/3187808147 shutdown_connections 2022-08-10T17:44:47.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 --2- 172.21.15.150:0/3187808147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c0718b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 --2- 172.21.15.150:0/3187808147 >> v2:172.21.15.197:3300/0 conn(0x7f1a0c1540f0 0x7f1a0c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 -- 172.21.15.150:0/3187808147 >> 172.21.15.150:0/3187808147 conn(0x7f1a0c06d0d0 msgr2=0x7f1a0c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 -- 172.21.15.150:0/3187808147 shutdown_connections 2022-08-10T17:44:47.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.393+0000 7f1a10d09700 1 -- 172.21.15.150:0/3187808147 wait complete. 2022-08-10T17:44:47.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.394+0000 7f1a10d09700 1 Processor -- start 2022-08-10T17:44:47.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.394+0000 7f1a10d09700 1 -- start start 2022-08-10T17:44:47.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a0c1540f0 0x7f1a0c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a0c1544c0 0x7f1a0c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c3740 con 0x7f1a0c068820 2022-08-10T17:44:47.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0afd10 con 0x7f1a0c1540f0 2022-08-10T17:44:47.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a10d09700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c1f40d0 con 0x7f1a0c1544c0 2022-08-10T17:44:47.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38966/0 (socket says 172.21.15.150:38966) 2022-08-10T17:44:47.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 -- 172.21.15.150:0/4171751086 learned_addr learned my addr 172.21.15.150:0/4171751086 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:47.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0ad9d700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a0c1544c0 0x7f1a0c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a0c1544c0 msgr2=0x7f1a0c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a0c1544c0 0x7f1a0c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a0c1540f0 msgr2=0x7f1a0c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a0c1540f0 0x7f1a0c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009b30 con 0x7f1a0c068820 2022-08-10T17:44:47.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.395+0000 7f1a0a59c700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00d800 tx=0x7f19fc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc012630 con 0x7f1a0c068820 2022-08-10T17:44:47.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc012790 con 0x7f1a0c068820 2022-08-10T17:44:47.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc012b40 con 0x7f1a0c068820 2022-08-10T17:44:47.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c159050 con 0x7f1a0c068820 2022-08-10T17:44:47.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c1f4380 con 0x7f1a0c068820 2022-08-10T17:44:47.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f1a10d09700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 0x7f1a0c0bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0672f0 con 0x7f1a0c0c9480 2022-08-10T17:44:47.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.396+0000 7f1a09d9b700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 0x7f1a0c0bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f1a09d9b700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a0c158930 con 0x7f1a0c0c9480 2022-08-10T17:44:47.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f1a09d9b700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 0x7f1a0c0bfeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a000092f0 tx=0x7f1a000096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011640 con 0x7f1a0c0c9480 2022-08-10T17:44:47.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f1a000117a0 con 0x7f1a0c0c9480 2022-08-10T17:44:47.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 msgr2=0x7f1a0c0bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 0x7f1a0c0bfeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a000092f0 tx=0x7f1a000096b0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 msgr2=0x7f1a0c0bfeb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c0c9480 0x7f1a0c0bfeb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.397+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f19fc01b030 con 0x7f1a0c068820 2022-08-10T17:44:47.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.398+0000 7f19faffd700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f19e8064dc0 0x7f19e8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.398+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f19fc081a80 con 0x7f1a0c068820 2022-08-10T17:44:47.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.398+0000 7f1a09d9b700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f19e8064dc0 0x7f19e8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.398+0000 7f1a09d9b700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f19e8064dc0 0x7f19e8067270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1a00013040 tx=0x7f1a00008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.404+0000 7f1a10d09700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 0x7f1a0c0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.404+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c072890 con 0x7f1a0c157c50 2022-08-10T17:44:47.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.404+0000 7f1a0ad9d700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 0x7f1a0c0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/4171751086 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1a0c0c7110 con 0x7f1a0c157c50 2022-08-10T17:44:47.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f1a0ad9d700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 0x7f1a0c0c03f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c064cd0 tx=0x7f1a04004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04004440 con 0x7f1a0c157c50 2022-08-10T17:44:47.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4378 (secure 0 0 0) 0x7f1a040045a0 con 0x7f1a0c157c50 2022-08-10T17:44:47.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 msgr2=0x7f1a0c0c03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 0x7f1a0c0c03f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c064cd0 tx=0x7f1a04004950 comp rx=0 tx=0).stop 2022-08-10T17:44:47.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 msgr2=0x7f1a0c0c03f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.405+0000 7f19faffd700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c157c50 0x7f1a0c0c03f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.422 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:44:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:44:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:47.446 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.446 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.446 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.446 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.447 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:47.447 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.447 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.447 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.448 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.448 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.448 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.449 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.449 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.450 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:47.450 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:47.450 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.450 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.451 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.451 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:47.451 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.452 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.452 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:47.452 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.453 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.453 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.453 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.453 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.454 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.454 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.454 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.454 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.455 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.455 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:47.455 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:47.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.456 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.456 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.456 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:47.457 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.457 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.457 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:47.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.458 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.458 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.458 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:47.458 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.459 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.459 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:47.459 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:47.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f19e8064dc0 msgr2=0x7f19e8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f19e8064dc0 0x7f19e8067270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1a00013040 tx=0x7f1a00008030 comp rx=0 tx=0).stop 2022-08-10T17:44:47.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 msgr2=0x7f1a0c1f01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00d800 tx=0x7f19fc00db10 comp rx=0 tx=0).stop 2022-08-10T17:44:47.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a0ad9d700 1 -- 172.21.15.150:0/4171751086 reap_dead start 2022-08-10T17:44:47.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 shutdown_connections 2022-08-10T17:44:47.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 --2- 172.21.15.150:0/4171751086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a0c068820 0x7f1a0c1f01e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 >> 172.21.15.150:0/4171751086 conn(0x7f1a0c06d0d0 msgr2=0x7f1a0c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 shutdown_connections 2022-08-10T17:44:47.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.406+0000 7f1a10d09700 1 -- 172.21.15.150:0/4171751086 wait complete. 2022-08-10T17:44:47.464 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:44:47.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.629+0000 7fd1456c1700 1 Processor -- start 2022-08-10T17:44:47.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.629+0000 7fd1456c1700 1 -- start start 2022-08-10T17:44:47.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.631+0000 7fd1456c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd140070290 0x7fd14006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.631+0000 7fd1456c1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd1400c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.631+0000 7fd1456c1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400c9990 con 0x7fd1400c26c0 2022-08-10T17:44:47.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.631+0000 7fd1456c1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14015b830 con 0x7fd140070290 2022-08-10T17:44:47.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.631+0000 7fd1456c1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015af60 con 0x7fd1400c8990 2022-08-10T17:44:47.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.632+0000 7fd13e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd140070290 0x7fd14006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.632+0000 7fd13e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd140070290 0x7fd14006dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38980/0 (socket says 172.21.15.150:38980) 2022-08-10T17:44:47.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.632+0000 7fd13effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd1400c26c0 0x7fd1400c3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51662/0 (socket says 172.21.15.150:51662) 2022-08-10T17:44:47.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.632+0000 7fd13e7fc700 1 -- 172.21.15.150:0/2132555559 learned_addr learned my addr 172.21.15.150:0/2132555559 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:47.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.633+0000 7fd13e7fc700 1 -- 172.21.15.150:0/2132555559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 msgr2=0x7fd1400c8e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:44:47.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.633+0000 7fd13e7fc700 1 --2- 172.21.15.150:0/2132555559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd1400c8e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.633+0000 7fd13e7fc700 1 -- 172.21.15.150:0/2132555559 >> v1:172.21.15.150:6789/0 conn(0x7fd1400c26c0 legacy=0x7fd1400c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.633+0000 7fd13e7fc700 1 -- 172.21.15.150:0/2132555559 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400706f0 con 0x7fd140070290 2022-08-10T17:44:47.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.633+0000 7fd13e7fc700 1 --2- 172.21.15.150:0/2132555559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd140070290 0x7fd14006dcf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd130006fd0 tx=0x7fd130009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d7ed5d16e4f5e2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.638+0000 7fd13dffb700 1 -- 172.21.15.150:0/2132555559 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130004230 con 0x7fd140070290 2022-08-10T17:44:47.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.639+0000 7fd13dffb700 1 -- 172.21.15.150:0/2132555559 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130004390 con 0x7fd140070290 2022-08-10T17:44:47.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.639+0000 7fd13dffb700 1 -- 172.21.15.150:0/2132555559 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130011870 con 0x7fd140070290 2022-08-10T17:44:47.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.639+0000 7fd1456c1700 1 -- 172.21.15.150:0/2132555559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd140070290 msgr2=0x7fd14006dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.639+0000 7fd1456c1700 1 --2- 172.21.15.150:0/2132555559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd140070290 0x7fd14006dcf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd130006fd0 tx=0x7fd130009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:47.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 -- 172.21.15.150:0/2132555559 shutdown_connections 2022-08-10T17:44:47.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 --2- 172.21.15.150:0/2132555559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd1400c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 --2- 172.21.15.150:0/2132555559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd140070290 0x7fd14006dcf0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd130006fd0 tx=0x7fd130009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:47.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 -- 172.21.15.150:0/2132555559 >> 172.21.15.150:0/2132555559 conn(0x7fd14006b500 msgr2=0x7fd14006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 -- 172.21.15.150:0/2132555559 shutdown_connections 2022-08-10T17:44:47.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.640+0000 7fd1456c1700 1 -- 172.21.15.150:0/2132555559 wait complete. 2022-08-10T17:44:47.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.642+0000 7fd1456c1700 1 Processor -- start 2022-08-10T17:44:47.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.642+0000 7fd1456c1700 1 -- start start 2022-08-10T17:44:47.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1400c26c0 0x7fd1400c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd140159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400c75f0 0x7fd140159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015ad20 con 0x7fd1400c75f0 2022-08-10T17:44:47.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140130ed0 con 0x7fd1400c26c0 2022-08-10T17:44:47.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.643+0000 7fd1456c1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c7af0 con 0x7fd1400c8990 2022-08-10T17:44:47.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd140159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd140159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53210/0 (socket says 172.21.15.150:53210) 2022-08-10T17:44:47.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 -- 172.21.15.150:0/725104137 learned_addr learned my addr 172.21.15.150:0/725104137 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:47.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1400c26c0 msgr2=0x7fd1400c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1400c26c0 0x7fd1400c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400c75f0 msgr2=0x7fd140159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400c75f0 0x7fd140159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.645+0000 7fd13e7fc700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300093e0 con 0x7fd1400c8990 2022-08-10T17:44:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.646+0000 7fd13e7fc700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd140159810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd130014040 tx=0x7fd1300045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.646+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130003720 con 0x7fd1400c8990 2022-08-10T17:44:47.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.646+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300038a0 con 0x7fd1400c8990 2022-08-10T17:44:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.646+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd140131170 con 0x7fd1400c8990 2022-08-10T17:44:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.646+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400c13b0 con 0x7fd1400c8990 2022-08-10T17:44:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.647+0000 7fd1456c1700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 0x7fd14012f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.647+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400673d0 con 0x7fd140149880 2022-08-10T17:44:47.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd13effd700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 0x7fd14012f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd13effd700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd140159470 con 0x7fd140149880 2022-08-10T17:44:47.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd13effd700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 0x7fd14012f730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c340 tx=0x7fd13400c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340072d0 con 0x7fd140149880 2022-08-10T17:44:47.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd134007430 con 0x7fd140149880 2022-08-10T17:44:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 msgr2=0x7fd14012f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.648+0000 7fd1277fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 0x7fd14012f730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c340 tx=0x7fd13400c700 comp rx=0 tx=0).stop 2022-08-10T17:44:47.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.649+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 msgr2=0x7fd14012f730 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.649+0000 7fd1277fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd140149880 0x7fd14012f730 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c340 tx=0x7fd13400c700 comp rx=0 tx=0).stop 2022-08-10T17:44:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.650+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130003c30 con 0x7fd1400c8990 2022-08-10T17:44:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.651+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd13002d070 con 0x7fd1400c8990 2022-08-10T17:44:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.652+0000 7fd1277fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd120064f90 0x7fd120067440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.652+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd130082fc0 con 0x7fd1400c8990 2022-08-10T17:44:47.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.652+0000 7fd13effd700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd120064f90 0x7fd120067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.653+0000 7fd13effd700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd120064f90 0x7fd120067440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c340 tx=0x7fd13400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.657+0000 7fd1456c1700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 0x7fd140130040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.657+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c0f70 con 0x7fd14012fc70 2022-08-10T17:44:47.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.657+0000 7fd13f7fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 0x7fd140130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.657+0000 7fd13f7fe700 1 -- 172.21.15.150:0/725104137 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd14006f4c0 con 0x7fd14012fc70 2022-08-10T17:44:47.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd13f7fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 0x7fd140130040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd13800bd20 tx=0x7fd138009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800cad0 con 0x7fd14012fc70 2022-08-10T17:44:47.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7fd13800cc30 con 0x7fd14012fc70 2022-08-10T17:44:47.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 msgr2=0x7fd140130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 0x7fd140130040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd13800bd20 tx=0x7fd138009e70 comp rx=0 tx=0).stop 2022-08-10T17:44:47.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 msgr2=0x7fd140130040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.660+0000 7fd1277fe700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd14012fc70 0x7fd140130040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.666 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:47.666 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:47.667 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:47.667 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:47.667 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:47.667 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:47.667 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:47.668 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:47.668 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:47.668 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.668 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:44:47.669 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.669 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:47.669 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:47.669 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.669 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.670 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.670 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.670 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.670 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.671 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.671 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.671 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.671 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.672 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:47.672 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:47.672 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.672 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.672 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.673 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.673 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.673 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.673 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.674 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.674 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.674 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.675 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:47.675 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:47.675 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:47.675 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:47.675 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:47.676 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:47.676 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.676 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.676 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:47.677 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:47.677 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:47.677 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:47.677 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:47.678 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:47.678 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.678 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:47.678 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.678 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.679 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.679 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.679 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.679 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.680 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.680 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.680 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.680 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.680 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:47.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.681 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:47.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.681 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:47.682 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:47.682 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.682 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.683 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.683 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:47.683 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.684 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.684 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:47.684 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.685 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.685 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.685 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.685 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.686 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.686 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.687 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:47.687 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:47.687 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.687 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.688 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.688 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:47.688 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.689 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.689 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:47.689 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.690 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.690 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.690 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.690 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.691 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.691 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.691 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.692 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:47.692 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:47.692 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.692 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.693 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:47.693 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.694 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.694 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:47.694 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.695 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.695 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.695 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.696 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.696 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.696 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.696 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.696 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.697 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.697 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:47.697 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:47.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.698 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.698 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.698 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:47.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.699 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:44:47.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.699 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.700 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.700 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:44:47.700 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.700 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.701 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:44:47.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.701 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.701 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.701 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:44:47.702 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.702 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.702 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:47.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.703 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:44:47.703 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.703 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:47.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.704 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.704 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.704 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:44:47.704 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.705 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.705 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:44:47.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.705 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.706 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.706 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:47.706 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.706 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.707 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:47.707 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:47.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd120064f90 msgr2=0x7fd120067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd120064f90 0x7fd120067440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c340 tx=0x7fd13400a000 comp rx=0 tx=0).stop 2022-08-10T17:44:47.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 msgr2=0x7fd140159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 --2- 172.21.15.150:0/725104137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1400c8990 0x7fd140159810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd130014040 tx=0x7fd1300045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd13f7fe700 1 -- 172.21.15.150:0/725104137 reap_dead start 2022-08-10T17:44:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 shutdown_connections 2022-08-10T17:44:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 >> 172.21.15.150:0/725104137 conn(0x7fd14006b500 msgr2=0x7fd1400c6900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 shutdown_connections 2022-08-10T17:44:47.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.661+0000 7fd1456c1700 1 -- 172.21.15.150:0/725104137 wait complete. 2022-08-10T17:44:47.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:44:47.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.853+0000 7efdf7982700 1 Processor -- start 2022-08-10T17:44:47.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.853+0000 7efdf7982700 1 -- start start 2022-08-10T17:44:47.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf7982700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efdf006c860 0x7efdf00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf7982700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 0x7efdf00c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf7982700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf00c4dc0 con 0x7efdf0150af0 2022-08-10T17:44:47.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf7982700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf00c5940 con 0x7efdf006c860 2022-08-10T17:44:47.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf7982700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00c9fc0 con 0x7efdf015a570 2022-08-10T17:44:47.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf571e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7efdf0150af0 0x7efdf0159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51678/0 (socket says 172.21.15.150:51678) 2022-08-10T17:44:47.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf571e700 1 -- 172.21.15.150:0/3705393251 learned_addr learned my addr 172.21.15.150:0/3705393251 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:47.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.854+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/3705393251 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 0x7efdf00c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf4f1d700 1 --2- 172.21.15.150:0/3705393251 >> v2:172.21.15.197:3300/0 conn(0x7efdf006c860 0x7efdf00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efddffff700 1 -- 172.21.15.150:0/3705393251 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327083833 0 0) 0x7efdf00c4dc0 con 0x7efdf0150af0 2022-08-10T17:44:47.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efddffff700 1 -- 172.21.15.150:0/3705393251 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd8003430 con 0x7efdf0150af0 2022-08-10T17:44:47.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf5f1f700 1 -- 172.21.15.150:0/3705393251 >> v2:172.21.15.197:3300/0 conn(0x7efdf006c860 msgr2=0x7efdf00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:47.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/3705393251 >> v2:172.21.15.197:3300/0 conn(0x7efdf006c860 0x7efdf00c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf5f1f700 1 -- 172.21.15.150:0/3705393251 >> v1:172.21.15.150:6789/0 conn(0x7efdf0150af0 legacy=0x7efdf0159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf5f1f700 1 -- 172.21.15.150:0/3705393251 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf006f9a0 con 0x7efdf015a570 2022-08-10T17:44:47.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/3705393251 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 0x7efdf00c4400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36217bfe4821cde4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efddffff700 1 -- 172.21.15.150:0/3705393251 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e070 con 0x7efdf015a570 2022-08-10T17:44:47.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efddffff700 1 -- 172.21.15.150:0/3705393251 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800bb20 con 0x7efdf015a570 2022-08-10T17:44:47.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.855+0000 7efddffff700 1 -- 172.21.15.150:0/3705393251 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8012430 con 0x7efdf015a570 2022-08-10T17:44:47.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 -- 172.21.15.150:0/3705393251 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 msgr2=0x7efdf00c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 --2- 172.21.15.150:0/3705393251 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 0x7efdf00c4400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde800b330 comp rx=0 tx=0).stop 2022-08-10T17:44:47.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 -- 172.21.15.150:0/3705393251 shutdown_connections 2022-08-10T17:44:47.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 --2- 172.21.15.150:0/3705393251 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf015a570 0x7efdf00c4400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 --2- 172.21.15.150:0/3705393251 >> v2:172.21.15.197:3300/0 conn(0x7efdf006c860 0x7efdf00c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 -- 172.21.15.150:0/3705393251 >> 172.21.15.150:0/3705393251 conn(0x7efdf00c92f0 msgr2=0x7efdf00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 -- 172.21.15.150:0/3705393251 shutdown_connections 2022-08-10T17:44:47.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.856+0000 7efdf7982700 1 -- 172.21.15.150:0/3705393251 wait complete. 2022-08-10T17:44:47.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.857+0000 7efdf7982700 1 Processor -- start 2022-08-10T17:44:47.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.857+0000 7efdf7982700 1 -- start start 2022-08-10T17:44:47.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efdf006c860 0x7efdf00bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 0x7efdf01e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf015a570 0x7efdf0146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00bfd70 con 0x7efdf015a570 2022-08-10T17:44:47.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0159bc0 con 0x7efdf006c860 2022-08-10T17:44:47.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf7982700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0159690 con 0x7efdf0150af0 2022-08-10T17:44:47.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf571e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efdf006c860 0x7efdf00bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 0x7efdf01e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf5f1f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf015a570 0x7efdf0146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 0x7efdf01e9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53228/0 (socket says 172.21.15.150:53228) 2022-08-10T17:44:47.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf571e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efdf006c860 0x7efdf00bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:49596/0 (socket says 172.21.15.150:49596) 2022-08-10T17:44:47.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 -- 172.21.15.150:0/2654964209 learned_addr learned my addr 172.21.15.150:0/2654964209 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:47.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efdf006c860 msgr2=0x7efdf00bf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efdf006c860 0x7efdf00bf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf015a570 msgr2=0x7efdf0146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf015a570 0x7efdf0146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009a70 con 0x7efdf0150af0 2022-08-10T17:44:47.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf015a570 0x7efdf0146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:44:47.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.858+0000 7efdf4f1d700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 0x7efdf01e9880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efde000e820 tx=0x7efde000eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.859+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0009580 con 0x7efdf0150af0 2022-08-10T17:44:47.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.859+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0013680 con 0x7efdf0150af0 2022-08-10T17:44:47.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.859+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00139f0 con 0x7efdf0150af0 2022-08-10T17:44:47.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.859+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf00bdee0 con 0x7efdf0150af0 2022-08-10T17:44:47.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.859+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf01598e0 con 0x7efdf0150af0 2022-08-10T17:44:47.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.860+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efde0023070 con 0x7efdf0150af0 2022-08-10T17:44:47.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.861+0000 7efdddffb700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efdd00650b0 0x7efdd0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.861+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efde0082460 con 0x7efdf0150af0 2022-08-10T17:44:47.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.861+0000 7efdf571e700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efdd00650b0 0x7efdd0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.861+0000 7efdf7982700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 0x7efdf00bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.861+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0159d00 con 0x7efdf00bd340 2022-08-10T17:44:47.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.862+0000 7efdf571e700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efdd00650b0 0x7efdd0067560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdec0011e0 tx=0x7efdec007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.863+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 0x7efdf00bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.863+0000 7efdf5f1f700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdf006e4e0 con 0x7efdf00bd340 2022-08-10T17:44:47.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.863+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 0x7efdf00bd8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde8004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80127e0 con 0x7efdf00bd340 2022-08-10T17:44:47.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7efde8012940 con 0x7efdf00bd340 2022-08-10T17:44:47.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 msgr2=0x7efdf00bd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 0x7efdf00bd8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde8004950 comp rx=0 tx=0).stop 2022-08-10T17:44:47.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 msgr2=0x7efdf00bd8f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.864+0000 7efdddffb700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf00bd340 0x7efdf00bd8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.877+0000 7efdf7982700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 0x7efdf01ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.877+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00bd710 con 0x7efdf01eede0 2022-08-10T17:44:47.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.877+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 0x7efdf01ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.878+0000 7efdf5f1f700 1 -- 172.21.15.150:0/2654964209 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efdf006e290 con 0x7efdf01eede0 2022-08-10T17:44:47.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.878+0000 7efdf5f1f700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 0x7efdf01ef1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efde800b370 tx=0x7efde8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:47.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.878+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde802c070 con 0x7efdf01eede0 2022-08-10T17:44:47.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.881+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4376 (secure 0 0 0) 0x7efde801bbf0 con 0x7efdf01eede0 2022-08-10T17:44:47.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.881+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 msgr2=0x7efdf01ef1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.881+0000 7efdddffb700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 0x7efdf01ef1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efde800b370 tx=0x7efde8012000 comp rx=0 tx=0).stop 2022-08-10T17:44:47.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.881+0000 7efdddffb700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 msgr2=0x7efdf01ef1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:47.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.881+0000 7efdddffb700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf01eede0 0x7efdf01ef1e0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efde800b370 tx=0x7efde8012000 comp rx=0 tx=0).stop 2022-08-10T17:44:47.886 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:47.886 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:47.886 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:47.887 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:47.887 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:47.887 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:47.887 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:47.887 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:47.888 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:47.888 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.888 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:44:47.888 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.889 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:47.889 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:47.889 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.889 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.890 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.890 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.890 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.890 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.890 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.891 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.891 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.891 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.891 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:47.892 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:47.892 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.892 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.892 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.892 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.893 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.893 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.893 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.893 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.893 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.894 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.894 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:47.894 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:47.895 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:47.895 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:47.895 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:47.895 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:47.895 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.896 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:47.896 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:47.896 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:47.896 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:47.897 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:47.897 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:47.897 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:47.897 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:47.897 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:47.898 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:47.898 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:47.898 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:47.898 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:47.899 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:47.899 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:47.899 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:47.899 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:47.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.901 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:47.901 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:47.901 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.901 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.902 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.902 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:47.902 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.903 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.903 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:47.903 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.904 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.904 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.904 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.905 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:47.905 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.905 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.905 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:47.906 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.907 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.908 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.910 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:47.911 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:47.912 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:47.913 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:47.915 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:47.916 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.917 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:47.918 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:47.919 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:47.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:47.920 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:47.920 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.882+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efdd00650b0 msgr2=0x7efdd0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.882+0000 7efdf7982700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efdd00650b0 0x7efdd0067560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdec0011e0 tx=0x7efdec007c40 comp rx=0 tx=0).stop 2022-08-10T17:44:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.882+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 msgr2=0x7efdf01e9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:47.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.882+0000 7efdf7982700 1 --2- 172.21.15.150:0/2654964209 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efdf0150af0 0x7efdf01e9880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efde000e820 tx=0x7efde000eb30 comp rx=0 tx=0).stop 2022-08-10T17:44:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.884+0000 7efdf5f1f700 1 -- 172.21.15.150:0/2654964209 reap_dead start 2022-08-10T17:44:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.884+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 shutdown_connections 2022-08-10T17:44:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.884+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 >> 172.21.15.150:0/2654964209 conn(0x7efdf00c92f0 msgr2=0x7efdf014e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.888+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 shutdown_connections 2022-08-10T17:44:47.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:47.888+0000 7efdf7982700 1 -- 172.21.15.150:0/2654964209 wait complete. 2022-08-10T17:44:47.924 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:44:47.924 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:44:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.081+0000 7fd690f16700 1 Processor -- start 2022-08-10T17:44:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.081+0000 7fd690f16700 1 -- start start 2022-08-10T17:44:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd690f16700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 0x7fd68c0c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd690f16700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd68c0c4410 0x7fd68c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd690f16700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c0c39a0 con 0x7fd68c06d480 2022-08-10T17:44:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd690f16700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0c4dd0 con 0x7fd68c0c4410 2022-08-10T17:44:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd690f16700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0b0ff0 con 0x7fd68c06d850 2022-08-10T17:44:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd68a59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd68c06d480 0x7fd68c0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51696/0 (socket says 172.21.15.150:51696) 2022-08-10T17:44:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd68a59c700 1 -- 172.21.15.150:0/2017314559 learned_addr learned my addr 172.21.15.150:0/2017314559 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd683fff700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 0x7fd68c0c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd68ad9d700 1 --2- 172.21.15.150:0/2017314559 >> v2:172.21.15.197:3300/0 conn(0x7fd68c0c4410 0x7fd68c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd689d9b700 1 -- 172.21.15.150:0/2017314559 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608398027 0 0) 0x7fd68c0c39a0 con 0x7fd68c06d480 2022-08-10T17:44:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.082+0000 7fd689d9b700 1 -- 172.21.15.150:0/2017314559 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c003430 con 0x7fd68c06d480 2022-08-10T17:44:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd68ad9d700 1 -- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 msgr2=0x7fd68c0c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd68ad9d700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 0x7fd68c0c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd68ad9d700 1 -- 172.21.15.150:0/2017314559 >> v1:172.21.15.150:6789/0 conn(0x7fd68c06d480 legacy=0x7fd68c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd68ad9d700 1 -- 172.21.15.150:0/2017314559 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c06e120 con 0x7fd68c0c4410 2022-08-10T17:44:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd683fff700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 0x7fd68c0c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:44:48.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd68ad9d700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c0c4410 0x7fd68c0c4890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd684009d90 tx=0x7fd68400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4bd3ae713e3c10 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd689d9b700 1 -- 172.21.15.150:0/2017314559 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400e070 con 0x7fd68c0c4410 2022-08-10T17:44:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd689d9b700 1 -- 172.21.15.150:0/2017314559 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400bb20 con 0x7fd68c0c4410 2022-08-10T17:44:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd689d9b700 1 -- 172.21.15.150:0/2017314559 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684012430 con 0x7fd68c0c4410 2022-08-10T17:44:48.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd690f16700 1 -- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c0c4410 msgr2=0x7fd68c0c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd690f16700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c0c4410 0x7fd68c0c4890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd684009d90 tx=0x7fd68400b330 comp rx=0 tx=0).stop 2022-08-10T17:44:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd690f16700 1 -- 172.21.15.150:0/2017314559 shutdown_connections 2022-08-10T17:44:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd690f16700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c0c4410 0x7fd68c0c4890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.083+0000 7fd690f16700 1 --2- 172.21.15.150:0/2017314559 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c06d850 0x7fd68c0c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.084+0000 7fd690f16700 1 -- 172.21.15.150:0/2017314559 >> 172.21.15.150:0/2017314559 conn(0x7fd68c06b3b0 msgr2=0x7fd68c06fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.084+0000 7fd690f16700 1 -- 172.21.15.150:0/2017314559 shutdown_connections 2022-08-10T17:44:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.084+0000 7fd690f16700 1 -- 172.21.15.150:0/2017314559 wait complete. 2022-08-10T17:44:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 Processor -- start 2022-08-10T17:44:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 -- start start 2022-08-10T17:44:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c06d850 0x7fd68c0c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c0c4410 0x7fd68c149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c156600 con 0x7fd68c06d480 2022-08-10T17:44:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0c6d10 con 0x7fd68c06d850 2022-08-10T17:44:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd690f16700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0694a0 con 0x7fd68c0c4410 2022-08-10T17:44:48.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.085+0000 7fd68a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39022/0 (socket says 172.21.15.150:39022) 2022-08-10T17:44:48.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 -- 172.21.15.150:0/1692849408 learned_addr learned my addr 172.21.15.150:0/1692849408 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:48.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd683fff700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c06d850 0x7fd68c0c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68ad9d700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c0c4410 0x7fd68c149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 -- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c0c4410 msgr2=0x7fd68c149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c0c4410 0x7fd68c149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 -- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c06d850 msgr2=0x7fd68c0c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c06d850 0x7fd68c0c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 -- 172.21.15.150:0/1692849408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674009310 con 0x7fd68c06d480 2022-08-10T17:44:48.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd68a59c700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c460 tx=0x7fd67c00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:48.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0072d0 con 0x7fd68c06d480 2022-08-10T17:44:48.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c007450 con 0x7fd68c06d480 2022-08-10T17:44:48.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd684009a70 con 0x7fd68c06d480 2022-08-10T17:44:48.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0057c0 con 0x7fd68c06d480 2022-08-10T17:44:48.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.086+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c069e70 con 0x7fd68c06d480 2022-08-10T17:44:48.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.088+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c072890 con 0x7fd68c06d480 2022-08-10T17:44:48.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.088+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd67c019030 con 0x7fd68c06d480 2022-08-10T17:44:48.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.088+0000 7fd682ffd700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 0x7fd670067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:48.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.088+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd67c081440 con 0x7fd68c06d480 2022-08-10T17:44:48.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.088+0000 7fd683fff700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 0x7fd670067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:48.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.089+0000 7fd683fff700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 0x7fd670067560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd68c156b60 tx=0x7fd6740090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:48.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.094+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd67c04f3a0 con 0x7fd68c06d480 2022-08-10T17:44:48.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.455+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fd68c06b780 con 0x7fd68c06d480 2022-08-10T17:44:48.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.456+0000 7fd682ffd700 1 -- 172.21.15.150:0/1692849408 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fd67c017020 con 0x7fd68c06d480 2022-08-10T17:44:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.458+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 msgr2=0x7fd670067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.458+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 0x7fd670067560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd68c156b60 tx=0x7fd6740090e0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.458+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 msgr2=0x7fd68c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:48.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.458+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c460 tx=0x7fd67c00c770 comp rx=0 tx=0).stop 2022-08-10T17:44:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 shutdown_connections 2022-08-10T17:44:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6700650b0 0x7fd670067560 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd68c0c4410 0x7fd68c149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68c06d480 0x7fd68c069930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 --2- 172.21.15.150:0/1692849408 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd68c06d850 0x7fd68c0c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 >> 172.21.15.150:0/1692849408 conn(0x7fd68c06b3b0 msgr2=0x7fd68c14c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 shutdown_connections 2022-08-10T17:44:48.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:48.459+0000 7fd690f16700 1 -- 172.21.15.150:0/1692849408 wait complete. 2022-08-10T17:44:48.477 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:44:58.478 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:44:58.479 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:44:58.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.776+0000 7f0a1cc20700 1 Processor -- start 2022-08-10T17:44:58.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.776+0000 7f0a1cc20700 1 -- start start 2022-08-10T17:44:58.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a1cc20700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a18150f50 0x7f0a18156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a1cc20700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a180c7d80 0x7f0a18157200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a1cc20700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a18070620 con 0x7f0a18150b80 2022-08-10T17:44:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a1cc20700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a180c5ac0 con 0x7f0a18150f50 2022-08-10T17:44:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a1cc20700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1815a860 con 0x7f0a180c7d80 2022-08-10T17:44:58.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.777+0000 7f0a15d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a18150f50 0x7f0a18156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a18150f50 0x7f0a18156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39076/0 (socket says 172.21.15.150:39076) 2022-08-10T17:44:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 -- 172.21.15.150:0/1013243394 learned_addr learned my addr 172.21.15.150:0/1013243394 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a16d9d700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a180c7d80 0x7f0a18157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 -- 172.21.15.150:0/1013243394 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a180c7d80 msgr2=0x7f0a18157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a180c7d80 0x7f0a18157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 -- 172.21.15.150:0/1013243394 >> v1:172.21.15.197:6789/0 conn(0x7f0a18150b80 legacy=0x7f0a180c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 -- 172.21.15.150:0/1013243394 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180ca810 con 0x7f0a18150f50 2022-08-10T17:44:58.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a1559a700 1 -- 172.21.15.150:0/1013243394 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447817344 0 0) 0x7f0a18070620 con 0x7f0a18150b80 2022-08-10T17:44:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a15d9b700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a18150f50 0x7f0a18156cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006fd0 tx=0x7f0a0c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d563d22dc71cf3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a1559a700 1 -- 172.21.15.150:0/1013243394 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004230 con 0x7f0a18150f50 2022-08-10T17:44:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a1559a700 1 -- 172.21.15.150:0/1013243394 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c004390 con 0x7f0a18150f50 2022-08-10T17:44:58.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.778+0000 7f0a1559a700 1 -- 172.21.15.150:0/1013243394 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011830 con 0x7f0a18150f50 2022-08-10T17:44:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 -- 172.21.15.150:0/1013243394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a18150f50 msgr2=0x7f0a18156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a18150f50 0x7f0a18156cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006fd0 tx=0x7f0a0c009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 -- 172.21.15.150:0/1013243394 shutdown_connections 2022-08-10T17:44:58.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a180c7d80 0x7f0a18157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/1013243394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a18150f50 0x7f0a18156cc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 -- 172.21.15.150:0/1013243394 >> 172.21.15.150:0/1013243394 conn(0x7f0a18071e40 msgr2=0x7f0a1806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 -- 172.21.15.150:0/1013243394 shutdown_connections 2022-08-10T17:44:58.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.779+0000 7f0a1cc20700 1 -- 172.21.15.150:0/1013243394 wait complete. 2022-08-10T17:44:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 Processor -- start 2022-08-10T17:44:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 -- start start 2022-08-10T17:44:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a18150b80 0x7f0a1814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a18150f50 0x7f0a180c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.781+0000 7f0a1cc20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c1b60 con 0x7f0a180c7d80 2022-08-10T17:44:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1cc20700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18159510 con 0x7f0a18150b80 2022-08-10T17:44:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1cc20700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1814f2c0 con 0x7f0a18150f50 2022-08-10T17:44:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39080/0 (socket says 172.21.15.150:39080) 2022-08-10T17:44:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 -- 172.21.15.150:0/826590289 learned_addr learned my addr 172.21.15.150:0/826590289 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a15d9b700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a18150b80 0x7f0a1814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a16d9d700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a18150f50 0x7f0a180c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 -- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a18150f50 msgr2=0x7f0a180c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a18150f50 0x7f0a180c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 -- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a18150b80 msgr2=0x7f0a1814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a18150b80 0x7f0a1814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 -- 172.21.15.150:0/826590289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0093e0 con 0x7f0a180c7d80 2022-08-10T17:44:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1659c700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c400 tx=0x7f0a0800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080052d0 con 0x7f0a180c7d80 2022-08-10T17:44:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08003500 con 0x7f0a180c7d80 2022-08-10T17:44:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1814f560 con 0x7f0a180c7d80 2022-08-10T17:44:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080038b0 con 0x7f0a180c7d80 2022-08-10T17:44:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.782+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1814fb20 con 0x7f0a180c7d80 2022-08-10T17:44:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.783+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a18072890 con 0x7f0a180c7d80 2022-08-10T17:44:58.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.784+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0a08019030 con 0x7f0a180c7d80 2022-08-10T17:44:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.784+0000 7f0a06ffd700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 0x7f09f4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.784+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0a08081410 con 0x7f0a180c7d80 2022-08-10T17:44:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.784+0000 7f0a15d9b700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 0x7f09f4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:58.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.785+0000 7f0a15d9b700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 0x7f09f4067590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a180c41a0 tx=0x7f0a0c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:58.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:58.788+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0a0804f3f0 con 0x7f0a180c7d80 2022-08-10T17:44:59.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.184+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0a1815a240 con 0x7f0a180c7d80 2022-08-10T17:44:59.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.184+0000 7f0a06ffd700 1 -- 172.21.15.150:0/826590289 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f0a08017020 con 0x7f0a180c7d80 2022-08-10T17:44:59.189 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:44:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 msgr2=0x7f09f4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 0x7f09f4067590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a180c41a0 tx=0x7f0a0c008030 comp rx=0 tx=0).stop 2022-08-10T17:44:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 msgr2=0x7f0a18158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c400 tx=0x7f0a0800c710 comp rx=0 tx=0).stop 2022-08-10T17:44:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 shutdown_connections 2022-08-10T17:44:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09f40650e0 0x7f09f4067590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a18150f50 0x7f0a180c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a180c7d80 0x7f0a18158ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 --2- 172.21.15.150:0/826590289 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a18150b80 0x7f0a1814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 >> 172.21.15.150:0/826590289 conn(0x7f0a18071e40 msgr2=0x7f0a18068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 shutdown_connections 2022-08-10T17:44:59.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.187+0000 7f0a1cc20700 1 -- 172.21.15.150:0/826590289 wait complete. 2022-08-10T17:44:59.204 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:44:59.204 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:44:59.205 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:44:59.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.344+0000 7f0a7c653700 1 Processor -- start 2022-08-10T17:44:59.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.344+0000 7f0a7c653700 1 -- start start 2022-08-10T17:44:59.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7c653700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0a74158700 0x7f0a740699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7c653700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a74156c30 con 0x7f0a741564d0 2022-08-10T17:44:59.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7c653700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a74156f10 con 0x7f0a74068110 2022-08-10T17:44:59.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7c653700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a741578b0 con 0x7f0a74158700 2022-08-10T17:44:59.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7a3ef700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0a741564d0 0x7f0a7406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51768/0 (socket says 172.21.15.150:51768) 2022-08-10T17:44:59.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.345+0000 7f0a7a3ef700 1 -- 172.21.15.150:0/4081134433 learned_addr learned my addr 172.21.15.150:0/4081134433 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:59.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a7abf0700 1 --2- 172.21.15.150:0/4081134433 >> v2:172.21.15.197:3300/0 conn(0x7f0a74158700 0x7f0a740699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656796673 0 0) 0x7f0a74156c30 con 0x7f0a741564d0 2022-08-10T17:44:59.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c003430 con 0x7f0a741564d0 2022-08-10T17:44:59.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577493093 0 0) 0x7f0a74156f10 con 0x7f0a74068110 2022-08-10T17:44:59.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a74156c30 con 0x7f0a74068110 2022-08-10T17:44:59.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a7abf0700 1 -- 172.21.15.150:0/4081134433 >> v1:172.21.15.197:6789/0 conn(0x7f0a74068110 legacy=0x7f0a74157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a7abf0700 1 -- 172.21.15.150:0/4081134433 >> v1:172.21.15.150:6789/0 conn(0x7f0a741564d0 legacy=0x7f0a7406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a7abf0700 1 -- 172.21.15.150:0/4081134433 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a741571f0 con 0x7f0a74158700 2022-08-10T17:44:59.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a7abf0700 1 --2- 172.21.15.150:0/4081134433 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74158700 0x7f0a740699b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009d90 tx=0x7f0a6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e4b7f93643fa2b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e070 con 0x7f0a74158700 2022-08-10T17:44:59.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00bb20 con 0x7f0a74158700 2022-08-10T17:44:59.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.346+0000 7f0a793ed700 1 -- 172.21.15.150:0/4081134433 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c012430 con 0x7f0a74158700 2022-08-10T17:44:59.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 -- 172.21.15.150:0/4081134433 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74158700 msgr2=0x7f0a740699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 --2- 172.21.15.150:0/4081134433 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74158700 0x7f0a740699b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009d90 tx=0x7f0a6c00b330 comp rx=0 tx=0).stop 2022-08-10T17:44:59.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 -- 172.21.15.150:0/4081134433 shutdown_connections 2022-08-10T17:44:59.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 --2- 172.21.15.150:0/4081134433 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74158700 0x7f0a740699b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 -- 172.21.15.150:0/4081134433 >> 172.21.15.150:0/4081134433 conn(0x7f0a7406b3b0 msgr2=0x7f0a7406fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 -- 172.21.15.150:0/4081134433 shutdown_connections 2022-08-10T17:44:59.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.347+0000 7f0a7c653700 1 -- 172.21.15.150:0/4081134433 wait complete. 2022-08-10T17:44:59.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.348+0000 7f0a7c653700 1 Processor -- start 2022-08-10T17:44:59.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.348+0000 7f0a7c653700 1 -- start start 2022-08-10T17:44:59.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a741564d0 0x7f0a7414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a74158700 0x7f0a741ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7414a1e0 con 0x7f0a74158700 2022-08-10T17:44:59.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7414ca80 con 0x7f0a74068110 2022-08-10T17:44:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7c653700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741efdd0 con 0x7f0a741564d0 2022-08-10T17:44:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7abf0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a74158700 0x7f0a741ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7abf0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a74158700 0x7f0a741ef380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39098/0 (socket says 172.21.15.150:39098) 2022-08-10T17:44:59.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:49686/0 (socket says 172.21.15.150:49686) 2022-08-10T17:44:59.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7abf0700 1 -- 172.21.15.150:0/1887577984 learned_addr learned my addr 172.21.15.150:0/1887577984 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:59.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a79bee700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a741564d0 0x7f0a7414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a741564d0 msgr2=0x7f0a7414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0a741564d0 0x7f0a7414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a74158700 msgr2=0x7f0a741ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a74158700 0x7f0a741ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.349+0000 7f0a7a3ef700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009a70 con 0x7f0a74068110 2022-08-10T17:44:59.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a7a3ef700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c3c0 tx=0x7f0a70001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700072d0 con 0x7f0a74068110 2022-08-10T17:44:59.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70007430 con 0x7f0a74068110 2022-08-10T17:44:59.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7414cd00 con 0x7f0a74068110 2022-08-10T17:44:59.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70005760 con 0x7f0a74068110 2022-08-10T17:44:59.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.350+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7414d2c0 con 0x7f0a74068110 2022-08-10T17:44:59.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a7c653700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 0x7f0a74149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740673d0 con 0x7f0a741ef8c0 2022-08-10T17:44:59.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a79bee700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 0x7f0a74149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a79bee700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a74072890 con 0x7f0a741ef8c0 2022-08-10T17:44:59.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a79bee700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 0x7f0a74149290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a741581c0 tx=0x7f0a6400f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.351+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400fe80 con 0x7f0a741ef8c0 2022-08-10T17:44:59.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f0a640052e0 con 0x7f0a741ef8c0 2022-08-10T17:44:59.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 msgr2=0x7f0a74149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 0x7f0a74149290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a741581c0 tx=0x7f0a6400f800 comp rx=0 tx=0).stop 2022-08-10T17:44:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 msgr2=0x7f0a74149290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741ef8c0 0x7f0a74149290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0a70019030 con 0x7f0a74068110 2022-08-10T17:44:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0a54064d90 0x7f0a54067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0a70081260 con 0x7f0a74068110 2022-08-10T17:44:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.352+0000 7f0a79bee700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0a54064d90 0x7f0a54067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.353+0000 7f0a79bee700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0a54064d90 0x7f0a54067240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007000 tx=0x7f0a64005000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.358+0000 7f0a7c653700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 0x7f0a741ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.358+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741574d0 con 0x7f0a741497d0 2022-08-10T17:44:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a7abf0700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 0x7f0a741ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a7abf0700 1 -- 172.21.15.150:0/1887577984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0a7406ddb0 con 0x7f0a741497d0 2022-08-10T17:44:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a7abf0700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 0x7f0a741ebc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b370 tx=0x7f0a6c0049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0098f0 con 0x7f0a741497d0 2022-08-10T17:44:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7f0a6c01c400 con 0x7f0a741497d0 2022-08-10T17:44:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 msgr2=0x7f0a741ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 0x7f0a741ebc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b370 tx=0x7f0a6c0049c0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 msgr2=0x7f0a741ebc60 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.359+0000 7f0a62ffd700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a741497d0 0x7f0a741ebc60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.378 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:59.378 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:59.378 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:59.378 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:44:59.379 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:59.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:59.379 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:59.379 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:59.380 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:59.380 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.380 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:44:59.380 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.381 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:59.381 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:59.381 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.381 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.382 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.382 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.382 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.382 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.383 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.383 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.383 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.383 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.384 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:59.384 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:59.384 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.384 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.384 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.385 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.385 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.385 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.385 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.386 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.386 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.386 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.387 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:59.387 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:59.387 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:59.387 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:59.388 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:59.388 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:59.388 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.388 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.389 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:59.389 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:59.389 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:59.389 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:59.389 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:59.390 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:59.390 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.390 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:59.390 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.391 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.391 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.391 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.391 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.392 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.392 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.392 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.392 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.393 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.393 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:59.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.393 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:59.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.394 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:59.394 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:59.394 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.395 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.395 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.395 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:59.395 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.396 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.396 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:59.397 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.397 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.397 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.398 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.398 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.398 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.398 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.399 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.400 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:59.400 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:59.400 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.400 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.401 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.401 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:59.401 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.402 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.403 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:59.403 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.403 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.403 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.404 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.404 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.404 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.405 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.405 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.406 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:59.406 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:59.406 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.406 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.407 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.407 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:59.408 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.408 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.409 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.410 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.410 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.411 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.411 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.411 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.411 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.412 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.412 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:59.413 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:59.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.413 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.413 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.414 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.414 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.414 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.416 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.417 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:59.417 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:59.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0a54064d90 msgr2=0x7f0a54067240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0a54064d90 0x7f0a54067240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007000 tx=0x7f0a64005000 comp rx=0 tx=0).stop 2022-08-10T17:44:59.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 msgr2=0x7f0a7414b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c3c0 tx=0x7f0a70001e70 comp rx=0 tx=0).stop 2022-08-10T17:44:59.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7abf0700 1 -- 172.21.15.150:0/1887577984 reap_dead start 2022-08-10T17:44:59.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 shutdown_connections 2022-08-10T17:44:59.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 --2- 172.21.15.150:0/1887577984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0a74068110 0x7f0a7414b3e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 >> 172.21.15.150:0/1887577984 conn(0x7f0a7406b3b0 msgr2=0x7f0a74155640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 shutdown_connections 2022-08-10T17:44:59.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.360+0000 7f0a7c653700 1 -- 172.21.15.150:0/1887577984 wait complete. 2022-08-10T17:44:59.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:44:59.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.566+0000 7f549fc0b700 1 Processor -- start 2022-08-10T17:44:59.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 -- start start 2022-08-10T17:44:59.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5498070240 0x7f54980c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5498157060 0x7f5498157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54980c3020 con 0x7f54980cd540 2022-08-10T17:44:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5498156930 con 0x7f5498157060 2022-08-10T17:44:59.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.567+0000 7f549fc0b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5498156bd0 con 0x7f5498070240 2022-08-10T17:44:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5498157060 0x7f5498157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549e1a8700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f54980cd540 0x7f54980691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51794/0 (socket says 172.21.15.150:51794) 2022-08-10T17:44:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549e1a8700 1 -- 172.21.15.150:0/3565711265 learned_addr learned my addr 172.21.15.150:0/3565711265 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:44:59.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d9a7700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5498070240 0x7f54980c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 -- 172.21.15.150:0/3565711265 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5498070240 msgr2=0x7f54980c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:59.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5498070240 0x7f54980c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 -- 172.21.15.150:0/3565711265 >> v1:172.21.15.150:6789/0 conn(0x7f54980cd540 legacy=0x7f54980691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 -- 172.21.15.150:0/3565711265 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549806f770 con 0x7f5498157060 2022-08-10T17:44:59.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549d1a6700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498157060 0x7f5498157490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54880096b0 tx=0x7f54880099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bd726c24541609 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549c9a5700 1 -- 172.21.15.150:0/3565711265 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488011830 con 0x7f5498157060 2022-08-10T17:44:59.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549c9a5700 1 -- 172.21.15.150:0/3565711265 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488011990 con 0x7f5498157060 2022-08-10T17:44:59.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.568+0000 7f549c9a5700 1 -- 172.21.15.150:0/3565711265 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488011d40 con 0x7f5498157060 2022-08-10T17:44:59.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 -- 172.21.15.150:0/3565711265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498157060 msgr2=0x7f5498157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498157060 0x7f5498157490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54880096b0 tx=0x7f54880099c0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 -- 172.21.15.150:0/3565711265 shutdown_connections 2022-08-10T17:44:59.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5498070240 0x7f54980c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 --2- 172.21.15.150:0/3565711265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498157060 0x7f5498157490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 -- 172.21.15.150:0/3565711265 >> 172.21.15.150:0/3565711265 conn(0x7f5498071e40 msgr2=0x7f54980cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 -- 172.21.15.150:0/3565711265 shutdown_connections 2022-08-10T17:44:59.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.569+0000 7f549fc0b700 1 -- 172.21.15.150:0/3565711265 wait complete. 2022-08-10T17:44:59.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.570+0000 7f549fc0b700 1 Processor -- start 2022-08-10T17:44:59.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.570+0000 7f549fc0b700 1 -- start start 2022-08-10T17:44:59.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 0x7f54981ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f54980cd540 0x7f5498151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5498157060 0x7f549814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981ec280 con 0x7f5498070240 2022-08-10T17:44:59.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981526d0 con 0x7f5498157060 2022-08-10T17:44:59.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5498152ee0 con 0x7f54980cd540 2022-08-10T17:44:59.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 0x7f54981ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 0x7f54981ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39116/0 (socket says 172.21.15.150:39116) 2022-08-10T17:44:59.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 -- 172.21.15.150:0/1955723402 learned_addr learned my addr 172.21.15.150:0/1955723402 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:59.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d1a6700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f54980cd540 0x7f5498151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549e1a8700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5498157060 0x7f549814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f54980cd540 msgr2=0x7f5498151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f54980cd540 0x7f5498151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5498157060 msgr2=0x7f549814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5498157060 0x7f549814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009310 con 0x7f5498070240 2022-08-10T17:44:59.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549e1a8700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5498157060 0x7f549814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:44:59.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549d9a7700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 0x7f54981ecc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f549400d800 tx=0x7f549400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494012630 con 0x7f5498070240 2022-08-10T17:44:59.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5494012790 con 0x7f5498070240 2022-08-10T17:44:59.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494012b40 con 0x7f5498070240 2022-08-10T17:44:59.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54981ed1d0 con 0x7f5498070240 2022-08-10T17:44:59.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.571+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498152c00 con 0x7f5498070240 2022-08-10T17:44:59.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.572+0000 7f549fc0b700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 0x7f549814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.572+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980673d0 con 0x7f54981ec3f0 2022-08-10T17:44:59.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f549d1a6700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 0x7f549814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f549401b030 con 0x7f5498070240 2022-08-10T17:44:59.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f549d1a6700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54981ecae0 con 0x7f54981ec3f0 2022-08-10T17:44:59.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f549d1a6700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 0x7f549814c6a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f549806f4b0 tx=0x7f5488004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54780650b0 0x7f5478067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5494081aa0 con 0x7f5498070240 2022-08-10T17:44:59.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f549e1a8700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54780650b0 0x7f5478067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548801f040 con 0x7f54981ec3f0 2022-08-10T17:44:59.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f54880117f0 con 0x7f54981ec3f0 2022-08-10T17:44:59.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 msgr2=0x7f549814c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 0x7f549814c6a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f549806f4b0 tx=0x7f5488004640 comp rx=0 tx=0).stop 2022-08-10T17:44:59.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 msgr2=0x7f549814c6a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.573+0000 7f54867fc700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54981ec3f0 0x7f549814c6a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.574+0000 7f549e1a8700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54780650b0 0x7f5478067560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5490005b10 tx=0x7f5490009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.580+0000 7f549fc0b700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 0x7f54981ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.580+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549808a2a0 con 0x7f54980c5380 2022-08-10T17:44:59.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.581+0000 7f549d1a6700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 0x7f54981ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.581+0000 7f549d1a6700 1 -- 172.21.15.150:0/1955723402 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5498072890 con 0x7f54980c5380 2022-08-10T17:44:59.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.581+0000 7f549d1a6700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 0x7f54981ef7c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5488009a00 tx=0x7f5488011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.581+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488034410 con 0x7f54980c5380 2022-08-10T17:44:59.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f5488034570 con 0x7f54980c5380 2022-08-10T17:44:59.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 msgr2=0x7f54981ef7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f54867fc700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 0x7f54981ef7c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5488009a00 tx=0x7f5488011000 comp rx=0 tx=0).stop 2022-08-10T17:44:59.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f54867fc700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 msgr2=0x7f54981ef7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f54867fc700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f54980c5380 0x7f54981ef7c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.598 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:59.599 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:59.599 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:59.599 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:59.599 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:59.599 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:59.600 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:59.600 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:59.600 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:59.600 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.601 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:44:59.601 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.601 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:59.601 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:59.602 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.602 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.602 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.602 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.603 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.603 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.603 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.603 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.603 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.604 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.604 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:59.604 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:59.604 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.605 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.605 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.605 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.605 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.606 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.606 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.606 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.606 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.606 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.607 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:59.607 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:59.607 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:59.608 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:59.608 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:59.608 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:59.608 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.609 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.609 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:59.609 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:59.609 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:59.609 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:59.610 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:59.610 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:59.610 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.610 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.612 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.612 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.612 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.612 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.613 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.613 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:59.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.613 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:59.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.614 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:59.614 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:59.614 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.614 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.615 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.615 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:59.615 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.616 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.616 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:59.616 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.617 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.617 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.617 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.618 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.618 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.618 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.618 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.619 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:59.619 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:59.619 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.620 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.620 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.620 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:59.621 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.621 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.621 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:59.622 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.622 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.623 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.623 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.623 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.623 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.624 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.624 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.625 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.626 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:59.626 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.627 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.627 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:59.627 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.627 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.629 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.630 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:59.630 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:59.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.630 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.631 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.631 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.631 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.631 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.632 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:44:59.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.632 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.632 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.632 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:44:59.633 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.633 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.633 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:44:59.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.634 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.634 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.634 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:44:59.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:44:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.636 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.636 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.637 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.637 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:44:59.637 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.637 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.638 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:44:59.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.643 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.644 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.644 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:44:59.644 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.644 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.645 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:59.645 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:59.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54780650b0 msgr2=0x7f5478067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54780650b0 0x7f5478067560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5490005b10 tx=0x7f5490009040 comp rx=0 tx=0).stop 2022-08-10T17:44:59.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 msgr2=0x7f54981ecc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 --2- 172.21.15.150:0/1955723402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5498070240 0x7f54981ecc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f549400d800 tx=0x7f549400db10 comp rx=0 tx=0).stop 2022-08-10T17:44:59.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549e1a8700 1 -- 172.21.15.150:0/1955723402 reap_dead start 2022-08-10T17:44:59.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549e1a8700 1 -- 172.21.15.150:0/1955723402 reap_dead start 2022-08-10T17:44:59.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 shutdown_connections 2022-08-10T17:44:59.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 >> 172.21.15.150:0/1955723402 conn(0x7f5498071e40 msgr2=0x7f5498154540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 shutdown_connections 2022-08-10T17:44:59.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.582+0000 7f549fc0b700 1 -- 172.21.15.150:0/1955723402 wait complete. 2022-08-10T17:44:59.650 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:44:59.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.797+0000 7f3fcdbcb700 1 Processor -- start 2022-08-10T17:44:59.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 -- start start 2022-08-10T17:44:59.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc8159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fc806c860 0x7f3fc815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3fc80647d0 0x7f3fc80c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc80c4dc0 con 0x7f3fc806c860 2022-08-10T17:44:59.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc80c5940 con 0x7f3fc80647d0 2022-08-10T17:44:59.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fcdbcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c9fc0 con 0x7f3fc8150af0 2022-08-10T17:44:59.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fc6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fc806c860 0x7f3fc815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.798+0000 7f3fc6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fc806c860 0x7f3fc815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39128/0 (socket says 172.21.15.150:39128) 2022-08-10T17:44:59.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/200230500 learned_addr learned my addr 172.21.15.150:0/200230500 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:59.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc8159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc7fff700 1 --2- 172.21.15.150:0/200230500 >> v2:172.21.15.197:3300/0 conn(0x7f3fc80647d0 0x7f3fc80c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/200230500 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 msgr2=0x7f3fc8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc8159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/200230500 >> v2:172.21.15.197:3300/0 conn(0x7f3fc80647d0 msgr2=0x7f3fc80c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:44:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/200230500 >> v2:172.21.15.197:3300/0 conn(0x7f3fc80647d0 0x7f3fc80c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/200230500 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc806f9a0 con 0x7f3fc806c860 2022-08-10T17:44:59.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc815a3a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80c0350 tx=0x7f3fb0009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7271424109a6276c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc67fc700 1 -- 172.21.15.150:0/200230500 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0004230 con 0x7f3fc806c860 2022-08-10T17:44:59.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc67fc700 1 -- 172.21.15.150:0/200230500 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0004390 con 0x7f3fc806c860 2022-08-10T17:44:59.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.799+0000 7f3fc67fc700 1 -- 172.21.15.150:0/200230500 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011850 con 0x7f3fc806c860 2022-08-10T17:44:59.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/200230500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 msgr2=0x7f3fc815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc815a3a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80c0350 tx=0x7f3fb0009a60 comp rx=0 tx=0).stop 2022-08-10T17:44:59.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/200230500 shutdown_connections 2022-08-10T17:44:59.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/200230500 >> v2:172.21.15.197:3300/0 conn(0x7f3fc80647d0 0x7f3fc80c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc8159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/200230500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc815a3a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/200230500 >> 172.21.15.150:0/200230500 conn(0x7f3fc80c92f0 msgr2=0x7f3fc80c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/200230500 shutdown_connections 2022-08-10T17:44:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.800+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/200230500 wait complete. 2022-08-10T17:44:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.801+0000 7f3fcdbcb700 1 Processor -- start 2022-08-10T17:44:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.801+0000 7f3fcdbcb700 1 -- start start 2022-08-10T17:44:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fc80647d0 0x7f3fc80c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc8146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc81470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81596d0 con 0x7f3fc806c860 2022-08-10T17:44:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81475e0 con 0x7f3fc80647d0 2022-08-10T17:44:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fcdbcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc814c260 con 0x7f3fc8150af0 2022-08-10T17:44:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc8146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc77fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fc80647d0 0x7f3fc80c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc8146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39136/0 (socket says 172.21.15.150:39136) 2022-08-10T17:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc77fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fc80647d0 0x7f3fc80c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:49726/0 (socket says 172.21.15.150:49726) 2022-08-10T17:44:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/2049906205 learned_addr learned my addr 172.21.15.150:0/2049906205 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc7fff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc81470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 msgr2=0x7f3fc81470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc81470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fc80647d0 msgr2=0x7f3fc80c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fc80647d0 0x7f3fc80c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00093e0 con 0x7f3fc806c860 2022-08-10T17:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc7fff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8150af0 0x7f3fc81470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:44:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.802+0000 7f3fc6ffd700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc8146b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0004000 tx=0x7f3fb00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.803+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011c60 con 0x7f3fc806c860 2022-08-10T17:44:59.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.803+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb001f070 con 0x7f3fc806c860 2022-08-10T17:44:59.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.803+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8151cd0 con 0x7f3fc806c860 2022-08-10T17:44:59.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.803+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0003520 con 0x7f3fc806c860 2022-08-10T17:44:59.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.803+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc814bca0 con 0x7f3fc806c860 2022-08-10T17:44:59.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 0x7f3fc8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8071e00 con 0x7f3fc8159af0 2022-08-10T17:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 0x7f3fc8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fc77fe700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fc8159440 con 0x7f3fc8159af0 2022-08-10T17:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3fb002a020 con 0x7f3fc806c860 2022-08-10T17:44:59.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 0x7f3fc8158f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800f3e0 tx=0x7f3fb800f7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fbffff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fac0650b0 0x7f3fac067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3fb00834b0 con 0x7f3fc806c860 2022-08-10T17:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.804+0000 7f3fc7fff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fac0650b0 0x7f3fac067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800e040 con 0x7f3fc8159af0 2022-08-10T17:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3fb800f040 con 0x7f3fc8159af0 2022-08-10T17:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 msgr2=0x7f3fc8158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 0x7f3fc8158f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800f3e0 tx=0x7f3fb800f7a0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 msgr2=0x7f3fc8158f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fbffff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc8159af0 0x7f3fc8158f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.805+0000 7f3fc7fff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fac0650b0 0x7f3fac067560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009d20 tx=0x7f3fc00090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 0x7f3fc81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:44:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8157cf0 con 0x7f3fc80ba5a0 2022-08-10T17:44:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 0x7f3fc81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:44:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fc77fe700 1 -- 172.21.15.150:0/2049906205 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3fc806e290 con 0x7f3fc80ba5a0 2022-08-10T17:44:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fc77fe700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 0x7f3fc81577b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800f3e0 tx=0x7f3fb8004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:44:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb801e860 con 0x7f3fc80ba5a0 2022-08-10T17:44:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f3fb8024040 con 0x7f3fc80ba5a0 2022-08-10T17:44:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 msgr2=0x7f3fc81577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 0x7f3fc81577b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800f3e0 tx=0x7f3fb8004950 comp rx=0 tx=0).stop 2022-08-10T17:44:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 msgr2=0x7f3fc81577b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:44:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.812+0000 7f3fbffff700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fc80ba5a0 0x7f3fc81577b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.831 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:44:59.832 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:59.832 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:59.832 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:44:59.832 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 72, 2022-08-10T17:44:59.833 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:44:59.833 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:44:59.833 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:44:59.833 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:44:59.834 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.834 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 15, 2022-08-10T17:44:59.834 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.834 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:44:59.835 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:44:59.835 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.835 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.835 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.835 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.836 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.836 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.836 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.836 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.837 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.837 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.837 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:44:59.837 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:44:59.838 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.838 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.838 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.838 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.839 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.839 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.839 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.839 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.839 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.840 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.840 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:44:59.840 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:44:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:44:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:44:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:44:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:44:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:44:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:44:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:44:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:44:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:44:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:44:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:44:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:44:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:44:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:44:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:44:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:44:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:44:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:44:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:44:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:44:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:44:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:44:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:44:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:44:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:44:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:44:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:44:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:44:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:44:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:44:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:44:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:44:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:44:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:44:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:44:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:44:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:44:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:44:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:44:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:44:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:44:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:44:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:44:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:44:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:44:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:44:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:44:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:44:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:44:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:44:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:44:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:44:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:44:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:44:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:44:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:44:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:44:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:44:59.867 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:44:59.867 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:44:59.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fac0650b0 msgr2=0x7f3fac067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fac0650b0 0x7f3fac067560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009d20 tx=0x7f3fc00090e0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 msgr2=0x7f3fc8146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:44:59.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 --2- 172.21.15.150:0/2049906205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fc806c860 0x7f3fc8146b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0004000 tx=0x7f3fb00045d0 comp rx=0 tx=0).stop 2022-08-10T17:44:59.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fc7fff700 1 -- 172.21.15.150:0/2049906205 reap_dead start 2022-08-10T17:44:59.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fc7fff700 1 -- 172.21.15.150:0/2049906205 reap_dead start 2022-08-10T17:44:59.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 shutdown_connections 2022-08-10T17:44:59.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 >> 172.21.15.150:0/2049906205 conn(0x7f3fc80c92f0 msgr2=0x7f3fc80c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:44:59.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 shutdown_connections 2022-08-10T17:44:59.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:44:59.813+0000 7f3fcdbcb700 1 -- 172.21.15.150:0/2049906205 wait complete. 2022-08-10T17:44:59.871 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2022-08-10T17:44:59.872 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:44:59.872 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2022-08-10T17:44:59.872 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:44:59.873 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-10T17:44:59.873 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:44:59.892 INFO:tasks.ceph.mon.b:Stopped 2022-08-10T17:44:59.892 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:44:59.893 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.074+0000 7fcd25f73700 1 Processor -- start 2022-08-10T17:45:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.074+0000 7fcd25f73700 1 -- start start 2022-08-10T17:45:00.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd25f73700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 0x7fcd200699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd25f73700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2015ab00 con 0x7fcd20150bd0 2022-08-10T17:45:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd25f73700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2006a050 con 0x7fcd200c6540 2022-08-10T17:45:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd25f73700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20159ef0 con 0x7fcd20150800 2022-08-10T17:45:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1ffff700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7fcd200c6540 legacy=0x7fcd2006f690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcd20150bd0 0x7fcd201572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51882/0 (socket says 172.21.15.150:51882) 2022-08-10T17:45:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1effd700 1 -- 172.21.15.150:0/3851271900 learned_addr learned my addr 172.21.15.150:0/3851271900 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1f7fe700 1 --2- 172.21.15.150:0/3851271900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 0x7fcd200699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678924565 0 0) 0x7fcd2015ab00 con 0x7fcd20150bd0 2022-08-10T17:45:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd00003430 con 0x7fcd20150bd0 2022-08-10T17:45:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422308517 0 0) 0x7fcd00003430 con 0x7fcd20150bd0 2022-08-10T17:45:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1f7fe700 1 -- 172.21.15.150:0/3851271900 >> v1:172.21.15.197:6789/0 conn(0x7fcd200c6540 legacy=0x7fcd2006f690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1f7fe700 1 -- 172.21.15.150:0/3851271900 >> v1:172.21.15.150:6789/0 conn(0x7fcd20150bd0 legacy=0x7fcd201572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.075+0000 7fcd1f7fe700 1 -- 172.21.15.150:0/3851271900 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2015a1d0 con 0x7fcd20150800 2022-08-10T17:45:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd1f7fe700 1 --2- 172.21.15.150:0/3851271900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 0x7fcd200699e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009dc0 tx=0x7fcd1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e341850f380ade94 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000e070 con 0x7fcd20150800 2022-08-10T17:45:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000ba20 con 0x7fcd20150800 2022-08-10T17:45:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd1e7fc700 1 -- 172.21.15.150:0/3851271900 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08001670 con 0x7fcd20150800 2022-08-10T17:45:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 -- 172.21.15.150:0/3851271900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 msgr2=0x7fcd200699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3851271900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 0x7fcd200699e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009dc0 tx=0x7fcd1000b330 comp rx=0 tx=0).stop 2022-08-10T17:45:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 -- 172.21.15.150:0/3851271900 shutdown_connections 2022-08-10T17:45:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3851271900 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd20150800 0x7fcd200699e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 -- 172.21.15.150:0/3851271900 >> 172.21.15.150:0/3851271900 conn(0x7fcd20071e40 msgr2=0x7fcd200692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 -- 172.21.15.150:0/3851271900 shutdown_connections 2022-08-10T17:45:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.076+0000 7fcd25f73700 1 -- 172.21.15.150:0/3851271900 wait complete. 2022-08-10T17:45:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 Processor -- start 2022-08-10T17:45:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 -- start start 2022-08-10T17:45:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd200c6540 0x7fcd2014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 0x7fcd201eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201eff00 con 0x7fcd20150800 2022-08-10T17:45:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201e0db0 con 0x7fcd200cae80 2022-08-10T17:45:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd25f73700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200cc2f0 con 0x7fcd200c6540 2022-08-10T17:45:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1ffff700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 msgr2=0x7fcd201eef80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 0x7fcd201eef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39208/0 (socket says 172.21.15.150:39208) 2022-08-10T17:45:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1effd700 1 -- 172.21.15.150:0/3277270412 learned_addr learned my addr 172.21.15.150:0/3277270412 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.078+0000 7fcd1f7fe700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd200c6540 0x7fcd2014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 -- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd200c6540 msgr2=0x7fcd2014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd200c6540 0x7fcd2014c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 -- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 msgr2=0x7fcd201eef80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 0x7fcd201eef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 -- 172.21.15.150:0/3277270412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009a70 con 0x7fcd20150800 2022-08-10T17:45:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd1effd700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd2008a160 tx=0x7fcd0800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080074e0 con 0x7fcd20150800 2022-08-10T17:45:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0800ce50 con 0x7fcd20150800 2022-08-10T17:45:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd201efc20 con 0x7fcd20150800 2022-08-10T17:45:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08004930 con 0x7fcd20150800 2022-08-10T17:45:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.079+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200c9fd0 con 0x7fcd20150800 2022-08-10T17:45:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.080+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd201e0830 con 0x7fcd20150800 2022-08-10T17:45:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.080+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcd0801a020 con 0x7fcd20150800 2022-08-10T17:45:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.081+0000 7fcd17fff700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 0x7fcd04067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:00.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.081+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcd08081bd0 con 0x7fcd20150800 2022-08-10T17:45:00.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.081+0000 7fcd1f7fe700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 0x7fcd04067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:00.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.081+0000 7fcd1f7fe700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 0x7fcd04067540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd10015040 tx=0x7fcd10010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:00.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.085+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcd201e0830 con 0x7fcd20150800 2022-08-10T17:45:00.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.407+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcd201e07d0 con 0x7fcd20150800 2022-08-10T17:45:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.407+0000 7fcd17fff700 1 -- 172.21.15.150:0/3277270412 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fcd0804fbb0 con 0x7fcd20150800 2022-08-10T17:45:00.411 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 msgr2=0x7fcd04067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 0x7fcd04067540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd10015040 tx=0x7fcd10010000 comp rx=0 tx=0).stop 2022-08-10T17:45:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 msgr2=0x7fcd200c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd2008a160 tx=0x7fcd0800c6e0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 shutdown_connections 2022-08-10T17:45:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcd200cae80 0x7fcd201eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcd04065090 0x7fcd04067540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcd200c6540 0x7fcd2014c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 --2- 172.21.15.150:0/3277270412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd20150800 0x7fcd200c1ae0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:00.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 >> 172.21.15.150:0/3277270412 conn(0x7fcd20071e40 msgr2=0x7fcd2014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:00.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 shutdown_connections 2022-08-10T17:45:00.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:00.410+0000 7fcd25f73700 1 -- 172.21.15.150:0/3277270412 wait complete. 2022-08-10T17:45:03.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:03.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.560+0000 7fdae476c700 1 Processor -- start 2022-08-10T17:45:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.561+0000 7fdae476c700 1 -- start start 2022-08-10T17:45:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.562+0000 7fdae476c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdadc155190 0x7fdadc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.562+0000 7fdae476c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0c6250 con 0x7fdadc155560 2022-08-10T17:45:03.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.562+0000 7fdae476c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0c4530 con 0x7fdadc06f4d0 2022-08-10T17:45:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.562+0000 7fdae476c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0c47b0 con 0x7fdadc155190 2022-08-10T17:45:03.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.564+0000 7fdae2d09700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7fdadc06f4d0 legacy=0x7fdadc15b120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:03.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae1d07700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdadc155560 0x7fdadc071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:51934/0 (socket says 172.21.15.150:51934) 2022-08-10T17:45:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae1d07700 1 -- 172.21.15.150:0/583613987 learned_addr learned my addr 172.21.15.150:0/583613987 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae2508700 1 --2- 172.21.15.150:0/583613987 >> v2:172.21.15.150:3300/0 conn(0x7fdadc155190 0x7fdadc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:03.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae1506700 1 -- 172.21.15.150:0/583613987 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782214300 0 0) 0x7fdadc0c6250 con 0x7fdadc155560 2022-08-10T17:45:03.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae1506700 1 -- 172.21.15.150:0/583613987 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac4003430 con 0x7fdadc155560 2022-08-10T17:45:03.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae2508700 1 -- 172.21.15.150:0/583613987 >> v1:172.21.15.197:6789/0 conn(0x7fdadc06f4d0 legacy=0x7fdadc15b120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:03.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae2508700 1 -- 172.21.15.150:0/583613987 >> v1:172.21.15.150:6789/0 conn(0x7fdadc155560 legacy=0x7fdadc071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:03.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.569+0000 7fdae2508700 1 -- 172.21.15.150:0/583613987 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0c6ec0 con 0x7fdadc155190 2022-08-10T17:45:03.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.570+0000 7fdae2508700 1 --2- 172.21.15.150:0/583613987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc155190 0x7fdadc06eed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda86d8082bb3860 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:03.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.570+0000 7fdae1506700 1 -- 172.21.15.150:0/583613987 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400e070 con 0x7fdadc155190 2022-08-10T17:45:03.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.570+0000 7fdae1506700 1 -- 172.21.15.150:0/583613987 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400bae0 con 0x7fdadc155190 2022-08-10T17:45:03.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.570+0000 7fdae1506700 1 -- 172.21.15.150:0/583613987 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400be90 con 0x7fdadc155190 2022-08-10T17:45:03.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.571+0000 7fdae476c700 1 -- 172.21.15.150:0/583613987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc155190 msgr2=0x7fdadc06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.571+0000 7fdae476c700 1 --2- 172.21.15.150:0/583613987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc155190 0x7fdadc06eed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad400b330 comp rx=0 tx=0).stop 2022-08-10T17:45:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.571+0000 7fdae476c700 1 -- 172.21.15.150:0/583613987 shutdown_connections 2022-08-10T17:45:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.571+0000 7fdae476c700 1 --2- 172.21.15.150:0/583613987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc155190 0x7fdadc06eed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.571+0000 7fdae476c700 1 -- 172.21.15.150:0/583613987 >> 172.21.15.150:0/583613987 conn(0x7fdadc068be0 msgr2=0x7fdadc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.573+0000 7fdae476c700 1 -- 172.21.15.150:0/583613987 shutdown_connections 2022-08-10T17:45:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.574+0000 7fdae476c700 1 -- 172.21.15.150:0/583613987 wait complete. 2022-08-10T17:45:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.576+0000 7fdae476c700 1 Processor -- start 2022-08-10T17:45:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.576+0000 7fdae476c700 1 -- start start 2022-08-10T17:45:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 0x7fdadc1f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 0x7fdadc156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc156ae0 con 0x7fdadc149910 2022-08-10T17:45:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0ca800 con 0x7fdadc155190 2022-08-10T17:45:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae476c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1f43d0 con 0x7fdadc06f4d0 2022-08-10T17:45:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae1d07700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 msgr2=0x7fdadc156f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae1d07700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 0x7fdadc156f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2508700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 0x7fdadc1f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39262/0 (socket says 172.21.15.150:39262) 2022-08-10T17:45:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 -- 172.21.15.150:0/2471820257 learned_addr learned my addr 172.21.15.150:0/2471820257 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 -- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 msgr2=0x7fdadc1f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 0x7fdadc1f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 -- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 msgr2=0x7fdadc156f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 0x7fdadc156f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2d09700 1 -- 172.21.15.150:0/2471820257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009a70 con 0x7fdadc149910 2022-08-10T17:45:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.577+0000 7fdae2508700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 0x7fdadc1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:45:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdae2d09700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00b3c0 tx=0x7fdacc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc003a70 con 0x7fdadc149910 2022-08-10T17:45:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc003bf0 con 0x7fdadc149910 2022-08-10T17:45:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0050d0 con 0x7fdadc149910 2022-08-10T17:45:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc156460 con 0x7fdadc149910 2022-08-10T17:45:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.578+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc1f4670 con 0x7fdadc149910 2022-08-10T17:45:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.579+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc156c20 con 0x7fdadc149910 2022-08-10T17:45:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.580+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdacc018030 con 0x7fdadc149910 2022-08-10T17:45:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.580+0000 7fdacaffd700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 0x7fdabc067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.580+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdacc081350 con 0x7fdadc149910 2022-08-10T17:45:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.582+0000 7fdae2508700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 0x7fdabc067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.583+0000 7fdae2508700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 0x7fdabc067510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000f80 tx=0x7fdad4011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.584+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fdadc156c20 con 0x7fdadc149910 2022-08-10T17:45:03.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.922+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdadc155f40 con 0x7fdadc149910 2022-08-10T17:45:03.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.922+0000 7fdacaffd700 1 -- 172.21.15.150:0/2471820257 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fdacc016020 con 0x7fdadc149910 2022-08-10T17:45:03.927 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 msgr2=0x7fdabc067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:03.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 0x7fdabc067510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000f80 tx=0x7fdad4011000 comp rx=0 tx=0).stop 2022-08-10T17:45:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 msgr2=0x7fdadc157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00b3c0 tx=0x7fdacc00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 shutdown_connections 2022-08-10T17:45:03.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdadc149910 0x7fdadc157440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdabc065060 0x7fdabc067510 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000f80 tx=0x7fdad4011000 comp rx=0 tx=0).stop 2022-08-10T17:45:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdadc06f4d0 0x7fdadc1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 --2- 172.21.15.150:0/2471820257 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdadc155190 0x7fdadc156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:03.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.925+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 >> 172.21.15.150:0/2471820257 conn(0x7fdadc068be0 msgr2=0x7fdadc152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:03.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.931+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 shutdown_connections 2022-08-10T17:45:03.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:03.931+0000 7fdae476c700 1 -- 172.21.15.150:0/2471820257 wait complete. 2022-08-10T17:45:06.949 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.089+0000 7f27a7bcd700 1 Processor -- start 2022-08-10T17:45:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.089+0000 7f27a7bcd700 1 -- start start 2022-08-10T17:45:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a7bcd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 0x7f27a006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a7bcd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27a00c3c00 0x7f27a00701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a7bcd700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00bcfe0 con 0x7f27a0150b40 2022-08-10T17:45:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a7bcd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a006f3e0 con 0x7f27a00c3c00 2022-08-10T17:45:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a7bcd700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a0069440 con 0x7f27a00644b0 2022-08-10T17:45:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a5969700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f27a0150b40 legacy=0x7f27a0068110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a5168700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 msgr2=0x7f27a006fc90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a5168700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 0x7f27a006fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a616a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27a00c3c00 0x7f27a00701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a616a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27a00c3c00 0x7f27a00701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39304/0 (socket says 172.21.15.150:39304) 2022-08-10T17:45:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.090+0000 7f27a616a700 1 -- 172.21.15.150:0/461524918 learned_addr learned my addr 172.21.15.150:0/461524918 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a616a700 1 -- 172.21.15.150:0/461524918 >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 msgr2=0x7f27a006fc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a616a700 1 --2- 172.21.15.150:0/461524918 >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 0x7f27a006fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a616a700 1 -- 172.21.15.150:0/461524918 >> v1:172.21.15.197:6789/0 conn(0x7f27a0150b40 legacy=0x7f27a0068110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a616a700 1 -- 172.21.15.150:0/461524918 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00c48f0 con 0x7f27a00c3c00 2022-08-10T17:45:07.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a616a700 1 --2- 172.21.15.150:0/461524918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00701d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27a006e000 tx=0x7f279800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93796bc7c37d9c2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:07.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a4967700 1 -- 172.21.15.150:0/461524918 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279800e070 con 0x7f27a00c3c00 2022-08-10T17:45:07.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a4967700 1 -- 172.21.15.150:0/461524918 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279800b980 con 0x7f27a00c3c00 2022-08-10T17:45:07.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.091+0000 7f27a4967700 1 -- 172.21.15.150:0/461524918 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279800bd30 con 0x7f27a00c3c00 2022-08-10T17:45:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 -- 172.21.15.150:0/461524918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 msgr2=0x7f27a00701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/461524918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00701d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27a006e000 tx=0x7f279800b330 comp rx=0 tx=0).stop 2022-08-10T17:45:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 -- 172.21.15.150:0/461524918 shutdown_connections 2022-08-10T17:45:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/461524918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00701d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/461524918 >> v2:172.21.15.197:3300/0 conn(0x7f27a00644b0 0x7f27a006fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 -- 172.21.15.150:0/461524918 >> 172.21.15.150:0/461524918 conn(0x7f27a00c9320 msgr2=0x7f27a00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:07.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 -- 172.21.15.150:0/461524918 shutdown_connections 2022-08-10T17:45:07.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.092+0000 7f27a7bcd700 1 -- 172.21.15.150:0/461524918 wait complete. 2022-08-10T17:45:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.094+0000 7f27a7bcd700 1 Processor -- start 2022-08-10T17:45:07.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.094+0000 7f27a7bcd700 1 -- start start 2022-08-10T17:45:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 0x7f27a0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27a0150b40 0x7f27a01e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00bf870 con 0x7f27a00c3c00 2022-08-10T17:45:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a01573f0 con 0x7f27a00644b0 2022-08-10T17:45:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a7bcd700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0155930 con 0x7f27a0150b40 2022-08-10T17:45:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5969700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 msgr2=0x7f27a0156240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5969700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 0x7f27a0156240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39308/0 (socket says 172.21.15.150:39308) 2022-08-10T17:45:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 -- 172.21.15.150:0/1836561619 learned_addr learned my addr 172.21.15.150:0/1836561619 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a616a700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27a0150b40 0x7f27a01e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:07.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 -- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27a0150b40 msgr2=0x7f27a01e27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:07.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27a0150b40 0x7f27a01e27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 -- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 msgr2=0x7f27a0156240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:07.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 0x7f27a0156240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.095+0000 7f27a5168700 1 -- 172.21.15.150:0/1836561619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009b30 con 0x7f27a00c3c00 2022-08-10T17:45:07.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f27a5168700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f279000b3c0 tx=0x7f279000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:07.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790005480 con 0x7f27a00c3c00 2022-08-10T17:45:07.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27900055e0 con 0x7f27a00c3c00 2022-08-10T17:45:07.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900039e0 con 0x7f27a00c3c00 2022-08-10T17:45:07.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a0156de0 con 0x7f27a00c3c00 2022-08-10T17:45:07.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.096+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a0155370 con 0x7f27a00c3c00 2022-08-10T17:45:07.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.097+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0068ed0 con 0x7f27a00c3c00 2022-08-10T17:45:07.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.100+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2790018030 con 0x7f27a00c3c00 2022-08-10T17:45:07.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.101+0000 7f278e7fc700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 0x7f2780067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:07.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.101+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f27900814b0 con 0x7f27a00c3c00 2022-08-10T17:45:07.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.106+0000 7f27a5969700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 0x7f2780067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:07.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.106+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f279004f420 con 0x7f27a00c3c00 2022-08-10T17:45:07.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.108+0000 7f27a5969700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 0x7f2780067590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f279c003840 tx=0x7f279c006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:07.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.437+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f27a0157660 con 0x7f27a00c3c00 2022-08-10T17:45:07.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.438+0000 7f278e7fc700 1 -- 172.21.15.150:0/1836561619 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f2790016020 con 0x7f27a00c3c00 2022-08-10T17:45:07.442 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:07.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 msgr2=0x7f2780067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:07.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 0x7f2780067590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f279c003840 tx=0x7f279c006c90 comp rx=0 tx=0).stop 2022-08-10T17:45:07.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 msgr2=0x7f27a00c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:07.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f279000b3c0 tx=0x7f279000b780 comp rx=0 tx=0).stop 2022-08-10T17:45:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 shutdown_connections 2022-08-10T17:45:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27800650e0 0x7f2780067590 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27a0150b40 0x7f27a01e27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27a00644b0 0x7f27a0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 --2- 172.21.15.150:0/1836561619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27a00c3c00 0x7f27a00c8410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.440+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 >> 172.21.15.150:0/1836561619 conn(0x7f27a00c9320 msgr2=0x7f27a01500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.441+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 shutdown_connections 2022-08-10T17:45:07.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:07.441+0000 7f27a7bcd700 1 -- 172.21.15.150:0/1836561619 wait complete. 2022-08-10T17:45:10.460 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:10.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.614+0000 7f0ddb1fa700 1 Processor -- start 2022-08-10T17:45:10.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.614+0000 7f0ddb1fa700 1 -- start start 2022-08-10T17:45:10.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0ddb1fa700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:10.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0ddb1fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0ddb1fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd406b310 con 0x7f0dd40896d0 2022-08-10T17:45:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0ddb1fa700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd406bf00 con 0x7f0dd40c5050 2022-08-10T17:45:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0ddb1fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40c3aa0 con 0x7f0dd4089aa0 2022-08-10T17:45:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0dd8f96700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0dd40896d0 0x7f0dd40c32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:52024/0 (socket says 172.21.15.150:52024) 2022-08-10T17:45:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.615+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 learned_addr learned my addr 172.21.15.150:0/2489608357 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.617+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 msgr2=0x7f0dd415d570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.617+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.617+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.638+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:45:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.638+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.638+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.638+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:10.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.818+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 msgr2=0x7f0dd415d570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:10.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.818+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:10.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.839+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:10.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.839+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:10.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.839+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:10.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.839+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:10.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:10.839+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:11.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.219+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 msgr2=0x7f0dd415d570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:11.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.219+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:11.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.240+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:11.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.240+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:11.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.240+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:11.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.240+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:11.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:11.240+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:12.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.020+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 msgr2=0x7f0dd415d570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:12.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.020+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:45:12.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.041+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:12.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.041+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:12.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.041+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:12.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.041+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:12.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:12.041+0000 7f0dd9797700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:45:13.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 msgr2=0x7f0dd415dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:13.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd4089aa0 0x7f0dd415dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:13.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 msgr2=0x7f0dd415d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:13.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.197:3300/0 conn(0x7f0dd40c5050 0x7f0dd415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:13.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.150:6789/0 conn(0x7f0dd40896d0 legacy=0x7f0dd40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:13.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:13.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 -- 172.21.15.150:0/2489608357 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd406b560 con 0x7f0dbc0060b0 2022-08-10T17:45:13.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd27fc700 1 -- 172.21.15.150:0/2489608357 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd406bf00 con 0x7f0dbc0035f0 2022-08-10T17:45:13.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:13.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.197:6789/0 conn(0x7f0dbc0060b0 legacy=0x7f0dbc008560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:13.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:13.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:13.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:13.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.616+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:13.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.197:6789/0 conn(0x7f0dbc0060b0 legacy=0x7f0dbc008560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:13.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:13.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:13.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:13.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:13.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:13.817+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:14.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.197:6789/0 conn(0x7f0dbc0060b0 legacy=0x7f0dbc008560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:14.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:14.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:14.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:14.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:14.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:14.218+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:15.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.019+0000 7f0dd3fff700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.197:6789/0 conn(0x7f0dbc0060b0 legacy=0x7f0dbc008560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:15.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.022+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> v2:172.21.15.150:3300/0 conn(0x7f0dbc0035f0 0x7f0dbc005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 >> v1:172.21.15.197:6789/0 conn(0x7f0dbc0060b0 legacy=0x7f0dbc008560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:15.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd8f96700 1 -- 172.21.15.150:0/2489608357 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc00ae40 con 0x7f0dbc0035f0 2022-08-10T17:45:15.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dbc0035f0 0x7f0dbc005a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8007c30 tx=0x7f0dc80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1695f70b44c4a4a5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd37fe700 1 -- 172.21.15.150:0/2489608357 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8017070 con 0x7f0dbc0035f0 2022-08-10T17:45:15.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd37fe700 1 -- 172.21.15.150:0/2489608357 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8012480 con 0x7f0dbc0035f0 2022-08-10T17:45:15.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.023+0000 7f0dd37fe700 1 -- 172.21.15.150:0/2489608357 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8005ea0 con 0x7f0dbc0035f0 2022-08-10T17:45:15.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/2489608357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dbc0035f0 msgr2=0x7f0dbc005a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dbc0035f0 0x7f0dbc005a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8007c30 tx=0x7f0dc80076c0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0dd9797700 1 -- 172.21.15.150:0/2489608357 reap_dead start 2022-08-10T17:45:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/2489608357 shutdown_connections 2022-08-10T17:45:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/2489608357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dbc0035f0 0x7f0dbc005a60 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8007c30 tx=0x7f0dc80076c0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.024+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/2489608357 >> 172.21.15.150:0/2489608357 conn(0x7f0dd40c8a10 msgr2=0x7f0dd40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.025+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/2489608357 shutdown_connections 2022-08-10T17:45:15.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.025+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/2489608357 wait complete. 2022-08-10T17:45:15.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.027+0000 7f0ddb1fa700 1 Processor -- start 2022-08-10T17:45:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.028+0000 7f0ddb1fa700 1 -- start start 2022-08-10T17:45:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 0x7f0dd40b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 0x7f0dd41fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 0x7f0dd4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40b6270 con 0x7f0dd4165520 2022-08-10T17:45:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd41fc340 con 0x7f0dd40c49b0 2022-08-10T17:45:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0ddb1fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40b8de0 con 0x7f0dd40c45e0 2022-08-10T17:45:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd9797700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 msgr2=0x7f0dd4157bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd9797700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 0x7f0dd4157bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd8f96700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 0x7f0dd40b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd8f96700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 0x7f0dd40b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53634/0 (socket says 172.21.15.150:53634) 2022-08-10T17:45:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd8f96700 1 -- 172.21.15.150:0/4292471567 learned_addr learned my addr 172.21.15.150:0/4292471567 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:15.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.029+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 0x7f0dd41fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 -- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 msgr2=0x7f0dd40b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 0x7f0dd40b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 -- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 msgr2=0x7f0dd4157bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 0x7f0dd4157bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 -- 172.21.15.150:0/4292471567 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd406b310 con 0x7f0dd4165520 2022-08-10T17:45:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd3fff700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 0x7f0dd41fcd90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0003840 tx=0x7f0dc000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000c960 con 0x7f0dd4165520 2022-08-10T17:45:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000a040 con 0x7f0dd4165520 2022-08-10T17:45:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd41665d0 con 0x7f0dd4165520 2022-08-10T17:45:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000cd20 con 0x7f0dd4165520 2022-08-10T17:45:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.030+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd41fc590 con 0x7f0dd4165520 2022-08-10T17:45:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.033+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0dc00153e0 con 0x7f0dd4165520 2022-08-10T17:45:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.033+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd41fc8c0 con 0x7f0dd4165520 2022-08-10T17:45:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.033+0000 7f0dd17fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 0x7f0dbc068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.033+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0dc0006e40 con 0x7f0dd4165520 2022-08-10T17:45:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.033+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 0x7f0dbc068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.034+0000 7f0dd8f96700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 0x7f0dbc068190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000c00 tx=0x7f0dc8012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.041+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0dc00446b0 con 0x7f0dd4165520 2022-08-10T17:45:15.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.398+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0dd406b840 con 0x7f0dd4165520 2022-08-10T17:45:15.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.399+0000 7f0dd17fa700 1 -- 172.21.15.150:0/4292471567 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f0dc0086060 con 0x7f0dd4165520 2022-08-10T17:45:15.403 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":76,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 msgr2=0x7f0dbc068190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 0x7f0dbc068190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000c00 tx=0x7f0dc8012000 comp rx=0 tx=0).stop 2022-08-10T17:45:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 msgr2=0x7f0dd41fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 0x7f0dd41fcd90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0003840 tx=0x7f0dc000bbe0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 shutdown_connections 2022-08-10T17:45:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0dd40c49b0 0x7f0dd4157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0dbc065ce0 0x7f0dbc068190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0dd40c45e0 0x7f0dd40b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 --2- 172.21.15.150:0/4292471567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dd4165520 0x7f0dd41fcd90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 >> 172.21.15.150:0/4292471567 conn(0x7f0dd40c8a10 msgr2=0x7f0dd40c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 shutdown_connections 2022-08-10T17:45:15.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.401+0000 7f0ddb1fa700 1 -- 172.21.15.150:0/4292471567 wait complete. 2022-08-10T17:45:15.417 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:45:15.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:45:15.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.560+0000 7f3510324700 1 Processor -- start 2022-08-10T17:45:15.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.560+0000 7f3510324700 1 -- start start 2022-08-10T17:45:15.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f3510324700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 0x7f3508071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f3510324700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3508068820 0x7f35080718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f3510324700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080c6100 con 0x7f35081544c0 2022-08-10T17:45:15.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f3510324700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080c5270 con 0x7f3508068820 2022-08-10T17:45:15.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f3510324700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080c5e00 con 0x7f35081540f0 2022-08-10T17:45:15.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f350e0c0700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 msgr2=0x7f3508071370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:15.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f350e0c0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 0x7f3508071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:15.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f350d8bf700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f35081544c0 0x7f3508068110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:52102/0 (socket says 172.21.15.150:52102) 2022-08-10T17:45:15.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.561+0000 7f350d8bf700 1 -- 172.21.15.150:0/3354025694 learned_addr learned my addr 172.21.15.150:0/3354025694 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:15.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 --2- 172.21.15.150:0/3354025694 >> v2:172.21.15.150:3300/0 conn(0x7f3508068820 0x7f35080718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994937677 0 0) 0x7f35080c6100 con 0x7f35081544c0 2022-08-10T17:45:15.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f0003430 con 0x7f35081544c0 2022-08-10T17:45:15.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 -- 172.21.15.150:0/3354025694 >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 msgr2=0x7f3508071370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:15.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 --2- 172.21.15.150:0/3354025694 >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 0x7f3508071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 -- 172.21.15.150:0/3354025694 >> v1:172.21.15.150:6789/0 conn(0x7f35081544c0 legacy=0x7f3508068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276686601 0 0) 0x7f34f0003430 con 0x7f35081544c0 2022-08-10T17:45:15.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 -- 172.21.15.150:0/3354025694 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350806eb00 con 0x7f3508068820 2022-08-10T17:45:15.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350e8c1700 1 --2- 172.21.15.150:0/3354025694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35080718b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3508064cd0 tx=0x7f350000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff54b419a6a9358f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000e070 con 0x7f3508068820 2022-08-10T17:45:15.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000ba20 con 0x7f3508068820 2022-08-10T17:45:15.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.562+0000 7f350d0be700 1 -- 172.21.15.150:0/3354025694 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8001670 con 0x7f3508068820 2022-08-10T17:45:15.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 -- 172.21.15.150:0/3354025694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 msgr2=0x7f35080718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 --2- 172.21.15.150:0/3354025694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35080718b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3508064cd0 tx=0x7f350000b330 comp rx=0 tx=0).stop 2022-08-10T17:45:15.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 -- 172.21.15.150:0/3354025694 shutdown_connections 2022-08-10T17:45:15.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 --2- 172.21.15.150:0/3354025694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35080718b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 --2- 172.21.15.150:0/3354025694 >> v2:172.21.15.197:3300/0 conn(0x7f35081540f0 0x7f3508071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 -- 172.21.15.150:0/3354025694 >> 172.21.15.150:0/3354025694 conn(0x7f350806d0d0 msgr2=0x7f35080c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 -- 172.21.15.150:0/3354025694 shutdown_connections 2022-08-10T17:45:15.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.563+0000 7f3510324700 1 -- 172.21.15.150:0/3354025694 wait complete. 2022-08-10T17:45:15.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.564+0000 7f3510324700 1 Processor -- start 2022-08-10T17:45:15.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 -- start start 2022-08-10T17:45:15.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35081540f0 0x7f35080c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35081544c0 0x7f35080c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3508148c50 con 0x7f3508068820 2022-08-10T17:45:15.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35081ef1f0 con 0x7f35081540f0 2022-08-10T17:45:15.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f3510324700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35081548f0 con 0x7f35081544c0 2022-08-10T17:45:15.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f350e0c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f350d8bf700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35081540f0 msgr2=0x7f35080c8940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:15.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f350e0c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39426/0 (socket says 172.21.15.150:39426) 2022-08-10T17:45:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f350e0c0700 1 -- 172.21.15.150:0/2880578780 learned_addr learned my addr 172.21.15.150:0/2880578780 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.565+0000 7f350d8bf700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35081540f0 0x7f35080c8940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e8c1700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35081544c0 0x7f35080c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35081544c0 msgr2=0x7f35080c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35081544c0 0x7f35080c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35081540f0 msgr2=0x7f35080c8940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35081540f0 0x7f35080c8940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500009a70 con 0x7f3508068820 2022-08-10T17:45:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f350e0c0700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f350400b430 tx=0x7f350400b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504003cd0 con 0x7f3508068820 2022-08-10T17:45:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504003e50 con 0x7f3508068820 2022-08-10T17:45:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35080c0150 con 0x7f3508068820 2022-08-10T17:45:15.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040052b0 con 0x7f3508068820 2022-08-10T17:45:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.566+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35080c0710 con 0x7f3508068820 2022-08-10T17:45:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.567+0000 7f3510324700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 0x7f35081ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.567+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080672f0 con 0x7f35081efea0 2022-08-10T17:45:15.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.567+0000 7f350d8bf700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 0x7f35081ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f350d8bf700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3508072890 con 0x7f35081efea0 2022-08-10T17:45:15.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f350d8bf700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 0x7f35081ef360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3508069e20 tx=0x7f34f800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80074e0 con 0x7f35081efea0 2022-08-10T17:45:15.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f34f8007640 con 0x7f35081efea0 2022-08-10T17:45:15.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 msgr2=0x7f35081ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 0x7f35081ef360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3508069e20 tx=0x7f34f800ca10 comp rx=0 tx=0).stop 2022-08-10T17:45:15.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 msgr2=0x7f35081ef360 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:15.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35081efea0 0x7f35081ef360 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.568+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f350400f070 con 0x7f3508068820 2022-08-10T17:45:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.569+0000 7f34f6ffd700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f34e8064dc0 0x7f34e8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.569+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3504081ab0 con 0x7f3508068820 2022-08-10T17:45:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.569+0000 7f350d8bf700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f34e8064dc0 0x7f34e8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.569+0000 7f350d8bf700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f34e8064dc0 0x7f34e8067270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35080c0d80 tx=0x7f34f800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.589 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:15.589 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:45:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 76, 2022-08-10T17:45:15.590 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:15.591 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:15.591 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:15.591 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.591 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:45:15.592 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:15.592 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:15.592 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:15.592 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.592 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.593 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.593 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.593 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.593 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.594 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.594 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.594 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.594 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.595 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:15.595 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:15.595 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.595 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.595 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.596 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.596 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.596 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.596 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.597 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.597 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.597 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.598 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:15.598 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:15.598 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:15.598 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:15.599 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:15.599 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:15.599 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:15.599 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:15.599 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:15.600 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:15.600 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:15.600 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:15.600 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:15.601 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:15.601 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:15.601 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:15.601 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.601 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.602 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.602 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.602 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.602 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.603 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.603 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.603 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.603 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.604 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:15.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.604 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:15.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.604 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:15.605 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:15.605 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.605 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.606 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.606 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:15.606 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.607 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:15.607 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.607 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.608 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.608 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:15.608 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:15.609 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.609 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.609 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.610 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:15.610 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:15.610 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.611 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.611 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.611 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:15.611 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.612 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.612 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:15.613 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.613 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.613 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.613 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:15.614 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:15.614 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.614 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.614 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.615 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:15.615 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:15.616 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.616 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.616 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.616 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:15.617 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.617 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.618 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:15.618 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.618 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.618 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.619 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:15.619 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:15.619 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.619 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.620 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.620 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.620 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.621 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:15.621 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:15.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.621 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.621 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.622 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.622 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.622 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:15.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.623 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.623 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.623 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:15.624 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.624 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.624 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:15.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.624 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.625 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.625 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:45:15.625 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.625 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.626 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:15.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.626 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.626 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.627 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:15.627 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.627 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.627 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:15.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.628 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.628 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.628 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.628 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.629 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.629 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:15.629 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:15.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.577+0000 7f3510324700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 0x7f35080bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.577+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c7110 con 0x7f3508151560 2022-08-10T17:45:15.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.577+0000 7f350e8c1700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 0x7f35080bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.578+0000 7f350e8c1700 1 -- 172.21.15.150:0/2880578780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f35080af9b0 con 0x7f3508151560 2022-08-10T17:45:15.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.578+0000 7f350e8c1700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 0x7f35080bdc60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3508064cd0 tx=0x7f3500004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.579+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000045f0 con 0x7f3508151560 2022-08-10T17:45:15.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4877 (secure 0 0 0) 0x7f3500004750 con 0x7f3508151560 2022-08-10T17:45:15.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 msgr2=0x7f35080bdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f34f6ffd700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 0x7f35080bdc60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3508064cd0 tx=0x7f3500004950 comp rx=0 tx=0).stop 2022-08-10T17:45:15.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f34f6ffd700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 msgr2=0x7f35080bdc60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:15.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f34f6ffd700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508151560 0x7f35080bdc60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f34e8064dc0 msgr2=0x7f34e8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f3510324700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f34e8064dc0 0x7f34e8067270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35080c0d80 tx=0x7f34f800a000 comp rx=0 tx=0).stop 2022-08-10T17:45:15.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 msgr2=0x7f35081ef960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f3510324700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f350400b430 tx=0x7f350400b7f0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.580+0000 7f350e8c1700 1 -- 172.21.15.150:0/2880578780 reap_dead start 2022-08-10T17:45:15.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.581+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 shutdown_connections 2022-08-10T17:45:15.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.581+0000 7f3510324700 1 --2- 172.21.15.150:0/2880578780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3508068820 0x7f35081ef960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.581+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 >> 172.21.15.150:0/2880578780 conn(0x7f350806d0d0 msgr2=0x7f35081e0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.581+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 shutdown_connections 2022-08-10T17:45:15.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.584+0000 7f3510324700 1 -- 172.21.15.150:0/2880578780 wait complete. 2022-08-10T17:45:15.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:45:15.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.770+0000 7f1440ad6700 1 Processor -- start 2022-08-10T17:45:15.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.770+0000 7f1440ad6700 1 -- start start 2022-08-10T17:45:15.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f1440ad6700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 0x7f143c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f1440ad6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f1440ad6700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c0707d0 con 0x7f143c0c45b0 2022-08-10T17:45:15.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f1440ad6700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c14d250 con 0x7f143c0c91d0 2022-08-10T17:45:15.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f1440ad6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c153980 con 0x7f143c0c4100 2022-08-10T17:45:15.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f143a59c700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 msgr2=0x7f143c0c3340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:15.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.772+0000 7f143a59c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 0x7f143c0c3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:15.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.773+0000 7f143ad9d700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f143c0c45b0 legacy=0x7f143c069c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:15.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.773+0000 7f1439d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.773+0000 7f1439d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53664/0 (socket says 172.21.15.150:53664) 2022-08-10T17:45:15.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.773+0000 7f1439d9b700 1 -- 172.21.15.150:0/2808138118 learned_addr learned my addr 172.21.15.150:0/2808138118 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:15.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.774+0000 7f1439d9b700 1 -- 172.21.15.150:0/2808138118 >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 msgr2=0x7f143c0c3340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:15.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.774+0000 7f1439d9b700 1 --2- 172.21.15.150:0/2808138118 >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 0x7f143c0c3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.774+0000 7f1439d9b700 1 -- 172.21.15.150:0/2808138118 >> v1:172.21.15.197:6789/0 conn(0x7f143c0c45b0 legacy=0x7f143c069c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:15.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.774+0000 7f1439d9b700 1 -- 172.21.15.150:0/2808138118 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c152b40 con 0x7f143c0c4100 2022-08-10T17:45:15.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.774+0000 7f1439d9b700 1 --2- 172.21.15.150:0/2808138118 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1430006fd0 tx=0x7f1430009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ff6f331dbeec8f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.776+0000 7f143959a700 1 -- 172.21.15.150:0/2808138118 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430011830 con 0x7f143c0c4100 2022-08-10T17:45:15.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.776+0000 7f143959a700 1 -- 172.21.15.150:0/2808138118 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430011990 con 0x7f143c0c4100 2022-08-10T17:45:15.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.777+0000 7f143959a700 1 -- 172.21.15.150:0/2808138118 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430011d40 con 0x7f143c0c4100 2022-08-10T17:45:15.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.777+0000 7f1440ad6700 1 -- 172.21.15.150:0/2808138118 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 msgr2=0x7f143c0c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.777+0000 7f1440ad6700 1 --2- 172.21.15.150:0/2808138118 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1430006fd0 tx=0x7f1430009a60 comp rx=0 tx=0).stop 2022-08-10T17:45:15.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 -- 172.21.15.150:0/2808138118 shutdown_connections 2022-08-10T17:45:15.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 --2- 172.21.15.150:0/2808138118 >> v2:172.21.15.197:3300/0 conn(0x7f143c0c91d0 0x7f143c0c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 --2- 172.21.15.150:0/2808138118 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c4100 0x7f143c0c3880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 -- 172.21.15.150:0/2808138118 >> 172.21.15.150:0/2808138118 conn(0x7f143c06b500 msgr2=0x7f143c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 -- 172.21.15.150:0/2808138118 shutdown_connections 2022-08-10T17:45:15.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.782+0000 7f1440ad6700 1 -- 172.21.15.150:0/2808138118 wait complete. 2022-08-10T17:45:15.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.783+0000 7f1440ad6700 1 Processor -- start 2022-08-10T17:45:15.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.783+0000 7f1440ad6700 1 -- start start 2022-08-10T17:45:15.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f143c0c4100 0x7f143c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c0c45b0 0x7f143c1f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 0x7f143c14c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0c3b20 con 0x7f143c0c45b0 2022-08-10T17:45:15.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c15c8f0 con 0x7f143c0c4100 2022-08-10T17:45:15.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1440ad6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c1f42a0 con 0x7f143c0c91d0 2022-08-10T17:45:15.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f143a59c700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f143c0c4100 msgr2=0x7f143c14a570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:45:15.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f143a59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f143c0c4100 0x7f143c14a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:15.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1439d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c0c45b0 0x7f143c1f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f143ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 0x7f143c14c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f1439d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c0c45b0 0x7f143c1f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39450/0 (socket says 172.21.15.150:39450) 2022-08-10T17:45:15.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.784+0000 7f143ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 0x7f143c14c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53670/0 (socket says 172.21.15.150:53670) 2022-08-10T17:45:15.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f1439d9b700 1 -- 172.21.15.150:0/3953667134 learned_addr learned my addr 172.21.15.150:0/3953667134 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:15.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f143c0c4100 msgr2=0x7f143c14a570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:15.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f143c0c4100 0x7f143c14a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c0c45b0 msgr2=0x7f143c1f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c0c45b0 0x7f143c1f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300093e0 con 0x7f143c0c91d0 2022-08-10T17:45:15.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.785+0000 7f143ad9d700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 0x7f143c14c490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f143400bdb0 tx=0x7f1434009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.786+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400cc90 con 0x7f143c0c91d0 2022-08-10T17:45:15.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.786+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143400cdf0 con 0x7f143c0c91d0 2022-08-10T17:45:15.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.786+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340156b0 con 0x7f143c0c91d0 2022-08-10T17:45:15.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.789+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c1f02b0 con 0x7f143c0c91d0 2022-08-10T17:45:15.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.789+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c1f0570 con 0x7f143c0c91d0 2022-08-10T17:45:15.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.789+0000 7f1440ad6700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 0x7f143c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.789+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0673d0 con 0x7f143c14b7a0 2022-08-10T17:45:15.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.790+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1434015810 con 0x7f143c0c91d0 2022-08-10T17:45:15.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.790+0000 7f143a59c700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 0x7f143c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1418065130 0x7f14180675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f143a59c700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f143c072890 con 0x7f143c14b7a0 2022-08-10T17:45:15.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1434082cd0 con 0x7f143c0c91d0 2022-08-10T17:45:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f1439d9b700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1418065130 0x7f14180675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f143a59c700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 0x7f143c1f0790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b310 tx=0x7f142c00b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c003ad0 con 0x7f143c14b7a0 2022-08-10T17:45:15.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f1439d9b700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1418065130 0x7f14180675e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f143c150f40 tx=0x7f1430008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f142c003c30 con 0x7f143c14b7a0 2022-08-10T17:45:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 msgr2=0x7f143c1f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 0x7f143c1f0790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b310 tx=0x7f142c00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 msgr2=0x7f143c1f0790 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:15.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.791+0000 7f142affd700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14b7a0 0x7f143c1f0790 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b310 tx=0x7f142c00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.800+0000 7f1440ad6700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 0x7f143c146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:15.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.800+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c152e00 con 0x7f143c14bcc0 2022-08-10T17:45:15.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f143a59c700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 0x7f143c146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:15.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f143a59c700 1 -- 172.21.15.150:0/3953667134 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f143c0c2cc0 con 0x7f143c14bcc0 2022-08-10T17:45:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f143a59c700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 0x7f143c146150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b310 tx=0x7f142c0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:15.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c011ae0 con 0x7f143c14bcc0 2022-08-10T17:45:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f142c01f420 con 0x7f143c14bcc0 2022-08-10T17:45:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 msgr2=0x7f143c146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 0x7f143c146150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b310 tx=0x7f142c0058e0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 msgr2=0x7f143c146150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.801+0000 7f142affd700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c14bcc0 0x7f143c146150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.808 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:15.808 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:15.809 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:15.809 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:45:15.809 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 76, 2022-08-10T17:45:15.809 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:15.809 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:15.810 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:15.810 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.810 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:45:15.810 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:15.811 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:15.811 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:15.811 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.811 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.812 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.812 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.812 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.812 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.813 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.813 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.813 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.813 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.814 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:15.814 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:15.814 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.814 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.815 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.815 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.815 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.815 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.816 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.816 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.816 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.816 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.817 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:15.817 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:15.817 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:15.818 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:15.818 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:15.818 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:15.818 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:15.819 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:15.819 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:15.819 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:15.819 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:15.820 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:15.820 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:15.820 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:15.820 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:15.821 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:15.821 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:15.821 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:15.822 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:15.822 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:15.822 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:15.822 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:15.823 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:15.823 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:15.823 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:15.824 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.824 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:15.824 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.824 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:15.825 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.825 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:15.825 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:15.825 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.826 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.826 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.826 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.827 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:15.827 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.827 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.828 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.828 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:15.828 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.828 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.829 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.829 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:15.829 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:15.830 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.830 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.830 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.831 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.831 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:15.831 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:15.832 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.832 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.832 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.832 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.833 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:15.833 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.833 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.833 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.834 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:15.834 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.834 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.835 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.835 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.835 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:15.835 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:15.835 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.836 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.836 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.837 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.837 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:15.837 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:15.837 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:15.837 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:15.838 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.838 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:15.838 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:15.839 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.839 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.839 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.839 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:15.839 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:15.840 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:15.840 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.840 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.841 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:15.841 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:15.841 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:15.841 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:15.842 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:15.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.842 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.843 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:15.843 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:15.843 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.844 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.844 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.844 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.844 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.845 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.845 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:15.845 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.845 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.846 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.846 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.846 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.846 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.847 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:15.847 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.847 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.847 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.848 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:15.848 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.848 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.848 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:15.849 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.849 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:45:15.849 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.849 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.851 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:45:15.851 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.851 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:15.852 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:15.852 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:15.852 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:15.852 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:15.852 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:15.853 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:15.854 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:15.854 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:15.854 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:15.854 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:15.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1418065130 msgr2=0x7f14180675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1418065130 0x7f14180675e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f143c150f40 tx=0x7f1430008030 comp rx=0 tx=0).stop 2022-08-10T17:45:15.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 msgr2=0x7f143c14c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:15.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 --2- 172.21.15.150:0/3953667134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f143c0c91d0 0x7f143c14c490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f143400bdb0 tx=0x7f1434009ef0 comp rx=0 tx=0).stop 2022-08-10T17:45:15.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f143ad9d700 1 -- 172.21.15.150:0/3953667134 reap_dead start 2022-08-10T17:45:15.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f143ad9d700 1 -- 172.21.15.150:0/3953667134 reap_dead start 2022-08-10T17:45:15.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 shutdown_connections 2022-08-10T17:45:15.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 >> 172.21.15.150:0/3953667134 conn(0x7f143c06b500 msgr2=0x7f143c1522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:15.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 shutdown_connections 2022-08-10T17:45:15.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:15.802+0000 7f1440ad6700 1 -- 172.21.15.150:0/3953667134 wait complete. 2022-08-10T17:45:15.859 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:45:35.860 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:45:35.861 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2022-08-10T17:45:35.861 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-10T17:45:35.861 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-10T17:45:35.868 INFO:tasks.ceph.mon.b:Started 2022-08-10T17:45:35.869 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:45:35.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:36.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.027+0000 7f7c16836700 1 Processor -- start 2022-08-10T17:45:36.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.027+0000 7f7c16836700 1 -- start start 2022-08-10T17:45:36.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c16836700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c10150b80 0x7f7c100c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c16836700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c10150f50 0x7f7c100c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c16836700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c10070620 con 0x7f7c100c7d80 2022-08-10T17:45:36.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c16836700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100c5ac0 con 0x7f7c10150b80 2022-08-10T17:45:36.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c16836700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015a860 con 0x7f7c10150f50 2022-08-10T17:45:36.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c14dd3700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f7c100c7d80 legacy=0x7f7c10156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:45:36.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c10150b80 0x7f7c100c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:36.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c10150b80 0x7f7c100c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39608/0 (socket says 172.21.15.150:39608) 2022-08-10T17:45:36.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 -- 172.21.15.150:0/2097317219 learned_addr learned my addr 172.21.15.150:0/2097317219 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:36.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0f7fe700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c10150f50 0x7f7c100c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:36.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 -- 172.21.15.150:0/2097317219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c10150f50 msgr2=0x7f7c100c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:36.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c10150f50 0x7f7c100c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 -- 172.21.15.150:0/2097317219 >> v1:172.21.15.197:6789/0 conn(0x7f7c100c7d80 legacy=0x7f7c10156cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:36.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.028+0000 7f7c0ffff700 1 -- 172.21.15.150:0/2097317219 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100ca810 con 0x7f7c10150b80 2022-08-10T17:45:36.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c0ffff700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c100c42a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5963d7b9efcaca server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:36.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c0effd700 1 -- 172.21.15.150:0/2097317219 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000107b0 con 0x7f7c10150b80 2022-08-10T17:45:36.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c0effd700 1 -- 172.21.15.150:0/2097317219 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00010910 con 0x7f7c10150b80 2022-08-10T17:45:36.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c0effd700 1 -- 172.21.15.150:0/2097317219 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00010ca0 con 0x7f7c10150b80 2022-08-10T17:45:36.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 -- 172.21.15.150:0/2097317219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 msgr2=0x7f7c100c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:36.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c100c42a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00009a60 comp rx=0 tx=0).stop 2022-08-10T17:45:36.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 -- 172.21.15.150:0/2097317219 shutdown_connections 2022-08-10T17:45:36.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c100c42a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 --2- 172.21.15.150:0/2097317219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c10150f50 0x7f7c100c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 -- 172.21.15.150:0/2097317219 >> 172.21.15.150:0/2097317219 conn(0x7f7c10071e40 msgr2=0x7f7c1006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:36.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 -- 172.21.15.150:0/2097317219 shutdown_connections 2022-08-10T17:45:36.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.029+0000 7f7c16836700 1 -- 172.21.15.150:0/2097317219 wait complete. 2022-08-10T17:45:36.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.031+0000 7f7c16836700 1 Processor -- start 2022-08-10T17:45:36.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.031+0000 7f7c16836700 1 -- start start 2022-08-10T17:45:36.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c100c7d80 0x7f7c1014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c10150f50 0x7f7c10155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1014f1b0 con 0x7f7c10150b80 2022-08-10T17:45:36.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1014b650 con 0x7f7c10150f50 2022-08-10T17:45:36.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c16836700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10155700 con 0x7f7c100c7d80 2022-08-10T17:45:36.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:36.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c100c7d80 0x7f7c1014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:36.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39614/0 (socket says 172.21.15.150:39614) 2022-08-10T17:45:36.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0f7fe700 1 -- 172.21.15.150:0/3642191374 learned_addr learned my addr 172.21.15.150:0/3642191374 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:36.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0f7fe700 1 -- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c100c7d80 msgr2=0x7f7c1014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:36.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.032+0000 7f7c0f7fe700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c100c7d80 0x7f7c1014b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0f7fe700 1 -- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c10150f50 msgr2=0x7f7c10155e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:36.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0f7fe700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c10150f50 0x7f7c10155e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0f7fe700 1 -- 172.21.15.150:0/3642191374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000093e0 con 0x7f7c10150b80 2022-08-10T17:45:36.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0f7fe700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e8a0 tx=0x7f7c0400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:36.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400c5e0 con 0x7f7c10150b80 2022-08-10T17:45:36.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400c740 con 0x7f7c10150b80 2022-08-10T17:45:36.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400caf0 con 0x7f7c10150b80 2022-08-10T17:45:36.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c101559e0 con 0x7f7c10150b80 2022-08-10T17:45:36.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.033+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1014bb60 con 0x7f7c10150b80 2022-08-10T17:45:36.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.034+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10155b70 con 0x7f7c10150b80 2022-08-10T17:45:36.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.035+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7c04019030 con 0x7f7c10150b80 2022-08-10T17:45:36.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.035+0000 7f7c0cff9700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 0x7f7bf0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:36.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.035+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7c04081e50 con 0x7f7c10150b80 2022-08-10T17:45:36.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.035+0000 7f7c0ffff700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 0x7f7bf0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:36.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.036+0000 7f7c0ffff700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 0x7f7bf0067560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c00013040 tx=0x7f7c00008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:36.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.041+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7c0404fe30 con 0x7f7c10150b80 2022-08-10T17:45:36.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.365+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7c10072890 con 0x7f7c10150b80 2022-08-10T17:45:36.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.368+0000 7f7c0cff9700 1 -- 172.21.15.150:0/3642191374 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f7c04021080 con 0x7f7c10150b80 2022-08-10T17:45:36.372 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":76,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:36.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.371+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 msgr2=0x7f7bf0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:36.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.371+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 0x7f7bf0067560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c00013040 tx=0x7f7c00008030 comp rx=0 tx=0).stop 2022-08-10T17:45:36.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.371+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 msgr2=0x7f7c10159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:36.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.371+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e8a0 tx=0x7f7c0400ec60 comp rx=0 tx=0).stop 2022-08-10T17:45:36.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 shutdown_connections 2022-08-10T17:45:36.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7c10150f50 0x7f7c10155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7bf00650b0 0x7f7bf0067560 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7c100c7d80 0x7f7c1014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 --2- 172.21.15.150:0/3642191374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c10150b80 0x7f7c10159550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:36.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 >> 172.21.15.150:0/3642191374 conn(0x7f7c10071e40 msgr2=0x7f7c100cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:36.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 shutdown_connections 2022-08-10T17:45:36.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:36.372+0000 7f7c16836700 1 -- 172.21.15.150:0/3642191374 wait complete. 2022-08-10T17:45:39.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:39.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.548+0000 7f1f37110700 1 Processor -- start 2022-08-10T17:45:39.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.548+0000 7f1f37110700 1 -- start start 2022-08-10T17:45:39.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f30070220 con 0x7f1f3014d700 2022-08-10T17:45:39.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3006c3b0 con 0x7f1f3014dad0 2022-08-10T17:45:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f37110700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3006e510 con 0x7f1f3006f570 2022-08-10T17:45:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39630/0 (socket says 172.21.15.150:39630) 2022-08-10T17:45:39.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 learned_addr learned my addr 172.21.15.150:0/2848378753 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:39.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:39.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:45:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.549+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:39.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:39.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:45:39.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:39.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:39.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:39.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:39.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:39.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:39.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:39.750+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:45:40.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:40.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:40.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:40.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.151+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:40.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.153+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.153+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:40.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.153+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.153+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.153+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:45:40.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:45:40.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:45:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f2ffff700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.952+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:45:40.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.954+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:40.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.954+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:45:40.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.954+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:45:40.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.954+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:40.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:40.954+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:45:42.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 msgr2=0x7f1f30153590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:42.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f3006f570 0x7f1f30153590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:42.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 msgr2=0x7f1f300c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:42.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.197:3300/0 conn(0x7f1f3014dad0 0x7f1f300c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:42.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 -- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 msgr2=0x7f1f3006bce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:45:42.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 --2- 172.21.15.150:0/2848378753 >> v2:172.21.15.150:3300/0 conn(0x7f1f3014d700 0x7f1f3006bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:42.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 -- 172.21.15.150:0/2848378753 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f300c3830 con 0x7f1f14007220 2022-08-10T17:45:42.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:42.549+0000 7f1f2e7fc700 1 -- 172.21.15.150:0/2848378753 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1400bf70 con 0x7f1f140035a0 2022-08-10T17:45:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.089+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343749301 0 0) 0x7f1f300c3830 con 0x7f1f14007220 2022-08-10T17:45:44.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.089+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f18003430 con 0x7f1f14007220 2022-08-10T17:45:44.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2359558038 0 0) 0x7f1f18003430 con 0x7f1f14007220 2022-08-10T17:45:44.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 >> v1:172.21.15.197:6789/0 conn(0x7f1f140035a0 legacy=0x7f1f140059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1400d170 con 0x7f1f14007220 2022-08-10T17:45:44.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f1f1c00d580 con 0x7f1f14007220 2022-08-10T17:45:44.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 >> v1:172.21.15.150:6789/0 conn(0x7f1f14007220 legacy=0x7f1f140096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f356ad700 1 -- 172.21.15.150:0/2848378753 reap_dead start 2022-08-10T17:45:44.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f18003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f180046d0 0x7f1f18004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f18009880 0x7f1f1800bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1800c1d0 con 0x7f1f18003900 2022-08-10T17:45:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1800c340 con 0x7f1f180046d0 2022-08-10T17:45:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.090+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1800c500 con 0x7f1f18009880 2022-08-10T17:45:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f18003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f180046d0 0x7f1f18004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f356ad700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f18009880 0x7f1f1800bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f18009880 msgr2=0x7f1f1800bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:44.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f18009880 0x7f1f1800bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f180046d0 msgr2=0x7f1f18004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:44.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f180046d0 0x7f1f18004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 -- 172.21.15.150:0/2848378753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18003430 con 0x7f1f18003900 2022-08-10T17:45:44.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f34eac700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f18003cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f24006fd0 tx=0x7f1f18005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98ded0d2357ee76 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24017070 con 0x7f1f18003900 2022-08-10T17:45:44.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400fb70 con 0x7f1f18003900 2022-08-10T17:45:44.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.091+0000 7f1f2f7fe700 1 -- 172.21.15.150:0/2848378753 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004020 con 0x7f1f18003900 2022-08-10T17:45:44.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 -- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 msgr2=0x7f1f18003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f18003cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f24006fd0 tx=0x7f1f18005700 comp rx=0 tx=0).stop 2022-08-10T17:45:44.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 -- 172.21.15.150:0/2848378753 shutdown_connections 2022-08-10T17:45:44.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f18009880 0x7f1f1800bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f180046d0 0x7f1f18004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 --2- 172.21.15.150:0/2848378753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f18003cf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 -- 172.21.15.150:0/2848378753 >> 172.21.15.150:0/2848378753 conn(0x7f1f300c8a10 msgr2=0x7f1f300c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 -- 172.21.15.150:0/2848378753 shutdown_connections 2022-08-10T17:45:44.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.092+0000 7f1f37110700 1 -- 172.21.15.150:0/2848378753 wait complete. 2022-08-10T17:45:44.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 Processor -- start 2022-08-10T17:45:44.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 -- start start 2022-08-10T17:45:44.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f180046d0 0x7f1f300c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300c2590 con 0x7f1f18003900 2022-08-10T17:45:44.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301e79c0 con 0x7f1f18009880 2022-08-10T17:45:44.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f37110700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b90a0 con 0x7f1f180046d0 2022-08-10T17:45:44.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f34eac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f34eac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39690/0 (socket says 172.21.15.150:39690) 2022-08-10T17:45:44.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f34eac700 1 -- 172.21.15.150:0/1895887308 learned_addr learned my addr 172.21.15.150:0/1895887308 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:44.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f356ad700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.094+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f180046d0 0x7f1f300c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f356ad700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 msgr2=0x7f1f300c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:45:44.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f356ad700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 msgr2=0x7f1f300c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:45:44.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f356ad700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:45:44.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f356ad700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:44.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f180046d0 msgr2=0x7f1f300c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f180046d0 0x7f1f300c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 msgr2=0x7f1f300c0670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:44.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 -- 172.21.15.150:0/1895887308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300c12d0 con 0x7f1f18003900 2022-08-10T17:45:44.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f34eac700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f24006e50 tx=0x7f1f240045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24003730 con 0x7f1f18003900 2022-08-10T17:45:44.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24003890 con 0x7f1f18003900 2022-08-10T17:45:44.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f30148210 con 0x7f1f18003900 2022-08-10T17:45:44.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24003c40 con 0x7f1f18003900 2022-08-10T17:45:44.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.095+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3014adb0 con 0x7f1f18003900 2022-08-10T17:45:44.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.096+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f30072890 con 0x7f1f18003900 2022-08-10T17:45:44.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.097+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1f24036070 con 0x7f1f18003900 2022-08-10T17:45:44.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.097+0000 7f1f2d7fa700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 0x7f1f14067ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.097+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1f24086b10 con 0x7f1f18003900 2022-08-10T17:45:44.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.098+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 0x7f1f14067ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.098+0000 7f1f2ffff700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 0x7f1f14067ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f301e4c00 tx=0x7f1f1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.106+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1f24054a90 con 0x7f1f18003900 2022-08-10T17:45:44.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.462+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f3006e7b0 con 0x7f1f18003900 2022-08-10T17:45:44.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.463+0000 7f1f2d7fa700 1 -- 172.21.15.150:0/1895887308 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f1f24034080 con 0x7f1f18003900 2022-08-10T17:45:44.467 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:44.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 msgr2=0x7f1f14067ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 0x7f1f14067ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f301e4c00 tx=0x7f1f1c008040 comp rx=0 tx=0).stop 2022-08-10T17:45:44.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 msgr2=0x7f1f300b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f24006e50 tx=0x7f1f240045d0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 shutdown_connections 2022-08-10T17:45:44.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1f18009880 0x7f1f300c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18003900 0x7f1f300b8b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1f140659f0 0x7f1f14067ea0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 --2- 172.21.15.150:0/1895887308 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1f180046d0 0x7f1f300c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 >> 172.21.15.150:0/1895887308 conn(0x7f1f300c8a10 msgr2=0x7f1f300c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 shutdown_connections 2022-08-10T17:45:44.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.465+0000 7f1f37110700 1 -- 172.21.15.150:0/1895887308 wait complete. 2022-08-10T17:45:44.481 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:45:44.481 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:45:44.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.634+0000 7f3fd6aed700 1 Processor -- start 2022-08-10T17:45:44.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.634+0000 7f3fd6aed700 1 -- start start 2022-08-10T17:45:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd6aed700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3fd006d2e0 0x7f3fd00c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd6aed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fd00c5da0 0x7f3fd00c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd6aed700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd006e230 con 0x7f3fd00c10d0 2022-08-10T17:45:44.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd6aed700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd00c4d60 con 0x7f3fd00c5da0 2022-08-10T17:45:44.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd6aed700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd006d750 con 0x7f3fd006d2e0 2022-08-10T17:45:44.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd508a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fd00c5da0 0x7f3fd00c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd4889700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3fd00c10d0 0x7f3fd015abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:52382/0 (socket says 172.21.15.150:52382) 2022-08-10T17:45:44.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fd4889700 1 -- 172.21.15.150:0/2168829919 learned_addr learned my addr 172.21.15.150:0/2168829919 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:44.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.635+0000 7f3fcffff700 1 --2- 172.21.15.150:0/2168829919 >> v2:172.21.15.197:3300/0 conn(0x7f3fd006d2e0 0x7f3fd00c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fd508a700 1 -- 172.21.15.150:0/2168829919 >> v2:172.21.15.197:3300/0 conn(0x7f3fd006d2e0 msgr2=0x7f3fd00c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:44.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fd508a700 1 --2- 172.21.15.150:0/2168829919 >> v2:172.21.15.197:3300/0 conn(0x7f3fd006d2e0 0x7f3fd00c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fd508a700 1 -- 172.21.15.150:0/2168829919 >> v1:172.21.15.150:6789/0 conn(0x7f3fd00c10d0 legacy=0x7f3fd015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fd508a700 1 -- 172.21.15.150:0/2168829919 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd006d990 con 0x7f3fd00c5da0 2022-08-10T17:45:44.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fcf7fe700 1 -- 172.21.15.150:0/2168829919 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573049151 0 0) 0x7f3fd006e230 con 0x7f3fd00c10d0 2022-08-10T17:45:44.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fd508a700 1 --2- 172.21.15.150:0/2168829919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c5da0 0x7f3fd00c2110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00be870 tx=0x7f3fc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819d90cf18a81955 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fcf7fe700 1 -- 172.21.15.150:0/2168829919 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800e070 con 0x7f3fd00c5da0 2022-08-10T17:45:44.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fcf7fe700 1 -- 172.21.15.150:0/2168829919 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc800bb20 con 0x7f3fd00c5da0 2022-08-10T17:45:44.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.636+0000 7f3fcf7fe700 1 -- 172.21.15.150:0/2168829919 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8012430 con 0x7f3fd00c5da0 2022-08-10T17:45:44.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2168829919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c5da0 msgr2=0x7f3fd00c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2168829919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c5da0 0x7f3fd00c2110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00be870 tx=0x7f3fc800b330 comp rx=0 tx=0).stop 2022-08-10T17:45:44.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2168829919 shutdown_connections 2022-08-10T17:45:44.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2168829919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c5da0 0x7f3fd00c2110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2168829919 >> v2:172.21.15.197:3300/0 conn(0x7f3fd006d2e0 0x7f3fd00c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2168829919 >> 172.21.15.150:0/2168829919 conn(0x7f3fd006fae0 msgr2=0x7f3fd006fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2168829919 shutdown_connections 2022-08-10T17:45:44.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.637+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2168829919 wait complete. 2022-08-10T17:45:44.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.638+0000 7f3fd6aed700 1 Processor -- start 2022-08-10T17:45:44.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.638+0000 7f3fd6aed700 1 -- start start 2022-08-10T17:45:44.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fd006d2e0 0x7f3fd01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c10d0 0x7f3fd0151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fd00c5da0 0x7f3fd00aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd006b340 con 0x7f3fd00c10d0 2022-08-10T17:45:44.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00ad5b0 con 0x7f3fd006d2e0 2022-08-10T17:45:44.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd6aed700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00ad010 con 0x7f3fd00c5da0 2022-08-10T17:45:44.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fcffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c10d0 0x7f3fd0151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fcffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c10d0 0x7f3fd0151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39710/0 (socket says 172.21.15.150:39710) 2022-08-10T17:45:44.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fcffff700 1 -- 172.21.15.150:0/2525804972 learned_addr learned my addr 172.21.15.150:0/2525804972 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:44.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fd006d2e0 0x7f3fd01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd508a700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fd00c5da0 0x7f3fd00aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fd00c5da0 msgr2=0x7f3fd00aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3fd00c5da0 0x7f3fd00aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c10d0 msgr2=0x7f3fd0151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00c10d0 0x7f3fd0151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.639+0000 7f3fd4889700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8009a70 con 0x7f3fd006d2e0 2022-08-10T17:45:44.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.640+0000 7f3fd4889700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fd006d2e0 0x7f3fd01510c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c410 tx=0x7f3fc400c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.640+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40072d0 con 0x7f3fd006d2e0 2022-08-10T17:45:44.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.640+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4007450 con 0x7f3fd006d2e0 2022-08-10T17:45:44.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.640+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd00ad2d0 con 0x7f3fd006d2e0 2022-08-10T17:45:44.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.640+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40075c0 con 0x7f3fd006d2e0 2022-08-10T17:45:44.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.641+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd006b060 con 0x7f3fd006d2e0 2022-08-10T17:45:44.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.641+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 0x7f3fd00af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.641+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00644b0 con 0x7f3fd00abb20 2022-08-10T17:45:44.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcffff700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 0x7f3fd00af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3fc401a020 con 0x7f3fd006d2e0 2022-08-10T17:45:44.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcffff700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fd0072890 con 0x7f3fd00abb20 2022-08-10T17:45:44.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcd7fa700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fb80650b0 0x7f3fb8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3fc4081ad0 con 0x7f3fd006d2e0 2022-08-10T17:45:44.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcffff700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 0x7f3fd00af4e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00c82e0 tx=0x7f3fbc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00f6d0 con 0x7f3fd00abb20 2022-08-10T17:45:44.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.642+0000 7f3fd508a700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fb80650b0 0x7f3fb8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3fbc00f830 con 0x7f3fd00abb20 2022-08-10T17:45:44.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 msgr2=0x7f3fd00af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fcd7fa700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 0x7f3fd00af4e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00c82e0 tx=0x7f3fbc011bf0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 msgr2=0x7f3fd00af4e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:44.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fcd7fa700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00abb20 0x7f3fd00af4e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.643+0000 7f3fd508a700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fb80650b0 0x7f3fb8067560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8014040 tx=0x7f3fc8011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.652+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 0x7f3fd01ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.652+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00abef0 con 0x7f3fd00ae470 2022-08-10T17:45:44.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.653+0000 7f3fcffff700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 0x7f3fd01ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.653+0000 7f3fcffff700 1 -- 172.21.15.150:0/2525804972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3fd00b0db0 con 0x7f3fd00ae470 2022-08-10T17:45:44.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.653+0000 7f3fcffff700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 0x7f3fd01ef660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc01c000 tx=0x7f3fbc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.653+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00fee0 con 0x7f3fd00ae470 2022-08-10T17:45:44.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.656+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4888 (secure 0 0 0) 0x7f3fbc02a3a0 con 0x7f3fd00ae470 2022-08-10T17:45:44.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.656+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 msgr2=0x7f3fd01ef660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.656+0000 7f3fcd7fa700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 0x7f3fd01ef660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc01c000 tx=0x7f3fbc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.656+0000 7f3fcd7fa700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 msgr2=0x7f3fd01ef660 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:44.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.656+0000 7f3fcd7fa700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fd00ae470 0x7f3fd01ef660 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc01c000 tx=0x7f3fbc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.664 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:44.664 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:44.665 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:44.665 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:45:44.665 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:44.665 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:44.665 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:44.666 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:44.666 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:44.666 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.666 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:45:44.667 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:44.667 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:44.667 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:44.667 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.668 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.668 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.668 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.668 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.668 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.669 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.669 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.669 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.669 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.670 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:44.670 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:44.670 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.670 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.671 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.671 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.671 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.671 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.672 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.672 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.672 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.672 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.673 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:44.673 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:44.673 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:44.673 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:44.674 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:44.674 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:44.674 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:44.674 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:44.675 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:44.675 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:44.675 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:44.675 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:44.676 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:44.676 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:44.676 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:44.676 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:44.677 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.677 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.677 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.677 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.678 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.678 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.678 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.678 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.679 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.679 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.679 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:44.679 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.680 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:44.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.680 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:44.680 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:44.681 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.681 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.681 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.682 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:44.682 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.682 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.688 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:44.688 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.688 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.689 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.689 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:44.689 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:44.689 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.690 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.690 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.691 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:44.691 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:44.691 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.691 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.692 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:44.692 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.693 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:44.693 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.694 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.694 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.694 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:44.695 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:44.695 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.695 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.695 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.696 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:44.696 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:44.696 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.697 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.697 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.697 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.699 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:44.699 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.699 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:44.700 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:44.700 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.700 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.701 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.701 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.702 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:44.702 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:44.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.702 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.703 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.703 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:44.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.703 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.704 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:44.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.704 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.704 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.704 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:44.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.705 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.705 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:44.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.706 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.706 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.706 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:45:44.706 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.707 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.707 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:44.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.707 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.707 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.708 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:45:44.708 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.708 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.708 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:44.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.709 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.709 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.709 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:44.710 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.710 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.710 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:44.710 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:44.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.659+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fb80650b0 msgr2=0x7f3fb8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.659+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3fb80650b0 0x7f3fb8067560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8014040 tx=0x7f3fc8011000 comp rx=0 tx=0).stop 2022-08-10T17:45:44.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.659+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fd006d2e0 msgr2=0x7f3fd01510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.659+0000 7f3fd6aed700 1 --2- 172.21.15.150:0/2525804972 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3fd006d2e0 0x7f3fd01510c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c410 tx=0x7f3fc400c720 comp rx=0 tx=0).stop 2022-08-10T17:45:44.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.661+0000 7f3fd508a700 1 -- 172.21.15.150:0/2525804972 reap_dead start 2022-08-10T17:45:44.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.661+0000 7f3fd508a700 1 -- 172.21.15.150:0/2525804972 reap_dead start 2022-08-10T17:45:44.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.664+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 shutdown_connections 2022-08-10T17:45:44.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.665+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 >> 172.21.15.150:0/2525804972 conn(0x7f3fd006fae0 msgr2=0x7f3fd00bea80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.665+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 shutdown_connections 2022-08-10T17:45:44.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.665+0000 7f3fd6aed700 1 -- 172.21.15.150:0/2525804972 wait complete. 2022-08-10T17:45:44.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:45:44.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.852+0000 7fd1f8039700 1 Processor -- start 2022-08-10T17:45:44.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.853+0000 7fd1f8039700 1 -- start start 2022-08-10T17:45:44.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.854+0000 7fd1f8039700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.854+0000 7fd1f8039700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd1f0070040 0x7fd1f00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.854+0000 7fd1f8039700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f01563c0 con 0x7fd1f006c860 2022-08-10T17:45:44.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.854+0000 7fd1f8039700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f0153590 con 0x7fd1f0070040 2022-08-10T17:45:44.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.854+0000 7fd1f8039700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0068650 con 0x7fd1f00bc830 2022-08-10T17:45:44.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.855+0000 7fd1f5dd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.855+0000 7fd1f5dd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53944/0 (socket says 172.21.15.150:53944) 2022-08-10T17:45:44.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.855+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/4195419061 learned_addr learned my addr 172.21.15.150:0/4195419061 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:44.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.856+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/4195419061 >> v2:172.21.15.197:3300/0 conn(0x7fd1f0070040 msgr2=0x7fd1f00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:44.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.856+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/4195419061 >> v2:172.21.15.197:3300/0 conn(0x7fd1f0070040 0x7fd1f00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.856+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/4195419061 >> v1:172.21.15.150:6789/0 conn(0x7fd1f006c860 legacy=0x7fd1f0152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:44.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.856+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/4195419061 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0150940 con 0x7fd1f00bc830 2022-08-10T17:45:44.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.856+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/4195419061 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00ba10 tx=0x7fd1ec00bd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edfcc8ab25c548ae server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.857+0000 7fd1f4dd3700 1 -- 172.21.15.150:0/4195419061 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004230 con 0x7fd1f00bc830 2022-08-10T17:45:44.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.858+0000 7fd1f4dd3700 1 -- 172.21.15.150:0/4195419061 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec004390 con 0x7fd1f00bc830 2022-08-10T17:45:44.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.858+0000 7fd1f4dd3700 1 -- 172.21.15.150:0/4195419061 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00db60 con 0x7fd1f00bc830 2022-08-10T17:45:44.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.858+0000 7fd1f8039700 1 -- 172.21.15.150:0/4195419061 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 msgr2=0x7fd1f0068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.858+0000 7fd1f8039700 1 --2- 172.21.15.150:0/4195419061 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00ba10 tx=0x7fd1ec00bd20 comp rx=0 tx=0).stop 2022-08-10T17:45:44.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.864+0000 7fd1f8039700 1 -- 172.21.15.150:0/4195419061 shutdown_connections 2022-08-10T17:45:44.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.864+0000 7fd1f8039700 1 --2- 172.21.15.150:0/4195419061 >> v2:172.21.15.197:3300/0 conn(0x7fd1f0070040 0x7fd1f00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.864+0000 7fd1f8039700 1 --2- 172.21.15.150:0/4195419061 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f00bc830 0x7fd1f0068110 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.864+0000 7fd1f8039700 1 -- 172.21.15.150:0/4195419061 >> 172.21.15.150:0/4195419061 conn(0x7fd1f00c92f0 msgr2=0x7fd1f00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.865+0000 7fd1f8039700 1 -- 172.21.15.150:0/4195419061 shutdown_connections 2022-08-10T17:45:44.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.865+0000 7fd1f8039700 1 -- 172.21.15.150:0/4195419061 wait complete. 2022-08-10T17:45:44.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.867+0000 7fd1f8039700 1 Processor -- start 2022-08-10T17:45:44.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.867+0000 7fd1f8039700 1 -- start start 2022-08-10T17:45:44.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f006c860 0x7fd1f0148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 0x7fd1f00c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00bc830 0x7fd1f00c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00c7750 con 0x7fd1f006c860 2022-08-10T17:45:44.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01f0490 con 0x7fd1f00bc830 2022-08-10T17:45:44.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.868+0000 7fd1f8039700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01f1440 con 0x7fd1f0070040 2022-08-10T17:45:44.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.870+0000 7fd1f55d4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 0x7fd1f00c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.870+0000 7fd1f55d4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 0x7fd1f00c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53950/0 (socket says 172.21.15.150:53950) 2022-08-10T17:45:44.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.870+0000 7fd1f55d4700 1 -- 172.21.15.150:0/2808194520 learned_addr learned my addr 172.21.15.150:0/2808194520 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:44.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f006c860 0x7fd1f0148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00bc830 msgr2=0x7fd1f00c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00bc830 0x7fd1f00c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f006c860 msgr2=0x7fd1f0148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f006c860 0x7fd1f0148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec00b670 con 0x7fd1f0070040 2022-08-10T17:45:44.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1f006c860 0x7fd1f0148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:45:44.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f55d4700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 0x7fd1f00c4780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b410 tx=0x7fd1e000b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011830 con 0x7fd1f0070040 2022-08-10T17:45:44.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0011990 con 0x7fd1f0070040 2022-08-10T17:45:44.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f0152bf0 con 0x7fd1f0070040 2022-08-10T17:45:44.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011d20 con 0x7fd1f0070040 2022-08-10T17:45:44.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.872+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f01f0960 con 0x7fd1f0070040 2022-08-10T17:45:44.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.873+0000 7fd1f8039700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 0x7fd1f00c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.873+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0071e00 con 0x7fd1f00c4cc0 2022-08-10T17:45:44.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.873+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 0x7fd1f00c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1f0072890 con 0x7fd1f00c4cc0 2022-08-10T17:45:44.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 0x7fd1f00c62b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec019040 tx=0x7fd1ec0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd1e0021070 con 0x7fd1f0070040 2022-08-10T17:45:44.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1d0065080 0x7fd1d0067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd1e0081f50 con 0x7fd1f0070040 2022-08-10T17:45:44.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1f65d6700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1d0065080 0x7fd1d0067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec006be0 con 0x7fd1f00c4cc0 2022-08-10T17:45:44.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd1ec003bc0 con 0x7fd1f00c4cc0 2022-08-10T17:45:44.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 msgr2=0x7fd1f00c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 0x7fd1f00c62b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec019040 tx=0x7fd1ec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 msgr2=0x7fd1f00c62b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:44.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.874+0000 7fd1de7fc700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f00c4cc0 0x7fd1f00c62b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.875+0000 7fd1f65d6700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1d0065080 0x7fd1d0067530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ab10 tx=0x7fd1e8009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.886+0000 7fd1f8039700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 0x7fd1f00c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:44.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.886+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0067100 con 0x7fd1f0153090 2022-08-10T17:45:44.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.890+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 0x7fd1f00c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:44.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.890+0000 7fd1f5dd5700 1 -- 172.21.15.150:0/2808194520 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd1f0068870 con 0x7fd1f0153090 2022-08-10T17:45:44.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.891+0000 7fd1f5dd5700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 0x7fd1f00c1a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00c50c0 tx=0x7fd1ec012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:44.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.891+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec020680 con 0x7fd1f0153090 2022-08-10T17:45:44.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.892+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4376 (secure 0 0 0) 0x7fd1ec0207e0 con 0x7fd1f0153090 2022-08-10T17:45:44.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.892+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 msgr2=0x7fd1f00c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.892+0000 7fd1de7fc700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 0x7fd1f00c1a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00c50c0 tx=0x7fd1ec012000 comp rx=0 tx=0).stop 2022-08-10T17:45:44.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.892+0000 7fd1de7fc700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 msgr2=0x7fd1f00c1a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:44.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.892+0000 7fd1de7fc700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd1f0153090 0x7fd1f00c1a80 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00c50c0 tx=0x7fd1ec012000 comp rx=0 tx=0).stop 2022-08-10T17:45:44.898 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:44.898 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:44.898 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:44.899 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:45:44.899 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:44.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:44.899 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:44.900 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:44.900 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:44.900 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.900 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:45:44.901 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:44.901 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:44.901 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:44.901 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.902 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.902 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.902 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.902 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.903 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.903 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.903 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.903 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.904 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.904 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:44.904 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:44.904 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.905 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.905 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.905 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.905 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.906 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.906 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.906 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.906 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.906 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.907 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:44.907 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:44.909 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:44.909 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:44.909 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:44.909 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:44.910 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:44.910 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:44.910 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:44.910 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:44.911 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:44.911 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:44.911 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:44.911 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:44.912 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:44.912 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:44.912 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:44.912 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:44.913 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:44.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:44.913 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.913 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:44.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:44.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.914 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:44.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:44.915 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.915 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.916 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.916 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:44.916 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.917 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:44.917 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.918 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.918 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.918 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:44.919 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:44.919 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.919 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.919 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.920 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:44.920 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:44.921 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.921 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.921 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.921 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:44.922 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.922 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.923 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:44.923 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.923 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.924 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:44.924 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:44.924 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.925 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.925 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.926 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:44.926 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:44.926 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:44.926 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:44.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.927 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:44.927 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:44.927 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.928 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:44.928 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:44.929 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:44.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.929 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.930 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:44.930 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:44.930 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:44.930 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:44.931 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:44.931 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.931 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.932 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:44.932 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:44.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.932 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.933 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.933 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:44.933 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.933 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:44.934 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:44.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:44.934 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:44.934 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:44.935 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:44.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:44.935 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:44.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:44.936 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:44.936 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:44.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.893+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1d0065080 msgr2=0x7fd1d0067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.893+0000 7fd1f8039700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd1d0065080 0x7fd1d0067530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ab10 tx=0x7fd1e8009250 comp rx=0 tx=0).stop 2022-08-10T17:45:44.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.893+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 msgr2=0x7fd1f00c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:44.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.893+0000 7fd1f8039700 1 --2- 172.21.15.150:0/2808194520 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd1f0070040 0x7fd1f00c4780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b410 tx=0x7fd1e000b7d0 comp rx=0 tx=0).stop 2022-08-10T17:45:44.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.893+0000 7fd1f65d6700 1 -- 172.21.15.150:0/2808194520 reap_dead start 2022-08-10T17:45:44.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.894+0000 7fd1f65d6700 1 -- 172.21.15.150:0/2808194520 reap_dead start 2022-08-10T17:45:44.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.896+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 shutdown_connections 2022-08-10T17:45:44.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.896+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 >> 172.21.15.150:0/2808194520 conn(0x7fd1f00c92f0 msgr2=0x7fd1f00c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:44.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.900+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 shutdown_connections 2022-08-10T17:45:44.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:44.900+0000 7fd1f8039700 1 -- 172.21.15.150:0/2808194520 wait complete. 2022-08-10T17:45:44.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:45:45.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.082+0000 7f36a6ab1700 1 Processor -- start 2022-08-10T17:45:45.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.082+0000 7f36a6ab1700 1 -- start start 2022-08-10T17:45:45.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a6ab1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36a00c3410 0x7f36a00c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a6ab1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f36a0068110 0x7f36a0155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a6ab1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a0158dc0 con 0x7f36a00c37e0 2022-08-10T17:45:45.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a6ab1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a0070580 con 0x7f36a00c3410 2022-08-10T17:45:45.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a6ab1700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a006fd90 con 0x7f36a0068110 2022-08-10T17:45:45.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a484d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36a00c3410 0x7f36a00c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a484d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36a00c3410 0x7f36a00c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39738/0 (socket says 172.21.15.150:39738) 2022-08-10T17:45:45.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.083+0000 7f36a484d700 1 -- 172.21.15.150:0/3723935874 learned_addr learned my addr 172.21.15.150:0/3723935874 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:45.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f369ffff700 1 --2- 172.21.15.150:0/3723935874 >> v2:172.21.15.197:3300/0 conn(0x7f36a0068110 0x7f36a0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f36a484d700 1 -- 172.21.15.150:0/3723935874 >> v2:172.21.15.197:3300/0 conn(0x7f36a0068110 msgr2=0x7f36a0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:45.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f36a484d700 1 --2- 172.21.15.150:0/3723935874 >> v2:172.21.15.197:3300/0 conn(0x7f36a0068110 0x7f36a0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f36a484d700 1 -- 172.21.15.150:0/3723935874 >> v1:172.21.15.197:6789/0 conn(0x7f36a00c37e0 legacy=0x7f36a0153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f36a484d700 1 -- 172.21.15.150:0/3723935874 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0158240 con 0x7f36a00c3410 2022-08-10T17:45:45.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f36a484d700 1 --2- 172.21.15.150:0/3723935874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c3410 0x7f36a00c7070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c65c0 tx=0x7f369800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0de9b6389e642c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f369f7fe700 1 -- 172.21.15.150:0/3723935874 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800e070 con 0x7f36a00c3410 2022-08-10T17:45:45.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f369f7fe700 1 -- 172.21.15.150:0/3723935874 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800b910 con 0x7f36a00c3410 2022-08-10T17:45:45.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.084+0000 7f369f7fe700 1 -- 172.21.15.150:0/3723935874 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800bcc0 con 0x7f36a00c3410 2022-08-10T17:45:45.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3723935874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c3410 msgr2=0x7f36a00c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3723935874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c3410 0x7f36a00c7070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c65c0 tx=0x7f369800b330 comp rx=0 tx=0).stop 2022-08-10T17:45:45.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3723935874 shutdown_connections 2022-08-10T17:45:45.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3723935874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c3410 0x7f36a00c7070 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3723935874 >> v2:172.21.15.197:3300/0 conn(0x7f36a0068110 0x7f36a0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3723935874 >> 172.21.15.150:0/3723935874 conn(0x7f36a006d0d0 msgr2=0x7f36a00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3723935874 shutdown_connections 2022-08-10T17:45:45.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.085+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3723935874 wait complete. 2022-08-10T17:45:45.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.087+0000 7f36a6ab1700 1 Processor -- start 2022-08-10T17:45:45.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.087+0000 7f36a6ab1700 1 -- start start 2022-08-10T17:45:45.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a0068110 0x7f36a00690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f36a00c3410 0x7f36a00ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 0x7f36a00aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01ebb90 con 0x7f36a00c37e0 2022-08-10T17:45:45.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01ea960 con 0x7f36a00c3410 2022-08-10T17:45:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a6ab1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01eb260 con 0x7f36a0068110 2022-08-10T17:45:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 0x7f36a00aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 0x7f36a00aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39746/0 (socket says 172.21.15.150:39746) 2022-08-10T17:45:45.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 learned_addr learned my addr 172.21.15.150:0/3999838795 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a0068110 msgr2=0x7f36a00690d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:45:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a0068110 0x7f36a00690d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f36a00c3410 msgr2=0x7f36a00ae620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:45.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.088+0000 7f36a504e700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f36a00c3410 0x7f36a00ae620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009b30 con 0x7f36a00c37e0 2022-08-10T17:45:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f36a504e700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 0x7f36a00aeb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f369000c3c0 tx=0x7f369000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900052d0 con 0x7f36a00c37e0 2022-08-10T17:45:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000ce10 con 0x7f36a00c37e0 2022-08-10T17:45:45.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900117d0 con 0x7f36a00c37e0 2022-08-10T17:45:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01eb540 con 0x7f36a00c37e0 2022-08-10T17:45:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.089+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01eac40 con 0x7f36a00c37e0 2022-08-10T17:45:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.091+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 0x7f36a01e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.091+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00672f0 con 0x7f36a00bfd50 2022-08-10T17:45:45.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.093+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3690019030 con 0x7f36a00c37e0 2022-08-10T17:45:45.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.093+0000 7f369d7fa700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f36840650e0 0x7f3684067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.093+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3690081460 con 0x7f36a00c37e0 2022-08-10T17:45:45.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.093+0000 7f369ffff700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f36840650e0 0x7f3684067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.093+0000 7f36a484d700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 0x7f36a01e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.094+0000 7f369ffff700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f36840650e0 0x7f3684067590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a00a7f00 tx=0x7f36880090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.096+0000 7f36a484d700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36a0072890 con 0x7f36a00bfd50 2022-08-10T17:45:45.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f36a484d700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 0x7f36a01e9d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c65c0 tx=0x7f3698004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698004450 con 0x7f36a00bfd50 2022-08-10T17:45:45.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f36980099b0 con 0x7f36a00bfd50 2022-08-10T17:45:45.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 msgr2=0x7f36a01e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 0x7f36a01e9d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c65c0 tx=0x7f3698004950 comp rx=0 tx=0).stop 2022-08-10T17:45:45.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 msgr2=0x7f36a01e9d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:45.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.097+0000 7f369d7fa700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a00bfd50 0x7f36a01e9d80 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c65c0 tx=0x7f3698004950 comp rx=0 tx=0).stop 2022-08-10T17:45:45.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.114+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 0x7f36a01ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.114+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01eb6d0 con 0x7f36a01ea2c0 2022-08-10T17:45:45.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.114+0000 7f36a484d700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 0x7f36a01ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.115+0000 7f36a484d700 1 -- 172.21.15.150:0/3999838795 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f36a01ea6c0 con 0x7f36a01ea2c0 2022-08-10T17:45:45.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f36a484d700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 0x7f36a01ebcd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f369800b370 tx=0x7f3698009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369802b070 con 0x7f36a01ea2c0 2022-08-10T17:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7f3698024610 con 0x7f36a01ea2c0 2022-08-10T17:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 msgr2=0x7f36a01ebcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 0x7f36a01ebcd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f369800b370 tx=0x7f3698009810 comp rx=0 tx=0).stop 2022-08-10T17:45:45.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 msgr2=0x7f36a01ebcd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:45.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.117+0000 7f369d7fa700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f36a01ea2c0 0x7f36a01ebcd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.123 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:45.123 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:45.124 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:45.124 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:45:45.124 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:45.124 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:45.125 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:45.125 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:45.125 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:45.125 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.126 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:45:45.126 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:45.126 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:45.126 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:45.127 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:45.127 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:45.127 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:45.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:45.127 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:45.128 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:45.128 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:45.128 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:45.128 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:45.129 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.129 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:45.129 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:45.129 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:45.130 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:45.130 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:45.130 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:45.130 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:45.131 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:45.131 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:45.131 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:45.131 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:45.131 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.132 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:45.132 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:45.132 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:45.133 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:45.133 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:45.133 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:45.133 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:45.134 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:45.134 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:45.134 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:45.134 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:45.135 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:45.135 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:45.135 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:45.135 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:45.136 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:45.136 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:45.136 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:45.136 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:45.137 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:45.137 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:45.137 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:45.137 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:45.137 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:45.138 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:45.138 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.138 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:45.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.139 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:45.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.139 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:45.139 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:45.140 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:45.140 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:45.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.140 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:45.140 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:45.141 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.141 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:45.142 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:45.142 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.142 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.142 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.143 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:45.143 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:45.143 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:45.143 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:45.144 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:45.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.144 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:45.145 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:45.145 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:45.145 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:45.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.145 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:45.146 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:45.146 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.147 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:45.147 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:45.147 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.148 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.148 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:45.148 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:45.148 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:45.149 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:45.149 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:45.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.150 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:45.150 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:45.150 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:45.150 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.161 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:45:45.161 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.161 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:45.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.162 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:45.162 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.162 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:45:45.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.163 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:45.163 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:45.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:45.163 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:45.164 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:45.164 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:45.164 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:45.164 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:45.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:45.165 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:45.165 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:45.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f36840650e0 msgr2=0x7f3684067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f36840650e0 0x7f3684067590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a00a7f00 tx=0x7f36880090e0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 msgr2=0x7f36a00aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 --2- 172.21.15.150:0/3999838795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a00c37e0 0x7f36a00aeb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f369000c3c0 tx=0x7f369000c780 comp rx=0 tx=0).stop 2022-08-10T17:45:45.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 reap_dead start 2022-08-10T17:45:45.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a504e700 1 -- 172.21.15.150:0/3999838795 reap_dead start 2022-08-10T17:45:45.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 shutdown_connections 2022-08-10T17:45:45.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 >> 172.21.15.150:0/3999838795 conn(0x7f36a006d0d0 msgr2=0x7f36a0153260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:45.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 shutdown_connections 2022-08-10T17:45:45.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.118+0000 7f36a6ab1700 1 -- 172.21.15.150:0/3999838795 wait complete. 2022-08-10T17:45:45.169 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:45:45.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:45:45.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.305+0000 7f7867281700 1 Processor -- start 2022-08-10T17:45:45.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 -- start start 2022-08-10T17:45:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 0x7f78600718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786006a050 con 0x7f786006ea90 2022-08-10T17:45:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78600c6220 con 0x7f786015a970 2022-08-10T17:45:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.306+0000 7f7867281700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78600c4420 con 0x7f78601544d0 2022-08-10T17:45:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786481c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f786006ea90 0x7f786015a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:38792/0 (socket says 172.21.15.150:38792) 2022-08-10T17:45:45.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53980/0 (socket says 172.21.15.150:53980) 2022-08-10T17:45:45.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786481c700 1 -- 172.21.15.150:0/75956610 learned_addr learned my addr 172.21.15.150:0/75956610 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:45.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786581e700 1 --2- 172.21.15.150:0/75956610 >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 0x7f78600718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f784ffff700 1 -- 172.21.15.150:0/75956610 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889124285 0 0) 0x7f786006a050 con 0x7f786006ea90 2022-08-10T17:45:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 -- 172.21.15.150:0/75956610 >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 msgr2=0x7f78600718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 --2- 172.21.15.150:0/75956610 >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 0x7f78600718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 -- 172.21.15.150:0/75956610 >> v1:172.21.15.197:6789/0 conn(0x7f786006ea90 legacy=0x7f786015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 -- 172.21.15.150:0/75956610 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600c4700 con 0x7f78601544d0 2022-08-10T17:45:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786581e700 1 --2- 172.21.15.150:0/75956610 >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 0x7f78600718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:45:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f786501d700 1 --2- 172.21.15.150:0/75956610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f785c0096b0 tx=0x7f785c0099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b87bbf62a6d3fb6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f784ffff700 1 -- 172.21.15.150:0/75956610 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c011830 con 0x7f78601544d0 2022-08-10T17:45:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f784ffff700 1 -- 172.21.15.150:0/75956610 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c011990 con 0x7f78601544d0 2022-08-10T17:45:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.307+0000 7f784ffff700 1 -- 172.21.15.150:0/75956610 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c011d40 con 0x7f78601544d0 2022-08-10T17:45:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 -- 172.21.15.150:0/75956610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 msgr2=0x7f7860071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 --2- 172.21.15.150:0/75956610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f785c0096b0 tx=0x7f785c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 -- 172.21.15.150:0/75956610 shutdown_connections 2022-08-10T17:45:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 --2- 172.21.15.150:0/75956610 >> v2:172.21.15.197:3300/0 conn(0x7f786015a970 0x7f78600718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 --2- 172.21.15.150:0/75956610 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f78601544d0 0x7f7860071370 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 -- 172.21.15.150:0/75956610 >> 172.21.15.150:0/75956610 conn(0x7f7860068110 msgr2=0x7f7860068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 -- 172.21.15.150:0/75956610 shutdown_connections 2022-08-10T17:45:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.308+0000 7f7867281700 1 -- 172.21.15.150:0/75956610 wait complete. 2022-08-10T17:45:45.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.309+0000 7f7867281700 1 Processor -- start 2022-08-10T17:45:45.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.310+0000 7f7867281700 1 -- start start 2022-08-10T17:45:45.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78601544d0 0x7f78601ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f786015a970 0x7f78600ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78601ebe10 con 0x7f78601544d0 2022-08-10T17:45:45.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786014ba50 con 0x7f786015a970 2022-08-10T17:45:45.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f7867281700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78600ca830 con 0x7f786006ea90 2022-08-10T17:45:45.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:53986/0 (socket says 172.21.15.150:53986) 2022-08-10T17:45:45.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 -- 172.21.15.150:0/3232127216 learned_addr learned my addr 172.21.15.150:0/3232127216 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:45.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786581e700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f786015a970 0x7f78600ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786481c700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78601544d0 0x7f78601ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 -- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f786015a970 msgr2=0x7f78600ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f786015a970 0x7f78600ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 -- 172.21.15.150:0/3232127216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78601544d0 msgr2=0x7f78601ec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78601544d0 0x7f78601ec2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 -- 172.21.15.150:0/3232127216 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c009310 con 0x7f786006ea90 2022-08-10T17:45:45.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f786501d700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f785c0090b0 tx=0x7f785c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.311+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c004220 con 0x7f786006ea90 2022-08-10T17:45:45.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.312+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c004380 con 0x7f786006ea90 2022-08-10T17:45:45.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.312+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860154950 con 0x7f786006ea90 2022-08-10T17:45:45.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.312+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c01a7c0 con 0x7f786006ea90 2022-08-10T17:45:45.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.312+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78601eb7e0 con 0x7f786006ea90 2022-08-10T17:45:45.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.313+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78601ec0f0 con 0x7f786006ea90 2022-08-10T17:45:45.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.313+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f785c00f050 con 0x7f786006ea90 2022-08-10T17:45:45.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.314+0000 7f784dffb700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 0x7f7840067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:45.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.314+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f785c0832d0 con 0x7f786006ea90 2022-08-10T17:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.314+0000 7f786481c700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 0x7f7840067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.316+0000 7f786481c700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 0x7f7840067590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f78600aff70 tx=0x7f7850007cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:45.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.319+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f785c051250 con 0x7f786006ea90 2022-08-10T17:45:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.642+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f7860072890 con 0x7f786006ea90 2022-08-10T17:45:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.643+0000 7f784dffb700 1 -- 172.21.15.150:0/3232127216 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f785c054870 con 0x7f786006ea90 2022-08-10T17:45:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 msgr2=0x7f7840067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 0x7f7840067590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f78600aff70 tx=0x7f7850007cf0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 msgr2=0x7f78601eeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f785c0090b0 tx=0x7f785c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 shutdown_connections 2022-08-10T17:45:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f786015a970 0x7f78600ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78400650e0 0x7f7840067590 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f786006ea90 0x7f78601eeda0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 --2- 172.21.15.150:0/3232127216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78601544d0 0x7f78601ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 >> 172.21.15.150:0/3232127216 conn(0x7f7860068110 msgr2=0x7f78601525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 shutdown_connections 2022-08-10T17:45:45.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:45.645+0000 7f7867281700 1 -- 172.21.15.150:0/3232127216 wait complete. 2022-08-10T17:45:45.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:45:55.670 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:45:55.671 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:56.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 Processor -- start 2022-08-10T17:45:56.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 -- start start 2022-08-10T17:45:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3006a3d0 con 0x7ffb300c7170 2022-08-10T17:45:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb30070810 con 0x7ffb300c3060 2022-08-10T17:45:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.008+0000 7ffb351df700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300c5fb0 con 0x7ffb3006af70 2022-08-10T17:45:56.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2ed9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2ed9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50418/0 (socket says 172.21.15.150:50418) 2022-08-10T17:45:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54050/0 (socket says 172.21.15.150:54050) 2022-08-10T17:45:56.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2ed9d700 1 -- 172.21.15.150:0/1683331497 learned_addr learned my addr 172.21.15.150:0/1683331497 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2e59c700 1 --1- 172.21.15.150:0/1683331497 >> v1:172.21.15.197:6789/0 conn(0x7ffb300c7170 0x7ffb3006a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:38862/0 (socket says 172.21.15.150:38862) 2022-08-10T17:45:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 -- 172.21.15.150:0/1683331497 >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 msgr2=0x7ffb3006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 --2- 172.21.15.150:0/1683331497 >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 -- 172.21.15.150:0/1683331497 >> v1:172.21.15.197:6789/0 conn(0x7ffb300c7170 legacy=0x7ffb3006a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 -- 172.21.15.150:0/1683331497 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3006fc90 con 0x7ffb3006af70 2022-08-10T17:45:56.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2ed9d700 1 --2- 172.21.15.150:0/1683331497 >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:45:56.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2f59e700 1 --2- 172.21.15.150:0/1683331497 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009d90 tx=0x7ffb2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3877696b6d7738cb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2dd9b700 1 -- 172.21.15.150:0/1683331497 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2800e070 con 0x7ffb3006af70 2022-08-10T17:45:56.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2dd9b700 1 -- 172.21.15.150:0/1683331497 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2800bb20 con 0x7ffb3006af70 2022-08-10T17:45:56.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.009+0000 7ffb2dd9b700 1 -- 172.21.15.150:0/1683331497 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28012430 con 0x7ffb3006af70 2022-08-10T17:45:56.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 -- 172.21.15.150:0/1683331497 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 msgr2=0x7ffb300c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 --2- 172.21.15.150:0/1683331497 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009d90 tx=0x7ffb2800b330 comp rx=0 tx=0).stop 2022-08-10T17:45:56.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 -- 172.21.15.150:0/1683331497 shutdown_connections 2022-08-10T17:45:56.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 --2- 172.21.15.150:0/1683331497 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb3006af70 0x7ffb300c4cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 --2- 172.21.15.150:0/1683331497 >> v2:172.21.15.197:3300/0 conn(0x7ffb300c3060 0x7ffb3006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 -- 172.21.15.150:0/1683331497 >> 172.21.15.150:0/1683331497 conn(0x7ffb30068be0 msgr2=0x7ffb300c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 -- 172.21.15.150:0/1683331497 shutdown_connections 2022-08-10T17:45:56.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.010+0000 7ffb351df700 1 -- 172.21.15.150:0/1683331497 wait complete. 2022-08-10T17:45:56.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 Processor -- start 2022-08-10T17:45:56.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 -- start start 2022-08-10T17:45:56.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb3006af70 0x7ffb30143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 0x7ffb3014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30144080 con 0x7ffb3006af70 2022-08-10T17:45:56.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30145680 con 0x7ffb300c3060 2022-08-10T17:45:56.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.012+0000 7ffb351df700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30145a50 con 0x7ffb300c7170 2022-08-10T17:45:56.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50426/0 (socket says 172.21.15.150:50426) 2022-08-10T17:45:56.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 -- 172.21.15.150:0/1852194680 learned_addr learned my addr 172.21.15.150:0/1852194680 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:56.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2f59e700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 0x7ffb3014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 -- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 msgr2=0x7ffb3014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 0x7ffb3014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 -- 172.21.15.150:0/1852194680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb3006af70 msgr2=0x7ffb30143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb3006af70 0x7ffb30143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 -- 172.21.15.150:0/1852194680 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200093e0 con 0x7ffb300c3060 2022-08-10T17:45:56.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2f59e700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 0x7ffb3014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:45:56.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb2e59c700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c3c0 tx=0x7ffb2400c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240074e0 con 0x7ffb300c3060 2022-08-10T17:45:56.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400ce20 con 0x7ffb300c3060 2022-08-10T17:45:56.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004930 con 0x7ffb300c3060 2022-08-10T17:45:56.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.013+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb28009a70 con 0x7ffb300c3060 2022-08-10T17:45:56.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.014+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb300c9e80 con 0x7ffb300c3060 2022-08-10T17:45:56.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.014+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3006fb00 con 0x7ffb300c3060 2022-08-10T17:45:56.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.015+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ffb24010070 con 0x7ffb300c3060 2022-08-10T17:45:56.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.015+0000 7ffb177fe700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 0x7ffb10067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.015+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ffb24081890 con 0x7ffb300c3060 2022-08-10T17:45:56.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.015+0000 7ffb2ed9d700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 0x7ffb10067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.016+0000 7ffb2ed9d700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 0x7ffb10067560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb200093b0 tx=0x7ffb20009300 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.020+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ffb2404f870 con 0x7ffb300c3060 2022-08-10T17:45:56.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.356+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffb3006f0a0 con 0x7ffb300c3060 2022-08-10T17:45:56.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.357+0000 7ffb177fe700 1 -- 172.21.15.150:0/1852194680 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7ffb24052e90 con 0x7ffb300c3060 2022-08-10T17:45:56.364 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:56.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 msgr2=0x7ffb10067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 0x7ffb10067560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb200093b0 tx=0x7ffb20009300 comp rx=0 tx=0).stop 2022-08-10T17:45:56.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 msgr2=0x7ffb3014cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c3c0 tx=0x7ffb2400c6d0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 shutdown_connections 2022-08-10T17:45:56.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb100650b0 0x7ffb10067560 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb200093b0 tx=0x7ffb20009300 comp rx=0 tx=0).stop 2022-08-10T17:45:56.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb300c7170 0x7ffb3014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb3006af70 0x7ffb30143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 --2- 172.21.15.150:0/1852194680 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb300c3060 0x7ffb3014cbb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.363+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 >> 172.21.15.150:0/1852194680 conn(0x7ffb30068be0 msgr2=0x7ffb30071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.364+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 shutdown_connections 2022-08-10T17:45:56.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.364+0000 7ffb351df700 1 -- 172.21.15.150:0/1852194680 wait complete. 2022-08-10T17:45:56.391 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:45:56.391 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:45:56.391 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:45:56.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.522+0000 7f27d64d1700 1 Processor -- start 2022-08-10T17:45:56.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.522+0000 7f27d64d1700 1 -- start start 2022-08-10T17:45:56.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d64d1700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f27d00c8af0 0x7f27d00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d64d1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27d00c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d64d1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006e070 con 0x7f27d00c4f10 2022-08-10T17:45:56.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d64d1700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d006ec10 con 0x7f27d00c8af0 2022-08-10T17:45:56.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d64d1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c5390 con 0x7f27d00c96b0 2022-08-10T17:45:56.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d4a6e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f27d00c4f10 0x7f27d006e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:52520/0 (socket says 172.21.15.150:52520) 2022-08-10T17:45:56.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27d4a6e700 1 -- 172.21.15.150:0/1855591796 learned_addr learned my addr 172.21.15.150:0/1855591796 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:56.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27cffff700 1 --2- 172.21.15.150:0/1855591796 >> v2:172.21.15.197:3300/0 conn(0x7f27d00c8af0 0x7f27d00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27d00c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.523+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037637783 0 0) 0x7f27d006e070 con 0x7f27d00c4f10 2022-08-10T17:45:56.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b8003410 con 0x7f27d00c4f10 2022-08-10T17:45:56.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2854066558 0 0) 0x7f27b8003410 con 0x7f27d00c4f10 2022-08-10T17:45:56.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 msgr2=0x7f27d00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27d00c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 >> v2:172.21.15.197:3300/0 conn(0x7f27d00c8af0 msgr2=0x7f27d00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 --2- 172.21.15.150:0/1855591796 >> v2:172.21.15.197:3300/0 conn(0x7f27d00c8af0 0x7f27d00c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00701c0 con 0x7f27d00c4f10 2022-08-10T17:45:56.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f27c80019f0 con 0x7f27d00c4f10 2022-08-10T17:45:56.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 >> v1:172.21.15.150:6789/0 conn(0x7f27d00c4f10 legacy=0x7f27d006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27b8003be0 0x7f27b8003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27b8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8008d10 0x7f27b800b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d006ec10 con 0x7f27b8003be0 2022-08-10T17:45:56.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c5390 con 0x7f27b8008d10 2022-08-10T17:45:56.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b800b7f0 con 0x7f27d00c96b0 2022-08-10T17:45:56.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27cffff700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27b8003be0 0x7f27b8003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.527+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27b8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27d4a6e700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8008d10 0x7f27b800b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 -- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 msgr2=0x7f27b8004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d00c96b0 0x7f27b8004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 -- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8008d10 msgr2=0x7f27b800b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8008d10 0x7f27b800b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 -- 172.21.15.150:0/1855591796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8003410 con 0x7f27b8003be0 2022-08-10T17:45:56.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27d4a6e700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8008d10 0x7f27b800b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:45:56.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27cffff700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27b8003be0 0x7f27b8003ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009a60 tx=0x7f27b8004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada451fd4776663 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0010650 con 0x7f27b8003be0 2022-08-10T17:45:56.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000a040 con 0x7f27b8003be0 2022-08-10T17:45:56.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.528+0000 7f27ceffd700 1 -- 172.21.15.150:0/1855591796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c00109b0 con 0x7f27b8003be0 2022-08-10T17:45:56.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.529+0000 7f27d64d1700 1 -- 172.21.15.150:0/1855591796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27b8003be0 msgr2=0x7f27b8003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.529+0000 7f27d64d1700 1 --2- 172.21.15.150:0/1855591796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27b8003be0 0x7f27b8003ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009a60 tx=0x7f27b8004c60 comp rx=0 tx=0).stop 2022-08-10T17:45:56.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.529+0000 7f27d4a6e700 1 -- 172.21.15.150:0/1855591796 reap_dead start 2022-08-10T17:45:56.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.530+0000 7f27d64d1700 1 -- 172.21.15.150:0/1855591796 shutdown_connections 2022-08-10T17:45:56.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.530+0000 7f27d64d1700 1 -- 172.21.15.150:0/1855591796 >> 172.21.15.150:0/1855591796 conn(0x7f27d006b500 msgr2=0x7f27d006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.530+0000 7f27d64d1700 1 -- 172.21.15.150:0/1855591796 shutdown_connections 2022-08-10T17:45:56.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.530+0000 7f27d64d1700 1 -- 172.21.15.150:0/1855591796 wait complete. 2022-08-10T17:45:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.532+0000 7f27d64d1700 1 Processor -- start 2022-08-10T17:45:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.532+0000 7f27d64d1700 1 -- start start 2022-08-10T17:45:56.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 0x7f27d01edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d01ee510 0x7f27d0163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d015f230 0x7f27d015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00be1e0 con 0x7f27d015f230 2022-08-10T17:45:56.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015fbe0 con 0x7f27b8003be0 2022-08-10T17:45:56.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27d64d1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01ec650 con 0x7f27d01ee510 2022-08-10T17:45:56.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27cffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 0x7f27d01edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27cffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 0x7f27d01edb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50444/0 (socket says 172.21.15.150:50444) 2022-08-10T17:45:56.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.533+0000 7f27cffff700 1 -- 172.21.15.150:0/1170293851 learned_addr learned my addr 172.21.15.150:0/1170293851 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:56.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27d4a6e700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d015f230 0x7f27d015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d01ee510 msgr2=0x7f27d0163cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:45:56.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27d01ee510 0x7f27d0163cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d015f230 msgr2=0x7f27d015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d015f230 0x7f27d015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00bf110 con 0x7f27b8003be0 2022-08-10T17:45:56.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.534+0000 7f27cffff700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 0x7f27d01edb90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f27c0010d20 tx=0x7f27c0004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.538+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0020040 con 0x7f27b8003be0 2022-08-10T17:45:56.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.538+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c0004220 con 0x7f27b8003be0 2022-08-10T17:45:56.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.538+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0011840 con 0x7f27b8003be0 2022-08-10T17:45:56.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.539+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00bf3f0 con 0x7f27b8003be0 2022-08-10T17:45:56.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.539+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d00bf9b0 con 0x7f27b8003be0 2022-08-10T17:45:56.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.543+0000 7f27d64d1700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 0x7f27d0205150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.543+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015fbe0 con 0x7f27d0204d50 2022-08-10T17:45:56.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.543+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 0x7f27d0205150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.543+0000 7f27cf7fe700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27d00c21f0 con 0x7f27d0204d50 2022-08-10T17:45:56.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.544+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 0x7f27d0205150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c9b00 tx=0x7f27c4012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.544+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4012040 con 0x7f27d0204d50 2022-08-10T17:45:56.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.545+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f27c4013040 con 0x7f27d0204d50 2022-08-10T17:45:56.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.545+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 msgr2=0x7f27d0205150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.545+0000 7f27ccff9700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 0x7f27d0205150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c9b00 tx=0x7f27c4012c10 comp rx=0 tx=0).stop 2022-08-10T17:45:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.545+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 msgr2=0x7f27d0205150 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:56.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.545+0000 7f27ccff9700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0204d50 0x7f27d0205150 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c9b00 tx=0x7f27c4012c10 comp rx=0 tx=0).stop 2022-08-10T17:45:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.551+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f27c002a020 con 0x7f27b8003be0 2022-08-10T17:45:56.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.551+0000 7f27ccff9700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0064e80 0x7f27b0067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.552+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f27c00834a0 con 0x7f27b8003be0 2022-08-10T17:45:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.552+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0064e80 0x7f27b0067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.552+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0064e80 0x7f27b0067330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007fd0 tx=0x7f27c4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.556+0000 7f27d64d1700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 0x7f27d020ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.556+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00bf580 con 0x7f27d0164230 2022-08-10T17:45:56.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.556+0000 7f27d4a6e700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 0x7f27d020ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27d4a6e700 1 -- 172.21.15.150:0/1170293851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f27d00bfb40 con 0x7f27d0164230 2022-08-10T17:45:56.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27d4a6e700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 0x7f27d020ddf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f27b800b980 tx=0x7f27c8007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8013570 con 0x7f27d0164230 2022-08-10T17:45:56.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4889 (secure 0 0 0) 0x7f27c80136d0 con 0x7f27d0164230 2022-08-10T17:45:56.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 msgr2=0x7f27d020ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 0x7f27d020ddf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f27b800b980 tx=0x7f27c8007610 comp rx=0 tx=0).stop 2022-08-10T17:45:56.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 msgr2=0x7f27d020ddf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:56.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.557+0000 7f27ccff9700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d0164230 0x7f27d020ddf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.564 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:56.564 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:56.565 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:56.565 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:45:56.565 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:56.565 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:56.566 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:56.566 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:56.566 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:56.566 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.567 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:45:56.567 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:56.567 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:56.567 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:56.568 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.568 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.568 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.568 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.568 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.569 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.569 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.569 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.570 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.570 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.570 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:56.570 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:56.571 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.571 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.571 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.571 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.571 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.572 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.572 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.572 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.572 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.573 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.573 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:56.574 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:56.574 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:56.574 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:56.574 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:56.575 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:56.575 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:56.575 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:56.575 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:56.576 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:56.576 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:56.576 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:56.576 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:56.577 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:56.577 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:56.577 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:56.577 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.578 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.578 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.578 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.578 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.579 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.579 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.579 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.579 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.579 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.580 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:56.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.580 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:56.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.581 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:56.581 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:56.581 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.581 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.582 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.582 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:56.582 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.583 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:56.584 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.584 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.584 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.585 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:56.585 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:56.585 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.585 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.585 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.586 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:56.586 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:56.587 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.587 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.587 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.588 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:56.588 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.589 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:56.589 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.590 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:56.591 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:56.591 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.591 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.591 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.592 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:56.592 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:56.592 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.593 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.594 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.594 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:56.594 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.595 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.595 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:56.595 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.596 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.596 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:56.596 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:56.597 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.597 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.597 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.597 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.598 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.598 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:56.598 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:56.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.599 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.599 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.599 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:56.600 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.600 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.600 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:56.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.600 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.601 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.601 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:56.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.601 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.602 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:56.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.602 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.602 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.603 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:45:56.603 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.603 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.603 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:56.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.604 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.604 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.604 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:45:56.605 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.605 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.605 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:56.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.606 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.606 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.606 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:56.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.606 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.607 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:56.607 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:56.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.558+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0064e80 msgr2=0x7f27b0067330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.558+0000 7f27d64d1700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0064e80 0x7f27b0067330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007fd0 tx=0x7f27c4008070 comp rx=0 tx=0).stop 2022-08-10T17:45:56.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.558+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 msgr2=0x7f27d01edb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.558+0000 7f27d64d1700 1 --2- 172.21.15.150:0/1170293851 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27b8003be0 0x7f27d01edb90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f27c0010d20 tx=0x7f27c0004640 comp rx=0 tx=0).stop 2022-08-10T17:45:56.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.559+0000 7f27d4a6e700 1 -- 172.21.15.150:0/1170293851 reap_dead start 2022-08-10T17:45:56.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.561+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 shutdown_connections 2022-08-10T17:45:56.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.561+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 >> 172.21.15.150:0/1170293851 conn(0x7f27d006b500 msgr2=0x7f27d0164a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.563+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 shutdown_connections 2022-08-10T17:45:56.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.563+0000 7f27d64d1700 1 -- 172.21.15.150:0/1170293851 wait complete. 2022-08-10T17:45:56.612 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:45:56.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.784+0000 7f7f112e2700 1 Processor -- start 2022-08-10T17:45:56.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.784+0000 7f7f112e2700 1 -- start start 2022-08-10T17:45:56.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.785+0000 7f7f112e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7f0c06c860 0x7f7f0c068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.785+0000 7f7f112e2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c070040 0x7f7f0c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.785+0000 7f7f112e2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c1563c0 con 0x7f7f0c0bc830 2022-08-10T17:45:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.785+0000 7f7f112e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c153590 con 0x7f7f0c06c860 2022-08-10T17:45:56.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.785+0000 7f7f112e2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c068650 con 0x7f7f0c070040 2022-08-10T17:45:56.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7f0c0bc830 0x7f7f0c152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:52544/0 (socket says 172.21.15.150:52544) 2022-08-10T17:45:56.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7f0c06c860 0x7f7f0c068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0affd700 1 -- 172.21.15.150:0/296929237 learned_addr learned my addr 172.21.15.150:0/296929237 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:56.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0b7fe700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c070040 0x7f7f0c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 -- 172.21.15.150:0/296929237 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c070040 msgr2=0x7f7f0c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:56.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c070040 0x7f7f0c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 -- 172.21.15.150:0/296929237 >> v1:172.21.15.150:6789/0 conn(0x7f7f0c0bc830 legacy=0x7f7f0c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 -- 172.21.15.150:0/296929237 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c150940 con 0x7f7f0c06c860 2022-08-10T17:45:56.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.786+0000 7f7f0a7fc700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 0x7f7f0c068110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a780 tx=0x7f7f0000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b026933ca89cb74 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.920+0000 7f7f09ffb700 1 -- 172.21.15.150:0/296929237 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00010680 con 0x7f7f0c06c860 2022-08-10T17:45:56.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.920+0000 7f7f09ffb700 1 -- 172.21.15.150:0/296929237 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f000107e0 con 0x7f7f0c06c860 2022-08-10T17:45:56.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.920+0000 7f7f09ffb700 1 -- 172.21.15.150:0/296929237 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00010b70 con 0x7f7f0c06c860 2022-08-10T17:45:56.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 -- 172.21.15.150:0/296929237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 msgr2=0x7f7f0c068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 0x7f7f0c068110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a780 tx=0x7f7f0000aa90 comp rx=0 tx=0).stop 2022-08-10T17:45:56.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 -- 172.21.15.150:0/296929237 shutdown_connections 2022-08-10T17:45:56.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c070040 0x7f7f0c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 --2- 172.21.15.150:0/296929237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 0x7f7f0c068110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.921+0000 7f7f112e2700 1 -- 172.21.15.150:0/296929237 >> 172.21.15.150:0/296929237 conn(0x7f7f0c0c92f0 msgr2=0x7f7f0c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.922+0000 7f7f112e2700 1 -- 172.21.15.150:0/296929237 shutdown_connections 2022-08-10T17:45:56.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.922+0000 7f7f112e2700 1 -- 172.21.15.150:0/296929237 wait complete. 2022-08-10T17:45:56.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.923+0000 7f7f112e2700 1 Processor -- start 2022-08-10T17:45:56.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.923+0000 7f7f112e2700 1 -- start start 2022-08-10T17:45:56.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 0x7f7f0c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c070040 0x7f7f0c1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 0x7f7f0c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c155260 con 0x7f7f0c06c860 2022-08-10T17:45:56.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c06c2d0 con 0x7f7f0c070040 2022-08-10T17:45:56.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f112e2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c06c5b0 con 0x7f7f0c0bc830 2022-08-10T17:45:56.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f0b7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 0x7f7f0c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f0b7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 0x7f7f0c0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54096/0 (socket says 172.21.15.150:54096) 2022-08-10T17:45:56.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.924+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 learned_addr learned my addr 172.21.15.150:0/555937241 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:56.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c070040 msgr2=0x7f7f0c1f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c070040 0x7f7f0c1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 msgr2=0x7f7f0c14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c06c860 0x7f7f0c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0000a3c0 con 0x7f7f0c0bc830 2022-08-10T17:45:56.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f0b7fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 0x7f7f0c0c57d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400bde0 tx=0x7f7f0400e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04010040 con 0x7f7f0c0bc830 2022-08-10T17:45:56.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400e930 con 0x7f7f0c0bc830 2022-08-10T17:45:56.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400ece0 con 0x7f7f0c0bc830 2022-08-10T17:45:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c154f80 con 0x7f7f0c0bc830 2022-08-10T17:45:56.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.925+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c14ed80 con 0x7f7f0c0bc830 2022-08-10T17:45:56.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.926+0000 7f7f112e2700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 0x7f7f0c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.926+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c071e00 con 0x7f7f0c0c7160 2022-08-10T17:45:56.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.926+0000 7f7f0affd700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 0x7f7f0c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.927+0000 7f7f0affd700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f0c0c6840 con 0x7f7f0c0c7160 2022-08-10T17:45:56.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.927+0000 7f7f0affd700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 0x7f7f0c0c5d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c340 tx=0x7f7efc00c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.927+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0072d0 con 0x7f7f0c0c7160 2022-08-10T17:45:56.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.927+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7f0401c030 con 0x7f7f0c0bc830 2022-08-10T17:45:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7eec065180 0x7f7eec067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7f040823b0 con 0x7f7f0c0bc830 2022-08-10T17:45:56.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7f0a7fc700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7eec065180 0x7f7eec067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f7efc007430 con 0x7f7f0c0c7160 2022-08-10T17:45:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 msgr2=0x7f7f0c0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 0x7f7f0c0c5d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c340 tx=0x7f7efc00c700 comp rx=0 tx=0).stop 2022-08-10T17:45:56.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 msgr2=0x7f7f0c0c5d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:56.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7ef37fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c0c7160 0x7f7f0c0c5d10 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c340 tx=0x7f7efc00c700 comp rx=0 tx=0).stop 2022-08-10T17:45:56.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.928+0000 7f7f0a7fc700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7eec065180 0x7f7eec067630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c153f60 tx=0x7f7f00010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.941+0000 7f7f112e2700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 0x7f7f0c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:56.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.941+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c155110 con 0x7f7f0c14fae0 2022-08-10T17:45:56.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.941+0000 7f7f0affd700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 0x7f7f0c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:56.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7f0affd700 1 -- 172.21.15.150:0/555937241 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7f0c154520 con 0x7f7f0c14fae0 2022-08-10T17:45:56.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7f0affd700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 0x7f7f0c153fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c310 tx=0x7f7efc005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:56.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0127e0 con 0x7f7f0c14fae0 2022-08-10T17:45:56.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f7efc020420 con 0x7f7f0c14fae0 2022-08-10T17:45:56.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 msgr2=0x7f7f0c153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 0x7f7f0c153fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c310 tx=0x7f7efc005700 comp rx=0 tx=0).stop 2022-08-10T17:45:56.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 msgr2=0x7f7f0c153fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:56.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.942+0000 7f7ef37fe700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7f0c14fae0 0x7f7f0c153fe0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c310 tx=0x7f7efc005700 comp rx=0 tx=0).stop 2022-08-10T17:45:56.948 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:56.949 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:56.949 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:56.949 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:45:56.950 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:56.950 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:56.950 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:56.950 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:56.951 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:56.951 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.951 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:45:56.951 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:56.951 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:56.952 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:56.952 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.952 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.952 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.953 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.953 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.953 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.953 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.953 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.954 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.954 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.954 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:56.954 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:56.955 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.955 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.955 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.955 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.956 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.956 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.956 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.956 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.956 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.957 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.957 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:56.957 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:56.958 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:56.958 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:56.958 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:56.958 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:56.958 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:56.959 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:56.959 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:56.959 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:56.959 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:56.961 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:56.961 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:56.961 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:56.961 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:56.962 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:56.962 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:56.962 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:56.962 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:56.962 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:56.963 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.963 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:56.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.963 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.964 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.965 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.965 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:56.965 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.967 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.967 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.967 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:56.968 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:56.968 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.968 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.968 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.969 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:56.969 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:56.969 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.970 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.970 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.970 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:56.970 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.971 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.971 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:56.972 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.972 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.972 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.972 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:56.973 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:56.973 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.973 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.973 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.974 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:56.974 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:56.974 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:56.975 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:56.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.975 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:56.975 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:56.976 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.976 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:56.977 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:56.977 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:56.977 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.977 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.978 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:56.978 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:56.978 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:56.978 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:56.979 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:56.979 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.979 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.980 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:56.980 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:56.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.980 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.980 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.981 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:56.981 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.981 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:56.981 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:56.983 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:56.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7eec065180 msgr2=0x7f7eec067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7eec065180 0x7f7eec067630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c153f60 tx=0x7f7f00010000 comp rx=0 tx=0).stop 2022-08-10T17:45:56.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 msgr2=0x7f7f0c0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:56.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 --2- 172.21.15.150:0/555937241 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7f0c0bc830 0x7f7f0c0c57d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400bde0 tx=0x7f7f0400e3a0 comp rx=0 tx=0).stop 2022-08-10T17:45:56.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 reap_dead start 2022-08-10T17:45:56.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f0b7fe700 1 -- 172.21.15.150:0/555937241 reap_dead start 2022-08-10T17:45:56.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 shutdown_connections 2022-08-10T17:45:56.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 >> 172.21.15.150:0/555937241 conn(0x7f7f0c0c92f0 msgr2=0x7f7f0c06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:56.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 shutdown_connections 2022-08-10T17:45:56.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:56.943+0000 7f7f112e2700 1 -- 172.21.15.150:0/555937241 wait complete. 2022-08-10T17:45:56.987 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:45:57.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.130+0000 7f106b64e700 1 Processor -- start 2022-08-10T17:45:57.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.130+0000 7f106b64e700 1 -- start start 2022-08-10T17:45:57.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f106b64e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f1064068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f106b64e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1064070040 0x7f10640c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f106b64e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10641563c0 con 0x7f10640bc830 2022-08-10T17:45:57.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f106b64e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1064153590 con 0x7f1064070040 2022-08-10T17:45:57.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f106b64e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1064068650 con 0x7f106406c860 2022-08-10T17:45:57.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f1069beb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1064070040 0x7f10640c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.131+0000 7f10693ea700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f10640bc830 0x7f1064152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:38916/0 (socket says 172.21.15.150:38916) 2022-08-10T17:45:57.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f10693ea700 1 -- 172.21.15.150:0/3595774598 learned_addr learned my addr 172.21.15.150:0/3595774598 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:45:57.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1068be9700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f1064068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1053fff700 1 -- 172.21.15.150:0/3595774598 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069924853 0 0) 0x7f10641563c0 con 0x7f10640bc830 2022-08-10T17:45:57.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1053fff700 1 -- 172.21.15.150:0/3595774598 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003430 con 0x7f10640bc830 2022-08-10T17:45:57.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1069beb700 1 -- 172.21.15.150:0/3595774598 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 msgr2=0x7f1064068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:57.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1069beb700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f1064068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1069beb700 1 -- 172.21.15.150:0/3595774598 >> v1:172.21.15.197:6789/0 conn(0x7f10640bc830 legacy=0x7f1064152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1069beb700 1 -- 172.21.15.150:0/3595774598 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064150940 con 0x7f1064070040 2022-08-10T17:45:57.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1069beb700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640c3bd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f105c009dc0 tx=0x7f105c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c3bc15a1d71767 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1053fff700 1 -- 172.21.15.150:0/3595774598 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00e070 con 0x7f1064070040 2022-08-10T17:45:57.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1053fff700 1 -- 172.21.15.150:0/3595774598 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00baa0 con 0x7f1064070040 2022-08-10T17:45:57.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.132+0000 7f1053fff700 1 -- 172.21.15.150:0/3595774598 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00be50 con 0x7f1064070040 2022-08-10T17:45:57.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 -- 172.21.15.150:0/3595774598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 msgr2=0x7f10640c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640c3bd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f105c009dc0 tx=0x7f105c00b330 comp rx=0 tx=0).stop 2022-08-10T17:45:57.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 -- 172.21.15.150:0/3595774598 shutdown_connections 2022-08-10T17:45:57.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640c3bd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 --2- 172.21.15.150:0/3595774598 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f1064068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.133+0000 7f106b64e700 1 -- 172.21.15.150:0/3595774598 >> 172.21.15.150:0/3595774598 conn(0x7f10640c92f0 msgr2=0x7f10640c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:57.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.134+0000 7f106b64e700 1 -- 172.21.15.150:0/3595774598 shutdown_connections 2022-08-10T17:45:57.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.134+0000 7f106b64e700 1 -- 172.21.15.150:0/3595774598 wait complete. 2022-08-10T17:45:57.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.135+0000 7f106b64e700 1 Processor -- start 2022-08-10T17:45:57.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.135+0000 7f106b64e700 1 -- start start 2022-08-10T17:45:57.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f10641dd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 0x7f10640baa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064155640 con 0x7f1064070040 2022-08-10T17:45:57.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064155e30 con 0x7f10640bc830 2022-08-10T17:45:57.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f106b64e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640c0a10 con 0x7f106406c860 2022-08-10T17:45:57.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f1069beb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 0x7f10640baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f1069beb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 0x7f10640baa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50484/0 (socket says 172.21.15.150:50484) 2022-08-10T17:45:57.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 learned_addr learned my addr 172.21.15.150:0/3473905929 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:57.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.136+0000 7f1068be9700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 msgr2=0x7f10641dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f106406c860 0x7f10641dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 msgr2=0x7f10640ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1064070040 0x7f10640ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009a70 con 0x7f10640bc830 2022-08-10T17:45:57.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1069beb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 0x7f10640baa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10640654b0 tx=0x7f105c004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0044c0 con 0x7f10640bc830 2022-08-10T17:45:57.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c004620 con 0x7f10640bc830 2022-08-10T17:45:57.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10641e0030 con 0x7f10640bc830 2022-08-10T17:45:57.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0266a0 con 0x7f10640bc830 2022-08-10T17:45:57.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.137+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1064154ca0 con 0x7f10640bc830 2022-08-10T17:45:57.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.138+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f105c012430 con 0x7f10640bc830 2022-08-10T17:45:57.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f106b64e700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 0x7f1040004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1040007d90 con 0x7f1040002a40 2022-08-10T17:45:57.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f10693ea700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 0x7f1040004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f1051ffb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10440650b0 0x7f1044067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f105c084680 con 0x7f10640bc830 2022-08-10T17:45:57.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f1068be9700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10440650b0 0x7f1044067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f10693ea700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1040007f50 con 0x7f1040002a40 2022-08-10T17:45:57.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.139+0000 7f10693ea700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 0x7f1040004ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f105400c310 tx=0x7f105400c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1068be9700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10440650b0 0x7f1044067560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10641de1b0 tx=0x7f10600090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540072d0 con 0x7f1040002a40 2022-08-10T17:45:57.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f105400ce90 con 0x7f1040002a40 2022-08-10T17:45:57.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 msgr2=0x7f1040004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 0x7f1040004ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f105400c310 tx=0x7f105400c6d0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 msgr2=0x7f1040004ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.140+0000 7f1051ffb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040002a40 0x7f1040004ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.147+0000 7f106b64e700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 0x7f1040007280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.147+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400078e0 con 0x7f1040006e20 2022-08-10T17:45:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.147+0000 7f10693ea700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 0x7f1040007280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.147+0000 7f10693ea700 1 -- 172.21.15.150:0/3473905929 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1040007aa0 con 0x7f1040006e20 2022-08-10T17:45:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f10693ea700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 0x7f1040007280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1054001eb0 tx=0x7f1054000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540138a0 con 0x7f1040006e20 2022-08-10T17:45:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f105401b070 con 0x7f1040006e20 2022-08-10T17:45:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 msgr2=0x7f1040007280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 0x7f1040007280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1054001eb0 tx=0x7f1054000ed0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 msgr2=0x7f1040007280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:45:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1051ffb700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1040006e20 0x7f1040007280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.162 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:45:57.162 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:57.162 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:57.163 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:45:57.163 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 84, 2022-08-10T17:45:57.163 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:45:57.163 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:45:57.163 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:45:57.164 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:45:57.164 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.164 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 13, 2022-08-10T17:45:57.164 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:57.165 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:45:57.165 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:45:57.165 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:57.165 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:57.165 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:57.166 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:57.166 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:57.166 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:57.166 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:57.167 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:57.167 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:57.167 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.167 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:45:57.167 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:45:57.168 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:57.168 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:57.168 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:57.168 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:57.169 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:57.169 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:57.169 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:57.169 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:57.169 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:57.170 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.170 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:45:57.171 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:45:57.171 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:45:57.171 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:45:57.171 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:45:57.171 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:45:57.172 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:57.172 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:45:57.172 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:45:57.172 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:45:57.173 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:45:57.173 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:45:57.173 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:45:57.173 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:45:57.174 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:45:57.174 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:45:57.174 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:45:57.174 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:45:57.175 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:45:57.175 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:45:57.175 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:45:57.175 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:45:57.175 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:45:57.176 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:45:57.176 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:45:57.176 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.176 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:45:57.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.177 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:45:57.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.177 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:45:57.177 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:45:57.178 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:57.178 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:57.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.178 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:57.179 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:45:57.179 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.180 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:57.180 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:45:57.180 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.180 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.180 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.181 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.181 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:45:57.181 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:45:57.181 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:57.182 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:57.182 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:57.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.182 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:45:57.183 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:45:57.183 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:57.183 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:57.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.184 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:57.184 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:45:57.184 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.185 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:57.185 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:45:57.185 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.186 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.186 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:45:57.186 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:45:57.187 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:57.187 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:57.187 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:57.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.188 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:45:57.188 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:45:57.188 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:45:57.188 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:45:57.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.189 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:45:57.189 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:45:57.189 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.190 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:45:57.190 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:45:57.190 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:45:57.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:45:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:45:57.192 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:45:57.192 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:45:57.192 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:45:57.192 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.192 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.193 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.193 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:45:57.193 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:45:57.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.193 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:57.194 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.194 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:57.194 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.194 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.195 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:45:57.195 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.195 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:57.195 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.195 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:57.196 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.196 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.196 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:45:57.196 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.196 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:57.197 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.197 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:45:57.197 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.197 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.198 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:45:57.198 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.198 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:45:57.198 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.198 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:57.199 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.199 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.199 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:57.199 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.199 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:45:57.200 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.200 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:45:57.200 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:45:57.200 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:45:57.201 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:45:57.201 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:45:57.201 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:45:57.201 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:45:57.201 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:45:57.202 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:45:57.202 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:45:57.202 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:45:57.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10440650b0 msgr2=0x7f1044067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f10440650b0 0x7f1044067560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10641de1b0 tx=0x7f10600090e0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 msgr2=0x7f10640baa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.204 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 --2- 172.21.15.150:0/3473905929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f10640bc830 0x7f10640baa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10640654b0 tx=0x7f105c004950 comp rx=0 tx=0).stop 2022-08-10T17:45:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 reap_dead start 2022-08-10T17:45:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f1069beb700 1 -- 172.21.15.150:0/3473905929 reap_dead start 2022-08-10T17:45:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 shutdown_connections 2022-08-10T17:45:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.148+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 >> 172.21.15.150:0/3473905929 conn(0x7f10640c92f0 msgr2=0x7f10640c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.149+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 shutdown_connections 2022-08-10T17:45:57.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.149+0000 7f106b64e700 1 -- 172.21.15.150:0/3473905929 wait complete. 2022-08-10T17:45:57.206 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:45:57.207 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:45:57.207 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:45:57.207 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:45:57.208 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:45:57.208 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:45:57.218 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:45:57.218 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:45:57.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:45:57.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.392+0000 7fa4b9eb3700 1 Processor -- start 2022-08-10T17:45:57.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.392+0000 7fa4b9eb3700 1 -- start start 2022-08-10T17:45:57.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b9eb3700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa4b4150b80 0x7fa4b40c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b9eb3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b9eb3700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b4070620 con 0x7fa4b4150f50 2022-08-10T17:45:57.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b9eb3700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b40c5ac0 con 0x7fa4b4150b80 2022-08-10T17:45:57.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b9eb3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b415a860 con 0x7fa4b41573d0 2022-08-10T17:45:57.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa4b4150b80 0x7fa4b40c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa4b4150b80 0x7fa4b40c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50532/0 (socket says 172.21.15.150:50532) 2022-08-10T17:45:57.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b2ffd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fa4b4150f50 0x7fa4b4156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:38974/0 (socket says 172.21.15.150:38974) 2022-08-10T17:45:57.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 -- 172.21.15.150:0/727094264 learned_addr learned my addr 172.21.15.150:0/727094264 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:57.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b3fff700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 -- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 msgr2=0x7fa4b40c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:45:57.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 -- 172.21.15.150:0/727094264 >> v1:172.21.15.197:6789/0 conn(0x7fa4b4150f50 legacy=0x7fa4b4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b37fe700 1 -- 172.21.15.150:0/727094264 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40ca810 con 0x7fa4b4150b80 2022-08-10T17:45:57.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.393+0000 7fa4b27fc700 1 -- 172.21.15.150:0/727094264 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919526759 0 0) 0x7fa4b4070620 con 0x7fa4b4150f50 2022-08-10T17:45:57.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.394+0000 7fa4b37fe700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c42a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009780 tx=0x7fa4a4009a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ada14d15bec0e2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.394+0000 7fa4b27fc700 1 -- 172.21.15.150:0/727094264 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4004230 con 0x7fa4b4150b80 2022-08-10T17:45:57.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.394+0000 7fa4b27fc700 1 -- 172.21.15.150:0/727094264 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a40043b0 con 0x7fa4b4150b80 2022-08-10T17:45:57.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.394+0000 7fa4b27fc700 1 -- 172.21.15.150:0/727094264 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4011870 con 0x7fa4b4150b80 2022-08-10T17:45:57.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 msgr2=0x7fa4b40c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c42a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009780 tx=0x7fa4a4009a90 comp rx=0 tx=0).stop 2022-08-10T17:45:57.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/727094264 shutdown_connections 2022-08-10T17:45:57.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/727094264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c42a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/727094264 >> 172.21.15.150:0/727094264 conn(0x7fa4b4071e40 msgr2=0x7fa4b406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:57.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/727094264 shutdown_connections 2022-08-10T17:45:57.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.395+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/727094264 wait complete. 2022-08-10T17:45:57.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.396+0000 7fa4b9eb3700 1 Processor -- start 2022-08-10T17:45:57.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.397+0000 7fa4b9eb3700 1 -- start start 2022-08-10T17:45:57.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 0x7fa4b40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41f2bd0 con 0x7fa4b4150f50 2022-08-10T17:45:57.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4158220 con 0x7fa4b4150b80 2022-08-10T17:45:57.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b9eb3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41f84e0 con 0x7fa4b41573d0 2022-08-10T17:45:57.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b2ffd700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 msgr2=0x7fa4b40cba90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:45:57.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b2ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 0x7fa4b40cba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:45:57.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b37fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b37fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50538/0 (socket says 172.21.15.150:50538) 2022-08-10T17:45:57.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b37fe700 1 -- 172.21.15.150:0/3994910636 learned_addr learned my addr 172.21.15.150:0/3994910636 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:45:57.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 -- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 msgr2=0x7fa4b40c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 -- 172.21.15.150:0/3994910636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 msgr2=0x7fa4b40cba90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:45:57.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 0x7fa4b40cba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b3fff700 1 -- 172.21.15.150:0/3994910636 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40093e0 con 0x7fa4b41573d0 2022-08-10T17:45:57.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.398+0000 7fa4b37fe700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:45:57.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4b3fff700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40cbfd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00eba0 tx=0x7fa4ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00ca30 con 0x7fa4b41573d0 2022-08-10T17:45:57.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00f040 con 0x7fa4b41573d0 2022-08-10T17:45:57.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b41f87c0 con 0x7fa4b41573d0 2022-08-10T17:45:57.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00cdd0 con 0x7fa4b41573d0 2022-08-10T17:45:57.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.399+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b41f8d80 con 0x7fa4b41573d0 2022-08-10T17:45:57.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.401+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c005170 con 0x7fa4b41573d0 2022-08-10T17:45:57.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.403+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa4ac014480 con 0x7fa4b41573d0 2022-08-10T17:45:57.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.403+0000 7fa4abfff700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 0x7fa498067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:45:57.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.403+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa4ac083020 con 0x7fa4b41573d0 2022-08-10T17:45:57.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.403+0000 7fa4b37fe700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 0x7fa498067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:45:57.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.404+0000 7fa4b37fe700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 0x7fa498067510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009ad0 tx=0x7fa4a4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:45:57.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.409+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa4ac050ef0 con 0x7fa4b41573d0 2022-08-10T17:45:57.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.755+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa48c0059a0 con 0x7fa4b41573d0 2022-08-10T17:45:57.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.756+0000 7fa4abfff700 1 -- 172.21.15.150:0/3994910636 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fa4ac018080 con 0x7fa4b41573d0 2022-08-10T17:45:57.760 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:45:57.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 msgr2=0x7fa498067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 0x7fa498067510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009ad0 tx=0x7fa4a4008030 comp rx=0 tx=0).stop 2022-08-10T17:45:57.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 msgr2=0x7fa4b40cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:45:57.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40cbfd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00eba0 tx=0x7fa4ac00eeb0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 shutdown_connections 2022-08-10T17:45:57.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa498065060 0x7fa498067510 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa4b41573d0 0x7fa4b40cbfd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa4b4150b80 0x7fa4b40c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 --2- 172.21.15.150:0/3994910636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b4150f50 0x7fa4b40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:45:57.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 >> 172.21.15.150:0/3994910636 conn(0x7fa4b4071e40 msgr2=0x7fa4b40c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:45:57.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 shutdown_connections 2022-08-10T17:45:57.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:45:57.758+0000 7fa4b9eb3700 1 -- 172.21.15.150:0/3994910636 wait complete. 2022-08-10T17:46:00.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:00.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 Processor -- start 2022-08-10T17:46:00.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 -- start start 2022-08-10T17:46:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6006b960 con 0x7fdb601541e0 2022-08-10T17:46:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600c7280 con 0x7fdb6006f0f0 2022-08-10T17:46:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb64983700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c5f50 con 0x7fdb600c4420 2022-08-10T17:46:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.920+0000 7fdb5e59c700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7fdb601541e0 legacy=0x7fdb60071370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:00.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb55d9b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54218/0 (socket says 172.21.15.150:54218) 2022-08-10T17:46:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 -- 172.21.15.150:0/2714548946 learned_addr learned my addr 172.21.15.150:0/2714548946 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:00.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb55d9b700 1 --2- 172.21.15.150:0/2714548946 >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50586/0 (socket says 172.21.15.150:50586) 2022-08-10T17:46:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 -- 172.21.15.150:0/2714548946 >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 msgr2=0x7fdb6006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 --2- 172.21.15.150:0/2714548946 >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 -- 172.21.15.150:0/2714548946 >> v1:172.21.15.150:6789/0 conn(0x7fdb601541e0 legacy=0x7fdb60071370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:00.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 -- 172.21.15.150:0/2714548946 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600c6fa0 con 0x7fdb600c4420 2022-08-10T17:46:00.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb55d9b700 1 --2- 172.21.15.150:0/2714548946 >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:00.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5ed9d700 1 --2- 172.21.15.150:0/2714548946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e50 tx=0x7fdb5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57235df94951369a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:00.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5dd9b700 1 -- 172.21.15.150:0/2714548946 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800e070 con 0x7fdb600c4420 2022-08-10T17:46:00.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5dd9b700 1 -- 172.21.15.150:0/2714548946 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800b8d0 con 0x7fdb600c4420 2022-08-10T17:46:00.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.921+0000 7fdb5dd9b700 1 -- 172.21.15.150:0/2714548946 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800bc80 con 0x7fdb600c4420 2022-08-10T17:46:00.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 -- 172.21.15.150:0/2714548946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 msgr2=0x7fdb60156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:00.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 --2- 172.21.15.150:0/2714548946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e50 tx=0x7fdb5800b330 comp rx=0 tx=0).stop 2022-08-10T17:46:00.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 -- 172.21.15.150:0/2714548946 shutdown_connections 2022-08-10T17:46:00.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 --2- 172.21.15.150:0/2714548946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb600c4420 0x7fdb60156b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 --2- 172.21.15.150:0/2714548946 >> v2:172.21.15.197:3300/0 conn(0x7fdb6006f0f0 0x7fdb6006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 -- 172.21.15.150:0/2714548946 >> 172.21.15.150:0/2714548946 conn(0x7fdb60068be0 msgr2=0x7fdb600c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 -- 172.21.15.150:0/2714548946 shutdown_connections 2022-08-10T17:46:00.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.922+0000 7fdb64983700 1 -- 172.21.15.150:0/2714548946 wait complete. 2022-08-10T17:46:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.923+0000 7fdb64983700 1 Processor -- start 2022-08-10T17:46:00.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.923+0000 7fdb64983700 1 -- start start 2022-08-10T17:46:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdb600c4420 0x7fdb600c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 0x7fdb600c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c3450 con 0x7fdb601541e0 2022-08-10T17:46:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c03c0 con 0x7fdb600c4420 2022-08-10T17:46:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb64983700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600ca510 con 0x7fdb6006f0f0 2022-08-10T17:46:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5ed9d700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 msgr2=0x7fdb600c8f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:00.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 0x7fdb600c8f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb55d9b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdb600c4420 0x7fdb600c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54220/0 (socket says 172.21.15.150:54220) 2022-08-10T17:46:00.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 -- 172.21.15.150:0/3401468717 learned_addr learned my addr 172.21.15.150:0/3401468717 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 -- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdb600c4420 msgr2=0x7fdb600c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdb600c4420 0x7fdb600c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 -- 172.21.15.150:0/3401468717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 msgr2=0x7fdb600c8f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:00.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 0x7fdb600c8f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.924+0000 7fdb5e59c700 1 -- 172.21.15.150:0/3401468717 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480092b0 con 0x7fdb6006f0f0 2022-08-10T17:46:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb5e59c700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000b460 tx=0x7fdb5000b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003cd0 con 0x7fdb6006f0f0 2022-08-10T17:46:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50003e50 con 0x7fdb6006f0f0 2022-08-10T17:46:00.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58009b30 con 0x7fdb6006f0f0 2022-08-10T17:46:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500052b0 con 0x7fdb6006f0f0 2022-08-10T17:46:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.925+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600c94a0 con 0x7fdb6006f0f0 2022-08-10T17:46:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.926+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb60072890 con 0x7fdb6006f0f0 2022-08-10T17:46:00.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.926+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdb5000f070 con 0x7fdb6006f0f0 2022-08-10T17:46:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.926+0000 7fdb577fe700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 0x7fdb44067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.927+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdb500819f0 con 0x7fdb6006f0f0 2022-08-10T17:46:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.927+0000 7fdb55d9b700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 0x7fdb44067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:00.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.927+0000 7fdb55d9b700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 0x7fdb44067510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdb600af330 tx=0x7fdb48009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:00.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:00.932+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fdb50083e60 con 0x7fdb6006f0f0 2022-08-10T17:46:01.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.260+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdb600c7470 con 0x7fdb6006f0f0 2022-08-10T17:46:01.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.262+0000 7fdb577fe700 1 -- 172.21.15.150:0/3401468717 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fdb5004f9d0 con 0x7fdb6006f0f0 2022-08-10T17:46:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:01.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.265+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 msgr2=0x7fdb44067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:01.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.265+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 0x7fdb44067510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdb600af330 tx=0x7fdb48009060 comp rx=0 tx=0).stop 2022-08-10T17:46:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.265+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 msgr2=0x7fdb600c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:01.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.265+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000b460 tx=0x7fdb5000b770 comp rx=0 tx=0).stop 2022-08-10T17:46:01.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 shutdown_connections 2022-08-10T17:46:01.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb601541e0 0x7fdb600c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:01.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdb44065060 0x7fdb44067510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:01.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdb6006f0f0 0x7fdb600c9eb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:01.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 --2- 172.21.15.150:0/3401468717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdb600c4420 0x7fdb600c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:01.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 >> 172.21.15.150:0/3401468717 conn(0x7fdb60068be0 msgr2=0x7fdb601510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:01.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 shutdown_connections 2022-08-10T17:46:01.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:01.266+0000 7fdb64983700 1 -- 172.21.15.150:0/3401468717 wait complete. 2022-08-10T17:46:04.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:04.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 Processor -- start 2022-08-10T17:46:04.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 -- start start 2022-08-10T17:46:04.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 0x7f6858068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6858068650 0x7f685806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580bcfe0 con 0x7f68580644b0 2022-08-10T17:46:04.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685806f3e0 con 0x7f6858150b40 2022-08-10T17:46:04.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f685dbbb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858069440 con 0x7f6858068650 2022-08-10T17:46:04.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.412+0000 7f68577fe700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 msgr2=0x7f6858068110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:04.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f68577fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 0x7f6858068110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:04.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6858068650 0x7f685806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:04.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6857fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f68580644b0 0x7f6858156820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:39070/0 (socket says 172.21.15.150:39070) 2022-08-10T17:46:04.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6857fff700 1 -- 172.21.15.150:0/2156442221 learned_addr learned my addr 172.21.15.150:0/2156442221 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:04.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 --2- 172.21.15.150:0/2156442221 >> v2:172.21.15.197:3300/0 conn(0x7f6858068650 0x7f685806fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50628/0 (socket says 172.21.15.150:50628) 2022-08-10T17:46:04.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 -- 172.21.15.150:0/2156442221 >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 msgr2=0x7f6858068110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 --2- 172.21.15.150:0/2156442221 >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 0x7f6858068110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 -- 172.21.15.150:0/2156442221 >> v1:172.21.15.197:6789/0 conn(0x7f68580644b0 legacy=0x7f6858156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 -- 172.21.15.150:0/2156442221 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580c48f0 con 0x7f6858068650 2022-08-10T17:46:04.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f6856ffd700 1 --2- 172.21.15.150:0/2156442221 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f685806fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f685806e000 tx=0x7f684c009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c055cee901b26021 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f68567fc700 1 -- 172.21.15.150:0/2156442221 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011830 con 0x7f6858068650 2022-08-10T17:46:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f68567fc700 1 -- 172.21.15.150:0/2156442221 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c011990 con 0x7f6858068650 2022-08-10T17:46:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.413+0000 7f68567fc700 1 -- 172.21.15.150:0/2156442221 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011d20 con 0x7f6858068650 2022-08-10T17:46:04.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 -- 172.21.15.150:0/2156442221 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 msgr2=0x7f685806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:04.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 --2- 172.21.15.150:0/2156442221 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f685806fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f685806e000 tx=0x7f684c009990 comp rx=0 tx=0).stop 2022-08-10T17:46:04.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 -- 172.21.15.150:0/2156442221 shutdown_connections 2022-08-10T17:46:04.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 --2- 172.21.15.150:0/2156442221 >> v2:172.21.15.150:3300/0 conn(0x7f6858150b40 0x7f6858068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 --2- 172.21.15.150:0/2156442221 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f685806fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 -- 172.21.15.150:0/2156442221 >> 172.21.15.150:0/2156442221 conn(0x7f68580c9320 msgr2=0x7f68580c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:04.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 -- 172.21.15.150:0/2156442221 shutdown_connections 2022-08-10T17:46:04.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.414+0000 7f685dbbb700 1 -- 172.21.15.150:0/2156442221 wait complete. 2022-08-10T17:46:04.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.415+0000 7f685dbbb700 1 Processor -- start 2022-08-10T17:46:04.425 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.415+0000 7f685dbbb700 1 -- start start 2022-08-10T17:46:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 0x7f68580bb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858146460 con 0x7f6858150b40 2022-08-10T17:46:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581f0560 con 0x7f6858068650 2022-08-10T17:46:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f685dbbb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580c00b0 con 0x7f68580644b0 2022-08-10T17:46:04.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f6857fff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 msgr2=0x7f68580bb340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:04.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f6857fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 0x7f68580bb340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:04.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f6856ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:04.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f68577fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:04.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f6856ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50634/0 (socket says 172.21.15.150:50634) 2022-08-10T17:46:04.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f68577fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54262/0 (socket says 172.21.15.150:54262) 2022-08-10T17:46:04.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.416+0000 7f6856ffd700 1 -- 172.21.15.150:0/1465587603 learned_addr learned my addr 172.21.15.150:0/1465587603 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:04.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 -- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 msgr2=0x7f6858144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:04.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 -- 172.21.15.150:0/1465587603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 msgr2=0x7f68580bb340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:04.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 0x7f68580bb340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 -- 172.21.15.150:0/1465587603 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c009310 con 0x7f68580644b0 2022-08-10T17:46:04.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f6856ffd700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:04.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f68577fe700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f684800b3c0 tx=0x7f684800b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848003ad0 con 0x7f68580644b0 2022-08-10T17:46:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848003c50 con 0x7f68580644b0 2022-08-10T17:46:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480050d0 con 0x7f68580644b0 2022-08-10T17:46:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68581f09f0 con 0x7f68580644b0 2022-08-10T17:46:04.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.417+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68581efc30 con 0x7f68580644b0 2022-08-10T17:46:04.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.418+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68581f0840 con 0x7f68580644b0 2022-08-10T17:46:04.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.418+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f684800f070 con 0x7f68580644b0 2022-08-10T17:46:04.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.419+0000 7f683ffff700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 0x7f6838067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:04.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.419+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6848081950 con 0x7f68580644b0 2022-08-10T17:46:04.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.419+0000 7f6856ffd700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 0x7f6838067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:04.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.419+0000 7f6856ffd700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 0x7f6838067540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6858157900 tx=0x7f684c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:04.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.423+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f684804f8b0 con 0x7f68580644b0 2022-08-10T17:46:04.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.813+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6858068e90 con 0x7f68580644b0 2022-08-10T17:46:04.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.814+0000 7f683ffff700 1 -- 172.21.15.150:0/1465587603 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f6848052ed0 con 0x7f68580644b0 2022-08-10T17:46:04.818 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:04.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 msgr2=0x7f6838067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 0x7f6838067540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6858157900 tx=0x7f684c008030 comp rx=0 tx=0).stop 2022-08-10T17:46:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 msgr2=0x7f68580bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f684800b3c0 tx=0x7f684800b6d0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 shutdown_connections 2022-08-10T17:46:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6858150b40 0x7f68580bb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6838065090 0x7f6838067540 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f68580644b0 0x7f68580bfb70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 --2- 172.21.15.150:0/1465587603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6858068650 0x7f6858144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 >> 172.21.15.150:0/1465587603 conn(0x7f68580c9320 msgr2=0x7f6858143180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 shutdown_connections 2022-08-10T17:46:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:04.816+0000 7f685dbbb700 1 -- 172.21.15.150:0/1465587603 wait complete. 2022-08-10T17:46:07.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:07.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.968+0000 7f8f247b3700 1 Processor -- start 2022-08-10T17:46:07.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.968+0000 7f8f247b3700 1 -- start start 2022-08-10T17:46:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.969+0000 7f8f247b3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.969+0000 7f8f247b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:07.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.969+0000 7f8f247b3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c06b670 con 0x7f8f1c0c4fc0 2022-08-10T17:46:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.969+0000 7f8f247b3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c166b90 con 0x7f8f1c0c4580 2022-08-10T17:46:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.969+0000 7f8f247b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c4e10 con 0x7f8f1c0894f0 2022-08-10T17:46:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.971+0000 7f8f2254f700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 msgr2=0x7f8f1c15d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:07.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.971+0000 7f8f2254f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.971+0000 7f8f21d4e700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f8f1c0c4fc0 legacy=0x7f8f1c06fdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:07.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.973+0000 7f8f22d50700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.973+0000 7f8f22d50700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54300/0 (socket says 172.21.15.150:54300) 2022-08-10T17:46:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.973+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 learned_addr learned my addr 172.21.15.150:0/737076109 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:07.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.978+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:46:07.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.978+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:07.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.978+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:07.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:07.978+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.172+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v1:172.21.15.150:6789/0 conn(0x7f8f1c0c4fc0 legacy=0x7f8f1c06fdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.172+0000 7f8f2254f700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 msgr2=0x7f8f1c15d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.172+0000 7f8f2254f700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:46:08.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.179+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:08.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.179+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:46:08.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.179+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:08.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.179+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:08.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.179+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:46:08.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.573+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v1:172.21.15.150:6789/0 conn(0x7f8f1c0c4fc0 legacy=0x7f8f1c06fdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:08.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.573+0000 7f8f2254f700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 msgr2=0x7f8f1c15d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:08.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.573+0000 7f8f2254f700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:46:08.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.580+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:08.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.580+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:46:08.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.580+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:08.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.580+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:08.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:08.580+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:46:09.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.374+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v1:172.21.15.150:6789/0 conn(0x7f8f1c0c4fc0 legacy=0x7f8f1c06fdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:09.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.374+0000 7f8f2254f700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 msgr2=0x7f8f1c15d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:09.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.374+0000 7f8f2254f700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:46:09.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.381+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.381+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:46:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.381+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.381+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:09.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:09.381+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:46:10.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.969+0000 7f8f0bfff700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c089970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:10.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.969+0000 7f8f0bfff700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f1c089970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:10.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.969+0000 7f8f0bfff700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 msgr2=0x7f8f1c15d970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:10.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.969+0000 7f8f0bfff700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.150:3300/0 conn(0x7f8f1c0c4580 0x7f8f1c15d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:10.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.969+0000 7f8f0bfff700 1 -- 172.21.15.150:0/737076109 >> v1:172.21.15.150:6789/0 conn(0x7f8f1c0c4fc0 legacy=0x7f8f1c06fdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:10.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f0bfff700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:10.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f0bfff700 1 -- 172.21.15.150:0/737076109 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c06b950 con 0x7f8efc0035e0 2022-08-10T17:46:10.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f0bfff700 1 -- 172.21.15.150:0/737076109 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c4e10 con 0x7f8efc007310 2022-08-10T17:46:10.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:10.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:46:10.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:10.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:10.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:10.970+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:11.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.171+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.171+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:46:11.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.171+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:11.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.171+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:11.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.171+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:46:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.572+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.572+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:46:11.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.572+0000 7f8f21d4e700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:46:11.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.572+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:46:11.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.572+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:46:11.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.941+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958242884 0 0) 0x7f8f1c06b950 con 0x7f8efc0035e0 2022-08-10T17:46:11.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.941+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f04003430 con 0x7f8efc0035e0 2022-08-10T17:46:11.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232126604 0 0) 0x7f8f04003430 con 0x7f8efc0035e0 2022-08-10T17:46:11.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 msgr2=0x7f8efc0097c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:11.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 --2- 172.21.15.150:0/737076109 >> v2:172.21.15.197:3300/0 conn(0x7f8efc007310 0x7f8efc0097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c06b670 con 0x7f8efc0035e0 2022-08-10T17:46:11.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f8f0c00c800 con 0x7f8efc0035e0 2022-08-10T17:46:11.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 >> v1:172.21.15.197:6789/0 conn(0x7f8efc0035e0 legacy=0x7f8efc005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:11.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 0x7f8f04003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f040046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 0x7f8f04005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c4e10 con 0x7f8f04003880 2022-08-10T17:46:11.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0400b9d0 con 0x7f8f04004c10 2022-08-10T17:46:11.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0400bb90 con 0x7f8f1c0894f0 2022-08-10T17:46:11.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 reap_dead start 2022-08-10T17:46:11.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2254f700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 msgr2=0x7f8f04003c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:11.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f2254f700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 0x7f8f04003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:11.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 0x7f8f04005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.944+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f040046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f040046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:11.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f040046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 msgr2=0x7f8f04003c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:11.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 0x7f8f04003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 -- 172.21.15.150:0/737076109 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c06b670 con 0x7f8f04004c10 2022-08-10T17:46:11.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f22d50700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 0x7f8f04005080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c067080 tx=0x7f8f04005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e17eb9fc87d1b1ed server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:11.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180115a0 con 0x7f8f04004c10 2022-08-10T17:46:11.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18004020 con 0x7f8f04004c10 2022-08-10T17:46:11.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.945+0000 7f8f2154d700 1 -- 172.21.15.150:0/737076109 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180043b0 con 0x7f8f04004c10 2022-08-10T17:46:11.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 -- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 msgr2=0x7f8f04005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:11.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 0x7f8f04005080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c067080 tx=0x7f8f04005700 comp rx=0 tx=0).stop 2022-08-10T17:46:11.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 -- 172.21.15.150:0/737076109 shutdown_connections 2022-08-10T17:46:11.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04004c10 0x7f8f04005080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f04003880 0x7f8f04003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 --2- 172.21.15.150:0/737076109 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f1c0894f0 0x7f8f040046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 -- 172.21.15.150:0/737076109 >> 172.21.15.150:0/737076109 conn(0x7f8f1c0c8a10 msgr2=0x7f8f1c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:11.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 -- 172.21.15.150:0/737076109 shutdown_connections 2022-08-10T17:46:11.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.946+0000 7f8f247b3700 1 -- 172.21.15.150:0/737076109 wait complete. 2022-08-10T17:46:11.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.948+0000 7f8f247b3700 1 Processor -- start 2022-08-10T17:46:11.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.948+0000 7f8f247b3700 1 -- start start 2022-08-10T17:46:11.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04003880 0x7f8f1c0bc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 0x7f8f1c1662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0bf1b0 con 0x7f8f1c0894f0 2022-08-10T17:46:11.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0be610 con 0x7f8f04003880 2022-08-10T17:46:11.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f247b3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0be310 con 0x7f8f04004c10 2022-08-10T17:46:11.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f22d50700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c1662c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:11.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f22d50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 0x7f8f1c1662c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:11.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54370/0 (socket says 172.21.15.150:54370) 2022-08-10T17:46:11.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 -- 172.21.15.150:0/3342323083 learned_addr learned my addr 172.21.15.150:0/3342323083 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:11.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 -- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04003880 msgr2=0x7f8f1c0bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:11.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04003880 0x7f8f1c0bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 -- 172.21.15.150:0/3342323083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 msgr2=0x7f8f1c1662c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:11.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 0x7f8f1c1662c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:11.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 -- 172.21.15.150:0/3342323083 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0bf800 con 0x7f8f04004c10 2022-08-10T17:46:11.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.949+0000 7f8f21d4e700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f14013d80 tx=0x7f8f14013e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:11.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.950+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14018070 con 0x7f8f04004c10 2022-08-10T17:46:11.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.950+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c0bce90 con 0x7f8f04004c10 2022-08-10T17:46:11.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.950+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14012b50 con 0x7f8f04004c10 2022-08-10T17:46:11.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.950+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14012ee0 con 0x7f8f04004c10 2022-08-10T17:46:11.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.950+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c0beb60 con 0x7f8f04004c10 2022-08-10T17:46:11.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.951+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c0c3ea0 con 0x7f8f04004c10 2022-08-10T17:46:11.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.951+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8f14024070 con 0x7f8f04004c10 2022-08-10T17:46:11.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.951+0000 7f8f0affd700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 0x7f8efc068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:11.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.952+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8f14009040 con 0x7f8f04004c10 2022-08-10T17:46:11.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.952+0000 7f8f2254f700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 0x7f8efc068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:11.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.952+0000 7f8f2254f700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 0x7f8efc068050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c000ea0 tx=0x7f8f0c00c540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:11.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:11.957+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8f14050e40 con 0x7f8f04004c10 2022-08-10T17:46:12.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.275+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8f1c072890 con 0x7f8f04004c10 2022-08-10T17:46:12.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.276+0000 7f8f0affd700 1 -- 172.21.15.150:0/3342323083 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f8f14022070 con 0x7f8f04004c10 2022-08-10T17:46:12.280 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":86,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.279+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 msgr2=0x7f8efc068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.279+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 0x7f8efc068050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c000ea0 tx=0x7f8f0c00c540 comp rx=0 tx=0).stop 2022-08-10T17:46:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.279+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 msgr2=0x7f8f1c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.279+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f14013d80 tx=0x7f8f14013e60 comp rx=0 tx=0).stop 2022-08-10T17:46:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 shutdown_connections 2022-08-10T17:46:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f1c0894f0 0x7f8f1c1662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8f04003880 0x7f8f1c0bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8efc065ba0 0x7f8efc068050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 --2- 172.21.15.150:0/3342323083 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8f04004c10 0x7f8f1c157520 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 >> 172.21.15.150:0/3342323083 conn(0x7f8f1c0c8a10 msgr2=0x7f8f1c158970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 shutdown_connections 2022-08-10T17:46:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.281+0000 7f8f247b3700 1 -- 172.21.15.150:0/3342323083 wait complete. 2022-08-10T17:46:12.300 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:46:12.301 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:46:12.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.475+0000 7fcc07604700 1 Processor -- start 2022-08-10T17:46:12.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.475+0000 7fcc07604700 1 -- start start 2022-08-10T17:46:12.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fcc00150bf0 0x7fcc0015a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 0x7fcc00156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0006e850 con 0x7fcc0006c120 2022-08-10T17:46:12.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0015ac70 con 0x7fcc00150bf0 2022-08-10T17:46:12.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc07604700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00070090 con 0x7fcc00064840 2022-08-10T17:46:12.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc05ba1700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 msgr2=0x7fcc00156a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:12.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc05ba1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 0x7fcc00156a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:12.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc04b9f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc053a0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fcc00150bf0 0x7fcc0015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc053a0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fcc00150bf0 0x7fcc0015a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50754/0 (socket says 172.21.15.150:50754) 2022-08-10T17:46:12.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc04b9f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54384/0 (socket says 172.21.15.150:54384) 2022-08-10T17:46:12.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.476+0000 7fcc053a0700 1 -- 172.21.15.150:0/3076683985 learned_addr learned my addr 172.21.15.150:0/3076683985 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 -- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 msgr2=0x7fcc0006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 -- 172.21.15.150:0/3076683985 >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 msgr2=0x7fcc00156a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 --2- 172.21.15.150:0/3076683985 >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 0x7fcc00156a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 -- 172.21.15.150:0/3076683985 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00150fc0 con 0x7fcc00150bf0 2022-08-10T17:46:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc04b9f700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcc053a0700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00150bf0 0x7fcc0015a730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc000c6ed0 tx=0x7fcbfc009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c20fdc7236676680 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcbeffff700 1 -- 172.21.15.150:0/3076683985 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004230 con 0x7fcc00150bf0 2022-08-10T17:46:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcbeffff700 1 -- 172.21.15.150:0/3076683985 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc004390 con 0x7fcc00150bf0 2022-08-10T17:46:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.477+0000 7fcbeffff700 1 -- 172.21.15.150:0/3076683985 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc011870 con 0x7fcc00150bf0 2022-08-10T17:46:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 -- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00150bf0 msgr2=0x7fcc0015a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00150bf0 0x7fcc0015a730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc000c6ed0 tx=0x7fcbfc009a60 comp rx=0 tx=0).stop 2022-08-10T17:46:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 -- 172.21.15.150:0/3076683985 shutdown_connections 2022-08-10T17:46:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 --2- 172.21.15.150:0/3076683985 >> v2:172.21.15.150:3300/0 conn(0x7fcc0006c120 0x7fcc00156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00150bf0 0x7fcc0015a730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 --2- 172.21.15.150:0/3076683985 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00064840 0x7fcc0006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 -- 172.21.15.150:0/3076683985 >> 172.21.15.150:0/3076683985 conn(0x7fcc0006aac0 msgr2=0x7fcc000c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 -- 172.21.15.150:0/3076683985 shutdown_connections 2022-08-10T17:46:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.478+0000 7fcc07604700 1 -- 172.21.15.150:0/3076683985 wait complete. 2022-08-10T17:46:12.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.480+0000 7fcc07604700 1 Processor -- start 2022-08-10T17:46:12.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.480+0000 7fcc07604700 1 -- start start 2022-08-10T17:46:12.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc0006c120 0x7fcc00157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00150bf0 0x7fcc000c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 0x7fcc000c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c2840 con 0x7fcc0006c120 2022-08-10T17:46:12.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00153cf0 con 0x7fcc001ef8e0 2022-08-10T17:46:12.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc07604700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00153fd0 con 0x7fcc00150bf0 2022-08-10T17:46:12.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc053a0700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc0006c120 msgr2=0x7fcc00157980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:12.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc053a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc0006c120 0x7fcc00157980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:12.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 0x7fcc000c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc04b9f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00150bf0 0x7fcc000c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 0x7fcc000c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50762/0 (socket says 172.21.15.150:50762) 2022-08-10T17:46:12.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 learned_addr learned my addr 172.21.15.150:0/2175786226 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:12.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00150bf0 msgr2=0x7fcc000c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc00150bf0 0x7fcc000c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc0006c120 msgr2=0x7fcc00157980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:12.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc0006c120 0x7fcc00157980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.481+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009310 con 0x7fcc001ef8e0 2022-08-10T17:46:12.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.482+0000 7fcc05ba1700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 0x7fcc000c4470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800be80 tx=0x7fcbf800bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:12.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.482+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800cd50 con 0x7fcc001ef8e0 2022-08-10T17:46:12.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.482+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf80060d0 con 0x7fcc001ef8e0 2022-08-10T17:46:12.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.482+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8006480 con 0x7fcc001ef8e0 2022-08-10T17:46:12.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.483+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc0093e0 con 0x7fcc001ef8e0 2022-08-10T17:46:12.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.483+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc001efd60 con 0x7fcc001ef8e0 2022-08-10T17:46:12.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.484+0000 7fcc07604700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 0x7fcc00147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.484+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00071e00 con 0x7fcc0006aac0 2022-08-10T17:46:12.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.484+0000 7fcc053a0700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 0x7fcc00147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.484+0000 7fcc053a0700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc000c22e0 con 0x7fcc0006aac0 2022-08-10T17:46:12.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcc053a0700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 0x7fcc00147680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc015000 tx=0x7fcbfc0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:12.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003720 con 0x7fcc0006aac0 2022-08-10T17:46:12.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fcbfc006dc0 con 0x7fcc0006aac0 2022-08-10T17:46:12.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 msgr2=0x7fcc00147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 0x7fcc00147680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc015000 tx=0x7fcbfc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 msgr2=0x7fcc00147680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:12.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc0006aac0 0x7fcc00147680 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.485+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcbf801d070 con 0x7fcc001ef8e0 2022-08-10T17:46:12.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.486+0000 7fcbedffb700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcbe0064d60 0x7fcbe0067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.486+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcbf80827a0 con 0x7fcc001ef8e0 2022-08-10T17:46:12.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.486+0000 7fcc053a0700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcbe0064d60 0x7fcbe0067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.503 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.486+0000 7fcc053a0700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcbe0064d60 0x7fcbe0067210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcc000c1940 tx=0x7fcbfc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:12.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.498+0000 7fcc07604700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 0x7fcc00145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:12.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.498+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c2980 con 0x7fcc00147bc0 2022-08-10T17:46:12.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.498+0000 7fcc04b9f700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 0x7fcc00145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:12.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcc04b9f700 1 -- 172.21.15.150:0/2175786226 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcc00072890 con 0x7fcc00147bc0 2022-08-10T17:46:12.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcc04b9f700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 0x7fcc00145d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc00155ca0 tx=0x7fcbf00118f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:12.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0015870 con 0x7fcc00147bc0 2022-08-10T17:46:12.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4877 (secure 0 0 0) 0x7fcbf00159d0 con 0x7fcc00147bc0 2022-08-10T17:46:12.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 msgr2=0x7fcc00145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 0x7fcc00145d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc00155ca0 tx=0x7fcbf00118f0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 msgr2=0x7fcc00145d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:12.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.499+0000 7fcbedffb700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc00147bc0 0x7fcc00145d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:12.508 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:12.508 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:12.508 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:12.508 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:46:12.509 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 86, 2022-08-10T17:46:12.509 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:12.509 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:12.509 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:12.510 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.510 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:46:12.510 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:12.510 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:12.511 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:12.511 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:12.511 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:12.511 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:12.512 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:12.512 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:12.512 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:12.512 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:12.512 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:12.513 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:12.513 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.513 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:12.513 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:12.514 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:12.514 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:12.514 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:12.514 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:12.514 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:12.515 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:12.515 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:12.515 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:12.515 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:12.516 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.516 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:12.516 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:12.517 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:12.517 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:12.517 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:12.517 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:12.517 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:12.518 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:12.518 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:12.518 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:12.518 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:12.519 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:12.519 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:12.519 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:12.519 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:12.520 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:12.520 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:12.520 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:12.520 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:12.520 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:12.521 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:12.521 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:12.521 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:12.521 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:12.522 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:12.522 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.522 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:12.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.523 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:12.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.523 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:12.523 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:12.523 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:12.524 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:12.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.524 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:12.524 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:12.525 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.525 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:12.526 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:12.526 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.526 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.526 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.527 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:12.527 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:12.527 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:12.527 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:12.528 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:12.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.528 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:12.529 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:12.529 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:12.529 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:12.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.530 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:12.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:12.530 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.531 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:12.531 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:12.531 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.531 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.532 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.532 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:12.532 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:12.532 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:12.533 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:12.533 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:12.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.534 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:12.534 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:12.534 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:12.534 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:12.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.535 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:12.535 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:12.535 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.536 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:12.536 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:12.536 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:12.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.537 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.537 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:12.537 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:12.538 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:12.538 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:12.538 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:12.538 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.539 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.539 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:12.539 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:12.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.540 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:12.540 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:12.540 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:12.540 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.541 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.541 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:12.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.541 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:12.542 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:12.542 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:12.542 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.542 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.542 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:12.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.543 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:12.543 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:12.543 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:46:12.544 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.544 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.544 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:12.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.544 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:12.545 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:12.545 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:46:12.545 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.545 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:12.546 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:12.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:12.546 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:12.546 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:12.547 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:12.547 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:12.547 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:12.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:12.547 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:12.548 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcbe0064d60 msgr2=0x7fcbe0067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcbe0064d60 0x7fcbe0067210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcc000c1940 tx=0x7fcbfc019000 comp rx=0 tx=0).stop 2022-08-10T17:46:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 msgr2=0x7fcc000c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 --2- 172.21.15.150:0/2175786226 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc001ef8e0 0x7fcc000c4470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800be80 tx=0x7fcbf800bf60 comp rx=0 tx=0).stop 2022-08-10T17:46:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 reap_dead start 2022-08-10T17:46:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc05ba1700 1 -- 172.21.15.150:0/2175786226 reap_dead start 2022-08-10T17:46:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 shutdown_connections 2022-08-10T17:46:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 >> 172.21.15.150:0/2175786226 conn(0x7fcc00064840 msgr2=0x7fcc000c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 shutdown_connections 2022-08-10T17:46:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:12.500+0000 7fcc07604700 1 -- 172.21.15.150:0/2175786226 wait complete. 2022-08-10T17:46:12.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:46:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.083+0000 7f68138e0700 1 Processor -- start 2022-08-10T17:46:13.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 -- start start 2022-08-10T17:46:13.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 0x7f680c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c14d250 con 0x7f680c06d9c0 2022-08-10T17:46:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0c3880 con 0x7f680c06df10 2022-08-10T17:46:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.084+0000 7f68138e0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c06a910 con 0x7f680c0c2250 2022-08-10T17:46:13.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f6811e7d700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 msgr2=0x7f680c06e350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:13.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f6811e7d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 0x7f680c06e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:13.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f681167c700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f680c06d9c0 legacy=0x7f680c153470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:46:13.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f6810e7b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f6810e7b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54406/0 (socket says 172.21.15.150:54406) 2022-08-10T17:46:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.085+0000 7f6810e7b700 1 -- 172.21.15.150:0/946483787 learned_addr learned my addr 172.21.15.150:0/946483787 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f6810e7b700 1 -- 172.21.15.150:0/946483787 >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 msgr2=0x7f680c06e350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f6810e7b700 1 --2- 172.21.15.150:0/946483787 >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 0x7f680c06e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f6810e7b700 1 -- 172.21.15.150:0/946483787 >> v1:172.21.15.150:6789/0 conn(0x7f680c06d9c0 legacy=0x7f680c153470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:13.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f6810e7b700 1 -- 172.21.15.150:0/946483787 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0c91e0 con 0x7f680c0c2250 2022-08-10T17:46:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f6810e7b700 1 --2- 172.21.15.150:0/946483787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67fc006fd0 tx=0x7f67fc009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b569909a7585a36f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:13.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.086+0000 7f67fbfff700 1 -- 172.21.15.150:0/946483787 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011830 con 0x7f680c0c2250 2022-08-10T17:46:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f67fbfff700 1 -- 172.21.15.150:0/946483787 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc011990 con 0x7f680c0c2250 2022-08-10T17:46:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 -- 172.21.15.150:0/946483787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 msgr2=0x7f680c0c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 --2- 172.21.15.150:0/946483787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67fc006fd0 tx=0x7f67fc009a60 comp rx=0 tx=0).stop 2022-08-10T17:46:13.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 -- 172.21.15.150:0/946483787 shutdown_connections 2022-08-10T17:46:13.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 --2- 172.21.15.150:0/946483787 >> v2:172.21.15.150:3300/0 conn(0x7f680c06df10 0x7f680c06e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 --2- 172.21.15.150:0/946483787 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c0c2250 0x7f680c0c3340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.087+0000 7f68138e0700 1 -- 172.21.15.150:0/946483787 >> 172.21.15.150:0/946483787 conn(0x7f680c06b500 msgr2=0x7f680c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:13.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.088+0000 7f68138e0700 1 -- 172.21.15.150:0/946483787 shutdown_connections 2022-08-10T17:46:13.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.088+0000 7f68138e0700 1 -- 172.21.15.150:0/946483787 wait complete. 2022-08-10T17:46:13.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.090+0000 7f68138e0700 1 Processor -- start 2022-08-10T17:46:13.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.091+0000 7f68138e0700 1 -- start start 2022-08-10T17:46:13.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f680c06d9c0 0x7f680c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 0x7f680c1f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f680c0c2250 0x7f680c1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0bc280 con 0x7f680c0c2250 2022-08-10T17:46:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0c9060 con 0x7f680c06d9c0 2022-08-10T17:46:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f68138e0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c150000 con 0x7f680c06df10 2022-08-10T17:46:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f6811e7d700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f680c0c2250 msgr2=0x7f680c1f3ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:13.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.092+0000 7f6811e7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f680c0c2250 0x7f680c1f3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 0x7f680c1f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f681167c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f680c06d9c0 0x7f680c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 0x7f680c1f0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54410/0 (socket says 172.21.15.150:54410) 2022-08-10T17:46:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 -- 172.21.15.150:0/108412686 learned_addr learned my addr 172.21.15.150:0/108412686 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:13.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f680c06d9c0 msgr2=0x7f680c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f680c06d9c0 0x7f680c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f680c0c2250 msgr2=0x7f680c1f3ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f680c0c2250 0x7f680c1f3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.093+0000 7f6810e7b700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0093e0 con 0x7f680c06df10 2022-08-10T17:46:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.094+0000 7f6810e7b700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 0x7f680c1f0200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009e60 tx=0x7f67fc0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:13.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.094+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc01a430 con 0x7f680c06df10 2022-08-10T17:46:13.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.097+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c0b8840 con 0x7f680c06df10 2022-08-10T17:46:13.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.097+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c0c8d80 con 0x7f680c06df10 2022-08-10T17:46:13.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.098+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc011b00 con 0x7f680c06df10 2022-08-10T17:46:13.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.098+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011d40 con 0x7f680c06df10 2022-08-10T17:46:13.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.100+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f67fc00f050 con 0x7f680c06df10 2022-08-10T17:46:13.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.100+0000 7f67f9ffb700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f67ec065090 0x7f67ec067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.100+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f67fc083c60 con 0x7f680c06df10 2022-08-10T17:46:13.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.105+0000 7f681167c700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f67ec065090 0x7f67ec067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.105+0000 7f68138e0700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 0x7f67e8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.105+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e8007d90 con 0x7f67e8002a40 2022-08-10T17:46:13.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.105+0000 7f6811e7d700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 0x7f67e8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f6811e7d700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67e8007f50 con 0x7f67e8002a40 2022-08-10T17:46:13.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f6811e7d700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 0x7f67e8004ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6804003c10 tx=0x7f6804009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:13.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6804015470 con 0x7f67e8002a40 2022-08-10T17:46:13.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f681167c700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f67ec065090 0x7f67ec067540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6808006fd0 tx=0x7f6808008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:13.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f68040155d0 con 0x7f67e8002a40 2022-08-10T17:46:13.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 msgr2=0x7f67e8004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 0x7f67e8004ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6804003c10 tx=0x7f6804009e90 comp rx=0 tx=0).stop 2022-08-10T17:46:13.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 msgr2=0x7f67e8004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:13.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.107+0000 7f67f9ffb700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8002a40 0x7f67e8004ef0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6804003c10 tx=0x7f6804009e90 comp rx=0 tx=0).stop 2022-08-10T17:46:13.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.122+0000 7f68138e0700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 0x7f67e80072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.122+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e8007910 con 0x7f67e8006e30 2022-08-10T17:46:13.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.122+0000 7f6811e7d700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 0x7f67e80072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.123+0000 7f6811e7d700 1 -- 172.21.15.150:0/108412686 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f67e8007ad0 con 0x7f67e8006e30 2022-08-10T17:46:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.123+0000 7f6811e7d700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 0x7f67e80072b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6804014000 tx=0x7f6804003b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:13.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.123+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6804005990 con 0x7f67e8006e30 2022-08-10T17:46:13.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.126+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f6804005af0 con 0x7f67e8006e30 2022-08-10T17:46:13.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.126+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 msgr2=0x7f67e80072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.126+0000 7f67f9ffb700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 0x7f67e80072b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6804014000 tx=0x7f6804003b50 comp rx=0 tx=0).stop 2022-08-10T17:46:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.126+0000 7f67f9ffb700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 msgr2=0x7f67e80072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:13.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.126+0000 7f67f9ffb700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f67e8006e30 0x7f67e80072b0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6804014000 tx=0x7f6804003b50 comp rx=0 tx=0).stop 2022-08-10T17:46:13.131 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:46:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 86, 2022-08-10T17:46:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:46:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:13.135 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:13.135 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:13.135 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:13.135 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:13.135 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:13.136 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:13.136 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:13.136 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:13.136 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.140 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:13.140 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:13.140 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:13.140 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:13.141 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:13.141 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:13.141 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:13.141 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:13.142 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:13.142 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:13.142 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:13.142 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:13.143 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:13.143 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:13.143 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:13.143 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:13.144 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:13.144 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:13.144 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:13.144 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:13.144 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:13.145 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:13.145 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:13.145 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:13.145 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:13.146 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.146 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:13.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.146 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:13.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.147 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:13.147 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:13.147 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:13.148 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:13.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.148 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:13.148 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:13.148 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.149 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:13.149 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:13.150 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.150 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.150 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:13.151 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:13.151 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:13.151 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:13.151 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:13.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.152 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:13.152 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:13.152 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:13.153 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:13.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.153 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:13.153 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:13.153 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.154 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:13.154 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:13.155 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.155 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.155 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.155 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:13.156 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:13.156 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:13.156 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:13.156 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:13.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.157 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:13.157 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:13.157 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:13.158 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:13.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.158 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:13.158 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:13.159 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.159 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:13.159 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:13.160 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:13.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.160 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:13.161 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:13.161 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:13.161 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:13.161 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:13.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.162 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.162 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:13.162 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:13.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.163 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:13.163 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.163 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:13.164 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.164 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.164 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:13.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.164 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:13.165 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.165 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:13.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.165 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.166 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:13.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.166 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:13.166 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.166 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:46:13.167 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.167 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.167 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:13.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.168 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:46:13.168 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.168 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:13.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.169 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:13.169 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.169 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:46:13.169 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.169 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:13.170 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:13.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:13.170 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:13.170 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:13.171 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:13.171 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:13.171 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:13.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:13.171 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:13.172 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:13.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f67ec065090 msgr2=0x7f67ec067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f67ec065090 0x7f67ec067540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6808006fd0 tx=0x7f6808008040 comp rx=0 tx=0).stop 2022-08-10T17:46:13.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 msgr2=0x7f680c1f0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:13.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 --2- 172.21.15.150:0/108412686 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f680c06df10 0x7f680c1f0200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009e60 tx=0x7f67fc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:46:13.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f6811e7d700 1 -- 172.21.15.150:0/108412686 reap_dead start 2022-08-10T17:46:13.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 shutdown_connections 2022-08-10T17:46:13.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 >> 172.21.15.150:0/108412686 conn(0x7f680c06b500 msgr2=0x7f680c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:13.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 shutdown_connections 2022-08-10T17:46:13.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:13.127+0000 7f68138e0700 1 -- 172.21.15.150:0/108412686 wait complete. 2022-08-10T17:46:13.175 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:46:33.177 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:46:33.178 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:46:33.178 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:46:33.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:46:33.182 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:46:33.182 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:46:33.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.855+0000 7f5719b7a700 1 Processor -- start 2022-08-10T17:46:33.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.855+0000 7f5719b7a700 1 -- start start 2022-08-10T17:46:33.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5719b7a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 0x7f57140c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5719b7a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f571406bec0 0x7f5714154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5719b7a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571406b490 con 0x7f571406d930 2022-08-10T17:46:33.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5719b7a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571406bd30 con 0x7f57140700a0 2022-08-10T17:46:33.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5719b7a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571415adb0 con 0x7f571406bec0 2022-08-10T17:46:33.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f57137fe700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 msgr2=0x7f57140c36c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:33.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f57137fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 0x7f57140c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:33.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5713fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f571406bec0 0x7f5714154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:33.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5712ffd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f571406d930 0x7f571415b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:39370/0 (socket says 172.21.15.150:39370) 2022-08-10T17:46:33.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.856+0000 7f5712ffd700 1 -- 172.21.15.150:0/3210343187 learned_addr learned my addr 172.21.15.150:0/3210343187 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:33.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f5713fff700 1 -- 172.21.15.150:0/3210343187 >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 msgr2=0x7f57140c36c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:33.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f5713fff700 1 --2- 172.21.15.150:0/3210343187 >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 0x7f57140c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:33.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f5713fff700 1 -- 172.21.15.150:0/3210343187 >> v1:172.21.15.197:6789/0 conn(0x7f571406d930 legacy=0x7f571415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:33.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f57127fc700 1 -- 172.21.15.150:0/3210343187 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882136493 0 0) 0x7f571406b490 con 0x7f571406d930 2022-08-10T17:46:33.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f5713fff700 1 -- 172.21.15.150:0/3210343187 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571406b770 con 0x7f571406bec0 2022-08-10T17:46:33.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f5713fff700 1 --2- 172.21.15.150:0/3210343187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714154ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f571406d8c0 tx=0x7f570c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0004f5808b4bfc1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:33.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f57127fc700 1 -- 172.21.15.150:0/3210343187 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c00e070 con 0x7f571406bec0 2022-08-10T17:46:33.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f57127fc700 1 -- 172.21.15.150:0/3210343187 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c00bbd0 con 0x7f571406bec0 2022-08-10T17:46:33.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.857+0000 7f57127fc700 1 -- 172.21.15.150:0/3210343187 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c012430 con 0x7f571406bec0 2022-08-10T17:46:33.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 -- 172.21.15.150:0/3210343187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 msgr2=0x7f5714154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:33.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3210343187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714154ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f571406d8c0 tx=0x7f570c00b330 comp rx=0 tx=0).stop 2022-08-10T17:46:33.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 -- 172.21.15.150:0/3210343187 shutdown_connections 2022-08-10T17:46:33.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3210343187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714154ca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:33.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3210343187 >> v2:172.21.15.150:3300/0 conn(0x7f57140700a0 0x7f57140c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:33.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 -- 172.21.15.150:0/3210343187 >> 172.21.15.150:0/3210343187 conn(0x7f57140c8a10 msgr2=0x7f57140c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:33.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 -- 172.21.15.150:0/3210343187 shutdown_connections 2022-08-10T17:46:33.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.858+0000 7f5719b7a700 1 -- 172.21.15.150:0/3210343187 wait complete. 2022-08-10T17:46:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.860+0000 7f5719b7a700 1 Processor -- start 2022-08-10T17:46:33.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.860+0000 7f5719b7a700 1 -- start start 2022-08-10T17:46:33.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f571406d930 0x7f57140c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 0x7f57140c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140bb0d0 con 0x7f57140700a0 2022-08-10T17:46:33.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714153e20 con 0x7f571406bec0 2022-08-10T17:46:33.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5719b7a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140bc3e0 con 0x7f571406d930 2022-08-10T17:46:33.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5713fff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 msgr2=0x7f57140c2970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:46:33.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5713fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 0x7f57140c2970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50934/0 (socket says 172.21.15.150:50934) 2022-08-10T17:46:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 -- 172.21.15.150:0/3339974008 learned_addr learned my addr 172.21.15.150:0/3339974008 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f5712ffd700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f571406d930 0x7f57140c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:33.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 -- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f571406d930 msgr2=0x7f57140c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f571406d930 0x7f57140c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 -- 172.21.15.150:0/3339974008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 msgr2=0x7f57140c2970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 0x7f57140c2970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:33.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.861+0000 7f57137fe700 1 -- 172.21.15.150:0/3339974008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c009a70 con 0x7f571406bec0 2022-08-10T17:46:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f57137fe700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f570400b3f0 tx=0x7f570400b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704003cd0 con 0x7f571406bec0 2022-08-10T17:46:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704003e50 con 0x7f571406bec0 2022-08-10T17:46:33.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140bef80 con 0x7f571406bec0 2022-08-10T17:46:33.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040052b0 con 0x7f571406bec0 2022-08-10T17:46:33.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.862+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140bc100 con 0x7f571406bec0 2022-08-10T17:46:33.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.863+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140bed60 con 0x7f571406bec0 2022-08-10T17:46:33.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.863+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5704018030 con 0x7f571406bec0 2022-08-10T17:46:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.864+0000 7f56fbfff700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 0x7f56f4067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.864+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5704081440 con 0x7f571406bec0 2022-08-10T17:46:33.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.864+0000 7f5712ffd700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 0x7f56f4067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.865+0000 7f5712ffd700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 0x7f56f4067510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5708007fd0 tx=0x7f5708007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:33.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:33.870+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f570404f2e0 con 0x7f571406bec0 2022-08-10T17:46:34.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.220+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f57140c3830 con 0x7f571406bec0 2022-08-10T17:46:34.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.220+0000 7f56fbfff700 1 -- 172.21.15.150:0/3339974008 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5704016600 con 0x7f571406bec0 2022-08-10T17:46:34.225 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":86,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:34.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.224+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 msgr2=0x7f56f4067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:34.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.224+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 0x7f56f4067510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5708007fd0 tx=0x7f5708007c60 comp rx=0 tx=0).stop 2022-08-10T17:46:34.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.224+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 msgr2=0x7f5714158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:34.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.224+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f570400b3f0 tx=0x7f570400b700 comp rx=0 tx=0).stop 2022-08-10T17:46:34.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 shutdown_connections 2022-08-10T17:46:34.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57140700a0 0x7f57140c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:34.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f571406bec0 0x7f5714158390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:34.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f56f4065060 0x7f56f4067510 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:34.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 --2- 172.21.15.150:0/3339974008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f571406d930 0x7f57140c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:34.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 >> 172.21.15.150:0/3339974008 conn(0x7f57140c8a10 msgr2=0x7f57140c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:34.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 shutdown_connections 2022-08-10T17:46:34.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:34.225+0000 7f5719b7a700 1 -- 172.21.15.150:0/3339974008 wait complete. 2022-08-10T17:46:37.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:37.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.385+0000 7f09b5bee700 1 Processor -- start 2022-08-10T17:46:37.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.386+0000 7f09b5bee700 1 -- start start 2022-08-10T17:46:37.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09b5bee700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f09b006af70 0x7f09b006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09b5bee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09b00c7170 0x7f09b00c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09b5bee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b006a3d0 con 0x7f09b00c3060 2022-08-10T17:46:37.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09b5bee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b0070810 con 0x7f09b00c7170 2022-08-10T17:46:37.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09b5bee700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00c5fb0 con 0x7f09b006af70 2022-08-10T17:46:37.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09af7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f09b00c3060 0x7f09b006a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53058/0 (socket says 172.21.15.150:53058) 2022-08-10T17:46:37.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09af7fe700 1 -- 172.21.15.150:0/376273189 learned_addr learned my addr 172.21.15.150:0/376273189 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:37.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 --2- 172.21.15.150:0/376273189 >> v2:172.21.15.150:3300/0 conn(0x7f09b00c7170 0x7f09b00c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09aeffd700 1 --2- 172.21.15.150:0/376273189 >> v2:172.21.15.197:3300/0 conn(0x7f09b006af70 0x7f09b006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09ae7fc700 1 -- 172.21.15.150:0/376273189 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280925813 0 0) 0x7f09b006a3d0 con 0x7f09b00c3060 2022-08-10T17:46:37.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09ae7fc700 1 -- 172.21.15.150:0/376273189 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f099c003430 con 0x7f09b00c3060 2022-08-10T17:46:37.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 -- 172.21.15.150:0/376273189 >> v2:172.21.15.197:3300/0 conn(0x7f09b006af70 msgr2=0x7f09b006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:37.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 --2- 172.21.15.150:0/376273189 >> v2:172.21.15.197:3300/0 conn(0x7f09b006af70 0x7f09b006ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 -- 172.21.15.150:0/376273189 >> v1:172.21.15.150:6789/0 conn(0x7f09b00c3060 legacy=0x7f09b006a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 -- 172.21.15.150:0/376273189 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b006fc90 con 0x7f09b00c7170 2022-08-10T17:46:37.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.387+0000 7f09affff700 1 --2- 172.21.15.150:0/376273189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b00c7170 0x7f09b00c4cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09b00cabc0 tx=0x7f09a80092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c82fbfa64e7d87 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09ae7fc700 1 -- 172.21.15.150:0/376273189 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800c890 con 0x7f09b00c7170 2022-08-10T17:46:37.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09ae7fc700 1 -- 172.21.15.150:0/376273189 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800c9f0 con 0x7f09b00c7170 2022-08-10T17:46:37.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09ae7fc700 1 -- 172.21.15.150:0/376273189 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800cda0 con 0x7f09b00c7170 2022-08-10T17:46:37.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 -- 172.21.15.150:0/376273189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b00c7170 msgr2=0x7f09b00c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 --2- 172.21.15.150:0/376273189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b00c7170 0x7f09b00c4cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09b00cabc0 tx=0x7f09a80092f0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 -- 172.21.15.150:0/376273189 shutdown_connections 2022-08-10T17:46:37.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 --2- 172.21.15.150:0/376273189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b00c7170 0x7f09b00c4cb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 --2- 172.21.15.150:0/376273189 >> v2:172.21.15.197:3300/0 conn(0x7f09b006af70 0x7f09b006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 -- 172.21.15.150:0/376273189 >> 172.21.15.150:0/376273189 conn(0x7f09b0068be0 msgr2=0x7f09b00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:37.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 -- 172.21.15.150:0/376273189 shutdown_connections 2022-08-10T17:46:37.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.388+0000 7f09b5bee700 1 -- 172.21.15.150:0/376273189 wait complete. 2022-08-10T17:46:37.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 Processor -- start 2022-08-10T17:46:37.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 -- start start 2022-08-10T17:46:37.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09b00c3060 0x7f09b00a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09b00c7170 0x7f09b00ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b01e7d20 con 0x7f09b006af70 2022-08-10T17:46:37.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00a92d0 con 0x7f09b00c3060 2022-08-10T17:46:37.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09b5bee700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b01dc140 con 0x7f09b00c7170 2022-08-10T17:46:37.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40384/0 (socket says 172.21.15.150:40384) 2022-08-10T17:46:37.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.390+0000 7f09af7fe700 1 -- 172.21.15.150:0/1351246379 learned_addr learned my addr 172.21.15.150:0/1351246379 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:37.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09aeffd700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09b00c3060 0x7f09b00a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09affff700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09b00c7170 0x7f09b00ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 -- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09b00c7170 msgr2=0x7f09b00ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09b00c7170 0x7f09b00ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 -- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09b00c3060 msgr2=0x7f09b00a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09b00c3060 0x7f09b00a77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 -- 172.21.15.150:0/1351246379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a800ba90 con 0x7f09b006af70 2022-08-10T17:46:37.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09af7fe700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09a000c400 tx=0x7f09a000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00072d0 con 0x7f09b006af70 2022-08-10T17:46:37.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0007450 con 0x7f09b006af70 2022-08-10T17:46:37.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00057c0 con 0x7f09b006af70 2022-08-10T17:46:37.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01eb7d0 con 0x7f09b006af70 2022-08-10T17:46:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.391+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01dc370 con 0x7f09b006af70 2022-08-10T17:46:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.392+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b006ff70 con 0x7f09b006af70 2022-08-10T17:46:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.393+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f09a0019030 con 0x7f09b006af70 2022-08-10T17:46:37.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.393+0000 7f0997fff700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 0x7f0990067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.393+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f09a0081430 con 0x7f09b006af70 2022-08-10T17:46:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.393+0000 7f09aeffd700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 0x7f0990067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.394+0000 7f09aeffd700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 0x7f0990067560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f09b00c9c40 tx=0x7f09a400f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.398+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f09a004f410 con 0x7f09b006af70 2022-08-10T17:46:37.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.718+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f09b0069120 con 0x7f09b006af70 2022-08-10T17:46:37.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.718+0000 7f0997fff700 1 -- 172.21.15.150:0/1351246379 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f09a0017020 con 0x7f09b006af70 2022-08-10T17:46:37.722 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:37.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.720+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 msgr2=0x7f0990067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.720+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 0x7f0990067560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f09b00c9c40 tx=0x7f09a400f040 comp rx=0 tx=0).stop 2022-08-10T17:46:37.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.720+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 msgr2=0x7f09b01eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.720+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09a000c400 tx=0x7f09a000c710 comp rx=0 tx=0).stop 2022-08-10T17:46:37.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 shutdown_connections 2022-08-10T17:46:37.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09900650b0 0x7f0990067560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09b00c7170 0x7f09b00ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09b006af70 0x7f09b01eb290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 --2- 172.21.15.150:0/1351246379 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09b00c3060 0x7f09b00a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 >> 172.21.15.150:0/1351246379 conn(0x7f09b0068be0 msgr2=0x7f09b006a760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:37.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 shutdown_connections 2022-08-10T17:46:37.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.721+0000 7f09b5bee700 1 -- 172.21.15.150:0/1351246379 wait complete. 2022-08-10T17:46:37.737 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:46:37.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:46:37.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.875+0000 7efe54461700 1 Processor -- start 2022-08-10T17:46:37.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.875+0000 7efe54461700 1 -- start start 2022-08-10T17:46:37.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe4c1552f0 0x7efe4c0c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c1556c0 0x7efe4c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efe4c158a20 0x7efe4c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c157db0 con 0x7efe4c1552f0 2022-08-10T17:46:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0b07e0 con 0x7efe4c158a20 2022-08-10T17:46:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe54461700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c155cb0 con 0x7efe4c1556c0 2022-08-10T17:46:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe529fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efe4c158a20 0x7efe4c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe529fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efe4c158a20 0x7efe4c0cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50984/0 (socket says 172.21.15.150:50984) 2022-08-10T17:46:37.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.876+0000 7efe529fe700 1 -- 172.21.15.150:0/745705053 learned_addr learned my addr 172.21.15.150:0/745705053 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe521fd700 1 --2- 172.21.15.150:0/745705053 >> v2:172.21.15.150:3300/0 conn(0x7efe4c1552f0 0x7efe4c0c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe529fe700 1 -- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c1556c0 msgr2=0x7efe4c1584e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe529fe700 1 --2- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c1556c0 0x7efe4c1584e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe529fe700 1 -- 172.21.15.150:0/745705053 >> v2:172.21.15.150:3300/0 conn(0x7efe4c1552f0 msgr2=0x7efe4c0c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe529fe700 1 --2- 172.21.15.150:0/745705053 >> v2:172.21.15.150:3300/0 conn(0x7efe4c1552f0 0x7efe4c0c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.877+0000 7efe529fe700 1 -- 172.21.15.150:0/745705053 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c06ba00 con 0x7efe4c158a20 2022-08-10T17:46:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.878+0000 7efe529fe700 1 --2- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c158a20 0x7efe4c0cabc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c8750 tx=0x7efe4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84984e9ac4421bb6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.878+0000 7efe511fb700 1 -- 172.21.15.150:0/745705053 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4400e070 con 0x7efe4c158a20 2022-08-10T17:46:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.878+0000 7efe511fb700 1 -- 172.21.15.150:0/745705053 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4400b9c0 con 0x7efe4c158a20 2022-08-10T17:46:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.878+0000 7efe511fb700 1 -- 172.21.15.150:0/745705053 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4400bd70 con 0x7efe4c158a20 2022-08-10T17:46:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.879+0000 7efe54461700 1 -- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c158a20 msgr2=0x7efe4c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.879+0000 7efe54461700 1 --2- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c158a20 0x7efe4c0cabc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c8750 tx=0x7efe4400b330 comp rx=0 tx=0).stop 2022-08-10T17:46:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.881+0000 7efe54461700 1 -- 172.21.15.150:0/745705053 shutdown_connections 2022-08-10T17:46:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.881+0000 7efe54461700 1 --2- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c158a20 0x7efe4c0cabc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.881+0000 7efe54461700 1 --2- 172.21.15.150:0/745705053 >> v2:172.21.15.150:3300/0 conn(0x7efe4c1552f0 0x7efe4c0c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.881+0000 7efe54461700 1 --2- 172.21.15.150:0/745705053 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c1556c0 0x7efe4c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.881+0000 7efe54461700 1 -- 172.21.15.150:0/745705053 >> 172.21.15.150:0/745705053 conn(0x7efe4c06d730 msgr2=0x7efe4c06db30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.883+0000 7efe54461700 1 -- 172.21.15.150:0/745705053 shutdown_connections 2022-08-10T17:46:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.883+0000 7efe54461700 1 -- 172.21.15.150:0/745705053 wait complete. 2022-08-10T17:46:37.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.885+0000 7efe54461700 1 Processor -- start 2022-08-10T17:46:37.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.885+0000 7efe54461700 1 -- start start 2022-08-10T17:46:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 0x7efe4c0bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c158a20 0x7efe4c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c150280 0x7efe4c14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c77d0 con 0x7efe4c158a20 2022-08-10T17:46:37.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c069f20 con 0x7efe4c1552f0 2022-08-10T17:46:37.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe54461700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c7ce0 con 0x7efe4c150280 2022-08-10T17:46:37.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe521fd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 0x7efe4c0bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe521fd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 0x7efe4c0bdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:50988/0 (socket says 172.21.15.150:50988) 2022-08-10T17:46:37.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.886+0000 7efe521fd700 1 -- 172.21.15.150:0/549873540 learned_addr learned my addr 172.21.15.150:0/549873540 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:37.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c150280 msgr2=0x7efe4c14a250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:46:37.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efe4c150280 0x7efe4c14a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c158a20 msgr2=0x7efe4c152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c158a20 0x7efe4c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009b30 con 0x7efe4c1552f0 2022-08-10T17:46:37.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.887+0000 7efe521fd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 0x7efe4c0bdd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00d5a0 tx=0x7efe3c00d960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.889+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0125f0 con 0x7efe4c1552f0 2022-08-10T17:46:37.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.889+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c012750 con 0x7efe4c1552f0 2022-08-10T17:46:37.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.889+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c012b00 con 0x7efe4c1552f0 2022-08-10T17:46:37.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.889+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0c8140 con 0x7efe4c1552f0 2022-08-10T17:46:37.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.890+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c069bb0 con 0x7efe4c1552f0 2022-08-10T17:46:37.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe54461700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 0x7efe4c14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0673d0 con 0x7efe4c068a50 2022-08-10T17:46:37.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe519fc700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 0x7efe4c14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efe3c012c60 con 0x7efe4c1552f0 2022-08-10T17:46:37.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe519fc700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe4c06a060 con 0x7efe4c068a50 2022-08-10T17:46:37.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe3affd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe2c065100 0x7efe2c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efe3c082540 con 0x7efe4c1552f0 2022-08-10T17:46:37.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.891+0000 7efe519fc700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 0x7efe4c14a790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c5290 tx=0x7efe4800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe529fe700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe2c065100 0x7efe2c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48011620 con 0x7efe4c068a50 2022-08-10T17:46:37.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7efe4800bec0 con 0x7efe4c068a50 2022-08-10T17:46:37.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 msgr2=0x7efe4c14a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 0x7efe4c14a790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c5290 tx=0x7efe4800b6a0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe529fe700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe2c065100 0x7efe2c0675b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe4c1506d0 tx=0x7efe44009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 msgr2=0x7efe4c14a790 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:37.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.892+0000 7efe3affd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c068a50 0x7efe4c14a790 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0c5290 tx=0x7efe4800b6a0 comp rx=0 tx=0).stop 2022-08-10T17:46:37.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.900+0000 7efe54461700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 0x7efe4c0b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:37.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.900+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c068e20 con 0x7efe4c1f3400 2022-08-10T17:46:37.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.900+0000 7efe519fc700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 0x7efe4c0b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:37.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe519fc700 1 -- 172.21.15.150:0/549873540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efe4c14acd0 con 0x7efe4c1f3400 2022-08-10T17:46:37.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe519fc700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 0x7efe4c0b90e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe48015000 tx=0x7efe48004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:37.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4801aa90 con 0x7efe4c1f3400 2022-08-10T17:46:37.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4378 (secure 0 0 0) 0x7efe4801abf0 con 0x7efe4c1f3400 2022-08-10T17:46:37.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 msgr2=0x7efe4c0b90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 0x7efe4c0b90e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe48015000 tx=0x7efe48004630 comp rx=0 tx=0).stop 2022-08-10T17:46:37.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 msgr2=0x7efe4c0b90e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:37.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.901+0000 7efe3affd700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe4c1f3400 0x7efe4c0b90e0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe48015000 tx=0x7efe48004630 comp rx=0 tx=0).stop 2022-08-10T17:46:37.907 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:37.908 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:37.908 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:37.908 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:46:37.908 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:37.909 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:37.909 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:37.909 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:37.909 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:37.910 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:37.910 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:46:37.910 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:37.910 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:37.910 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:37.911 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:37.911 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:37.911 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:37.911 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:37.912 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:37.912 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:37.912 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:37.912 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:37.912 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:37.913 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:37.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:37.913 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:37.913 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:37.914 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:37.914 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:37.914 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:37.914 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:37.915 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:37.915 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:37.915 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:37.915 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:37.915 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.916 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:37.916 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:37.916 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:37.916 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:37.917 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:37.917 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:37.917 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:37.917 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:37.918 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:37.918 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:37.918 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:37.918 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:37.918 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:37.919 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:37.919 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:37.919 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:37.919 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:37.920 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:37.920 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:37.920 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:37.920 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:37.920 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:37.921 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.922 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:37.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:37.926 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:37.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:37.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:37.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.936 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:37.937 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:37.938 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:37.939 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:37.940 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:37.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:37.942 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:37.942 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:37.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe2c065100 msgr2=0x7efe2c0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe54461700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe2c065100 0x7efe2c0675b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe4c1506d0 tx=0x7efe44009000 comp rx=0 tx=0).stop 2022-08-10T17:46:37.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 msgr2=0x7efe4c0bdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:37.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe54461700 1 --2- 172.21.15.150:0/549873540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efe4c1552f0 0x7efe4c0bdd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00d5a0 tx=0x7efe3c00d960 comp rx=0 tx=0).stop 2022-08-10T17:46:37.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe529fe700 1 -- 172.21.15.150:0/549873540 reap_dead start 2022-08-10T17:46:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.902+0000 7efe529fe700 1 -- 172.21.15.150:0/549873540 reap_dead start 2022-08-10T17:46:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.904+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 shutdown_connections 2022-08-10T17:46:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.904+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 >> 172.21.15.150:0/549873540 conn(0x7efe4c06d730 msgr2=0x7efe4c1545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:37.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.904+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 shutdown_connections 2022-08-10T17:46:37.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:37.904+0000 7efe54461700 1 -- 172.21.15.150:0/549873540 wait complete. 2022-08-10T17:46:37.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:46:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.101+0000 7f247ac19700 1 Processor -- start 2022-08-10T17:46:38.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.101+0000 7f247ac19700 1 -- start start 2022-08-10T17:46:38.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f247ac19700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f247406c8a0 0x7f2474157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f247ac19700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 0x7f2474158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f247ac19700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24740c48e0 con 0x7f247414e970 2022-08-10T17:46:38.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f247ac19700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24740c13a0 con 0x7f247406c8a0 2022-08-10T17:46:38.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f247ac19700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24740bcd00 con 0x7f247414ed40 2022-08-10T17:46:38.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f247406c8a0 0x7f2474157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f247406c8a0 0x7f2474157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40412/0 (socket says 172.21.15.150:40412) 2022-08-10T17:46:38.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 -- 172.21.15.150:0/2581495206 learned_addr learned my addr 172.21.15.150:0/2581495206 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f24791b6700 1 --2- 172.21.15.150:0/2581495206 >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 0x7f2474158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 -- 172.21.15.150:0/2581495206 >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 msgr2=0x7f2474158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:38.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 --2- 172.21.15.150:0/2581495206 >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 0x7f2474158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 -- 172.21.15.150:0/2581495206 >> v1:172.21.15.197:6789/0 conn(0x7f247414e970 legacy=0x7f24740689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 -- 172.21.15.150:0/2581495206 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474064550 con 0x7f247406c8a0 2022-08-10T17:46:38.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f24791b6700 1 --2- 172.21.15.150:0/2581495206 >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 0x7f2474158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:38.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.103+0000 7f2473fff700 1 --2- 172.21.15.150:0/2581495206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247406c8a0 0x7f2474157d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24740c05b0 tx=0x7f2460009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f016c8620f23dabc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f24737fe700 1 -- 172.21.15.150:0/2581495206 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460004230 con 0x7f247406c8a0 2022-08-10T17:46:38.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f24737fe700 1 -- 172.21.15.150:0/2581495206 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460004390 con 0x7f247406c8a0 2022-08-10T17:46:38.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f24737fe700 1 -- 172.21.15.150:0/2581495206 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460011850 con 0x7f247406c8a0 2022-08-10T17:46:38.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 -- 172.21.15.150:0/2581495206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247406c8a0 msgr2=0x7f2474157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 --2- 172.21.15.150:0/2581495206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247406c8a0 0x7f2474157d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24740c05b0 tx=0x7f2460009a60 comp rx=0 tx=0).stop 2022-08-10T17:46:38.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 -- 172.21.15.150:0/2581495206 shutdown_connections 2022-08-10T17:46:38.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 --2- 172.21.15.150:0/2581495206 >> v2:172.21.15.197:3300/0 conn(0x7f247414ed40 0x7f2474158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 --2- 172.21.15.150:0/2581495206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247406c8a0 0x7f2474157d10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 -- 172.21.15.150:0/2581495206 >> 172.21.15.150:0/2581495206 conn(0x7f24740c92f0 msgr2=0x7f24740c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 -- 172.21.15.150:0/2581495206 shutdown_connections 2022-08-10T17:46:38.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.104+0000 7f247ac19700 1 -- 172.21.15.150:0/2581495206 wait complete. 2022-08-10T17:46:38.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.105+0000 7f247ac19700 1 Processor -- start 2022-08-10T17:46:38.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.106+0000 7f247ac19700 1 -- start start 2022-08-10T17:46:38.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f247406c8a0 0x7f24741ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f247414e970 0x7f24740be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 0x7f24740bf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24741ed790 con 0x7f247414ed40 2022-08-10T17:46:38.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24741df6b0 con 0x7f247414e970 2022-08-10T17:46:38.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f247ac19700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24741eda30 con 0x7f247406c8a0 2022-08-10T17:46:38.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 0x7f24740bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 0x7f24740bf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40416/0 (socket says 172.21.15.150:40416) 2022-08-10T17:46:38.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 learned_addr learned my addr 172.21.15.150:0/1933104309 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f247406c8a0 msgr2=0x7f24741ec4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:38.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f247406c8a0 0x7f24741ec4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f247414e970 msgr2=0x7f24740be340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:38.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f247414e970 0x7f24740be340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.107+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c009a70 con 0x7f247414ed40 2022-08-10T17:46:38.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.108+0000 7f24791b6700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 0x7f24740bf330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f246c00efc0 tx=0x7f246c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.108+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00cb40 con 0x7f247414ed40 2022-08-10T17:46:38.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.108+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00f040 con 0x7f247414ed40 2022-08-10T17:46:38.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.108+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c0038a0 con 0x7f247414ed40 2022-08-10T17:46:38.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.109+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24600093e0 con 0x7f247414ed40 2022-08-10T17:46:38.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.109+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24740bde20 con 0x7f247414ed40 2022-08-10T17:46:38.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.110+0000 7f247ac19700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 0x7f24741ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.110+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474071e00 con 0x7f24741eaa80 2022-08-10T17:46:38.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.110+0000 7f24789b5700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 0x7f24741ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.111+0000 7f24789b5700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2474072890 con 0x7f24741eaa80 2022-08-10T17:46:38.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.111+0000 7f24789b5700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 0x7f24741ecb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f246800c310 tx=0x7f246800c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.114+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f246c014480 con 0x7f247414ed40 2022-08-10T17:46:38.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.114+0000 7f24717fa700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f245c087110 0x7f245c0895c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f246c082e30 con 0x7f247414ed40 2022-08-10T17:46:38.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468005280 con 0x7f24741eaa80 2022-08-10T17:46:38.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f24680053e0 con 0x7f24741eaa80 2022-08-10T17:46:38.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 msgr2=0x7f24741ecb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 0x7f24741ecb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f246800c310 tx=0x7f246800c6d0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 msgr2=0x7f24741ecb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:38.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.115+0000 7f24717fa700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24741eaa80 0x7f24741ecb80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.119+0000 7f2473fff700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f245c087110 0x7f245c0895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.119+0000 7f2473fff700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f245c087110 0x7f245c0895c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f247406ccb0 tx=0x7f2460008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.126+0000 7f247ac19700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 0x7f24741ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.126+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474149c60 con 0x7f24740bf870 2022-08-10T17:46:38.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24789b5700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 0x7f24741ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24789b5700 1 -- 172.21.15.150:0/1933104309 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f247414db10 con 0x7f24740bf870 2022-08-10T17:46:38.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24789b5700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 0x7f24741ed0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f246800c310 tx=0x7f2468000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468006df0 con 0x7f24740bf870 2022-08-10T17:46:38.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4886 (secure 0 0 0) 0x7f2468003500 con 0x7f24740bf870 2022-08-10T17:46:38.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 msgr2=0x7f24741ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 0x7f24741ed0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f246800c310 tx=0x7f2468000ed0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 msgr2=0x7f24741ed0c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:38.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.127+0000 7f24717fa700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f24740bf870 0x7f24741ed0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.134 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:38.134 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:38.135 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:38.135 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:46:38.135 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:38.135 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:38.136 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:38.136 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:38.136 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:38.136 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.136 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:46:38.137 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:38.137 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:38.137 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:38.137 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.138 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.138 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.138 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.138 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.138 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.139 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.139 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.139 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.139 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.140 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:38.140 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:38.140 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.140 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.141 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.141 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.141 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.141 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.141 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.142 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.142 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.142 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.143 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:38.143 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:38.143 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:38.143 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:38.143 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:38.144 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:38.144 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:38.144 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:38.144 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:38.144 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:38.145 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:38.145 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:38.145 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:38.145 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.147 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.147 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.147 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.148 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.148 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.148 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.148 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.149 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.149 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:38.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.149 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:38.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.150 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:38.150 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:38.150 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.151 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.151 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.151 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:38.151 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.152 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.152 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:38.153 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.153 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.153 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.154 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:38.154 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:38.154 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.154 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.155 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.155 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:38.155 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:38.156 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.156 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.156 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.157 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:38.157 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.157 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.158 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:38.158 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.158 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.158 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.159 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:38.159 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:38.159 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.159 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.160 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.160 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:38.161 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:38.161 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.161 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.161 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.162 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:38.162 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.163 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.163 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:38.163 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.163 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.164 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.164 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:38.164 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:38.164 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.165 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.165 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.165 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.166 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:38.166 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:38.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.166 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.167 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.167 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:38.167 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.167 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.168 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:38.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.168 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.168 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.168 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:38.169 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.169 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.169 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:38.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.170 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.170 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.170 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:46:38.170 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.170 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.171 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:38.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.171 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.171 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.172 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:38.172 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.172 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.172 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:38.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.173 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.173 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.173 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:38.173 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.174 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.174 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:38.174 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:38.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f245c087110 msgr2=0x7f245c0895c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f245c087110 0x7f245c0895c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f247406ccb0 tx=0x7f2460008030 comp rx=0 tx=0).stop 2022-08-10T17:46:38.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 msgr2=0x7f24740bf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 --2- 172.21.15.150:0/1933104309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f247414ed40 0x7f24740bf330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f246c00efc0 tx=0x7f246c00c3a0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 reap_dead start 2022-08-10T17:46:38.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f24791b6700 1 -- 172.21.15.150:0/1933104309 reap_dead start 2022-08-10T17:46:38.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 shutdown_connections 2022-08-10T17:46:38.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 >> 172.21.15.150:0/1933104309 conn(0x7f24740c92f0 msgr2=0x7f24740688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 shutdown_connections 2022-08-10T17:46:38.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.128+0000 7f247ac19700 1 -- 172.21.15.150:0/1933104309 wait complete. 2022-08-10T17:46:38.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:46:38.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.339+0000 7f1a52dd5700 1 Processor -- start 2022-08-10T17:46:38.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.340+0000 7f1a52dd5700 1 -- start start 2022-08-10T17:46:38.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a52dd5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a52dd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 0x7f1a4c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a52dd5700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0707d0 con 0x7f1a4c0c45b0 2022-08-10T17:46:38.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a52dd5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c14d250 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a52dd5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c153980 con 0x7f1a4c0c4100 2022-08-10T17:46:38.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40424/0 (socket says 172.21.15.150:40424) 2022-08-10T17:46:38.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 -- 172.21.15.150:0/1280737012 learned_addr learned my addr 172.21.15.150:0/1280737012 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 0x7f1a4c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 -- 172.21.15.150:0/1280737012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 msgr2=0x7f1a4c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:38.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 0x7f1a4c0c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 -- 172.21.15.150:0/1280737012 >> v1:172.21.15.197:6789/0 conn(0x7f1a4c0c45b0 legacy=0x7f1a4c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.341+0000 7f1a50b71700 1 -- 172.21.15.150:0/1280737012 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c152b40 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.342+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 0x7f1a4c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:38.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.342+0000 7f1a50b71700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a4000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92900cfd144b9a03 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.342+0000 7f1a4b7fe700 1 -- 172.21.15.150:0/1280737012 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40010070 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.342+0000 7f1a4b7fe700 1 -- 172.21.15.150:0/1280737012 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40004030 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.342+0000 7f1a4b7fe700 1 -- 172.21.15.150:0/1280737012 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400043c0 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 -- 172.21.15.150:0/1280737012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c91d0 msgr2=0x7f1a4c0c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a4000d330 comp rx=0 tx=0).stop 2022-08-10T17:46:38.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 -- 172.21.15.150:0/1280737012 shutdown_connections 2022-08-10T17:46:38.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c91d0 0x7f1a4c0c3340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/1280737012 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c4100 0x7f1a4c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 -- 172.21.15.150:0/1280737012 >> 172.21.15.150:0/1280737012 conn(0x7f1a4c06b500 msgr2=0x7f1a4c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 -- 172.21.15.150:0/1280737012 shutdown_connections 2022-08-10T17:46:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.343+0000 7f1a52dd5700 1 -- 172.21.15.150:0/1280737012 wait complete. 2022-08-10T17:46:38.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.345+0000 7f1a52dd5700 1 Processor -- start 2022-08-10T17:46:38.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.345+0000 7f1a52dd5700 1 -- start start 2022-08-10T17:46:38.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c4100 0x7f1a4c0bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a4c0c45b0 0x7f1a4c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 0x7f1a4c1ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1ed510 con 0x7f1a4c0c4100 2022-08-10T17:46:38.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1ed1c0 con 0x7f1a4c0c45b0 2022-08-10T17:46:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a52dd5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0bd2d0 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a51372700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 0x7f1a4c1ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a51372700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 0x7f1a4c1ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54654/0 (socket says 172.21.15.150:54654) 2022-08-10T17:46:38.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.346+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 learned_addr learned my addr 172.21.15.150:0/665992419 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c4100 0x7f1a4c0bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a4c0c45b0 0x7f1a4c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a4c0c45b0 msgr2=0x7f1a4c14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a4c0c45b0 0x7f1a4c14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c4100 msgr2=0x7f1a4c0bcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c4100 0x7f1a4c0bcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009a70 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a4c0c4100 0x7f1a4c0bcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:46:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1a4c0c45b0 0x7f1a4c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:46:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a51372700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 0x7f1a4c1ed9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c3f0 tx=0x7f1a3c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0052d0 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c011590 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a40008460 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c011940 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.347+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c0bd890 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.348+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 0x7f1a4c1edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.348+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0673d0 con 0x7f1a4c1dd610 2022-08-10T17:46:38.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.348+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 0x7f1a4c1edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1a3c019030 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a50b71700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4c1ed6c0 con 0x7f1a4c1dd610 2022-08-10T17:46:38.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 0x7f1a4c1edee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a400045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1a2c0650b0 0x7f1a2c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1a3c0814c0 con 0x7f1a4c0c91d0 2022-08-10T17:46:38.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1a2c0650b0 0x7f1a2c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40023070 con 0x7f1a4c1dd610 2022-08-10T17:46:38.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f1a40008ab0 con 0x7f1a4c1dd610 2022-08-10T17:46:38.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 msgr2=0x7f1a4c1edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 0x7f1a4c1edee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a400045d0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 msgr2=0x7f1a4c1edee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:38.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.349+0000 7f1a497fa700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1dd610 0x7f1a4c1edee0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.350+0000 7f1a4bfff700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1a2c0650b0 0x7f1a2c067560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fd0 tx=0x7f1a4400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.363+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 0x7f1a4c0c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.363+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c150690 con 0x7f1a4c1ef2c0 2022-08-10T17:46:38.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.363+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 0x7f1a4c0c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a50b71700 1 -- 172.21.15.150:0/665992419 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1a4c06c170 con 0x7f1a4c1ef2c0 2022-08-10T17:46:38.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a50b71700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 0x7f1a4c0c14e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071110 tx=0x7f1a40015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000b4c0 con 0x7f1a4c1ef2c0 2022-08-10T17:46:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7f1a4000b620 con 0x7f1a4c1ef2c0 2022-08-10T17:46:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 msgr2=0x7f1a4c0c14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 0x7f1a4c0c14e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071110 tx=0x7f1a40015000 comp rx=0 tx=0).stop 2022-08-10T17:46:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 msgr2=0x7f1a4c0c14e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.364+0000 7f1a497fa700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c1ef2c0 0x7f1a4c0c14e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.373 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:46:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:46:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:46:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:46:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:46:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:38.419 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1a2c0650b0 msgr2=0x7f1a2c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1a2c0650b0 0x7f1a2c067560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fd0 tx=0x7f1a4400b040 comp rx=0 tx=0).stop 2022-08-10T17:46:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 msgr2=0x7f1a4c1ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 --2- 172.21.15.150:0/665992419 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1a4c0c91d0 0x7f1a4c1ed9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c3f0 tx=0x7f1a3c00c7b0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 reap_dead start 2022-08-10T17:46:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a51372700 1 -- 172.21.15.150:0/665992419 reap_dead start 2022-08-10T17:46:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 shutdown_connections 2022-08-10T17:46:38.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 >> 172.21.15.150:0/665992419 conn(0x7f1a4c06b500 msgr2=0x7f1a4c151900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 shutdown_connections 2022-08-10T17:46:38.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.365+0000 7f1a52dd5700 1 -- 172.21.15.150:0/665992419 wait complete. 2022-08-10T17:46:38.423 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:46:38.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:46:38.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.579+0000 7f6a9f5a7700 1 Processor -- start 2022-08-10T17:46:38.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.579+0000 7f6a9f5a7700 1 -- start start 2022-08-10T17:46:38.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.580+0000 7f6a9f5a7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6a980c4420 0x7f6a980c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.580+0000 7f6a9f5a7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a98071920 0x7f6a98157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.580+0000 7f6a9f5a7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a98070810 con 0x7f6a98071550 2022-08-10T17:46:38.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.580+0000 7f6a9f5a7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a980c7510 con 0x7f6a98071920 2022-08-10T17:46:38.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.580+0000 7f6a9f5a7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9815e290 con 0x7f6a980c4420 2022-08-10T17:46:38.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6a980c4420 0x7f6a980c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6a980c4420 0x7f6a980c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51040/0 (socket says 172.21.15.150:51040) 2022-08-10T17:46:38.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 -- 172.21.15.150:0/3905085103 learned_addr learned my addr 172.21.15.150:0/3905085103 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 -- 172.21.15.150:0/3905085103 >> v2:172.21.15.150:3300/0 conn(0x7f6a98071920 msgr2=0x7f6a98157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:38.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 --2- 172.21.15.150:0/3905085103 >> v2:172.21.15.150:3300/0 conn(0x7f6a98071920 0x7f6a98157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 -- 172.21.15.150:0/3905085103 >> v1:172.21.15.150:6789/0 conn(0x7f6a98071550 legacy=0x7f6a9815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 -- 172.21.15.150:0/3905085103 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9815e570 con 0x7f6a980c4420 2022-08-10T17:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a9cb42700 1 --2- 172.21.15.150:0/3905085103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a980c4420 0x7f6a980c6fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a98069420 tx=0x7f6a88009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc550ed13734d58 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a87fff700 1 -- 172.21.15.150:0/3905085103 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011830 con 0x7f6a980c4420 2022-08-10T17:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a87fff700 1 -- 172.21.15.150:0/3905085103 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88011990 con 0x7f6a980c4420 2022-08-10T17:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.581+0000 7f6a87fff700 1 -- 172.21.15.150:0/3905085103 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011d20 con 0x7f6a980c4420 2022-08-10T17:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3905085103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a980c4420 msgr2=0x7f6a980c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3905085103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a980c4420 0x7f6a980c6fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a98069420 tx=0x7f6a88009a60 comp rx=0 tx=0).stop 2022-08-10T17:46:38.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3905085103 shutdown_connections 2022-08-10T17:46:38.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3905085103 >> v2:172.21.15.150:3300/0 conn(0x7f6a98071920 0x7f6a98157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3905085103 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a980c4420 0x7f6a980c6fd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3905085103 >> 172.21.15.150:0/3905085103 conn(0x7f6a9806d0d0 msgr2=0x7f6a980c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3905085103 shutdown_connections 2022-08-10T17:46:38.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.582+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3905085103 wait complete. 2022-08-10T17:46:38.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.584+0000 7f6a9f5a7700 1 Processor -- start 2022-08-10T17:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.584+0000 7f6a9f5a7700 1 -- start start 2022-08-10T17:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 0x7f6a981f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a98071920 0x7f6a9814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 0x7f6a981574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981f0c60 con 0x7f6a980c4420 2022-08-10T17:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981f0670 con 0x7f6a98071920 2022-08-10T17:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9f5a7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9814dce0 con 0x7f6a98071550 2022-08-10T17:46:38.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9d343700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 0x7f6a981f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9d343700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 0x7f6a981f1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54674/0 (socket says 172.21.15.150:54674) 2022-08-10T17:46:38.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9d343700 1 -- 172.21.15.150:0/3406820862 learned_addr learned my addr 172.21.15.150:0/3406820862 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:38.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9db44700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 0x7f6a981574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.585+0000 7f6a9cb42700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a98071920 0x7f6a9814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 -- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 msgr2=0x7f6a981f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 0x7f6a981f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 -- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a98071920 msgr2=0x7f6a9814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a98071920 0x7f6a9814f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 -- 172.21.15.150:0/3406820862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880093e0 con 0x7f6a980c4420 2022-08-10T17:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.586+0000 7f6a9db44700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 0x7f6a981574f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000be50 tx=0x7f6a90009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.588+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000cbb0 con 0x7f6a980c4420 2022-08-10T17:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.588+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9000cd30 con 0x7f6a980c4420 2022-08-10T17:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.588+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000cea0 con 0x7f6a980c4420 2022-08-10T17:46:38.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.588+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981f15c0 con 0x7f6a980c4420 2022-08-10T17:46:38.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.588+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981f0880 con 0x7f6a980c4420 2022-08-10T17:46:38.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.589+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9814e190 con 0x7f6a980c4420 2022-08-10T17:46:38.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.589+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6a9001b030 con 0x7f6a980c4420 2022-08-10T17:46:38.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.590+0000 7f6a85ffb700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 0x7f6a78067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:38.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.590+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6a90081f40 con 0x7f6a980c4420 2022-08-10T17:46:38.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.594+0000 7f6a9d343700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 0x7f6a78067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:38.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.595+0000 7f6a9d343700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 0x7f6a78067590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6a940068c0 tx=0x7f6a94006850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:38.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.600+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6a9004c6b0 con 0x7f6a980c4420 2022-08-10T17:46:38.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.947+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f6a981f0da0 con 0x7f6a980c4420 2022-08-10T17:46:38.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.950+0000 7f6a85ffb700 1 -- 172.21.15.150:0/3406820862 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f6a981f0da0 con 0x7f6a980c4420 2022-08-10T17:46:38.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 msgr2=0x7f6a78067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 0x7f6a78067590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6a940068c0 tx=0x7f6a94006850 comp rx=0 tx=0).stop 2022-08-10T17:46:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 msgr2=0x7f6a981574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 0x7f6a981574f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000be50 tx=0x7f6a90009ed0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 shutdown_connections 2022-08-10T17:46:38.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a980c4420 0x7f6a981574f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6a780650e0 0x7f6a78067590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6a98071550 0x7f6a981f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 --2- 172.21.15.150:0/3406820862 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6a98071920 0x7f6a9814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 >> 172.21.15.150:0/3406820862 conn(0x7f6a9806d0d0 msgr2=0x7f6a98159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 shutdown_connections 2022-08-10T17:46:38.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:38.954+0000 7f6a9f5a7700 1 -- 172.21.15.150:0/3406820862 wait complete. 2022-08-10T17:46:38.971 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:46:48.973 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:46:48.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:50.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.490+0000 7f9a61b18700 1 Processor -- start 2022-08-10T17:46:50.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.490+0000 7f9a61b18700 1 -- start start 2022-08-10T17:46:50.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a61b18700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:50.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a61b18700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c06b490 con 0x7f9a5c0700a0 2022-08-10T17:46:50.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a61b18700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c06b770 con 0x7f9a5c06d930 2022-08-10T17:46:50.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a61b18700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c06bd30 con 0x7f9a5c1553b0 2022-08-10T17:46:50.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:50.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:54728/0 (socket says 172.21.15.150:54728) 2022-08-10T17:46:50.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.492+0000 7f9a5bfff700 1 -- 172.21.15.150:0/1793052392 learned_addr learned my addr 172.21.15.150:0/1793052392 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:50.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5bfff700 1 -- 172.21.15.150:0/1793052392 >> v1:172.21.15.197:6789/0 conn(0x7f9a5c06d930 legacy=0x7f9a5c154ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:50.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5bfff700 1 -- 172.21.15.150:0/1793052392 >> v1:172.21.15.150:6789/0 conn(0x7f9a5c0700a0 legacy=0x7f9a5c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:50.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5bfff700 1 -- 172.21.15.150:0/1793052392 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c06ba50 con 0x7f9a5c1553b0 2022-08-10T17:46:50.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5bfff700 1 --2- 172.21.15.150:0/1793052392 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009e80 tx=0x7f9a5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15cd5776e11d856a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:50.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5a7fc700 1 -- 172.21.15.150:0/1793052392 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400e070 con 0x7f9a5c1553b0 2022-08-10T17:46:50.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5a7fc700 1 -- 172.21.15.150:0/1793052392 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5400b980 con 0x7f9a5c1553b0 2022-08-10T17:46:50.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.493+0000 7f9a5a7fc700 1 -- 172.21.15.150:0/1793052392 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400bd30 con 0x7f9a5c1553b0 2022-08-10T17:46:50.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 -- 172.21.15.150:0/1793052392 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 msgr2=0x7f9a5c0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:50.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 --2- 172.21.15.150:0/1793052392 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009e80 tx=0x7f9a5400b330 comp rx=0 tx=0).stop 2022-08-10T17:46:50.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 -- 172.21.15.150:0/1793052392 shutdown_connections 2022-08-10T17:46:50.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 --2- 172.21.15.150:0/1793052392 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c1553b0 0x7f9a5c0c36c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 -- 172.21.15.150:0/1793052392 >> 172.21.15.150:0/1793052392 conn(0x7f9a5c0c8a10 msgr2=0x7f9a5c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:50.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 -- 172.21.15.150:0/1793052392 shutdown_connections 2022-08-10T17:46:50.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.494+0000 7f9a61b18700 1 -- 172.21.15.150:0/1793052392 wait complete. 2022-08-10T17:46:50.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.495+0000 7f9a61b18700 1 Processor -- start 2022-08-10T17:46:50.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.496+0000 7f9a61b18700 1 -- start start 2022-08-10T17:46:50.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:50.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c0700a0 0x7f9a5c1e5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:50.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a5c1553b0 0x7f9a5c1f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:50.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c150cf0 con 0x7f9a5c06d930 2022-08-10T17:46:50.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c151b30 con 0x7f9a5c1553b0 2022-08-10T17:46:50.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a61b18700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c150f20 con 0x7f9a5c0700a0 2022-08-10T17:46:50.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:50.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40508/0 (socket says 172.21.15.150:40508) 2022-08-10T17:46:50.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c0700a0 0x7f9a5c1e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:50.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 -- 172.21.15.150:0/2629633428 learned_addr learned my addr 172.21.15.150:0/2629633428 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:50.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5bfff700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a5c1553b0 0x7f9a5c1f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:50.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 -- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c0700a0 msgr2=0x7f9a5c1e5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:50.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c0700a0 0x7f9a5c1e5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 -- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a5c1553b0 msgr2=0x7f9a5c1f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:50.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a5c1553b0 0x7f9a5c1f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 -- 172.21.15.150:0/2629633428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009b30 con 0x7f9a5c06d930 2022-08-10T17:46:50.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.497+0000 7f9a5b7fe700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c410 tx=0x7f9a4c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:50.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.498+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00ce70 con 0x7f9a5c06d930 2022-08-10T17:46:50.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.498+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c151200 con 0x7f9a5c06d930 2022-08-10T17:46:50.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.498+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c003500 con 0x7f9a5c06d930 2022-08-10T17:46:50.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.498+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0038d0 con 0x7f9a5c06d930 2022-08-10T17:46:50.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.498+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c1517c0 con 0x7f9a5c06d930 2022-08-10T17:46:50.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.499+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c151950 con 0x7f9a5c06d930 2022-08-10T17:46:50.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.501+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9a4c010070 con 0x7f9a5c06d930 2022-08-10T17:46:50.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.501+0000 7f9a43fff700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 0x7f9a3c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:50.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.502+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9a4c081140 con 0x7f9a5c06d930 2022-08-10T17:46:50.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.502+0000 7f9a5affd700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 0x7f9a3c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:50.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.503+0000 7f9a5affd700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 0x7f9a3c067560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a50006fd0 tx=0x7f9a50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:50.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.508+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f9a4c04f1c0 con 0x7f9a5c06d930 2022-08-10T17:46:50.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.844+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9a5c151ca0 con 0x7f9a5c06d930 2022-08-10T17:46:50.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.846+0000 7f9a43fff700 1 -- 172.21.15.150:0/2629633428 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f9a4c017020 con 0x7f9a5c06d930 2022-08-10T17:46:50.850 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:50.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 msgr2=0x7f9a3c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:50.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 0x7f9a3c067560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a50006fd0 tx=0x7f9a50008040 comp rx=0 tx=0).stop 2022-08-10T17:46:50.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 msgr2=0x7f9a5c0bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:50.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c410 tx=0x7f9a4c00c720 comp rx=0 tx=0).stop 2022-08-10T17:46:50.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 shutdown_connections 2022-08-10T17:46:50.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9a5c1553b0 0x7f9a5c1f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a5c06d930 0x7f9a5c0bd5e0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c410 tx=0x7f9a4c00c720 comp rx=0 tx=0).stop 2022-08-10T17:46:50.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9a3c0650b0 0x7f9a3c067560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 --2- 172.21.15.150:0/2629633428 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9a5c0700a0 0x7f9a5c1e5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:50.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 >> 172.21.15.150:0/2629633428 conn(0x7f9a5c0c8a10 msgr2=0x7f9a5c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:50.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 shutdown_connections 2022-08-10T17:46:50.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:50.850+0000 7f9a61b18700 1 -- 172.21.15.150:0/2629633428 wait complete. 2022-08-10T17:46:50.868 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:46:50.868 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:46:50.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:46:51.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.019+0000 7f8a54636700 1 Processor -- start 2022-08-10T17:46:51.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.019+0000 7f8a54636700 1 -- start start 2022-08-10T17:46:51.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a54636700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a4c14ed30 0x7f8a4c0c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a54636700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0c36f0 con 0x7f8a4c06b640 2022-08-10T17:46:51.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a54636700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c06ca30 con 0x7f8a4c0c5570 2022-08-10T17:46:51.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a54636700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c14f100 con 0x7f8a4c14ed30 2022-08-10T17:46:51.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a523d2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a4c14ed30 0x7f8a4c0c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a52bd3700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f8a4c0c5570 0x7f8a4c155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:39556/0 (socket says 172.21.15.150:39556) 2022-08-10T17:46:51.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a51bd1700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a4c06b640 0x7f8a4c0c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53206/0 (socket says 172.21.15.150:53206) 2022-08-10T17:46:51.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a52bd3700 1 -- 172.21.15.150:0/366342882 learned_addr learned my addr 172.21.15.150:0/366342882 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:51.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852604628 0 0) 0x7f8a4c06ca30 con 0x7f8a4c0c5570 2022-08-10T17:46:51.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a34003430 con 0x7f8a4c0c5570 2022-08-10T17:46:51.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.020+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799520933 0 0) 0x7f8a3c001040 con 0x7f8a4c06b640 2022-08-10T17:46:51.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.021+0000 7f8a523d2700 1 -- 172.21.15.150:0/366342882 >> v1:172.21.15.197:6789/0 conn(0x7f8a4c0c5570 legacy=0x7f8a4c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.021+0000 7f8a523d2700 1 -- 172.21.15.150:0/366342882 >> v1:172.21.15.150:6789/0 conn(0x7f8a4c06b640 legacy=0x7f8a4c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.021+0000 7f8a523d2700 1 -- 172.21.15.150:0/366342882 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c06a450 con 0x7f8a4c14ed30 2022-08-10T17:46:51.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.021+0000 7f8a523d2700 1 --2- 172.21.15.150:0/366342882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c0c20f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a480096b0 tx=0x7f8a480099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb855aca1204fda4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.022+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48004230 con 0x7f8a4c14ed30 2022-08-10T17:46:51.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.022+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a48004390 con 0x7f8a4c14ed30 2022-08-10T17:46:51.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.022+0000 7f8a513d0700 1 -- 172.21.15.150:0/366342882 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480107d0 con 0x7f8a4c14ed30 2022-08-10T17:46:51.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.022+0000 7f8a54636700 1 -- 172.21.15.150:0/366342882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c14ed30 msgr2=0x7f8a4c0c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.022+0000 7f8a54636700 1 --2- 172.21.15.150:0/366342882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c0c20f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a480096b0 tx=0x7f8a480099c0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.023+0000 7f8a54636700 1 -- 172.21.15.150:0/366342882 shutdown_connections 2022-08-10T17:46:51.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.023+0000 7f8a54636700 1 --2- 172.21.15.150:0/366342882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c0c20f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.023+0000 7f8a54636700 1 -- 172.21.15.150:0/366342882 >> 172.21.15.150:0/366342882 conn(0x7f8a4c06e1f0 msgr2=0x7f8a4c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.023+0000 7f8a54636700 1 -- 172.21.15.150:0/366342882 shutdown_connections 2022-08-10T17:46:51.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.023+0000 7f8a54636700 1 -- 172.21.15.150:0/366342882 wait complete. 2022-08-10T17:46:51.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.024+0000 7f8a54636700 1 Processor -- start 2022-08-10T17:46:51.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.024+0000 7f8a54636700 1 -- start start 2022-08-10T17:46:51.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 0x7f8a4c069370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a4c1447a0 0x7f8a4c144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0c7850 con 0x7f8a4c0c5570 2022-08-10T17:46:51.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c145150 con 0x7f8a4c14ed30 2022-08-10T17:46:51.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a54636700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c155ae0 con 0x7f8a4c1447a0 2022-08-10T17:46:51.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 0x7f8a4c069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 0x7f8a4c069370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40528/0 (socket says 172.21.15.150:40528) 2022-08-10T17:46:51.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 -- 172.21.15.150:0/1881746279 learned_addr learned my addr 172.21.15.150:0/1881746279 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:51.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a51bd1700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a52bd3700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a4c1447a0 0x7f8a4c144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a4c1447a0 msgr2=0x7f8a4c144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a4c1447a0 0x7f8a4c144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a4c14ed30 msgr2=0x7f8a4c155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a4c14ed30 0x7f8a4c155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48009310 con 0x7f8a4c0c5570 2022-08-10T17:46:51.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a523d2700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 0x7f8a4c069370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009a00 tx=0x7f8a480045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.026+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48003520 con 0x7f8a4c0c5570 2022-08-10T17:46:51.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480036a0 con 0x7f8a4c0c5570 2022-08-10T17:46:51.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48003a50 con 0x7f8a4c0c5570 2022-08-10T17:46:51.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c0c60f0 con 0x7f8a4c0c5570 2022-08-10T17:46:51.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c0c7190 con 0x7f8a4c0c5570 2022-08-10T17:46:51.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a54636700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 0x7f8a4c1ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0644b0 con 0x7f8a4c06b640 2022-08-10T17:46:51.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.027+0000 7f8a51bd1700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 0x7f8a4c1ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.028+0000 7f8a51bd1700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a4c0c7990 con 0x7f8a4c06b640 2022-08-10T17:46:51.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.028+0000 7f8a51bd1700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 0x7f8a4c1ef470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000f60 tx=0x7f8a3c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.028+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c017070 con 0x7f8a4c06b640 2022-08-10T17:46:51.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.028+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8a4802c070 con 0x7f8a4c0c5570 2022-08-10T17:46:51.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a2c0650f0 0x7f8a2c0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8a480832b0 con 0x7f8a4c0c5570 2022-08-10T17:46:51.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a52bd3700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a2c0650f0 0x7f8a2c0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f8a3c0133f0 con 0x7f8a4c06b640 2022-08-10T17:46:51.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 msgr2=0x7f8a4c1ef470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 0x7f8a4c1ef470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000f60 tx=0x7f8a3c001650 comp rx=0 tx=0).stop 2022-08-10T17:46:51.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 msgr2=0x7f8a4c1ef470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a3affd700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c06b640 0x7f8a4c1ef470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.029+0000 7f8a52bd3700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a2c0650f0 0x7f8a2c0675a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8a440012e0 tx=0x7f8a44004c50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.036+0000 7f8a54636700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 0x7f8a4c1ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.036+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c067100 con 0x7f8a4c0c7320 2022-08-10T17:46:51.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.036+0000 7f8a51bd1700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 0x7f8a4c1ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.036+0000 7f8a51bd1700 1 -- 172.21.15.150:0/1881746279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8a4c0caa30 con 0x7f8a4c0c7320 2022-08-10T17:46:51.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.036+0000 7f8a51bd1700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 0x7f8a4c1ef9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c015040 tx=0x7f8a3c000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c01bca0 con 0x7f8a4c0c7320 2022-08-10T17:46:51.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7f8a3c023450 con 0x7f8a4c0c7320 2022-08-10T17:46:51.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 msgr2=0x7f8a4c1ef9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 0x7f8a4c1ef9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c015040 tx=0x7f8a3c000fb0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 msgr2=0x7f8a4c1ef9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a3affd700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c7320 0x7f8a4c1ef9b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.051 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:51.051 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:51.051 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:51.051 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:46:51.052 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:51.052 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:51.052 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:51.052 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:51.053 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:51.053 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.053 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 15, 2022-08-10T17:46:51.053 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.054 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:51.054 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:51.054 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.054 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.055 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.055 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.055 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.055 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.056 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.056 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.056 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.056 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.057 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:51.057 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:51.057 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.057 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.058 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.058 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.058 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.058 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.059 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.059 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.059 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.059 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.060 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.060 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:51.060 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:51.060 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:51.061 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:51.061 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:51.061 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:51.061 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.062 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.062 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:51.062 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:51.062 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:51.063 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:51.063 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:51.063 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:51.063 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.064 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:51.064 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.064 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.064 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.066 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.066 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.066 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:51.066 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.067 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:51.067 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.067 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:51.067 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:51.068 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.068 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.068 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.068 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.069 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:51.069 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.069 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.070 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.070 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:51.070 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.070 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.071 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.071 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.071 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.071 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.072 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.072 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.072 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.073 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.073 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:51.073 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:51.073 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.074 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.074 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.074 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:51.075 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.075 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.075 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.076 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:51.076 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.076 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.076 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.077 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.077 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.077 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.078 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.078 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.078 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.078 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.079 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:51.079 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:51.079 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.079 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.080 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.080 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.080 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:51.080 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.081 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.081 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:46:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:51.089 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:51.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a2c0650f0 msgr2=0x7f8a2c0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a2c0650f0 0x7f8a2c0675a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8a440012e0 tx=0x7f8a44004c50 comp rx=0 tx=0).stop 2022-08-10T17:46:51.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 msgr2=0x7f8a4c069370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 --2- 172.21.15.150:0/1881746279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a4c0c5570 0x7f8a4c069370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009a00 tx=0x7f8a480045d0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a52bd3700 1 -- 172.21.15.150:0/1881746279 reap_dead start 2022-08-10T17:46:51.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a52bd3700 1 -- 172.21.15.150:0/1881746279 reap_dead start 2022-08-10T17:46:51.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 shutdown_connections 2022-08-10T17:46:51.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 >> 172.21.15.150:0/1881746279 conn(0x7f8a4c06e1f0 msgr2=0x7f8a4c157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 shutdown_connections 2022-08-10T17:46:51.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.037+0000 7f8a54636700 1 -- 172.21.15.150:0/1881746279 wait complete. 2022-08-10T17:46:51.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:46:51.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.252+0000 7fb6729de700 1 Processor -- start 2022-08-10T17:46:51.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.252+0000 7fb6729de700 1 -- start start 2022-08-10T17:46:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb6729de700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb66c0c7220 0x7fb66c0c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb6729de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb66c0c25c0 0x7fb66c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb6729de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c0c2a60 con 0x7fb66c0c4d90 2022-08-10T17:46:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb6729de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0c5e10 con 0x7fb66c0c25c0 2022-08-10T17:46:51.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb6729de700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0c1c30 con 0x7fb66c0c7220 2022-08-10T17:46:51.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb66c0c25c0 0x7fb66c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb66bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb66c0c4d90 0x7fb66c0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53220/0 (socket says 172.21.15.150:53220) 2022-08-10T17:46:51.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb66bfff700 1 -- 172.21.15.150:0/3165377873 learned_addr learned my addr 172.21.15.150:0/3165377873 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:51.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb66b7fe700 1 --2- 172.21.15.150:0/3165377873 >> v2:172.21.15.197:3300/0 conn(0x7fb66c0c7220 0x7fb66c0c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 -- 172.21.15.150:0/3165377873 >> v2:172.21.15.197:3300/0 conn(0x7fb66c0c7220 msgr2=0x7fb66c0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:51.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 --2- 172.21.15.150:0/3165377873 >> v2:172.21.15.197:3300/0 conn(0x7fb66c0c7220 0x7fb66c0c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 -- 172.21.15.150:0/3165377873 >> v1:172.21.15.150:6789/0 conn(0x7fb66c0c4d90 legacy=0x7fb66c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 -- 172.21.15.150:0/3165377873 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0699c0 con 0x7fb66c0c25c0 2022-08-10T17:46:51.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.253+0000 7fb670f7b700 1 --2- 172.21.15.150:0/3165377873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c25c0 0x7fb66c06fca0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0afcf0 tx=0x7fb66400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c347c7d22e039180 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb66affd700 1 -- 172.21.15.150:0/3165377873 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664010070 con 0x7fb66c0c25c0 2022-08-10T17:46:51.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb66affd700 1 -- 172.21.15.150:0/3165377873 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66400b2e0 con 0x7fb66c0c25c0 2022-08-10T17:46:51.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb66affd700 1 -- 172.21.15.150:0/3165377873 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66400dc10 con 0x7fb66c0c25c0 2022-08-10T17:46:51.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 -- 172.21.15.150:0/3165377873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c25c0 msgr2=0x7fb66c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 --2- 172.21.15.150:0/3165377873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c25c0 0x7fb66c06fca0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0afcf0 tx=0x7fb66400d330 comp rx=0 tx=0).stop 2022-08-10T17:46:51.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 -- 172.21.15.150:0/3165377873 shutdown_connections 2022-08-10T17:46:51.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 --2- 172.21.15.150:0/3165377873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c25c0 0x7fb66c06fca0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 --2- 172.21.15.150:0/3165377873 >> v2:172.21.15.197:3300/0 conn(0x7fb66c0c7220 0x7fb66c0c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 -- 172.21.15.150:0/3165377873 >> 172.21.15.150:0/3165377873 conn(0x7fb66c06d0d0 msgr2=0x7fb66c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 -- 172.21.15.150:0/3165377873 shutdown_connections 2022-08-10T17:46:51.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.254+0000 7fb6729de700 1 -- 172.21.15.150:0/3165377873 wait complete. 2022-08-10T17:46:51.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.256+0000 7fb6729de700 1 Processor -- start 2022-08-10T17:46:51.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.256+0000 7fb6729de700 1 -- start start 2022-08-10T17:46:51.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb66c0c25c0 0x7fb66c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c4d90 0x7fb66c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 0x7fb66c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c0100 con 0x7fb66c0c7220 2022-08-10T17:46:51.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0bf480 con 0x7fb66c0c4d90 2022-08-10T17:46:51.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb6729de700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0bf760 con 0x7fb66c0c25c0 2022-08-10T17:46:51.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 0x7fb66c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 0x7fb66c150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40550/0 (socket says 172.21.15.150:40550) 2022-08-10T17:46:51.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 learned_addr learned my addr 172.21.15.150:0/709481358 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:51.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb66b7fe700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c4d90 0x7fb66c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb66bfff700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb66c0c25c0 0x7fb66c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb66c0c25c0 msgr2=0x7fb66c152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb66c0c25c0 0x7fb66c152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c4d90 msgr2=0x7fb66c14faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c4d90 0x7fb66c14faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66400bc80 con 0x7fb66c0c7220 2022-08-10T17:46:51.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb66b7fe700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c4d90 0x7fb66c14faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:51.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.257+0000 7fb670f7b700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 0x7fb66c150030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06deb0 tx=0x7fb664004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664004240 con 0x7fb66c0c7220 2022-08-10T17:46:51.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66400b450 con 0x7fb66c0c7220 2022-08-10T17:46:51.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0bfa40 con 0x7fb66c0c7220 2022-08-10T17:46:51.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664004620 con 0x7fb66c0c7220 2022-08-10T17:46:51.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c1ed320 con 0x7fb66c0c7220 2022-08-10T17:46:51.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb6729de700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 0x7fb66c0be490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.258+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c0910 con 0x7fb66c0c0240 2022-08-10T17:46:51.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.259+0000 7fb66bfff700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 0x7fb66c0be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.259+0000 7fb66bfff700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb66c072890 con 0x7fb66c0c0240 2022-08-10T17:46:51.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.259+0000 7fb66bfff700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 0x7fb66c0be490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c00f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.259+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c001290 con 0x7fb66c0c0240 2022-08-10T17:46:51.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.259+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb66401d420 con 0x7fb66c0c7220 2022-08-10T17:46:51.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb64c065120 0x7fb64c0675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb6640834e0 con 0x7fb66c0c7220 2022-08-10T17:46:51.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb66b7fe700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb64c065120 0x7fb64c0675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fb65c0072e0 con 0x7fb66c0c0240 2022-08-10T17:46:51.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 msgr2=0x7fb66c0be490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 0x7fb66c0be490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c00f8d0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 msgr2=0x7fb66c0be490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.260+0000 7fb668ff9700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c0c0240 0x7fb66c0be490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.261+0000 7fb66b7fe700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb64c065120 0x7fb64c0675d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0afbe0 tx=0x7fb6600090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.267+0000 7fb6729de700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 0x7fb66c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.267+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0672f0 con 0x7fb66c1ece40 2022-08-10T17:46:51.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.267+0000 7fb66bfff700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 0x7fb66c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb66bfff700 1 -- 172.21.15.150:0/709481358 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb66c068e40 con 0x7fb66c1ece40 2022-08-10T17:46:51.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb66bfff700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 0x7fb66c14ee50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c01cc30 con 0x7fb66c1ece40 2022-08-10T17:46:51.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4887 (secure 0 0 0) 0x7fb65c01cd90 con 0x7fb66c1ece40 2022-08-10T17:46:51.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 msgr2=0x7fb66c14ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 0x7fb66c14ee50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c005700 comp rx=0 tx=0).stop 2022-08-10T17:46:51.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 msgr2=0x7fb66c14ee50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.268+0000 7fb668ff9700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb66c1ece40 0x7fb66c14ee50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.282 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:51.282 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:46:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 16, 2022-08-10T17:46:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.284 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.285 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.287 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.287 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.287 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:51.287 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:51.288 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.288 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.288 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.288 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.288 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.289 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.289 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.289 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.289 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.290 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.290 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:51.290 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:51.290 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:51.291 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:51.291 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:51.291 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:51.291 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.292 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.292 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:51.292 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:51.292 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:51.293 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:51.293 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:51.293 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:51.293 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.293 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:51.294 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.294 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.294 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.294 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.296 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.296 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:51.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.296 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:51.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.297 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:51.297 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:51.297 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.297 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.298 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.298 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:51.298 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.299 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.299 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:51.299 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.300 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.300 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.301 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.301 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.301 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.301 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.302 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:51.302 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:51.302 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.303 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.303 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.303 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:51.304 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.304 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.304 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:51.305 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.305 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.305 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.305 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.306 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.306 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.306 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.306 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.307 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:51.307 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:51.308 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.308 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.308 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.308 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:51.309 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.309 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.309 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.311 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.312 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.313 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:51.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:51.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.316 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:46:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.317 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:51.318 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.319 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.321 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:51.321 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:51.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb64c065120 msgr2=0x7fb64c0675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb64c065120 0x7fb64c0675d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0afbe0 tx=0x7fb6600090e0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 msgr2=0x7fb66c150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 --2- 172.21.15.150:0/709481358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb66c0c7220 0x7fb66c150030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb66c06deb0 tx=0x7fb664004950 comp rx=0 tx=0).stop 2022-08-10T17:46:51.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 reap_dead start 2022-08-10T17:46:51.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb670f7b700 1 -- 172.21.15.150:0/709481358 reap_dead start 2022-08-10T17:46:51.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 shutdown_connections 2022-08-10T17:46:51.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 >> 172.21.15.150:0/709481358 conn(0x7fb66c06d0d0 msgr2=0x7fb66c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 shutdown_connections 2022-08-10T17:46:51.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.269+0000 7fb6729de700 1 -- 172.21.15.150:0/709481358 wait complete. 2022-08-10T17:46:51.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:46:51.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.464+0000 7fbb33430700 1 Processor -- start 2022-08-10T17:46:51.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.464+0000 7fbb33430700 1 -- start start 2022-08-10T17:46:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb33430700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fbb2c0c5a40 0x7fbb2c0be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb33430700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb33430700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0c6c50 con 0x7fbb2c0c28c0 2022-08-10T17:46:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb33430700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c6f30 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb33430700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c7210 con 0x7fbb2c0c5a40 2022-08-10T17:46:51.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40562/0 (socket says 172.21.15.150:40562) 2022-08-10T17:46:51.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 -- 172.21.15.150:0/3235747527 learned_addr learned my addr 172.21.15.150:0/3235747527 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:51.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb311cc700 1 --2- 172.21.15.150:0/3235747527 >> v2:172.21.15.197:3300/0 conn(0x7fbb2c0c5a40 0x7fbb2c0be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 -- 172.21.15.150:0/3235747527 >> v2:172.21.15.197:3300/0 conn(0x7fbb2c0c5a40 msgr2=0x7fbb2c0be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:51.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 --2- 172.21.15.150:0/3235747527 >> v2:172.21.15.197:3300/0 conn(0x7fbb2c0c5a40 0x7fbb2c0be8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 -- 172.21.15.150:0/3235747527 >> v1:172.21.15.197:6789/0 conn(0x7fbb2c0c28c0 legacy=0x7fbb2c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:51.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 -- 172.21.15.150:0/3235747527 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0c74f0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.466+0000 7fbb319cd700 1 --2- 172.21.15.150:0/3235747527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c072140 tx=0x7fbb1c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba83eb966bb2e983 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.467+0000 7fbb1bfff700 1 -- 172.21.15.150:0/3235747527 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0107b0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.467+0000 7fbb1bfff700 1 -- 172.21.15.150:0/3235747527 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c010930 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.467+0000 7fbb1bfff700 1 -- 172.21.15.150:0/3235747527 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c010ce0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 -- 172.21.15.150:0/3235747527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c37e0 msgr2=0x7fbb2c06d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 --2- 172.21.15.150:0/3235747527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c072140 tx=0x7fbb1c009a60 comp rx=0 tx=0).stop 2022-08-10T17:46:51.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 -- 172.21.15.150:0/3235747527 shutdown_connections 2022-08-10T17:46:51.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 --2- 172.21.15.150:0/3235747527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c06d9f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 --2- 172.21.15.150:0/3235747527 >> v2:172.21.15.197:3300/0 conn(0x7fbb2c0c5a40 0x7fbb2c0be8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 -- 172.21.15.150:0/3235747527 >> 172.21.15.150:0/3235747527 conn(0x7fbb2c06fae0 msgr2=0x7fbb2c06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 -- 172.21.15.150:0/3235747527 shutdown_connections 2022-08-10T17:46:51.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.468+0000 7fbb33430700 1 -- 172.21.15.150:0/3235747527 wait complete. 2022-08-10T17:46:51.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 Processor -- start 2022-08-10T17:46:51.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 -- start start 2022-08-10T17:46:51.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c28c0 0x7fbb2c1da510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c1f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c5a40 0x7fbb2c1f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1daa50 con 0x7fbb2c0c28c0 2022-08-10T17:46:51.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1df3a0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.470+0000 7fbb33430700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1f42d0 con 0x7fbb2c0c5a40 2022-08-10T17:46:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c1f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb319cd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c5a40 0x7fbb2c1f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c1f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51162/0 (socket says 172.21.15.150:51162) 2022-08-10T17:46:51.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 -- 172.21.15.150:0/1505690721 learned_addr learned my addr 172.21.15.150:0/1505690721 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb311cc700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c28c0 0x7fbb2c1da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c5a40 msgr2=0x7fbb2c1f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c5a40 0x7fbb2c1f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c28c0 msgr2=0x7fbb2c1da510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2c0c28c0 0x7fbb2c1da510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0093e0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb319cd700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c5a40 0x7fbb2c1f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb309cb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c1f0d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b3c0 tx=0x7fbb2800b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.471+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011620 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.472+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28011780 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.472+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c1f1270 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.472+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011b30 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.472+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c1df0c0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.472+0000 7fbb33430700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 0x7fbb2c0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1f4170 con 0x7fbb2c1f1cb0 2022-08-10T17:46:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb311cc700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 0x7fbb2c0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb311cc700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb2c0c4280 con 0x7fbb2c1f1cb0 2022-08-10T17:46:51.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb311cc700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 0x7fbb2c0bf870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400f410 tx=0x7fbb2400f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fbb28021070 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.473+0000 7fbb19ffb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbb0c0650b0 0x7fbb0c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fbb28081ed0 con 0x7fbb2c0c37e0 2022-08-10T17:46:51.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb319cd700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbb0c0650b0 0x7fbb0c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400e040 con 0x7fbb2c1f1cb0 2022-08-10T17:46:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fbb2400f040 con 0x7fbb2c1f1cb0 2022-08-10T17:46:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 msgr2=0x7fbb2c0bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 0x7fbb2c0bf870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400f410 tx=0x7fbb2400f7d0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 msgr2=0x7fbb2c0bf870 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb19ffb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c1f1cb0 0x7fbb2c0bf870 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400f410 tx=0x7fbb2400f7d0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.474+0000 7fbb319cd700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbb0c0650b0 0x7fbb0c067560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c072140 tx=0x7fbb1c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.483+0000 7fbb33430700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 0x7fbb2c0bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.483+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0644b0 con 0x7fbb2c0c0cb0 2022-08-10T17:46:51.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.483+0000 7fbb311cc700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 0x7fbb2c0bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb311cc700 1 -- 172.21.15.150:0/1505690721 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbb2c072890 con 0x7fbb2c0c0cb0 2022-08-10T17:46:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb311cc700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 0x7fbb2c0bfdb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb24012010 tx=0x7fbb24004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2402c070 con 0x7fbb2c0c0cb0 2022-08-10T17:46:51.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7fbb24024040 con 0x7fbb2c0c0cb0 2022-08-10T17:46:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 msgr2=0x7fbb2c0bfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 0x7fbb2c0bfdb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb24012010 tx=0x7fbb24004950 comp rx=0 tx=0).stop 2022-08-10T17:46:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 msgr2=0x7fbb2c0bfdb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:46:51.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.484+0000 7fbb19ffb700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fbb2c0c0cb0 0x7fbb2c0bfdb0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb24012010 tx=0x7fbb24004950 comp rx=0 tx=0).stop 2022-08-10T17:46:51.496 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:46:51.496 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:46:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 90, 2022-08-10T17:46:51.497 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:46:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:46:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:46:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:46:51.498 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 16, 2022-08-10T17:46:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:46:51.499 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:46:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.500 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.501 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.502 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:46:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:46:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.503 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.504 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.505 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:46:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:46:51.506 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:46:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:46:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:46:51.507 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:46:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:46:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:46:51.508 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:46:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:46:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:46:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:46:51.509 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:46:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:46:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:46:51.510 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:46:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:46:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:46:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:46:51.511 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:46:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:46:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:46:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:46:51.512 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:46:51.513 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.513 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:46:51.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.513 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:46:51.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.514 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:46:51.514 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:46:51.515 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.515 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.515 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.516 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:46:51.516 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.517 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.517 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:46:51.517 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.519 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:46:51.519 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.519 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.519 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.520 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:46:51.521 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:46:51.521 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.521 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.522 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.522 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:46:51.522 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.523 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:46:51.524 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.524 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.524 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.525 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.525 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:46:51.525 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.526 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.526 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.527 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:46:51.527 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:46:51.527 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:46:51.528 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:46:51.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.528 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:46:51.528 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:46:51.529 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:46:51.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:46:51.530 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:46:51.530 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.530 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.531 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.531 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:46:51.532 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:46:51.532 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:46:51.532 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:46:51.532 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.533 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.533 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:46:51.533 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:46:51.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.534 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.534 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.534 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.535 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.535 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:46:51.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.535 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.536 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.536 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:51.536 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.536 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.537 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:46:51.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.537 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.537 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.538 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:46:51.538 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.538 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.538 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:46:51.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.539 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:46:51.539 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.539 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.540 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.540 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.540 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:46:51.541 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.541 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:46:51.541 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:46:51.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:46:51.542 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:46:51.542 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:46:51.542 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:46:51.542 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:46:51.543 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:46:51.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:46:51.543 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:46:51.543 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:46:51.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbb0c0650b0 msgr2=0x7fbb0c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fbb0c0650b0 0x7fbb0c067560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c072140 tx=0x7fbb1c008030 comp rx=0 tx=0).stop 2022-08-10T17:46:51.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 msgr2=0x7fbb2c1f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 --2- 172.21.15.150:0/1505690721 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fbb2c0c37e0 0x7fbb2c1f0d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b3c0 tx=0x7fbb2800b6d0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb319cd700 1 -- 172.21.15.150:0/1505690721 reap_dead start 2022-08-10T17:46:51.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb319cd700 1 -- 172.21.15.150:0/1505690721 reap_dead start 2022-08-10T17:46:51.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 shutdown_connections 2022-08-10T17:46:51.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 >> 172.21.15.150:0/1505690721 conn(0x7fbb2c06fae0 msgr2=0x7fbb2c1e5500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 shutdown_connections 2022-08-10T17:46:51.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.485+0000 7fbb33430700 1 -- 172.21.15.150:0/1505690721 wait complete. 2022-08-10T17:46:51.548 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:46:51.548 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:46:51.549 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:46:51.549 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:46:51.549 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:46:51.550 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:46:51.571 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:46:51.572 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:46:51.572 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:51.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.737+0000 7fab00757700 1 Processor -- start 2022-08-10T17:46:51.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.738+0000 7fab00757700 1 -- start start 2022-08-10T17:46:51.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.739+0000 7fab00757700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7faaf81553b0 0x7faaf80c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.739+0000 7fab00757700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf806b490 con 0x7faaf806d930 2022-08-10T17:46:51.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.739+0000 7fab00757700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf806b770 con 0x7faaf80700a0 2022-08-10T17:46:51.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.739+0000 7fab00757700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf806bd30 con 0x7faaf81553b0 2022-08-10T17:46:51.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafdcf2700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7faaf806d930 0x7faaf8154ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53276/0 (socket says 172.21.15.150:53276) 2022-08-10T17:46:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafdcf2700 1 -- 172.21.15.150:0/387945395 learned_addr learned my addr 172.21.15.150:0/387945395 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafecf4700 1 --2- 172.21.15.150:0/387945395 >> v2:172.21.15.197:3300/0 conn(0x7faaf81553b0 0x7faaf80c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693762375 0 0) 0x7faaf806b490 con 0x7faaf806d930 2022-08-10T17:46:51.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae0003430 con 0x7faaf806d930 2022-08-10T17:46:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafecf4700 1 -- 172.21.15.150:0/387945395 >> v1:172.21.15.197:6789/0 conn(0x7faaf80700a0 legacy=0x7faaf815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694733040 0 0) 0x7faaf806b770 con 0x7faaf80700a0 2022-08-10T17:46:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafecf4700 1 -- 172.21.15.150:0/387945395 >> v1:172.21.15.150:6789/0 conn(0x7faaf806d930 legacy=0x7faaf8154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafecf4700 1 -- 172.21.15.150:0/387945395 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf806ba50 con 0x7faaf81553b0 2022-08-10T17:46:51.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.740+0000 7faafecf4700 1 --2- 172.21.15.150:0/387945395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf81553b0 0x7faaf80c36c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009d90 tx=0x7faaf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b51ea57509e442 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.741+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000e070 con 0x7faaf81553b0 2022-08-10T17:46:51.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.741+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000bb20 con 0x7faaf81553b0 2022-08-10T17:46:51.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.741+0000 7faafd4f1700 1 -- 172.21.15.150:0/387945395 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000beb0 con 0x7faaf81553b0 2022-08-10T17:46:51.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.741+0000 7fab00757700 1 -- 172.21.15.150:0/387945395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf81553b0 msgr2=0x7faaf80c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.741+0000 7fab00757700 1 --2- 172.21.15.150:0/387945395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf81553b0 0x7faaf80c36c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009d90 tx=0x7faaf000b330 comp rx=0 tx=0).stop 2022-08-10T17:46:51.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.742+0000 7fab00757700 1 -- 172.21.15.150:0/387945395 shutdown_connections 2022-08-10T17:46:51.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.742+0000 7fab00757700 1 --2- 172.21.15.150:0/387945395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf81553b0 0x7faaf80c36c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.742+0000 7fab00757700 1 -- 172.21.15.150:0/387945395 >> 172.21.15.150:0/387945395 conn(0x7faaf80c8a10 msgr2=0x7faaf80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:51.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.742+0000 7fab00757700 1 -- 172.21.15.150:0/387945395 shutdown_connections 2022-08-10T17:46:51.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.742+0000 7fab00757700 1 -- 172.21.15.150:0/387945395 wait complete. 2022-08-10T17:46:51.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.743+0000 7fab00757700 1 Processor -- start 2022-08-10T17:46:51.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.744+0000 7fab00757700 1 -- start start 2022-08-10T17:46:51.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf80700a0 0x7faaf80c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 0x7faaf80c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8158660 con 0x7faaf806d930 2022-08-10T17:46:51.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80b5f10 con 0x7faaf80700a0 2022-08-10T17:46:51.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7fab00757700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80b61f0 con 0x7faaf81553b0 2022-08-10T17:46:51.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafecf4700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 msgr2=0x7faaf80c6e50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:46:51.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafecf4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 0x7faaf80c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:51.756 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40600/0 (socket says 172.21.15.150:40600) 2022-08-10T17:46:51.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 -- 172.21.15.150:0/3017274284 learned_addr learned my addr 172.21.15.150:0/3017274284 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:51.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafdcf2700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf80700a0 0x7faaf80c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 -- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 msgr2=0x7faaf80c6e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:51.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 0x7faaf80c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 -- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf80700a0 msgr2=0x7faaf80c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:51.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf80700a0 0x7faaf80c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:51.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 -- 172.21.15.150:0/3017274284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf0009a70 con 0x7faaf806d930 2022-08-10T17:46:51.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.745+0000 7faafe4f3700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faae800c400 tx=0x7faae800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.746+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800ce80 con 0x7faaf806d930 2022-08-10T17:46:51.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.746+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8003500 con 0x7faaf806d930 2022-08-10T17:46:51.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.746+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8003890 con 0x7faaf806d930 2022-08-10T17:46:51.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.746+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf80b64d0 con 0x7faaf806d930 2022-08-10T17:46:51.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.746+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf80b6a90 con 0x7faaf806d930 2022-08-10T17:46:51.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.747+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8155780 con 0x7faaf806d930 2022-08-10T17:46:51.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.747+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7faae8019030 con 0x7faaf806d930 2022-08-10T17:46:51.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.748+0000 7faae6ffd700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 0x7faad8067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:51.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.748+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7faae8081480 con 0x7faaf806d930 2022-08-10T17:46:51.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.748+0000 7faafdcf2700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 0x7faad8067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:51.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.748+0000 7faafdcf2700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 0x7faad8067540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faaf80c7870 tx=0x7faaf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:51.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:51.753+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7faae804f460 con 0x7faaf806d930 2022-08-10T17:46:52.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.092+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7faaf81e5d10 con 0x7faaf806d930 2022-08-10T17:46:52.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.093+0000 7faae6ffd700 1 -- 172.21.15.150:0/3017274284 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7faae8052a80 con 0x7faaf806d930 2022-08-10T17:46:52.097 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:52.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.095+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 msgr2=0x7faad8067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:52.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.095+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 0x7faad8067540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faaf80c7870 tx=0x7faaf4009040 comp rx=0 tx=0).stop 2022-08-10T17:46:52.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.095+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 msgr2=0x7faaf8156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:52.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.095+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faae800c400 tx=0x7faae800c710 comp rx=0 tx=0).stop 2022-08-10T17:46:52.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 shutdown_connections 2022-08-10T17:46:52.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faad8065090 0x7faad8067540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:52.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faaf81553b0 0x7faaf80c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:52.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf806d930 0x7faaf8156d70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:52.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 --2- 172.21.15.150:0/3017274284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faaf80700a0 0x7faaf80c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:52.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.099+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 >> 172.21.15.150:0/3017274284 conn(0x7faaf80c8a10 msgr2=0x7faaf8069910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:52.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.101+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 shutdown_connections 2022-08-10T17:46:52.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:52.102+0000 7fab00757700 1 -- 172.21.15.150:0/3017274284 wait complete. 2022-08-10T17:46:55.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:55.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.275+0000 7f20e18e4700 1 Processor -- start 2022-08-10T17:46:55.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.275+0000 7f20e18e4700 1 -- start start 2022-08-10T17:46:55.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.276+0000 7f20e18e4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f20dc0705d0 0x7f20dc0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.276+0000 7f20e18e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 0x7f20dc0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.276+0000 7f20e18e4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0bf640 con 0x7f20dc14d080 2022-08-10T17:46:55.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20db7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 0x7f20dc0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20da7fc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f20dc0705d0 0x7f20dc0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20db7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 0x7f20dc0c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40644/0 (socket says 172.21.15.150:40644) 2022-08-10T17:46:55.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20db7fe700 1 -- 172.21.15.150:0/3591740522 learned_addr learned my addr 172.21.15.150:0/3591740522 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:55.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc06c2b0 con 0x7f20dc0c4d30 2022-08-10T17:46:55.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc156400 con 0x7f20dc0705d0 2022-08-10T17:46:55.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986185132 0 0) 0x7f20cc001110 con 0x7f20dc14d080 2022-08-10T17:46:55.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc003430 con 0x7f20dc14d080 2022-08-10T17:46:55.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302801825 0 0) 0x7f20bc003430 con 0x7f20dc14d080 2022-08-10T17:46:55.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 >> v2:172.21.15.197:3300/0 conn(0x7f20dc0705d0 msgr2=0x7f20dc0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:55.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 --2- 172.21.15.150:0/3591740522 >> v2:172.21.15.197:3300/0 conn(0x7f20dc0705d0 0x7f20dc0c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 msgr2=0x7f20dc0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:55.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 --2- 172.21.15.150:0/3591740522 >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 0x7f20dc0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc1566e0 con 0x7f20dc14d080 2022-08-10T17:46:55.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f20cc001800 con 0x7f20dc14d080 2022-08-10T17:46:55.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.277+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 >> v1:172.21.15.150:6789/0 conn(0x7f20dc14d080 legacy=0x7f20dc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:55.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 0x7f20bc003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20bc0046d0 0x7f20bc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc0051a0 0x7f20bc00fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc06c2b0 con 0x7f20bc0046d0 2022-08-10T17:46:55.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc156400 con 0x7f20bc003880 2022-08-10T17:46:55.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0078f0 con 0x7f20bc0051a0 2022-08-10T17:46:55.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20db7fe700 1 --2- 172.21.15.150:0/3591740522 >> v2:172.21.15.150:3300/0 conn(0x7f20dc0c4d30 0x7f20dc0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:46:55.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20da7fc700 1 --2- 172.21.15.150:0/3591740522 >> v2:172.21.15.197:3300/0 conn(0x7f20dc0705d0 0x7f20dc0c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:46:55.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 0x7f20bc003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20da7fc700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20bc0046d0 0x7f20bc004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20db7fe700 1 -- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc0051a0 msgr2=0x7f20bc00fca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:46:55.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20db7fe700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc0051a0 0x7f20bc00fca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:55.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 -- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc0051a0 msgr2=0x7f20bc00fca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:46:55.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc0051a0 0x7f20bc00fca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 -- 172.21.15.150:0/3591740522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20bc0046d0 msgr2=0x7f20bc004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:46:55.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20bc0046d0 0x7f20bc004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20daffd700 1 -- 172.21.15.150:0/3591740522 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc1566e0 con 0x7f20bc003880 2022-08-10T17:46:55.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20da7fc700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20bc0046d0 0x7f20bc004b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:46:55.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.278+0000 7f20db7fe700 1 -- 172.21.15.150:0/3591740522 reap_dead start 2022-08-10T17:46:55.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20daffd700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 0x7f20bc003c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00c160 tx=0x7f20bc005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf78182ced19694f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:55.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00cc60 con 0x7f20bc003880 2022-08-10T17:46:55.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc00cdc0 con 0x7f20bc003880 2022-08-10T17:46:55.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20d9ffb700 1 -- 172.21.15.150:0/3591740522 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc007290 con 0x7f20bc003880 2022-08-10T17:46:55.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 msgr2=0x7f20bc003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:55.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.279+0000 7f20e18e4700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 0x7f20bc003c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00c160 tx=0x7f20bc005700 comp rx=0 tx=0).stop 2022-08-10T17:46:55.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.280+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 shutdown_connections 2022-08-10T17:46:55.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.280+0000 7f20e18e4700 1 --2- 172.21.15.150:0/3591740522 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20bc003880 0x7f20bc003c90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.280+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 >> 172.21.15.150:0/3591740522 conn(0x7f20dc0c8a10 msgr2=0x7f20dc0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:55.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.280+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 shutdown_connections 2022-08-10T17:46:55.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.280+0000 7f20e18e4700 1 -- 172.21.15.150:0/3591740522 wait complete. 2022-08-10T17:46:55.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.281+0000 7f20e18e4700 1 Processor -- start 2022-08-10T17:46:55.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.281+0000 7f20e18e4700 1 -- start start 2022-08-10T17:46:55.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 0x7f20dc155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0bd4d0 0x7f20dc0bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0bd0b0 con 0x7f20dc0bd4d0 2022-08-10T17:46:55.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc149f80 con 0x7f20dc1495d0 2022-08-10T17:46:55.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20e18e4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc153ea0 con 0x7f20bc003880 2022-08-10T17:46:55.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20daffd700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 msgr2=0x7f20dc155750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:46:55.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.282+0000 7f20daffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 0x7f20dc155750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:55.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51248/0 (socket says 172.21.15.150:51248) 2022-08-10T17:46:55.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20da7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0bd4d0 0x7f20dc0bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 -- 172.21.15.150:0/2217678451 learned_addr learned my addr 172.21.15.150:0/2217678451 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:55.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 -- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 msgr2=0x7f20dc155750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:55.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 0x7f20dc155750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 -- 172.21.15.150:0/2217678451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0bd4d0 msgr2=0x7f20dc0bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:55.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0bd4d0 0x7f20dc0bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 -- 172.21.15.150:0/2217678451 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0c86a0 con 0x7f20dc1495d0 2022-08-10T17:46:55.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20db7fe700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20d4001250 tx=0x7f20d40089a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:55.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4010070 con 0x7f20dc1495d0 2022-08-10T17:46:55.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4015420 con 0x7f20dc1495d0 2022-08-10T17:46:55.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.283+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40157b0 con 0x7f20dc1495d0 2022-08-10T17:46:55.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.284+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc1eb360 con 0x7f20dc1495d0 2022-08-10T17:46:55.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.284+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc0bc9f0 con 0x7f20dc1495d0 2022-08-10T17:46:55.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.285+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0bc850 con 0x7f20dc1495d0 2022-08-10T17:46:55.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.286+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f20d40093f0 con 0x7f20dc1495d0 2022-08-10T17:46:55.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.286+0000 7f20d3fff700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 0x7f20c0067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:55.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.286+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f20d4080de0 con 0x7f20dc1495d0 2022-08-10T17:46:55.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.287+0000 7f20daffd700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 0x7f20c0067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:55.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.287+0000 7f20daffd700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 0x7f20c0067540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001ac0 tx=0x7f20cc009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:55.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.295+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f20dc0bc850 con 0x7f20dc1495d0 2022-08-10T17:46:55.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.642+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f20dc0bc850 con 0x7f20dc1495d0 2022-08-10T17:46:55.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.644+0000 7f20d3fff700 1 -- 172.21.15.150:0/2217678451 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f20dc0bc850 con 0x7f20dc1495d0 2022-08-10T17:46:55.651 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 msgr2=0x7f20c0067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 0x7f20c0067540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001ac0 tx=0x7f20cc009030 comp rx=0 tx=0).stop 2022-08-10T17:46:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 msgr2=0x7f20dc149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20d4001250 tx=0x7f20d40089a0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 shutdown_connections 2022-08-10T17:46:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20dc1495d0 0x7f20dc149a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20c0065090 0x7f20c0067540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20bc003880 0x7f20dc155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 --2- 172.21.15.150:0/2217678451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20dc0bd4d0 0x7f20dc0bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:55.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.651+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 >> 172.21.15.150:0/2217678451 conn(0x7f20dc0c8a10 msgr2=0x7f20dc0c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:55.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.652+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 shutdown_connections 2022-08-10T17:46:55.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:55.652+0000 7f20e18e4700 1 -- 172.21.15.150:0/2217678451 wait complete. 2022-08-10T17:46:58.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:46:58.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.813+0000 7f0c0626d700 1 Processor -- start 2022-08-10T17:46:58.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.813+0000 7f0c0626d700 1 -- start start 2022-08-10T17:46:58.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0c0626d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c001573d0 0x7f0c001621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:58.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0c0626d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c00070620 con 0x7f0c00150b80 2022-08-10T17:46:58.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0c0626d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000ca810 con 0x7f0c00150f50 2022-08-10T17:46:58.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0c0626d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c000c5ac0 con 0x7f0c001573d0 2022-08-10T17:46:58.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0c0480a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c001573d0 0x7f0c001621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:58.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0bfffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0c00150b80 0x7f0c000c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53364/0 (socket says 172.21.15.150:53364) 2022-08-10T17:46:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.814+0000 7f0bfffff700 1 -- 172.21.15.150:0/3618253659 learned_addr learned my addr 172.21.15.150:0/3618253659 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:46:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0c0480a700 1 -- 172.21.15.150:0/3618253659 >> v1:172.21.15.197:6789/0 conn(0x7f0c00150f50 legacy=0x7f0c00156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0c0480a700 1 -- 172.21.15.150:0/3618253659 >> v1:172.21.15.150:6789/0 conn(0x7f0c00150b80 legacy=0x7f0c000c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:58.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0c0480a700 1 -- 172.21.15.150:0/3618253659 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00070010 con 0x7f0c001573d0 2022-08-10T17:46:58.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0c0480a700 1 --2- 172.21.15.150:0/3618253659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c001573d0 0x7f0c001621f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009d90 tx=0x7f0bf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdea8388672e25b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:58.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0bfeffd700 1 -- 172.21.15.150:0/3618253659 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800e070 con 0x7f0c001573d0 2022-08-10T17:46:58.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0bfeffd700 1 -- 172.21.15.150:0/3618253659 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800bbd0 con 0x7f0c001573d0 2022-08-10T17:46:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.815+0000 7f0bfeffd700 1 -- 172.21.15.150:0/3618253659 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8012430 con 0x7f0c001573d0 2022-08-10T17:46:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 -- 172.21.15.150:0/3618253659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c001573d0 msgr2=0x7f0c001621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 --2- 172.21.15.150:0/3618253659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c001573d0 0x7f0c001621f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009d90 tx=0x7f0bf800b330 comp rx=0 tx=0).stop 2022-08-10T17:46:58.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 -- 172.21.15.150:0/3618253659 shutdown_connections 2022-08-10T17:46:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 --2- 172.21.15.150:0/3618253659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c001573d0 0x7f0c001621f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 -- 172.21.15.150:0/3618253659 >> 172.21.15.150:0/3618253659 conn(0x7f0c00071e40 msgr2=0x7f0c0006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 -- 172.21.15.150:0/3618253659 shutdown_connections 2022-08-10T17:46:58.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.816+0000 7f0c0626d700 1 -- 172.21.15.150:0/3618253659 wait complete. 2022-08-10T17:46:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.817+0000 7f0c0626d700 1 Processor -- start 2022-08-10T17:46:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.817+0000 7f0c0626d700 1 -- start start 2022-08-10T17:46:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0c00150b80 0x7f0c001efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:58.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 0x7f0c00153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00152c80 con 0x7f0c00150f50 2022-08-10T17:46:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c001523c0 con 0x7f0c00150b80 2022-08-10T17:46:58.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c001f0030 con 0x7f0c001573d0 2022-08-10T17:46:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0480a700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 msgr2=0x7f0c00153110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:46:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0480a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 0x7f0c00153110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:46:58.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40692/0 (socket says 172.21.15.150:40692) 2022-08-10T17:46:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 -- 172.21.15.150:0/1604621925 learned_addr learned my addr 172.21.15.150:0/1604621925 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:46:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bfffff700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0c00150b80 0x7f0c001efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 -- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 msgr2=0x7f0c00153110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:46:58.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 0x7f0c00153110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 -- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0c00150b80 msgr2=0x7f0c001efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0c00150b80 0x7f0c001efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 -- 172.21.15.150:0/1604621925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009a70 con 0x7f0c00150f50 2022-08-10T17:46:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bff7fe700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c3f0 tx=0x7f0bf000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00052d0 con 0x7f0c00150f50 2022-08-10T17:46:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000ce30 con 0x7f0c00150f50 2022-08-10T17:46:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0015a0b0 con 0x7f0c00150f50 2022-08-10T17:46:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00117b0 con 0x7f0c00150f50 2022-08-10T17:46:58.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.818+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c00152630 con 0x7f0c00150f50 2022-08-10T17:46:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.820+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c001548a0 con 0x7f0c00150f50 2022-08-10T17:46:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.820+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0bf0019030 con 0x7f0c00150f50 2022-08-10T17:46:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.820+0000 7f0bfcff9700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 0x7f0be0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:46:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.820+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0bf0081440 con 0x7f0c00150f50 2022-08-10T17:46:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.820+0000 7f0bfffff700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 0x7f0be0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:46:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.821+0000 7f0bfffff700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 0x7f0be0067510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4005790 tx=0x7f0bf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:46:58.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:58.825+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0bf004f420 con 0x7f0c00150f50 2022-08-10T17:46:59.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.183+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0c00150270 con 0x7f0c00150f50 2022-08-10T17:46:59.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.183+0000 7f0bfcff9700 1 -- 172.21.15.150:0/1604621925 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f0bf0017080 con 0x7f0c00150f50 2022-08-10T17:46:59.188 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:46:59.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 msgr2=0x7f0be0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:59.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 0x7f0be0067510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4005790 tx=0x7f0bf4009040 comp rx=0 tx=0).stop 2022-08-10T17:46:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 msgr2=0x7f0c00155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:46:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c3f0 tx=0x7f0bf000c700 comp rx=0 tx=0).stop 2022-08-10T17:46:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 shutdown_connections 2022-08-10T17:46:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0be0065060 0x7f0be0067510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:59.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c001573d0 0x7f0c00153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0c00150b80 0x7f0c001efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 --2- 172.21.15.150:0/1604621925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c00150f50 0x7f0c00155790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:46:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 >> 172.21.15.150:0/1604621925 conn(0x7f0c00071e40 msgr2=0x7f0c0014eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:46:59.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 shutdown_connections 2022-08-10T17:46:59.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:46:59.196+0000 7f0c0626d700 1 -- 172.21.15.150:0/1604621925 wait complete. 2022-08-10T17:47:02.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:02.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.371+0000 7f32877e8700 1 Processor -- start 2022-08-10T17:47:02.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.371+0000 7f32877e8700 1 -- start start 2022-08-10T17:47:02.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f32877e8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:02.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f32877e8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32800c4930 con 0x7f32801577a0 2022-08-10T17:47:02.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f32877e8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328015adc0 con 0x7f32801573d0 2022-08-10T17:47:02.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f32877e8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800c5610 con 0x7f328015a950 2022-08-10T17:47:02.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3284d83700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3285584700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f32801573d0 0x7f32800c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:39760/0 (socket says 172.21.15.150:39760) 2022-08-10T17:47:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3285584700 1 -- 172.21.15.150:0/891940644 learned_addr learned my addr 172.21.15.150:0/891940644 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3285d85700 1 --1- 172.21.15.150:0/891940644 >> v1:172.21.15.150:6789/0 conn(0x7f32801577a0 0x7f32800c6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53412/0 (socket says 172.21.15.150:53412) 2022-08-10T17:47:02.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:02.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:02.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:02.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.372+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:02.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:02.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.573+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:02.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.573+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:02.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:02.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:47:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.974+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.974+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:02.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:47:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:03.776+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:03.776+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:03.776+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:03.776+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:03.776+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:47:05.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 msgr2=0x7f32800c5ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:05.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.150:3300/0 conn(0x7f328015a950 0x7f32800c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:05.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 -- 172.21.15.150:0/891940644 >> v1:172.21.15.197:6789/0 conn(0x7f32801573d0 legacy=0x7f32800c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 -- 172.21.15.150:0/891940644 >> v1:172.21.15.150:6789/0 conn(0x7f32801577a0 legacy=0x7f32800c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 -- 172.21.15.150:0/891940644 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800c5610 con 0x7f32600060f0 2022-08-10T17:47:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f326effd700 1 -- 172.21.15.150:0/891940644 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3260008c40 con 0x7f3260003620 2022-08-10T17:47:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3285584700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 msgr2=0x7f3260005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3285584700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.372+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:05.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3285584700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 msgr2=0x7f3260005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:05.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3285584700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:47:05.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:05.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:47:05.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:05.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:05.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.573+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:47:05.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3285584700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 msgr2=0x7f3260005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:05.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3285584700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:47:05.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:47:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 msgr2=0x7f3260008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:05.974+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:47:06.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.776+0000 7f3285584700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 msgr2=0x7f3260005a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:06.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.776+0000 7f3285584700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:47:06.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.776+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> v2:172.21.15.197:3300/0 conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:06.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 msgr2=0x7f3260005a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:06.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3260003620 0x7f3260005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:06.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f3284d83700 1 -- 172.21.15.150:0/891940644 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800c58f0 con 0x7f32600060f0 2022-08-10T17:47:06.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f3284d83700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32600060f0 0x7f3260008580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3270006ee0 tx=0x7f3270017cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a71ccbe90aade4f5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:06.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f326ffff700 1 -- 172.21.15.150:0/891940644 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004030 con 0x7f32600060f0 2022-08-10T17:47:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f326ffff700 1 -- 172.21.15.150:0/891940644 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270004190 con 0x7f32600060f0 2022-08-10T17:47:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.777+0000 7f326ffff700 1 -- 172.21.15.150:0/891940644 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270019950 con 0x7f32600060f0 2022-08-10T17:47:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.778+0000 7f32877e8700 1 -- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32600060f0 msgr2=0x7f3260008580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.778+0000 7f32877e8700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32600060f0 0x7f3260008580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3270006ee0 tx=0x7f3270017cb0 comp rx=0 tx=0).stop 2022-08-10T17:47:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f3285d85700 1 -- 172.21.15.150:0/891940644 reap_dead start 2022-08-10T17:47:06.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f32877e8700 1 -- 172.21.15.150:0/891940644 shutdown_connections 2022-08-10T17:47:06.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f32877e8700 1 --2- 172.21.15.150:0/891940644 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f32600060f0 0x7f3260008580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:06.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f32877e8700 1 -- 172.21.15.150:0/891940644 >> 172.21.15.150:0/891940644 conn(0x7f3280070590 msgr2=0x7f3280071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:06.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f32877e8700 1 -- 172.21.15.150:0/891940644 shutdown_connections 2022-08-10T17:47:06.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.780+0000 7f32877e8700 1 -- 172.21.15.150:0/891940644 wait complete. 2022-08-10T17:47:06.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.782+0000 7f32877e8700 1 Processor -- start 2022-08-10T17:47:06.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.782+0000 7f32877e8700 1 -- start start 2022-08-10T17:47:06.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.782+0000 7f32877e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32600060f0 0x7f32800bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f32877e8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 0x7f32800cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f32877e8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f32877e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280068ac0 con 0x7f32600060f0 2022-08-10T17:47:06.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f32877e8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800bfa00 con 0x7f3280068110 2022-08-10T17:47:06.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f32877e8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32800bfc70 con 0x7f3280069b90 2022-08-10T17:47:06.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3284d83700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 msgr2=0x7f32800cb340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:06.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3284d83700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 0x7f32800cb340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:06.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:06.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51380/0 (socket says 172.21.15.150:51380) 2022-08-10T17:47:06.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 -- 172.21.15.150:0/761037280 learned_addr learned my addr 172.21.15.150:0/761037280 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:06.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285584700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32600060f0 0x7f32800bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:06.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 -- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 msgr2=0x7f32800cb340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:06.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 0x7f32800cb340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:06.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 -- 172.21.15.150:0/761037280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32600060f0 msgr2=0x7f32800bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:06.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32600060f0 0x7f32800bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:06.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 -- 172.21.15.150:0/761037280 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327000e040 con 0x7f3280068110 2022-08-10T17:47:06.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.783+0000 7f3285d85700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32800673a0 tx=0x7f327800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.784+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800ceb0 con 0x7f3280068110 2022-08-10T17:47:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.784+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3278007110 con 0x7f3280068110 2022-08-10T17:47:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.784+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780074a0 con 0x7f3280068110 2022-08-10T17:47:06.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.784+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32801f8fb0 con 0x7f3280068110 2022-08-10T17:47:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.784+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32801f9570 con 0x7f3280068110 2022-08-10T17:47:06.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.785+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800c6360 con 0x7f3280068110 2022-08-10T17:47:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.786+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f327801b070 con 0x7f3280068110 2022-08-10T17:47:06.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.786+0000 7f326dffb700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 0x7f32600682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.786+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f32780810d0 con 0x7f3280068110 2022-08-10T17:47:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.786+0000 7f3285584700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 0x7f32600682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.787+0000 7f3285584700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 0x7f32600682c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f327c000f60 tx=0x7f327c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:06.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:06.791+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f327804f0b0 con 0x7f3280068110 2022-08-10T17:47:07.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.127+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f32800c5cc0 con 0x7f3280068110 2022-08-10T17:47:07.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.128+0000 7f326dffb700 1 -- 172.21.15.150:0/761037280 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f3278019080 con 0x7f3280068110 2022-08-10T17:47:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:07.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 msgr2=0x7f32600682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 0x7f32600682c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f327c000f60 tx=0x7f327c009040 comp rx=0 tx=0).stop 2022-08-10T17:47:07.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 msgr2=0x7f3280068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32800673a0 tx=0x7f327800c7b0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 shutdown_connections 2022-08-10T17:47:07.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3280068110 0x7f3280068580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32600060f0 0x7f32800bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3260065e10 0x7f32600682c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 --2- 172.21.15.150:0/761037280 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3280069b90 0x7f32800cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 >> 172.21.15.150:0/761037280 conn(0x7f3280070590 msgr2=0x7f32800c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:07.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 shutdown_connections 2022-08-10T17:47:07.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.130+0000 7f32877e8700 1 -- 172.21.15.150:0/761037280 wait complete. 2022-08-10T17:47:07.148 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:47:07.149 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:47:07.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.298+0000 7f2c4d28d700 1 Processor -- start 2022-08-10T17:47:07.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.298+0000 7f2c4d28d700 1 -- start start 2022-08-10T17:47:07.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c4d28d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 0x7f2c4806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c4d28d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c4806fd20 0x7f2c480701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c4d28d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4815bc10 con 0x7f2c48154ee0 2022-08-10T17:47:07.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c4d28d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480bc770 con 0x7f2c4806fd20 2022-08-10T17:47:07.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c4d28d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815b680 con 0x7f2c480bc8e0 2022-08-10T17:47:07.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c467fc700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 msgr2=0x7f2c4806f7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:07.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c467fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 0x7f2c4806f7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:07.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c4806fd20 0x7f2c480701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c4806fd20 0x7f2c480701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40802/0 (socket says 172.21.15.150:40802) 2022-08-10T17:47:07.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 -- 172.21.15.150:0/2765789925 learned_addr learned my addr 172.21.15.150:0/2765789925 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:07.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 -- 172.21.15.150:0/2765789925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 msgr2=0x7f2c4806f7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:07.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 --2- 172.21.15.150:0/2765789925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 0x7f2c4806f7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 -- 172.21.15.150:0/2765789925 >> v1:172.21.15.197:6789/0 conn(0x7f2c48154ee0 legacy=0x7f2c4815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.299+0000 7f2c477fe700 1 -- 172.21.15.150:0/2765789925 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48064650 con 0x7f2c4806fd20 2022-08-10T17:47:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.300+0000 7f2c477fe700 1 --2- 172.21.15.150:0/2765789925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4806fd20 0x7f2c480701a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b01cc835a2d17ed server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.300+0000 7f2c45ffb700 1 -- 172.21.15.150:0/2765789925 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000e070 con 0x7f2c4806fd20 2022-08-10T17:47:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.300+0000 7f2c45ffb700 1 -- 172.21.15.150:0/2765789925 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000b980 con 0x7f2c4806fd20 2022-08-10T17:47:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.300+0000 7f2c45ffb700 1 -- 172.21.15.150:0/2765789925 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000bd30 con 0x7f2c4806fd20 2022-08-10T17:47:07.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 -- 172.21.15.150:0/2765789925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4806fd20 msgr2=0x7f2c480701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/2765789925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4806fd20 0x7f2c480701a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4000b330 comp rx=0 tx=0).stop 2022-08-10T17:47:07.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 -- 172.21.15.150:0/2765789925 shutdown_connections 2022-08-10T17:47:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/2765789925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4806fd20 0x7f2c480701a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/2765789925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c480bc8e0 0x7f2c4806f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 -- 172.21.15.150:0/2765789925 >> 172.21.15.150:0/2765789925 conn(0x7f2c480c92f0 msgr2=0x7f2c480c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 -- 172.21.15.150:0/2765789925 shutdown_connections 2022-08-10T17:47:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.301+0000 7f2c4d28d700 1 -- 172.21.15.150:0/2765789925 wait complete. 2022-08-10T17:47:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.302+0000 7f2c4d28d700 1 Processor -- start 2022-08-10T17:47:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.304+0000 7f2c4d28d700 1 -- start start 2022-08-10T17:47:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c4806fd20 0x7f2c4814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bc8e0 0x7f2c48151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 0x7f2c481fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48150a10 con 0x7f2c480bc8e0 2022-08-10T17:47:07.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480bdb00 con 0x7f2c48154ee0 2022-08-10T17:47:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c4d28d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480be750 con 0x7f2c4806fd20 2022-08-10T17:47:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c46ffd700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c4806fd20 msgr2=0x7f2c4814f0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c46ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c4806fd20 0x7f2c4814f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:07.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 0x7f2c481fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bc8e0 0x7f2c48151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 0x7f2c481fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51396/0 (socket says 172.21.15.150:51396) 2022-08-10T17:47:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c477fe700 1 -- 172.21.15.150:0/1771517833 learned_addr learned my addr 172.21.15.150:0/1771517833 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c4806fd20 msgr2=0x7f2c4814f0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c4806fd20 0x7f2c4814f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 msgr2=0x7f2c481fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 0x7f2c481fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c467fc700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009b30 con 0x7f2c480bc8e0 2022-08-10T17:47:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.305+0000 7f2c477fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c48154ee0 0x7f2c481fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:47:07.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.306+0000 7f2c467fc700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bc8e0 0x7f2c48151a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b360 tx=0x7f2c3c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.306+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c003ac0 con 0x7f2c480bc8e0 2022-08-10T17:47:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.306+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c480be470 con 0x7f2c480bc8e0 2022-08-10T17:47:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.306+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c003c40 con 0x7f2c480bc8e0 2022-08-10T17:47:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.307+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0050d0 con 0x7f2c480bc8e0 2022-08-10T17:47:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.307+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c480bd4b0 con 0x7f2c480bc8e0 2022-08-10T17:47:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.310+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 0x7f2c481fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.310+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48071e00 con 0x7f2c4815d9f0 2022-08-10T17:47:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.311+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2c3c00f070 con 0x7f2c480bc8e0 2022-08-10T17:47:07.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.311+0000 7f2c2f7fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2c28065180 0x7f2c28067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.311+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2c3c081950 con 0x7f2c480bc8e0 2022-08-10T17:47:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.311+0000 7f2c477fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2c28065180 0x7f2c28067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.312+0000 7f2c477fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2c28065180 0x7f2c28067630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009420 tx=0x7f2c40009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.312+0000 7f2c46ffd700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 0x7f2c481fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c46ffd700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c48072890 con 0x7f2c4815d9f0 2022-08-10T17:47:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c46ffd700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 0x7f2c481fc8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c38007fd0 tx=0x7f2c3800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380072d0 con 0x7f2c4815d9f0 2022-08-10T17:47:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f2c3800cec0 con 0x7f2c4815d9f0 2022-08-10T17:47:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 msgr2=0x7f2c481fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 0x7f2c481fc8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c38007fd0 tx=0x7f2c3800c6a0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 msgr2=0x7f2c481fc8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:07.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.313+0000 7f2c2f7fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c4815d9f0 0x7f2c481fc8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.321+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 0x7f2c481fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.321+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815b930 con 0x7f2c480bd670 2022-08-10T17:47:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.321+0000 7f2c46ffd700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 0x7f2c481fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.321+0000 7f2c46ffd700 1 -- 172.21.15.150:0/1771517833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2c480c3ca0 con 0x7f2c480bd670 2022-08-10T17:47:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.321+0000 7f2c46ffd700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 0x7f2c481fce00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c38013000 tx=0x7f2c38001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38013920 con 0x7f2c480bd670 2022-08-10T17:47:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4537 (secure 0 0 0) 0x7f2c3801b070 con 0x7f2c480bd670 2022-08-10T17:47:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 msgr2=0x7f2c481fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 0x7f2c481fce00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c38013000 tx=0x7f2c38001000 comp rx=0 tx=0).stop 2022-08-10T17:47:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 msgr2=0x7f2c481fce00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:07.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c2f7fe700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bd670 0x7f2c481fce00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.334 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:47:07.335 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:07.335 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:07.335 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:47:07.335 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 94, 2022-08-10T17:47:07.336 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:47:07.336 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:47:07.336 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:47:07.337 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.337 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:47:07.337 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:07.338 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:47:07.338 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:47:07.338 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.338 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.339 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.339 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.339 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.340 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.340 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.340 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.340 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.341 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.341 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:47:07.341 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:47:07.342 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.342 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.342 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.342 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.343 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.343 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.344 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.344 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.344 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.345 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.345 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:47:07.345 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:47:07.346 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:47:07.346 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:47:07.346 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:47:07.346 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:47:07.347 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:07.347 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:07.347 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:47:07.348 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:47:07.348 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:47:07.348 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:47:07.349 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:47:07.349 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:47:07.349 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:07.350 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:47:07.350 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.350 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.350 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.350 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.351 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.351 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.351 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.351 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.352 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.352 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.352 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:47:07.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.354 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.354 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.354 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:47:07.355 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.355 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.356 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:47:07.356 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.356 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.357 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:47:07.357 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:47:07.357 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.357 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.358 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.358 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:07.359 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:07.359 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.359 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.360 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.360 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:47:07.360 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.361 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.361 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:47:07.361 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.362 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.362 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:47:07.363 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:47:07.363 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.363 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.363 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.364 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:07.364 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:07.364 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.365 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.365 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.365 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:47:07.366 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.366 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.367 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:47:07.367 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.367 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.367 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.368 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:47:07.368 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:47:07.368 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.369 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.369 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.369 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.369 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.370 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:47:07.370 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:47:07.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.371 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.371 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.371 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:07.371 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.372 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.372 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:47:07.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.372 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.372 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.373 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:47:07.373 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.373 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.373 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:47:07.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.374 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.374 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.374 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:47:07.375 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.375 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.375 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:47:07.376 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:47:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2c28065180 msgr2=0x7f2c28067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2c28065180 0x7f2c28067630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009420 tx=0x7f2c40009000 comp rx=0 tx=0).stop 2022-08-10T17:47:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bc8e0 msgr2=0x7f2c48151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c4d28d700 1 --2- 172.21.15.150:0/1771517833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c480bc8e0 0x7f2c48151a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b360 tx=0x7f2c3c00b670 comp rx=0 tx=0).stop 2022-08-10T17:47:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c477fe700 1 -- 172.21.15.150:0/1771517833 reap_dead start 2022-08-10T17:47:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.322+0000 7f2c477fe700 1 -- 172.21.15.150:0/1771517833 reap_dead start 2022-08-10T17:47:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.323+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 shutdown_connections 2022-08-10T17:47:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.323+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 >> 172.21.15.150:0/1771517833 conn(0x7f2c480c92f0 msgr2=0x7f2c48165a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.323+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 shutdown_connections 2022-08-10T17:47:07.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.323+0000 7f2c4d28d700 1 -- 172.21.15.150:0/1771517833 wait complete. 2022-08-10T17:47:07.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:47:07.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.522+0000 7f66423b0700 1 Processor -- start 2022-08-10T17:47:07.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.522+0000 7f66423b0700 1 -- start start 2022-08-10T17:47:07.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f66423b0700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f663c151290 0x7f663c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f66423b0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f663c068bf0 0x7f663c0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f66423b0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0c1f40 con 0x7f663c158170 2022-08-10T17:47:07.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f66423b0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0c7d90 con 0x7f663c068bf0 2022-08-10T17:47:07.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f66423b0700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0c2220 con 0x7f663c151290 2022-08-10T17:47:07.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f664094d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f663c068bf0 0x7f663c0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f663b7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f663c158170 0x7f663c157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53498/0 (socket says 172.21.15.150:53498) 2022-08-10T17:47:07.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f663b7fe700 1 -- 172.21.15.150:0/3813613019 learned_addr learned my addr 172.21.15.150:0/3813613019 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f663bfff700 1 --2- 172.21.15.150:0/3813613019 >> v2:172.21.15.197:3300/0 conn(0x7f663c151290 0x7f663c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f664094d700 1 -- 172.21.15.150:0/3813613019 >> v2:172.21.15.197:3300/0 conn(0x7f663c151290 msgr2=0x7f663c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f664094d700 1 --2- 172.21.15.150:0/3813613019 >> v2:172.21.15.197:3300/0 conn(0x7f663c151290 0x7f663c0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.523+0000 7f664094d700 1 -- 172.21.15.150:0/3813613019 >> v1:172.21.15.150:6789/0 conn(0x7f663c158170 legacy=0x7f663c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f663affd700 1 -- 172.21.15.150:0/3813613019 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700926812 0 0) 0x7f663c0c1f40 con 0x7f663c158170 2022-08-10T17:47:07.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f664094d700 1 -- 172.21.15.150:0/3813613019 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0c2500 con 0x7f663c068bf0 2022-08-10T17:47:07.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f664094d700 1 --2- 172.21.15.150:0/3813613019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c068bf0 0x7f663c0c2910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f663c0cdeb0 tx=0x7f663400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b4714526231dc9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f663affd700 1 -- 172.21.15.150:0/3813613019 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400e070 con 0x7f663c068bf0 2022-08-10T17:47:07.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f663affd700 1 -- 172.21.15.150:0/3813613019 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400bb20 con 0x7f663c068bf0 2022-08-10T17:47:07.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f663affd700 1 -- 172.21.15.150:0/3813613019 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634012430 con 0x7f663c068bf0 2022-08-10T17:47:07.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f66423b0700 1 -- 172.21.15.150:0/3813613019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c068bf0 msgr2=0x7f663c0c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f66423b0700 1 --2- 172.21.15.150:0/3813613019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c068bf0 0x7f663c0c2910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f663c0cdeb0 tx=0x7f663400b330 comp rx=0 tx=0).stop 2022-08-10T17:47:07.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f66423b0700 1 -- 172.21.15.150:0/3813613019 shutdown_connections 2022-08-10T17:47:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.524+0000 7f66423b0700 1 --2- 172.21.15.150:0/3813613019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c068bf0 0x7f663c0c2910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.525+0000 7f66423b0700 1 --2- 172.21.15.150:0/3813613019 >> v2:172.21.15.197:3300/0 conn(0x7f663c151290 0x7f663c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.525+0000 7f66423b0700 1 -- 172.21.15.150:0/3813613019 >> 172.21.15.150:0/3813613019 conn(0x7f663c06f880 msgr2=0x7f663c06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.525+0000 7f66423b0700 1 -- 172.21.15.150:0/3813613019 shutdown_connections 2022-08-10T17:47:07.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.525+0000 7f66423b0700 1 -- 172.21.15.150:0/3813613019 wait complete. 2022-08-10T17:47:07.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 Processor -- start 2022-08-10T17:47:07.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 -- start start 2022-08-10T17:47:07.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f663c068bf0 0x7f663c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c151290 0x7f663c145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 0x7f663c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0cda80 con 0x7f663c158170 2022-08-10T17:47:07.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c6f60 con 0x7f663c151290 2022-08-10T17:47:07.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.526+0000 7f66423b0700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0cdca0 con 0x7f663c068bf0 2022-08-10T17:47:07.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f663bfff700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f663c068bf0 msgr2=0x7f663c0cd540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:07.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 0x7f663c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f663bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f663c068bf0 0x7f663c0cd540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:07.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 0x7f663c15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40826/0 (socket says 172.21.15.150:40826) 2022-08-10T17:47:07.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 learned_addr learned my addr 172.21.15.150:0/4136584124 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:07.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f663b7fe700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c151290 0x7f663c145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f663c068bf0 msgr2=0x7f663c0cd540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:07.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f663c068bf0 0x7f663c0cd540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c151290 msgr2=0x7f663c145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c151290 0x7f663c145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009a70 con 0x7f663c158170 2022-08-10T17:47:07.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f664094d700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 0x7f663c15a580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f663c064f10 tx=0x7f6634004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634004450 con 0x7f663c158170 2022-08-10T17:47:07.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6634020070 con 0x7f663c158170 2022-08-10T17:47:07.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c0c6350 con 0x7f663c158170 2022-08-10T17:47:07.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340047f0 con 0x7f663c158170 2022-08-10T17:47:07.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.527+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c0c6910 con 0x7f663c158170 2022-08-10T17:47:07.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.528+0000 7f66423b0700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 0x7f663c15aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.528+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0cb900 con 0x7f663c0c30b0 2022-08-10T17:47:07.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.528+0000 7f663bfff700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 0x7f663c15aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.528+0000 7f663bfff700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f663c071e10 con 0x7f663c0c30b0 2022-08-10T17:47:07.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f663bfff700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 0x7f663c15aac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e770 tx=0x7f662c00eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f66340125e0 con 0x7f663c158170 2022-08-10T17:47:07.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f661c065090 0x7f661c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c004020 con 0x7f663c0c30b0 2022-08-10T17:47:07.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6634022070 con 0x7f663c158170 2022-08-10T17:47:07.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f663b7fe700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f661c065090 0x7f661c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f662c004180 con 0x7f663c0c30b0 2022-08-10T17:47:07.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 msgr2=0x7f663c15aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 0x7f663c15aac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e770 tx=0x7f662c00eb30 comp rx=0 tx=0).stop 2022-08-10T17:47:07.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 msgr2=0x7f663c15aac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:07.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.529+0000 7f6638ff9700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c30b0 0x7f663c15aac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.530+0000 7f663b7fe700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f661c065090 0x7f661c067540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f663c159390 tx=0x7f6630007b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.536+0000 7f66423b0700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 0x7f663c0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:07.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.536+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0644b0 con 0x7f663c0c6aa0 2022-08-10T17:47:07.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.536+0000 7f663bfff700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 0x7f663c0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:07.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f663bfff700 1 -- 172.21.15.150:0/4136584124 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f663c072890 con 0x7f663c0c6aa0 2022-08-10T17:47:07.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f663bfff700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 0x7f663c0c54d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e770 tx=0x7f662c004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:07.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c029070 con 0x7f663c0c6aa0 2022-08-10T17:47:07.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5018 (secure 0 0 0) 0x7f662c021040 con 0x7f663c0c6aa0 2022-08-10T17:47:07.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 msgr2=0x7f663c0c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 0x7f663c0c54d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e770 tx=0x7f662c004640 comp rx=0 tx=0).stop 2022-08-10T17:47:07.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 msgr2=0x7f663c0c54d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:07.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f6638ff9700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f663c0c6aa0 0x7f663c0c54d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:07.556 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:47:07.556 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:07.556 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:07.557 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:47:07.557 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 94, 2022-08-10T17:47:07.557 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:47:07.557 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:47:07.558 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:47:07.558 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.558 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:47:07.558 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:07.559 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:47:07.559 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:47:07.559 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.559 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.560 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.560 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.560 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.560 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.561 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.561 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.561 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.561 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.562 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:47:07.562 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:47:07.562 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.562 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.563 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.563 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.563 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.563 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.564 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.564 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.564 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.564 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.565 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:47:07.565 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:47:07.566 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:47:07.566 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:47:07.566 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:47:07.566 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:47:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:47:07.567 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:47:07.568 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:47:07.568 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:47:07.568 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:47:07.568 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:47:07.569 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:07.569 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:47:07.569 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:07.569 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:07.570 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:07.570 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:07.570 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:07.570 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:07.571 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:07.571 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:07.571 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:07.571 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.572 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:47:07.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.572 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:47:07.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.572 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:07.573 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:07.573 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.573 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.574 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.574 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:47:07.574 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:47:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.576 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.576 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:47:07.576 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:47:07.577 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.577 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.577 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.578 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:07.578 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:07.578 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.578 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.579 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:47:07.579 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.580 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.580 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:47:07.580 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.581 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.581 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.581 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:47:07.582 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:47:07.582 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.582 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.582 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.583 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:07.583 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:07.583 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:07.584 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:07.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.584 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:07.584 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:47:07.584 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.585 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:07.585 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:47:07.586 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:07.586 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.586 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.587 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:47:07.587 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:47:07.587 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:07.587 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:07.587 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:07.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.588 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.588 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:47:07.589 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:47:07.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.589 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.589 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:07.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.590 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.590 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:47:07.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.591 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.591 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.591 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:47:07.591 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.591 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.592 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:47:07.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.592 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.592 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.593 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:47:07.593 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.593 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.593 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:47:07.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.594 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:47:07.594 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.594 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:07.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.595 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.595 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.595 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:47:07.596 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.596 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:07.596 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:47:07.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:07.597 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:07.597 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:07.597 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:47:07.598 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:07.598 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:07.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:07.598 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:47:07.599 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:47:07.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f661c065090 msgr2=0x7f661c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f661c065090 0x7f661c067540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f663c159390 tx=0x7f6630007b10 comp rx=0 tx=0).stop 2022-08-10T17:47:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 msgr2=0x7f663c15a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 --2- 172.21.15.150:0/4136584124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663c158170 0x7f663c15a580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f663c064f10 tx=0x7f6634004950 comp rx=0 tx=0).stop 2022-08-10T17:47:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 reap_dead start 2022-08-10T17:47:07.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f664094d700 1 -- 172.21.15.150:0/4136584124 reap_dead start 2022-08-10T17:47:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 shutdown_connections 2022-08-10T17:47:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 >> 172.21.15.150:0/4136584124 conn(0x7f663c06f880 msgr2=0x7f663c14e940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.537+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 shutdown_connections 2022-08-10T17:47:07.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:07.538+0000 7f66423b0700 1 -- 172.21.15.150:0/4136584124 wait complete. 2022-08-10T17:47:07.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:47:27.604 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:47:27.605 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:47:27.605 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:47:27.606 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:47:27.924 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:47:27.924 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:47:27.924 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:28.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.203+0000 7f93556bb700 1 Processor -- start 2022-08-10T17:47:28.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.206+0000 7f93556bb700 1 -- start start 2022-08-10T17:47:28.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.207+0000 7f93556bb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f935014ce90 0x7f935006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.207+0000 7f93556bb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f935006c050 0x7f935006b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.207+0000 7f93556bb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500c5270 con 0x7f93500c4060 2022-08-10T17:47:28.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.207+0000 7f93556bb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500c47c0 con 0x7f935006c050 2022-08-10T17:47:28.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.207+0000 7f93556bb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500705f0 con 0x7f935014ce90 2022-08-10T17:47:28.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f935014ce90 0x7f935006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:28.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f935014ce90 0x7f935006b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51560/0 (socket says 172.21.15.150:51560) 2022-08-10T17:47:28.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 -- 172.21.15.150:0/3660015035 learned_addr learned my addr 172.21.15.150:0/3660015035 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:28.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 -- 172.21.15.150:0/3660015035 >> v2:172.21.15.150:3300/0 conn(0x7f935006c050 msgr2=0x7f935006b850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:28.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 --2- 172.21.15.150:0/3660015035 >> v2:172.21.15.150:3300/0 conn(0x7f935006c050 0x7f935006b850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 -- 172.21.15.150:0/3660015035 >> v1:172.21.15.197:6789/0 conn(0x7f93500c4060 legacy=0x7f9350152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:28.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 -- 172.21.15.150:0/3660015035 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500c49d0 con 0x7f935014ce90 2022-08-10T17:47:28.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934effd700 1 --2- 172.21.15.150:0/3660015035 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f935014ce90 0x7f935006b310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93500c65c0 tx=0x7f9340009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df4180990dc7145 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:28.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.208+0000 7f934dffb700 1 -- 172.21.15.150:0/3660015035 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340011420 con 0x7f935014ce90 2022-08-10T17:47:28.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.209+0000 7f934dffb700 1 -- 172.21.15.150:0/3660015035 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340011580 con 0x7f935014ce90 2022-08-10T17:47:28.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.209+0000 7f934dffb700 1 -- 172.21.15.150:0/3660015035 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340011930 con 0x7f935014ce90 2022-08-10T17:47:28.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.209+0000 7f93556bb700 1 -- 172.21.15.150:0/3660015035 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f935014ce90 msgr2=0x7f935006b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:28.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.209+0000 7f93556bb700 1 --2- 172.21.15.150:0/3660015035 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f935014ce90 0x7f935006b310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93500c65c0 tx=0x7f9340009f90 comp rx=0 tx=0).stop 2022-08-10T17:47:28.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.210+0000 7f93556bb700 1 -- 172.21.15.150:0/3660015035 shutdown_connections 2022-08-10T17:47:28.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.210+0000 7f93556bb700 1 --2- 172.21.15.150:0/3660015035 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f935014ce90 0x7f935006b310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.210+0000 7f93556bb700 1 --2- 172.21.15.150:0/3660015035 >> v2:172.21.15.150:3300/0 conn(0x7f935006c050 0x7f935006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.210+0000 7f93556bb700 1 -- 172.21.15.150:0/3660015035 >> 172.21.15.150:0/3660015035 conn(0x7f93500c8a10 msgr2=0x7f93500c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.210+0000 7f93556bb700 1 -- 172.21.15.150:0/3660015035 shutdown_connections 2022-08-10T17:47:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.211+0000 7f93556bb700 1 -- 172.21.15.150:0/3660015035 wait complete. 2022-08-10T17:47:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.212+0000 7f93556bb700 1 Processor -- start 2022-08-10T17:47:28.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.212+0000 7f93556bb700 1 -- start start 2022-08-10T17:47:28.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 0x7f935015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.222 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f93501f1370 0x7f935013f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350144080 con 0x7f93500c4060 2022-08-10T17:47:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501f0680 con 0x7f93501f1370 2022-08-10T17:47:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f93556bb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93501f0ee0 con 0x7f935014ce90 2022-08-10T17:47:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40972/0 (socket says 172.21.15.150:40972) 2022-08-10T17:47:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 -- 172.21.15.150:0/3586631968 learned_addr learned my addr 172.21.15.150:0/3586631968 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934e7fc700 1 -- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 msgr2=0x7f935015c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934e7fc700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 0x7f935015c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934f7fe700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f93501f1370 0x7f935013f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 -- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 msgr2=0x7f935015c8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 0x7f935015c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 -- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f93501f1370 msgr2=0x7f935013f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f93501f1370 0x7f935013f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.213+0000 7f934effd700 1 -- 172.21.15.150:0/3586631968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009c70 con 0x7f93500c4060 2022-08-10T17:47:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f934effd700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93500c4900 tx=0x7f93400045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340011b00 con 0x7f93500c4060 2022-08-10T17:47:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934001f070 con 0x7f93500c4060 2022-08-10T17:47:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93501492f0 con 0x7f93500c4060 2022-08-10T17:47:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350141a20 con 0x7f93500c4060 2022-08-10T17:47:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.214+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340009700 con 0x7f93500c4060 2022-08-10T17:47:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.215+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c005170 con 0x7f93500c4060 2022-08-10T17:47:28.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.219+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f934000f050 con 0x7f93500c4060 2022-08-10T17:47:28.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.220+0000 7f93377fe700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 0x7f9330067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:28.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.220+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9340021070 con 0x7f93500c4060 2022-08-10T17:47:28.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.220+0000 7f934e7fc700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 0x7f9330067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:28.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.220+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f9340052090 con 0x7f93500c4060 2022-08-10T17:47:28.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.220+0000 7f934e7fc700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 0x7f9330067540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9350149510 tx=0x7f9344006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:28.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.555+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f932c0056f0 con 0x7f93500c4060 2022-08-10T17:47:28.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.555+0000 7f93377fe700 1 -- 172.21.15.150:0/3586631968 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f9340006c00 con 0x7f93500c4060 2022-08-10T17:47:28.559 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:28.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 msgr2=0x7f9330067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 0x7f9330067540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9350149510 tx=0x7f9344006bf0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 msgr2=0x7f935014b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f93500c4900 tx=0x7f93400045d0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 shutdown_connections 2022-08-10T17:47:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f93501f1370 0x7f935013f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93500c4060 0x7f935014b180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9330065090 0x7f9330067540 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 --2- 172.21.15.150:0/3586631968 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f935014ce90 0x7f935015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:28.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 >> 172.21.15.150:0/3586631968 conn(0x7f93500c8a10 msgr2=0x7f9350151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:28.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 shutdown_connections 2022-08-10T17:47:28.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:28.557+0000 7f93556bb700 1 -- 172.21.15.150:0/3586631968 wait complete. 2022-08-10T17:47:31.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:31.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 Processor -- start 2022-08-10T17:47:31.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 -- start start 2022-08-10T17:47:31.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 0x7f58200c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5820069510 0x7f58200c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820154240 con 0x7f58200bd5e0 2022-08-10T17:47:31.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5820068450 con 0x7f5820069510 2022-08-10T17:47:31.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5826df1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5820153630 con 0x7f5820150d60 2022-08-10T17:47:31.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.710+0000 7f5824b8d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 msgr2=0x7f58200c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:31.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f5824b8d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 0x7f58200c4410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:31.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f58200bd5e0 0x7f58200c5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53672/0 (socket says 172.21.15.150:53672) 2022-08-10T17:47:31.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581ffff700 1 -- 172.21.15.150:0/3100790225 learned_addr learned my addr 172.21.15.150:0/3100790225 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:31.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 --2- 172.21.15.150:0/3100790225 >> v2:172.21.15.150:3300/0 conn(0x7f5820069510 0x7f58200c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:31.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581f7fe700 1 -- 172.21.15.150:0/3100790225 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178531327 0 0) 0x7f5820154240 con 0x7f58200bd5e0 2022-08-10T17:47:31.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581f7fe700 1 -- 172.21.15.150:0/3100790225 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5804003430 con 0x7f58200bd5e0 2022-08-10T17:47:31.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 -- 172.21.15.150:0/3100790225 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 msgr2=0x7f58200c4410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:31.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 --2- 172.21.15.150:0/3100790225 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 0x7f58200c4410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:31.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 -- 172.21.15.150:0/3100790225 >> v1:172.21.15.150:6789/0 conn(0x7f58200bd5e0 legacy=0x7f58200c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:31.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 -- 172.21.15.150:0/3100790225 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820153910 con 0x7f5820069510 2022-08-10T17:47:31.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f582538e700 1 --2- 172.21.15.150:0/3100790225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58200c4950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5818009d90 tx=0x7f581800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a116d4af430431 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:31.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581f7fe700 1 -- 172.21.15.150:0/3100790225 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800e070 con 0x7f5820069510 2022-08-10T17:47:31.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581f7fe700 1 -- 172.21.15.150:0/3100790225 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800bb20 con 0x7f5820069510 2022-08-10T17:47:31.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.711+0000 7f581f7fe700 1 -- 172.21.15.150:0/3100790225 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818012430 con 0x7f5820069510 2022-08-10T17:47:31.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 -- 172.21.15.150:0/3100790225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 msgr2=0x7f58200c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:31.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 --2- 172.21.15.150:0/3100790225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58200c4950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5818009d90 tx=0x7f581800b330 comp rx=0 tx=0).stop 2022-08-10T17:47:31.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 -- 172.21.15.150:0/3100790225 shutdown_connections 2022-08-10T17:47:31.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 --2- 172.21.15.150:0/3100790225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58200c4950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:31.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 --2- 172.21.15.150:0/3100790225 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5820150d60 0x7f58200c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:31.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 -- 172.21.15.150:0/3100790225 >> 172.21.15.150:0/3100790225 conn(0x7f58200c65e0 msgr2=0x7f58200c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:31.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 -- 172.21.15.150:0/3100790225 shutdown_connections 2022-08-10T17:47:31.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.712+0000 7f5826df1700 1 -- 172.21.15.150:0/3100790225 wait complete. 2022-08-10T17:47:31.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.713+0000 7f5826df1700 1 Processor -- start 2022-08-10T17:47:31.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.713+0000 7f5826df1700 1 -- start start 2022-08-10T17:47:31.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f58200bd5e0 0x7f582014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 0x7f582014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582014f1f0 con 0x7f5820069510 2022-08-10T17:47:31.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582014ebc0 con 0x7f58200bd5e0 2022-08-10T17:47:31.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58201ea380 con 0x7f58200c8ac0 2022-08-10T17:47:31.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f582538e700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 msgr2=0x7f582014ab20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:31.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f582538e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 0x7f582014ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:31.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40996/0 (socket says 172.21.15.150:40996) 2022-08-10T17:47:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 -- 172.21.15.150:0/948887275 learned_addr learned my addr 172.21.15.150:0/948887275 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f581ffff700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f58200bd5e0 0x7f582014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 -- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 msgr2=0x7f582014ab20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:31.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 0x7f582014ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:31.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 -- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f58200bd5e0 msgr2=0x7f582014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:31.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f58200bd5e0 0x7f582014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:31.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 -- 172.21.15.150:0/948887275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009a70 con 0x7f5820069510 2022-08-10T17:47:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5824b8d700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f581400b430 tx=0x7f581400b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814003cd0 con 0x7f5820069510 2022-08-10T17:47:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581400be90 con 0x7f5820069510 2022-08-10T17:47:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58201ea660 con 0x7f5820069510 2022-08-10T17:47:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.714+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140052b0 con 0x7f5820069510 2022-08-10T17:47:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.715+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582014ee10 con 0x7f5820069510 2022-08-10T17:47:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.715+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582014efa0 con 0x7f5820069510 2022-08-10T17:47:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.716+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f581400f070 con 0x7f5820069510 2022-08-10T17:47:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.716+0000 7f581d7fa700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 0x7f5808067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:31.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.716+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f58140819c0 con 0x7f5820069510 2022-08-10T17:47:31.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.716+0000 7f581ffff700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 0x7f5808067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:31.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.717+0000 7f581ffff700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 0x7f5808067510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f580c0011e0 tx=0x7f580c007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:31.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:31.720+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f581404f940 con 0x7f5820069510 2022-08-10T17:47:32.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.091+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f58200672b0 con 0x7f5820069510 2022-08-10T17:47:32.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.091+0000 7f581d7fa700 1 -- 172.21.15.150:0/948887275 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5814052f60 con 0x7f5820069510 2022-08-10T17:47:32.095 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:32.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.094+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 msgr2=0x7f5808067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:32.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.094+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 0x7f5808067510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f580c0011e0 tx=0x7f580c007c40 comp rx=0 tx=0).stop 2022-08-10T17:47:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.094+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 msgr2=0x7f58201e9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:32.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.094+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f581400b430 tx=0x7f581400b740 comp rx=0 tx=0).stop 2022-08-10T17:47:32.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 shutdown_connections 2022-08-10T17:47:32.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5808065060 0x7f5808067510 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:32.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f58200c8ac0 0x7f582014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:32.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5820069510 0x7f58201e9b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:32.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 --2- 172.21.15.150:0/948887275 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f58200bd5e0 0x7f582014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:32.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 >> 172.21.15.150:0/948887275 conn(0x7f58200c65e0 msgr2=0x7f582006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:32.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 shutdown_connections 2022-08-10T17:47:32.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:32.096+0000 7f5826df1700 1 -- 172.21.15.150:0/948887275 wait complete. 2022-08-10T17:47:35.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:35.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.272+0000 7fe559547700 1 Processor -- start 2022-08-10T17:47:35.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.272+0000 7fe559547700 1 -- start start 2022-08-10T17:47:35.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe559547700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 0x7fe55406b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe559547700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe55406c050 0x7fe55406b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe559547700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540c5270 con 0x7fe5540c9520 2022-08-10T17:47:35.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe559547700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540c47c0 con 0x7fe55406c050 2022-08-10T17:47:35.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe559547700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540705f0 con 0x7fe55414ce90 2022-08-10T17:47:35.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe552ffd700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 msgr2=0x7fe55406b310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:35.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe552ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 0x7fe55406b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:35.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe5537fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe5540c9520 0x7fe5541560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53706/0 (socket says 172.21.15.150:53706) 2022-08-10T17:47:35.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.273+0000 7fe5537fe700 1 -- 172.21.15.150:0/4199264339 learned_addr learned my addr 172.21.15.150:0/4199264339 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:35.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 --2- 172.21.15.150:0/4199264339 >> v2:172.21.15.150:3300/0 conn(0x7fe55406c050 0x7fe55406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:35.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe551ffb700 1 -- 172.21.15.150:0/4199264339 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85045201 0 0) 0x7fe5540c5270 con 0x7fe5540c9520 2022-08-10T17:47:35.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe551ffb700 1 -- 172.21.15.150:0/4199264339 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe540003430 con 0x7fe5540c9520 2022-08-10T17:47:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 -- 172.21.15.150:0/4199264339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 msgr2=0x7fe55406b310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 --2- 172.21.15.150:0/4199264339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 0x7fe55406b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 -- 172.21.15.150:0/4199264339 >> v1:172.21.15.150:6789/0 conn(0x7fe5540c9520 legacy=0x7fe5541560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:35.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 -- 172.21.15.150:0/4199264339 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540c49d0 con 0x7fe55406c050 2022-08-10T17:47:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe5527fc700 1 --2- 172.21.15.150:0/4199264339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55406c050 0x7fe55406b850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5480096b0 tx=0x7fe5480099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0e4a14380d0587 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe551ffb700 1 -- 172.21.15.150:0/4199264339 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480107b0 con 0x7fe55406c050 2022-08-10T17:47:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe551ffb700 1 -- 172.21.15.150:0/4199264339 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548010910 con 0x7fe55406c050 2022-08-10T17:47:35.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.274+0000 7fe551ffb700 1 -- 172.21.15.150:0/4199264339 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548010ca0 con 0x7fe55406c050 2022-08-10T17:47:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 -- 172.21.15.150:0/4199264339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55406c050 msgr2=0x7fe55406b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 --2- 172.21.15.150:0/4199264339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55406c050 0x7fe55406b850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5480096b0 tx=0x7fe5480099c0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 -- 172.21.15.150:0/4199264339 shutdown_connections 2022-08-10T17:47:35.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 --2- 172.21.15.150:0/4199264339 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55414ce90 0x7fe55406b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 --2- 172.21.15.150:0/4199264339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55406c050 0x7fe55406b850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 -- 172.21.15.150:0/4199264339 >> 172.21.15.150:0/4199264339 conn(0x7fe5540c8a10 msgr2=0x7fe5540c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 -- 172.21.15.150:0/4199264339 shutdown_connections 2022-08-10T17:47:35.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.275+0000 7fe559547700 1 -- 172.21.15.150:0/4199264339 wait complete. 2022-08-10T17:47:35.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.277+0000 7fe559547700 1 Processor -- start 2022-08-10T17:47:35.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.277+0000 7fe559547700 1 -- start start 2022-08-10T17:47:35.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 0x7fe554088b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55414ce90 0x7fe5541511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55414ea20 con 0x7fe55414ce90 2022-08-10T17:47:35.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540bf360 con 0x7fe5540c9520 2022-08-10T17:47:35.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe559547700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe554089040 con 0x7fe55406c050 2022-08-10T17:47:35.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe552ffd700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 msgr2=0x7fe554088b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:47:35.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe552ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 0x7fe554088b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:35.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe5527fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:35.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe5527fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51624/0 (socket says 172.21.15.150:51624) 2022-08-10T17:47:35.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe5527fc700 1 -- 172.21.15.150:0/2559863304 learned_addr learned my addr 172.21.15.150:0/2559863304 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:35.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.278+0000 7fe5537fe700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55414ce90 0x7fe5541511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:35.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 -- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 msgr2=0x7fe554088b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:35.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 0x7fe554088b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 -- 172.21.15.150:0/2559863304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55414ce90 msgr2=0x7fe5541511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:35.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55414ce90 0x7fe5541511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 -- 172.21.15.150:0/2559863304 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009310 con 0x7fe5540c9520 2022-08-10T17:47:35.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.279+0000 7fe5527fc700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe548012000 tx=0x7fe5480045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:35.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.280+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548010f10 con 0x7fe5540c9520 2022-08-10T17:47:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.280+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54801f070 con 0x7fe5540c9520 2022-08-10T17:47:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.280+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe554146810 con 0x7fe5540c9520 2022-08-10T17:47:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.280+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540beda0 con 0x7fe5540c9520 2022-08-10T17:47:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.280+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480107b0 con 0x7fe5540c9520 2022-08-10T17:47:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.281+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe530005170 con 0x7fe5540c9520 2022-08-10T17:47:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.281+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe54800f070 con 0x7fe5540c9520 2022-08-10T17:47:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.282+0000 7fe53b7fe700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 0x7fe5340675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.282+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe548083890 con 0x7fe5540c9520 2022-08-10T17:47:35.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.282+0000 7fe552ffd700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 0x7fe5340675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:35.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.283+0000 7fe552ffd700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 0x7fe5340675e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe544003840 tx=0x7fe544006c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:35.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.287+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe5480519c0 con 0x7fe5540c9520 2022-08-10T17:47:35.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.630+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe5300059a0 con 0x7fe5540c9520 2022-08-10T17:47:35.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.631+0000 7fe53b7fe700 1 -- 172.21.15.150:0/2559863304 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7fe548054fe0 con 0x7fe5540c9520 2022-08-10T17:47:35.635 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:35.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 msgr2=0x7fe5340675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:35.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 0x7fe5340675e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe544003840 tx=0x7fe544006c40 comp rx=0 tx=0).stop 2022-08-10T17:47:35.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 msgr2=0x7fe55414d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:35.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe548012000 tx=0x7fe5480045d0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 shutdown_connections 2022-08-10T17:47:35.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe55414ce90 0x7fe5541511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe534065130 0x7fe5340675e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe55406c050 0x7fe554088b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 --2- 172.21.15.150:0/2559863304 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5540c9520 0x7fe55414d550 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:35.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 >> 172.21.15.150:0/2559863304 conn(0x7fe5540c8a10 msgr2=0x7fe554069750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:35.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 shutdown_connections 2022-08-10T17:47:35.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:35.633+0000 7fe559547700 1 -- 172.21.15.150:0/2559863304 wait complete. 2022-08-10T17:47:38.650 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:38.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.792+0000 7fa7b6872700 1 Processor -- start 2022-08-10T17:47:38.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.793+0000 7fa7b6872700 1 -- start start 2022-08-10T17:47:38.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b6872700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 0x7fa7b006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b6872700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa7b00705d0 0x7fa7b00c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b6872700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b00bf640 con 0x7fa7b006c0e0 2022-08-10T17:47:38.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b6872700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b0156400 con 0x7fa7b014d080 2022-08-10T17:47:38.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b6872700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b01566e0 con 0x7fa7b00705d0 2022-08-10T17:47:38.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7affff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 0x7fa7b006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b4e0f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa7b006c0e0 0x7fa7b00c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53726/0 (socket says 172.21.15.150:53726) 2022-08-10T17:47:38.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7b4e0f700 1 -- 172.21.15.150:0/2238892247 learned_addr learned my addr 172.21.15.150:0/2238892247 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:38.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/2238892247 >> v2:172.21.15.197:3300/0 conn(0x7fa7b00705d0 0x7fa7b00c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7aeffd700 1 -- 172.21.15.150:0/2238892247 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399786024 0 0) 0x7fa7a8001490 con 0x7fa7b006c0e0 2022-08-10T17:47:38.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7aeffd700 1 -- 172.21.15.150:0/2238892247 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa79c003430 con 0x7fa7b006c0e0 2022-08-10T17:47:38.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7af7fe700 1 -- 172.21.15.150:0/2238892247 >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 msgr2=0x7fa7b006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:38.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/2238892247 >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 0x7fa7b006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:38.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7af7fe700 1 -- 172.21.15.150:0/2238892247 >> v1:172.21.15.150:6789/0 conn(0x7fa7b006c0e0 legacy=0x7fa7b00c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:38.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7af7fe700 1 -- 172.21.15.150:0/2238892247 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b01569c0 con 0x7fa7b00705d0 2022-08-10T17:47:38.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.794+0000 7fa7affff700 1 --2- 172.21.15.150:0/2238892247 >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 0x7fa7b006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:47:38.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/2238892247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b00705d0 0x7fa7b00c47f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b92d0 tx=0x7fa7a4009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd1451b5cdb333df server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:38.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7aeffd700 1 -- 172.21.15.150:0/2238892247 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40107b0 con 0x7fa7b00705d0 2022-08-10T17:47:38.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7aeffd700 1 -- 172.21.15.150:0/2238892247 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4010910 con 0x7fa7b00705d0 2022-08-10T17:47:38.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7aeffd700 1 -- 172.21.15.150:0/2238892247 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4010c80 con 0x7fa7b00705d0 2022-08-10T17:47:38.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 -- 172.21.15.150:0/2238892247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b00705d0 msgr2=0x7fa7b00c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:38.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 --2- 172.21.15.150:0/2238892247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b00705d0 0x7fa7b00c47f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b92d0 tx=0x7fa7a4009990 comp rx=0 tx=0).stop 2022-08-10T17:47:38.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 -- 172.21.15.150:0/2238892247 shutdown_connections 2022-08-10T17:47:38.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 --2- 172.21.15.150:0/2238892247 >> v2:172.21.15.150:3300/0 conn(0x7fa7b014d080 0x7fa7b006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:38.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 --2- 172.21.15.150:0/2238892247 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b00705d0 0x7fa7b00c47f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:38.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.795+0000 7fa7b6872700 1 -- 172.21.15.150:0/2238892247 >> 172.21.15.150:0/2238892247 conn(0x7fa7b00c8a10 msgr2=0x7fa7b00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:38.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.796+0000 7fa7b6872700 1 -- 172.21.15.150:0/2238892247 shutdown_connections 2022-08-10T17:47:38.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.796+0000 7fa7b6872700 1 -- 172.21.15.150:0/2238892247 wait complete. 2022-08-10T17:47:38.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.797+0000 7fa7b6872700 1 Processor -- start 2022-08-10T17:47:38.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.797+0000 7fa7b6872700 1 -- start start 2022-08-10T17:47:38.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b014d080 0x7fa7b00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00beae0 con 0x7fa7b006c0e0 2022-08-10T17:47:38.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0152ee0 con 0x7fa7b014d080 2022-08-10T17:47:38.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.798+0000 7fa7b6872700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00bd520 con 0x7fa7b00705d0 2022-08-10T17:47:38.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41048/0 (socket says 172.21.15.150:41048) 2022-08-10T17:47:38.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 -- 172.21.15.150:0/259340824 learned_addr learned my addr 172.21.15.150:0/259340824 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:38.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7b4e0f700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b014d080 0x7fa7b00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7af7fe700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 msgr2=0x7fa7b00bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:47:38.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7af7fe700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 msgr2=0x7fa7b00bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:38.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:38.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 msgr2=0x7fa7b00bd9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:38.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b014d080 msgr2=0x7fa7b00c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b014d080 0x7fa7b00c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:38.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 -- 172.21.15.150:0/259340824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009310 con 0x7fa7b006c0e0 2022-08-10T17:47:38.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7affff700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e8a0 tx=0x7fa7a000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:38.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0013680 con 0x7fa7b006c0e0 2022-08-10T17:47:38.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a00137e0 con 0x7fa7b006c0e0 2022-08-10T17:47:38.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4009310 con 0x7fa7b006c0e0 2022-08-10T17:47:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0013b70 con 0x7fa7b006c0e0 2022-08-10T17:47:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.799+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b00bcbf0 con 0x7fa7b006c0e0 2022-08-10T17:47:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.800+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b00bd800 con 0x7fa7b006c0e0 2022-08-10T17:47:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.801+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa7a0019030 con 0x7fa7b006c0e0 2022-08-10T17:47:38.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.801+0000 7fa7acff9700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 0x7fa790067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.801+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa7a0082090 con 0x7fa7b006c0e0 2022-08-10T17:47:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.801+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 0x7fa790067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.802+0000 7fa7af7fe700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 0x7fa790067590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000c00 tx=0x7fa7a401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:38.805+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa7a0050070 con 0x7fa7b006c0e0 2022-08-10T17:47:39.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.147+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa7b0072890 con 0x7fa7b006c0e0 2022-08-10T17:47:39.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.147+0000 7fa7acff9700 1 -- 172.21.15.150:0/259340824 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7fa7a0021600 con 0x7fa7b006c0e0 2022-08-10T17:47:39.151 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:39.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 msgr2=0x7fa790067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:39.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 0x7fa790067590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000c00 tx=0x7fa7a401c040 comp rx=0 tx=0).stop 2022-08-10T17:47:39.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 msgr2=0x7fa7b0152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:39.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e8a0 tx=0x7fa7a000ebb0 comp rx=0 tx=0).stop 2022-08-10T17:47:39.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 shutdown_connections 2022-08-10T17:47:39.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa7b014d080 0x7fa7b00c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:39.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7b006c0e0 0x7fa7b0152560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:39.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa7900650e0 0x7fa790067590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:39.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 --2- 172.21.15.150:0/259340824 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa7b00705d0 0x7fa7b00bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:39.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.149+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 >> 172.21.15.150:0/259340824 conn(0x7fa7b00c8a10 msgr2=0x7fa7b014aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:39.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.150+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 shutdown_connections 2022-08-10T17:47:39.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:39.150+0000 7fa7b6872700 1 -- 172.21.15.150:0/259340824 wait complete. 2022-08-10T17:47:42.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:42.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.309+0000 7f3d2aabb700 1 Processor -- start 2022-08-10T17:47:42.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.309+0000 7f3d2aabb700 1 -- start start 2022-08-10T17:47:42.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d2aabb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d2406af70 0x7f3d2406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d2aabb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3d240c7170 0x7f3d240c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d2aabb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2406a3d0 con 0x7f3d240c3060 2022-08-10T17:47:42.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d2aabb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d24070810 con 0x7f3d2406af70 2022-08-10T17:47:42.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d2aabb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240c5fb0 con 0x7f3d240c7170 2022-08-10T17:47:42.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d2406af70 0x7f3d2406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d2406af70 0x7f3d2406ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41088/0 (socket says 172.21.15.150:41088) 2022-08-10T17:47:42.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 -- 172.21.15.150:0/3351347896 learned_addr learned my addr 172.21.15.150:0/3351347896 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:42.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d28857700 1 --1- 172.21.15.150:0/3351347896 >> v1:172.21.15.150:6789/0 conn(0x7f3d240c3060 0x7f3d2406a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53766/0 (socket says 172.21.15.150:53766) 2022-08-10T17:47:42.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d29058700 1 --2- 172.21.15.150:0/3351347896 >> v2:172.21.15.197:3300/0 conn(0x7f3d240c7170 0x7f3d240c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 -- 172.21.15.150:0/3351347896 >> v2:172.21.15.197:3300/0 conn(0x7f3d240c7170 msgr2=0x7f3d240c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:42.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 --2- 172.21.15.150:0/3351347896 >> v2:172.21.15.197:3300/0 conn(0x7f3d240c7170 0x7f3d240c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 -- 172.21.15.150:0/3351347896 >> v1:172.21.15.150:6789/0 conn(0x7f3d240c3060 legacy=0x7f3d2406a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:42.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 -- 172.21.15.150:0/3351347896 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2406fc90 con 0x7f3d2406af70 2022-08-10T17:47:42.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d237fe700 1 -- 172.21.15.150:0/3351347896 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059992152 0 0) 0x7f3d2406a3d0 con 0x7f3d240c3060 2022-08-10T17:47:42.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d23fff700 1 --2- 172.21.15.150:0/3351347896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2406ea50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3d2406e800 tx=0x7f3d10009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5758b64024e91057 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:42.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.310+0000 7f3d237fe700 1 -- 172.21.15.150:0/3351347896 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10005cb0 con 0x7f3d2406af70 2022-08-10T17:47:42.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d237fe700 1 -- 172.21.15.150:0/3351347896 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10005e10 con 0x7f3d2406af70 2022-08-10T17:47:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d237fe700 1 -- 172.21.15.150:0/3351347896 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10006250 con 0x7f3d2406af70 2022-08-10T17:47:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 -- 172.21.15.150:0/3351347896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 msgr2=0x7f3d2406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/3351347896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2406ea50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3d2406e800 tx=0x7f3d10009a40 comp rx=0 tx=0).stop 2022-08-10T17:47:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 -- 172.21.15.150:0/3351347896 shutdown_connections 2022-08-10T17:47:42.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/3351347896 >> v2:172.21.15.197:3300/0 conn(0x7f3d240c7170 0x7f3d240c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/3351347896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2406ea50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 -- 172.21.15.150:0/3351347896 >> 172.21.15.150:0/3351347896 conn(0x7f3d24068be0 msgr2=0x7f3d240c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:42.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 -- 172.21.15.150:0/3351347896 shutdown_connections 2022-08-10T17:47:42.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.311+0000 7f3d2aabb700 1 -- 172.21.15.150:0/3351347896 wait complete. 2022-08-10T17:47:42.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.312+0000 7f3d2aabb700 1 Processor -- start 2022-08-10T17:47:42.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.312+0000 7f3d2aabb700 1 -- start start 2022-08-10T17:47:42.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d240c7170 0x7f3d240718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2414c9a0 con 0x7f3d2406af70 2022-08-10T17:47:42.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241eb970 con 0x7f3d240c7170 2022-08-10T17:47:42.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d2aabb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240ca320 con 0x7f3d240c3060 2022-08-10T17:47:42.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d28857700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d28857700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41092/0 (socket says 172.21.15.150:41092) 2022-08-10T17:47:42.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d28857700 1 -- 172.21.15.150:0/2648955577 learned_addr learned my addr 172.21.15.150:0/2648955577 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:42.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d29058700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d240c7170 0x7f3d240718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d23fff700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d23fff700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 msgr2=0x7f3d24071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:47:42.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d23fff700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 msgr2=0x7f3d24071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:42.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d23fff700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.313+0000 7f3d23fff700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 msgr2=0x7f3d24071370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d240c7170 msgr2=0x7f3d240718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:42.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d240c7170 0x7f3d240718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 -- 172.21.15.150:0/2648955577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10009370 con 0x7f3d2406af70 2022-08-10T17:47:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d28857700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c450 tx=0x7f3d1800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d180072d0 con 0x7f3d2406af70 2022-08-10T17:47:42.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d18007430 con 0x7f3d2406af70 2022-08-10T17:47:42.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d241e7480 con 0x7f3d2406af70 2022-08-10T17:47:42.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d180048f0 con 0x7f3d2406af70 2022-08-10T17:47:42.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.314+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d24154a80 con 0x7f3d2406af70 2022-08-10T17:47:42.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.315+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2406ff70 con 0x7f3d2406af70 2022-08-10T17:47:42.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.315+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3d1801a020 con 0x7f3d2406af70 2022-08-10T17:47:42.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.316+0000 7f3d217fa700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 0x7f3d0c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:42.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.316+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3d18081c50 con 0x7f3d2406af70 2022-08-10T17:47:42.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.316+0000 7f3d23fff700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 0x7f3d0c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:42.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.316+0000 7f3d23fff700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 0x7f3d0c067590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009a80 tx=0x7f3d10008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:42.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.320+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f3d1804fc30 con 0x7f3d2406af70 2022-08-10T17:47:42.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.686+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3d24069120 con 0x7f3d2406af70 2022-08-10T17:47:42.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.687+0000 7f3d217fa700 1 -- 172.21.15.150:0/2648955577 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f3d18053250 con 0x7f3d2406af70 2022-08-10T17:47:42.691 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":36,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:42.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.689+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 msgr2=0x7f3d0c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:42.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.689+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 0x7f3d0c067590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009a80 tx=0x7f3d10008070 comp rx=0 tx=0).stop 2022-08-10T17:47:42.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.689+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 msgr2=0x7f3d2414a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:42.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.689+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c450 tx=0x7f3d1800c760 comp rx=0 tx=0).stop 2022-08-10T17:47:42.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 shutdown_connections 2022-08-10T17:47:42.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d240c7170 0x7f3d240718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2406af70 0x7f3d2414a890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d0c0650e0 0x7f3d0c067590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 --2- 172.21.15.150:0/2648955577 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d240c3060 0x7f3d24071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:42.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 >> 172.21.15.150:0/2648955577 conn(0x7f3d24068be0 msgr2=0x7f3d240c0490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:42.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 shutdown_connections 2022-08-10T17:47:42.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:42.690+0000 7f3d2aabb700 1 -- 172.21.15.150:0/2648955577 wait complete. 2022-08-10T17:47:45.707 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:45.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.843+0000 7f8470a28700 1 Processor -- start 2022-08-10T17:47:45.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.843+0000 7f8470a28700 1 -- start start 2022-08-10T17:47:45.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8470a28700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8470a28700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 0x7f846c166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8470a28700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c06b310 con 0x7f846c0c5050 2022-08-10T17:47:45.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8470a28700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c06bf00 con 0x7f846c089aa0 2022-08-10T17:47:45.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8470a28700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c3830 con 0x7f846c0896d0 2022-08-10T17:47:45.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f846ad9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 0x7f846c166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f846a59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8463fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f846c0c5050 0x7f846c15d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40162/0 (socket says 172.21.15.150:40162) 2022-08-10T17:47:45.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f8463fff700 1 -- 172.21.15.150:0/3407758361 learned_addr learned my addr 172.21.15.150:0/3407758361 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:45.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f846a59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55348/0 (socket says 172.21.15.150:55348) 2022-08-10T17:47:45.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.844+0000 7f846ad9d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 0x7f846c166c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51720/0 (socket says 172.21.15.150:51720) 2022-08-10T17:47:45.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.845+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312591593 0 0) 0x7f846c06b310 con 0x7f846c0c5050 2022-08-10T17:47:45.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8458003410 con 0x7f846c0c5050 2022-08-10T17:47:45.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f846a59c700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 msgr2=0x7f846c0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:47:45.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f846a59c700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 msgr2=0x7f846c0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:45.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:45.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:45.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952007678 0 0) 0x7f8458003410 con 0x7f846c0c5050 2022-08-10T17:47:45.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 msgr2=0x7f846c0c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:45.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f846c0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 msgr2=0x7f846c166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:45.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 --2- 172.21.15.150:0/3407758361 >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 0x7f846c166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0c3aa0 con 0x7f846c0c5050 2022-08-10T17:47:45.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f8454001670 con 0x7f846c0c5050 2022-08-10T17:47:45.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 >> v1:172.21.15.197:6789/0 conn(0x7f846c0c5050 legacy=0x7f846c15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:45.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458007dc0 0x7f84580081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8458008810 0x7f8458008c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f8458009400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c06bf00 con 0x7f8458007dc0 2022-08-10T17:47:45.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c3830 con 0x7f8458008810 2022-08-10T17:47:45.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.876+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845800fcb0 con 0x7f846c0896d0 2022-08-10T17:47:45.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846ad9d700 1 --2- 172.21.15.150:0/3407758361 >> v2:172.21.15.197:3300/0 conn(0x7f846c089aa0 0x7f846c166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:47:45.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f8463fff700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8458008810 0x7f8458008c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458007dc0 0x7f84580081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846ad9d700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f8458009400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 msgr2=0x7f8458009400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:45.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f8458009400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8458008810 msgr2=0x7f8458008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:45.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8458008810 0x7f8458008c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 -- 172.21.15.150:0/3407758361 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458003410 con 0x7f8458007dc0 2022-08-10T17:47:45.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846ad9d700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f846c0896d0 0x7f8458009400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:47:45.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f846a59c700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458007dc0 0x7f84580081f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a9a0 tx=0x7f84580036c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446f90c4df55b318 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:45.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.877+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00f040 con 0x7f8458007dc0 2022-08-10T17:47:45.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.878+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c004020 con 0x7f8458007dc0 2022-08-10T17:47:45.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.878+0000 7f8469d9b700 1 -- 172.21.15.150:0/3407758361 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c0043d0 con 0x7f8458007dc0 2022-08-10T17:47:45.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.879+0000 7f8470a28700 1 -- 172.21.15.150:0/3407758361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458007dc0 msgr2=0x7f84580081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:45.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.879+0000 7f8470a28700 1 --2- 172.21.15.150:0/3407758361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458007dc0 0x7f84580081f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a9a0 tx=0x7f84580036c0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.880+0000 7f846ad9d700 1 -- 172.21.15.150:0/3407758361 reap_dead start 2022-08-10T17:47:45.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.880+0000 7f8470a28700 1 -- 172.21.15.150:0/3407758361 shutdown_connections 2022-08-10T17:47:45.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.880+0000 7f8470a28700 1 -- 172.21.15.150:0/3407758361 >> 172.21.15.150:0/3407758361 conn(0x7f846c0c8a10 msgr2=0x7f846c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.882+0000 7f8470a28700 1 -- 172.21.15.150:0/3407758361 shutdown_connections 2022-08-10T17:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.882+0000 7f8470a28700 1 -- 172.21.15.150:0/3407758361 wait complete. 2022-08-10T17:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.883+0000 7f8470a28700 1 Processor -- start 2022-08-10T17:47:45.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.883+0000 7f8470a28700 1 -- start start 2022-08-10T17:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f846c088f80 0x7f846c205610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0b7d10 con 0x7f846c088b10 2022-08-10T17:47:45.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0b6bc0 con 0x7f846c088f80 2022-08-10T17:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8470a28700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0bc1c0 con 0x7f8458007dc0 2022-08-10T17:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8463fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8463fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41140/0 (socket says 172.21.15.150:41140) 2022-08-10T17:47:45.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f8463fff700 1 -- 172.21.15.150:0/79427048 learned_addr learned my addr 172.21.15.150:0/79427048 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.884+0000 7f846a59c700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f846ad9d700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f846c088f80 0x7f846c205610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f846a59c700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 msgr2=0x7f846c0bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:47:45.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f846a59c700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 msgr2=0x7f846c0bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:45.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f846a59c700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:45.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f846a59c700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:45.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 msgr2=0x7f846c0bbc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:45.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f846c088f80 msgr2=0x7f846c205610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:45.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f846c088f80 0x7f846c205610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:45.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 -- 172.21.15.150:0/79427048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0b8670 con 0x7f846c088b10 2022-08-10T17:47:45.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8463fff700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8454004a30 tx=0x7f8454004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:45.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454001670 con 0x7f846c088b10 2022-08-10T17:47:45.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845400f8d0 con 0x7f846c088b10 2022-08-10T17:47:45.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.885+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400fc80 con 0x7f846c088b10 2022-08-10T17:47:45.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.891+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c15ac30 con 0x7f846c088b10 2022-08-10T17:47:45.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.891+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c0b6290 con 0x7f846c088b10 2022-08-10T17:47:45.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.892+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f845401c030 con 0x7f846c088b10 2022-08-10T17:47:45.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.893+0000 7f8462ffd700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 0x7f84500675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:45.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.893+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8454081c00 con 0x7f846c088b10 2022-08-10T17:47:45.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.893+0000 7f846a59c700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 0x7f84500675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:45.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.893+0000 7f846a59c700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 0x7f84500675b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a120 tx=0x7f845c012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:45.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.895+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c204f20 con 0x7f846c088b10 2022-08-10T17:47:45.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:45.900+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f845401a080 con 0x7f846c088b10 2022-08-10T17:47:46.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.260+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f846c073340 con 0x7f846c088b10 2022-08-10T17:47:46.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.260+0000 7f8462ffd700 1 -- 172.21.15.150:0/79427048 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f8454004e60 con 0x7f846c088b10 2022-08-10T17:47:46.264 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":39,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:46.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 msgr2=0x7f84500675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 0x7f84500675b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a120 tx=0x7f845c012000 comp rx=0 tx=0).stop 2022-08-10T17:47:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 msgr2=0x7f846c2050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8454004a30 tx=0x7f8454004d40 comp rx=0 tx=0).stop 2022-08-10T17:47:46.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 shutdown_connections 2022-08-10T17:47:46.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f846c088f80 0x7f846c205610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:46.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8450065100 0x7f84500675b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:46.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8458007dc0 0x7f846c0bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:46.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 --2- 172.21.15.150:0/79427048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f846c088b10 0x7f846c2050d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:46.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.262+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 >> 172.21.15.150:0/79427048 conn(0x7f846c0c8a10 msgr2=0x7f846c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:46.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.263+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 shutdown_connections 2022-08-10T17:47:46.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:46.263+0000 7f8470a28700 1 -- 172.21.15.150:0/79427048 wait complete. 2022-08-10T17:47:49.279 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:47:49.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.435+0000 7f73b6137700 1 Processor -- start 2022-08-10T17:47:49.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.435+0000 7f73b6137700 1 -- start start 2022-08-10T17:47:49.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.436+0000 7f73b6137700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f73b00bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.436+0000 7f73b6137700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73b00cb6a0 0x7f73b00c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.436+0000 7f73b6137700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00c6900 con 0x7f73b0156800 2022-08-10T17:47:49.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.436+0000 7f73b6137700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00ba910 con 0x7f73b00cb6a0 2022-08-10T17:47:49.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.436+0000 7f73b6137700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0157750 con 0x7f73b00c6530 2022-08-10T17:47:49.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73affff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f73b0156800 0x7f73b006d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53840/0 (socket says 172.21.15.150:53840) 2022-08-10T17:47:49.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73affff700 1 -- 172.21.15.150:0/2166113048 learned_addr learned my addr 172.21.15.150:0/2166113048 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:49.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f73b00bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73af7fe700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 msgr2=0x7f73b00bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:47:49.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73af7fe700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 msgr2=0x7f73b00bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:49.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f73b00bae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:49.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f73b00bae80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:49.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513761015 0 0) 0x7f73a8001490 con 0x7f73b0156800 2022-08-10T17:47:49.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739c003430 con 0x7f73b0156800 2022-08-10T17:47:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466871671 0 0) 0x7f739c003430 con 0x7f73b0156800 2022-08-10T17:47:49.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 msgr2=0x7f73b00bae80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f73b00bae80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 >> v2:172.21.15.150:3300/0 conn(0x7f73b00cb6a0 msgr2=0x7f73b00c5460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:47:49.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 --2- 172.21.15.150:0/2166113048 >> v2:172.21.15.150:3300/0 conn(0x7f73b00cb6a0 0x7f73b00c5460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00c59a0 con 0x7f73b0156800 2022-08-10T17:47:49.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f73a8001b80 con 0x7f73b0156800 2022-08-10T17:47:49.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 >> v1:172.21.15.150:6789/0 conn(0x7f73b0156800 legacy=0x7f73b006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:49.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f739c003880 0x7f739c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f739c0046d0 0x7f739c004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f739c0050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00ba910 con 0x7f739c003880 2022-08-10T17:47:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0157750 con 0x7f739c0046d0 2022-08-10T17:47:49.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.437+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c00baa0 con 0x7f73b00c6530 2022-08-10T17:47:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f739c003880 0x7f739c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73affff700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f739c0050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 msgr2=0x7f739c0050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:49.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b00c6530 0x7f739c0050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f739c0046d0 msgr2=0x7f739c004b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:47:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f739c0046d0 0x7f739c004b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 -- 172.21.15.150:0/2166113048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c003430 con 0x7f739c003880 2022-08-10T17:47:49.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f739c003880 0x7f739c003c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f73a000b8f0 tx=0x7f739c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650baa772d9bdb4a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:49.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0018070 con 0x7f739c003880 2022-08-10T17:47:49.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0004020 con 0x7f739c003880 2022-08-10T17:47:49.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.438+0000 7f73ae7fc700 1 -- 172.21.15.150:0/2166113048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00041d0 con 0x7f739c003880 2022-08-10T17:47:49.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.439+0000 7f73b6137700 1 -- 172.21.15.150:0/2166113048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f739c003880 msgr2=0x7f739c003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:49.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.439+0000 7f73b6137700 1 --2- 172.21.15.150:0/2166113048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f739c003880 0x7f739c003c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f73a000b8f0 tx=0x7f739c005700 comp rx=0 tx=0).stop 2022-08-10T17:47:49.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.439+0000 7f73affff700 1 -- 172.21.15.150:0/2166113048 reap_dead start 2022-08-10T17:47:49.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.439+0000 7f73b6137700 1 -- 172.21.15.150:0/2166113048 shutdown_connections 2022-08-10T17:47:49.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.439+0000 7f73b6137700 1 -- 172.21.15.150:0/2166113048 >> 172.21.15.150:0/2166113048 conn(0x7f73b006fae0 msgr2=0x7f73b006fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:49.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.449+0000 7f73b6137700 1 -- 172.21.15.150:0/2166113048 shutdown_connections 2022-08-10T17:47:49.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.450+0000 7f73b6137700 1 -- 172.21.15.150:0/2166113048 wait complete. 2022-08-10T17:47:49.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.452+0000 7f73b6137700 1 Processor -- start 2022-08-10T17:47:49.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.452+0000 7f73b6137700 1 -- start start 2022-08-10T17:47:49.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b01533b0 0x7f73b014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01dcee0 con 0x7f73b00c8c60 2022-08-10T17:47:49.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b014f900 con 0x7f73b01533b0 2022-08-10T17:47:49.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73b6137700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b014fba0 con 0x7f73b014a050 2022-08-10T17:47:49.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41168/0 (socket says 172.21.15.150:41168) 2022-08-10T17:47:49.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 -- 172.21.15.150:0/2219842754 learned_addr learned my addr 172.21.15.150:0/2219842754 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:49.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73affff700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73aeffd700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b01533b0 0x7f73b014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73affff700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 msgr2=0x7f73b01ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:47:49.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73affff700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 msgr2=0x7f73b01ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:49.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73affff700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:49.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73affff700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:49.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 msgr2=0x7f73b01ef490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:47:49.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b01533b0 msgr2=0x7f73b014e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:49.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b01533b0 0x7f73b014e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.453+0000 7f73af7fe700 1 -- 172.21.15.150:0/2219842754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b01dc920 con 0x7f73b00c8c60 2022-08-10T17:47:49.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f73af7fe700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f73a0016040 tx=0x7f73a0004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:49.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0018050 con 0x7f73b00c8c60 2022-08-10T17:47:49.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a001d440 con 0x7f73b00c8c60 2022-08-10T17:47:49.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b01dcc00 con 0x7f73b00c8c60 2022-08-10T17:47:49.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0006ce0 con 0x7f73b00c8c60 2022-08-10T17:47:49.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.454+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b0152550 con 0x7f73b00c8c60 2022-08-10T17:47:49.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.456+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0157190 con 0x7f73b00c8c60 2022-08-10T17:47:49.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.456+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f73a001d7f0 con 0x7f73b00c8c60 2022-08-10T17:47:49.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.456+0000 7f7397fff700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 0x7f73900675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:49.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.457+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f73a0082f40 con 0x7f73b00c8c60 2022-08-10T17:47:49.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.457+0000 7f73aeffd700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 0x7f73900675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:49.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.457+0000 7f73aeffd700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 0x7f73900675e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73b0153780 tx=0x7f73a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:49.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.464+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f73a00b36b0 con 0x7f73b00c8c60 2022-08-10T17:47:49.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.850+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f73b00c7fd0 con 0x7f73b00c8c60 2022-08-10T17:47:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.851+0000 7f7397fff700 1 -- 172.21.15.150:0/2219842754 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1518 (secure 0 0 0) 0x7f73a0050fc0 con 0x7f73b00c8c60 2022-08-10T17:47:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 msgr2=0x7f73900675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 0x7f73900675e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73b0153780 tx=0x7f73a4008040 comp rx=0 tx=0).stop 2022-08-10T17:47:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 msgr2=0x7f73b014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f73a0016040 tx=0x7f73a0004640 comp rx=0 tx=0).stop 2022-08-10T17:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 shutdown_connections 2022-08-10T17:47:49.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7390065130 0x7f73900675e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f73b014a050 0x7f73b01ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73b00c8c60 0x7f73b014e310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 --2- 172.21.15.150:0/2219842754 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f73b01533b0 0x7f73b014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 >> 172.21.15.150:0/2219842754 conn(0x7f73b006fae0 msgr2=0x7f73b01546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 shutdown_connections 2022-08-10T17:47:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:49.853+0000 7f73b6137700 1 -- 172.21.15.150:0/2219842754 wait complete. 2022-08-10T17:47:49.875 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:47:49.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:47:50.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.007+0000 7fb771e79700 1 Processor -- start 2022-08-10T17:47:50.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.007+0000 7fb771e79700 1 -- start start 2022-08-10T17:47:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.007+0000 7fb771e79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb76c0c4d90 0x7fb76c0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb771e79700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb771e79700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c0699c0 con 0x7fb76c0c2080 2022-08-10T17:47:50.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb771e79700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c0c5e10 con 0x7fb76c0c4d90 2022-08-10T17:47:50.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb771e79700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0c1c30 con 0x7fb76c0c7220 2022-08-10T17:47:50.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb76c0c4d90 0x7fb76c0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76bfff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fb76c0c2080 0x7fb76c0c2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40212/0 (socket says 172.21.15.150:40212) 2022-08-10T17:47:50.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb76c0c4d90 0x7fb76c0c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41178/0 (socket says 172.21.15.150:41178) 2022-08-10T17:47:50.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76bfff700 1 -- 172.21.15.150:0/1027323302 learned_addr learned my addr 172.21.15.150:0/1027323302 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:50.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76affd700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 -- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 msgr2=0x7fb76c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:50.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76affd700 1 -- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 msgr2=0x7fb76c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:47:50.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76a7fc700 1 -- 172.21.15.150:0/1027323302 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292623195 0 0) 0x7fb76c0699c0 con 0x7fb76c0c2080 2022-08-10T17:47:50.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76affd700 1 -- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 msgr2=0x7fb76c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:47:50.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76affd700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:50.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76affd700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:50.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 -- 172.21.15.150:0/1027323302 >> v1:172.21.15.197:6789/0 conn(0x7fb76c0c2080 legacy=0x7fb76c0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 -- 172.21.15.150:0/1027323302 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c068e40 con 0x7fb76c0c4d90 2022-08-10T17:47:50.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.008+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c0c5160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0096e0 tx=0x7fb75c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbffea2e8cd2ef18 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.018 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.009+0000 7fb76a7fc700 1 -- 172.21.15.150:0/1027323302 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011830 con 0x7fb76c0c4d90 2022-08-10T17:47:50.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.009+0000 7fb76a7fc700 1 -- 172.21.15.150:0/1027323302 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c011990 con 0x7fb76c0c4d90 2022-08-10T17:47:50.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.009+0000 7fb76a7fc700 1 -- 172.21.15.150:0/1027323302 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011d20 con 0x7fb76c0c4d90 2022-08-10T17:47:50.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.009+0000 7fb771e79700 1 -- 172.21.15.150:0/1027323302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 msgr2=0x7fb76c0c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.019 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.009+0000 7fb771e79700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c0c5160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0096e0 tx=0x7fb75c0099f0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 -- 172.21.15.150:0/1027323302 shutdown_connections 2022-08-10T17:47:50.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c0c5160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 --2- 172.21.15.150:0/1027323302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c7220 0x7fb76c0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 -- 172.21.15.150:0/1027323302 >> 172.21.15.150:0/1027323302 conn(0x7fb76c06d0d0 msgr2=0x7fb76c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:50.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 -- 172.21.15.150:0/1027323302 shutdown_connections 2022-08-10T17:47:50.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.011+0000 7fb771e79700 1 -- 172.21.15.150:0/1027323302 wait complete. 2022-08-10T17:47:50.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.012+0000 7fb771e79700 1 Processor -- start 2022-08-10T17:47:50.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 -- start start 2022-08-10T17:47:50.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c2080 0x7fb76c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb76c0c7220 0x7fb76c14b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0c92f0 con 0x7fb76c0c4d90 2022-08-10T17:47:50.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1511b0 con 0x7fb76c0c7220 2022-08-10T17:47:50.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.013+0000 7fb771e79700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c151d30 con 0x7fb76c0c2080 2022-08-10T17:47:50.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41186/0 (socket says 172.21.15.150:41186) 2022-08-10T17:47:50.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 -- 172.21.15.150:0/2956439449 learned_addr learned my addr 172.21.15.150:0/2956439449 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:50.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76bfff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb76c0c7220 0x7fb76c14b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c2080 msgr2=0x7fb76c1521c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:47:50.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb76c0c2080 0x7fb76c1521c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb76c0c7220 msgr2=0x7fb76c14b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb76c0c7220 0x7fb76c14b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009310 con 0x7fb76c0c4d90 2022-08-10T17:47:50.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb76affd700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c152700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb76000d7d0 tx=0x7fb76000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600125f0 con 0x7fb76c0c4d90 2022-08-10T17:47:50.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760012770 con 0x7fb76c0c4d90 2022-08-10T17:47:50.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c151470 con 0x7fb76c0c4d90 2022-08-10T17:47:50.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760012b20 con 0x7fb76c0c4d90 2022-08-10T17:47:50.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.014+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c0c01b0 con 0x7fb76c0c4d90 2022-08-10T17:47:50.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.015+0000 7fb771e79700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 0x7fb76c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.015+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0672f0 con 0x7fb76c14be80 2022-08-10T17:47:50.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 0x7fb76c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb76b7fe700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb76c151e70 con 0x7fb76c14be80 2022-08-10T17:47:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 0x7fb76c151640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0096e0 tx=0x7fb75c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb760012c80 con 0x7fb76c0c4d90 2022-08-10T17:47:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb753fff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb74c065050 0x7fb74c067500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb760082430 con 0x7fb76c0c4d90 2022-08-10T17:47:50.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb76bfff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb74c065050 0x7fb74c067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.016+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c003720 con 0x7fb76c14be80 2022-08-10T17:47:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fb75c01f070 con 0x7fb76c14be80 2022-08-10T17:47:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 msgr2=0x7fb76c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb753fff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 0x7fb76c151640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0096e0 tx=0x7fb75c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 msgr2=0x7fb76c151640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:50.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb753fff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c14be80 0x7fb76c151640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.017+0000 7fb76bfff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb74c065050 0x7fb74c067500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7640012e0 tx=0x7fb764007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.027+0000 7fb771e79700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 0x7fb76c149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.027+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c151b80 con 0x7fb76c149950 2022-08-10T17:47:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.027+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 0x7fb76c149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.027+0000 7fb76b7fe700 1 -- 172.21.15.150:0/2956439449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb76c1610d0 con 0x7fb76c149950 2022-08-10T17:47:50.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.027+0000 7fb76b7fe700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 0x7fb76c149d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c0090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c02a040 con 0x7fb76c149950 2022-08-10T17:47:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7fb75c02e030 con 0x7fb76c149950 2022-08-10T17:47:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 msgr2=0x7fb76c149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 0x7fb76c149d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c0090e0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 msgr2=0x7fb76c149d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:50.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb753fff700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c149950 0x7fb76c149d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.037 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:47:50.038 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:50.038 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:50.038 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:47:50.038 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:47:50.039 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:47:50.039 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:47:50.039 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:47:50.039 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:47:50.039 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.040 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:47:50.040 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:50.040 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:47:50.040 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:47:50.041 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.041 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.041 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.041 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.042 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.042 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.042 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.042 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.042 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.043 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.043 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:47:50.043 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:47:50.043 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.044 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.044 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.044 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.044 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.044 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.045 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.045 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.045 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.045 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.046 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:47:50.046 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:47:50.046 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:47:50.047 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:47:50.047 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:47:50.047 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:47:50.047 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:50.047 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:50.048 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:47:50.048 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:47:50.048 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:47:50.048 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:47:50.049 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:47:50.049 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:47:50.049 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:50.049 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:47:50.049 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.050 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.050 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.050 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.050 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.051 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.051 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.051 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.051 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.052 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.052 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:47:50.052 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.052 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:47:50.052 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.053 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:50.053 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:50.053 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.053 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.054 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.054 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.054 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:47:50.054 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.055 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.055 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.055 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.055 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:47:50.056 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.056 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.056 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.056 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.056 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:47:50.057 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:47:50.057 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.057 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.057 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.058 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.058 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:50.058 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:50.059 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.059 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.059 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.059 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.059 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:47:50.060 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.060 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.060 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.060 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.061 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:47:50.061 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.061 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.061 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.062 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:47:50.062 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:47:50.062 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.063 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.063 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.064 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:50.064 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:50.064 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.064 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.065 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.065 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:47:50.065 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.065 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.066 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.066 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.066 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:47:50.066 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.067 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.067 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.067 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:47:50.068 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:47:50.068 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.068 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.068 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.069 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.069 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.069 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:47:50.070 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:47:50.070 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.070 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.070 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.071 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:50.071 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.071 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.071 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:47:50.072 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.072 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.072 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.072 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:47:50.073 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.073 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.073 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:47:50.073 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.074 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.074 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.074 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:47:50.075 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.075 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.075 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:47:50.076 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:47:50.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb74c065050 msgr2=0x7fb74c067500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb74c065050 0x7fb74c067500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7640012e0 tx=0x7fb764007f60 comp rx=0 tx=0).stop 2022-08-10T17:47:50.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 msgr2=0x7fb76c152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 --2- 172.21.15.150:0/2956439449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb76c0c4d90 0x7fb76c152700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb76000d7d0 tx=0x7fb76000dae0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb76bfff700 1 -- 172.21.15.150:0/2956439449 reap_dead start 2022-08-10T17:47:50.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb76bfff700 1 -- 172.21.15.150:0/2956439449 reap_dead start 2022-08-10T17:47:50.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 shutdown_connections 2022-08-10T17:47:50.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.028+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 >> 172.21.15.150:0/2956439449 conn(0x7fb76c06d0d0 msgr2=0x7fb76c0ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:50.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.029+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 shutdown_connections 2022-08-10T17:47:50.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.029+0000 7fb771e79700 1 -- 172.21.15.150:0/2956439449 wait complete. 2022-08-10T17:47:50.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:47:50.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.224+0000 7fe7e13c2700 1 Processor -- start 2022-08-10T17:47:50.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.224+0000 7fe7e13c2700 1 -- start start 2022-08-10T17:47:50.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7e13c2700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe7dc0c7850 0x7fe7dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7e13c2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc0c7cb0 con 0x7fe7dc151290 2022-08-10T17:47:50.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7e13c2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc0c1f40 con 0x7fe7dc158170 2022-08-10T17:47:50.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7e13c2700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc069130 con 0x7fe7dc0c7850 2022-08-10T17:47:50.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7daffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe7dc151290 0x7fe7dc157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53878/0 (socket says 172.21.15.150:53878) 2022-08-10T17:47:50.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7daffd700 1 -- 172.21.15.150:0/1387325264 learned_addr learned my addr 172.21.15.150:0/1387325264 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:50.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.225+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/1387325264 >> v2:172.21.15.197:3300/0 conn(0x7fe7dc0c7850 0x7fe7dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846237146 0 0) 0x7fe7dc0c7cb0 con 0x7fe7dc151290 2022-08-10T17:47:50.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c8003430 con 0x7fe7dc151290 2022-08-10T17:47:50.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514642842 0 0) 0x7fe7dc0c1f40 con 0x7fe7dc158170 2022-08-10T17:47:50.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7dc0c7cb0 con 0x7fe7dc158170 2022-08-10T17:47:50.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7db7fe700 1 -- 172.21.15.150:0/1387325264 >> v1:172.21.15.197:6789/0 conn(0x7fe7dc158170 legacy=0x7fe7dc0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7db7fe700 1 -- 172.21.15.150:0/1387325264 >> v1:172.21.15.150:6789/0 conn(0x7fe7dc151290 legacy=0x7fe7dc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7db7fe700 1 -- 172.21.15.150:0/1387325264 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0c2220 con 0x7fe7dc0c7850 2022-08-10T17:47:50.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/1387325264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009d90 tx=0x7fe7d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae88ffb48e7607e5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400e070 con 0x7fe7dc0c7850 2022-08-10T17:47:50.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400bb20 con 0x7fe7dc0c7850 2022-08-10T17:47:50.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.226+0000 7fe7d9ffb700 1 -- 172.21.15.150:0/1387325264 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400be90 con 0x7fe7dc0c7850 2022-08-10T17:47:50.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 -- 172.21.15.150:0/1387325264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc0c7850 msgr2=0x7fe7dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/1387325264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009d90 tx=0x7fe7d400b330 comp rx=0 tx=0).stop 2022-08-10T17:47:50.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 -- 172.21.15.150:0/1387325264 shutdown_connections 2022-08-10T17:47:50.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/1387325264 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc068bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 -- 172.21.15.150:0/1387325264 >> 172.21.15.150:0/1387325264 conn(0x7fe7dc06f880 msgr2=0x7fe7dc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:50.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 -- 172.21.15.150:0/1387325264 shutdown_connections 2022-08-10T17:47:50.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.227+0000 7fe7e13c2700 1 -- 172.21.15.150:0/1387325264 wait complete. 2022-08-10T17:47:50.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.228+0000 7fe7e13c2700 1 Processor -- start 2022-08-10T17:47:50.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.228+0000 7fe7e13c2700 1 -- start start 2022-08-10T17:47:50.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc151290 0x7fe7dc0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7dc158170 0x7fe7dc1efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0cb320 con 0x7fe7dc0c7850 2022-08-10T17:47:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c95f0 con 0x7fe7dc151290 2022-08-10T17:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7e13c2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1f0620 con 0x7fe7dc158170 2022-08-10T17:47:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41204/0 (socket says 172.21.15.150:41204) 2022-08-10T17:47:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 -- 172.21.15.150:0/3350928337 learned_addr learned my addr 172.21.15.150:0/3350928337 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc151290 0x7fe7dc0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7dc158170 0x7fe7dc1efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7dc158170 msgr2=0x7fe7dc1efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7dc158170 0x7fe7dc1efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc151290 msgr2=0x7fe7dc0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc151290 0x7fe7dc0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7daffd700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009a70 con 0x7fe7dc0c7850 2022-08-10T17:47:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe7dc158170 0x7fe7dc1efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:47:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.229+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc151290 0x7fe7dc0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:47:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7daffd700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc0c9a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00c3c0 tx=0x7fe7cc00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0072d0 con 0x7fe7dc0c7850 2022-08-10T17:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc007430 con 0x7fe7dc0c7850 2022-08-10T17:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0058b0 con 0x7fe7dc0c7850 2022-08-10T17:47:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc157e10 con 0x7fe7dc0c7850 2022-08-10T17:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.230+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc0c8fa0 con 0x7fe7dc0c7850 2022-08-10T17:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 0x7fe7dc140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0644b0 con 0x7fe7dc1f0130 2022-08-10T17:47:50.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 0x7fe7dc140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7da7fc700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7dc0c9730 con 0x7fe7dc1f0130 2022-08-10T17:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 0x7fe7dc140e90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0c2860 tx=0x7fe7d000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.231+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe7cc019030 con 0x7fe7dc0c7850 2022-08-10T17:47:50.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.232+0000 7fe7c37fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7bc0650b0 0x7fe7bc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.232+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe7cc0812d0 con 0x7fe7dc0c7850 2022-08-10T17:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.232+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7bc0650b0 0x7fe7bc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.233+0000 7fe7db7fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7bc0650b0 0x7fe7bc067560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009fd0 tx=0x7fe7d4011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00050d0 con 0x7fe7dc1f0130 2022-08-10T17:47:50.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe7d0005230 con 0x7fe7dc1f0130 2022-08-10T17:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 msgr2=0x7fe7dc140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 0x7fe7dc140e90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0c2860 tx=0x7fe7d000e720 comp rx=0 tx=0).stop 2022-08-10T17:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 msgr2=0x7fe7dc140e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:50.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.234+0000 7fe7c37fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc1f0130 0x7fe7dc140e90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.244+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 0x7fe7dc1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.244+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c98d0 con 0x7fe7dc068cd0 2022-08-10T17:47:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.244+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 0x7fe7dc1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7da7fc700 1 -- 172.21.15.150:0/3350928337 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe7dc071e10 con 0x7fe7dc068cd0 2022-08-10T17:47:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7da7fc700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 0x7fe7dc1413d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0c2860 tx=0x7fe7d0000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0014890 con 0x7fe7dc068cd0 2022-08-10T17:47:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7fe7d00149f0 con 0x7fe7dc068cd0 2022-08-10T17:47:50.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 msgr2=0x7fe7dc1413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 0x7fe7dc1413d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0c2860 tx=0x7fe7d0000ed0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 msgr2=0x7fe7dc1413d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:50.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.247+0000 7fe7c37fe700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe7dc068cd0 0x7fe7dc1413d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.269 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:47:50.269 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:50.270 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:50.270 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:47:50.270 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:47:50.270 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:47:50.271 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:47:50.271 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:47:50.271 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:47:50.271 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.272 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:47:50.272 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:50.272 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:47:50.272 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:47:50.273 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.273 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.273 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.273 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.273 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.274 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.274 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.274 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.275 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.275 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:47:50.275 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:47:50.275 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.276 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.276 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.276 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.276 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.276 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.277 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.277 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.277 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.277 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.278 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:47:50.278 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:47:50.279 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:47:50.279 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:47:50.279 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:47:50.279 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:47:50.280 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:50.280 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:50.280 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:47:50.280 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:47:50.280 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:47:50.281 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:47:50.281 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:47:50.281 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:47:50.281 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:50.282 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:47:50.282 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:50.282 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:50.282 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:50.283 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:50.283 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:50.283 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:50.283 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:50.284 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:50.284 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:50.284 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.284 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:47:50.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.285 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:47:50.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.285 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:50.285 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:50.286 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.286 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.286 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.286 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:47:50.287 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.287 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.288 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:47:50.288 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.288 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.288 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.289 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:47:50.289 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:47:50.290 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.290 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.290 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.291 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:50.291 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:50.291 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.292 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.292 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.292 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:47:50.293 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.294 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.294 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:47:50.294 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.294 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.295 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.295 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:47:50.295 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:47:50.296 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.296 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.296 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.297 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:50.297 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:50.297 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:50.298 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:50.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.298 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:50.298 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:47:50.298 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.299 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:50.300 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:47:50.300 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:50.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.300 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.301 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:47:50.301 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:47:50.301 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:50.302 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:50.302 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:50.302 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.302 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.303 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:47:50.303 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:47:50.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.304 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.304 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.304 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:50.304 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.304 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.305 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:47:50.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.305 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.305 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.306 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:47:50.306 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.306 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:47:50.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.307 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.307 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.307 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:47:50.307 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.308 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.308 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:47:50.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.308 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:47:50.309 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.309 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:50.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.310 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.310 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.310 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:47:50.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.311 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:50.311 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:47:50.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:50.311 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:50.312 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:50.312 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:47:50.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:50.312 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:47:50.313 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:47:50.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7bc0650b0 msgr2=0x7fe7bc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe7bc0650b0 0x7fe7bc067560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009fd0 tx=0x7fe7d4011000 comp rx=0 tx=0).stop 2022-08-10T17:47:50.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 msgr2=0x7fe7dc0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 --2- 172.21.15.150:0/3350928337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7dc0c7850 0x7fe7dc0c9a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00c3c0 tx=0x7fe7cc00c780 comp rx=0 tx=0).stop 2022-08-10T17:47:50.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7db7fe700 1 -- 172.21.15.150:0/3350928337 reap_dead start 2022-08-10T17:47:50.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7db7fe700 1 -- 172.21.15.150:0/3350928337 reap_dead start 2022-08-10T17:47:50.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 shutdown_connections 2022-08-10T17:47:50.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 >> 172.21.15.150:0/3350928337 conn(0x7fe7dc06f880 msgr2=0x7fe7dc146b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:50.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 shutdown_connections 2022-08-10T17:47:50.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.248+0000 7fe7e13c2700 1 -- 172.21.15.150:0/3350928337 wait complete. 2022-08-10T17:47:50.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:47:50.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.456+0000 7f20d4e7c700 1 Processor -- start 2022-08-10T17:47:50.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.456+0000 7f20d4e7c700 1 -- start start 2022-08-10T17:47:50.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.456+0000 7f20d4e7c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 0x7f20d0071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.456+0000 7f20d4e7c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20d00c80e0 0x7f20d00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.456+0000 7f20d4e7c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d00c79e0 0x7f20d00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20d4e7c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00c89e0 con 0x7f20d00c80e0 2022-08-10T17:47:50.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20d4e7c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00c8cc0 con 0x7f20d0150aa0 2022-08-10T17:47:50.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20d4e7c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00c8fa0 con 0x7f20d00c79e0 2022-08-10T17:47:50.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20d00c80e0 0x7f20d00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20d00c80e0 0x7f20d00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41218/0 (socket says 172.21.15.150:41218) 2022-08-10T17:47:50.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 -- 172.21.15.150:0/1745524134 learned_addr learned my addr 172.21.15.150:0/1745524134 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:50.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20ced9d700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d00c79e0 0x7f20d00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20ce59c700 1 --2- 172.21.15.150:0/1745524134 >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 0x7f20d0071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 -- 172.21.15.150:0/1745524134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d00c79e0 msgr2=0x7f20d00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:50.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d00c79e0 0x7f20d00c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 -- 172.21.15.150:0/1745524134 >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 msgr2=0x7f20d0071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:50.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/1745524134 >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 0x7f20d0071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 -- 172.21.15.150:0/1745524134 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00c9280 con 0x7f20d00c80e0 2022-08-10T17:47:50.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20ce59c700 1 --2- 172.21.15.150:0/1745524134 >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 0x7f20d0071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:47:50.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d00c9740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20d008a120 tx=0x7f20b8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c17f72ce291566 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cd59a700 1 -- 172.21.15.150:0/1745524134 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004230 con 0x7f20d00c80e0 2022-08-10T17:47:50.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cd59a700 1 -- 172.21.15.150:0/1745524134 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8004390 con 0x7f20d00c80e0 2022-08-10T17:47:50.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.457+0000 7f20cd59a700 1 -- 172.21.15.150:0/1745524134 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8011830 con 0x7f20d00c80e0 2022-08-10T17:47:50.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 -- 172.21.15.150:0/1745524134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 msgr2=0x7f20d00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d00c9740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20d008a120 tx=0x7f20b8009a60 comp rx=0 tx=0).stop 2022-08-10T17:47:50.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 -- 172.21.15.150:0/1745524134 shutdown_connections 2022-08-10T17:47:50.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d00c79e0 0x7f20d00c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/1745524134 >> v2:172.21.15.197:3300/0 conn(0x7f20d0150aa0 0x7f20d0071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/1745524134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d00c9740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 -- 172.21.15.150:0/1745524134 >> 172.21.15.150:0/1745524134 conn(0x7f20d0068d60 msgr2=0x7f20d0071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:50.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 -- 172.21.15.150:0/1745524134 shutdown_connections 2022-08-10T17:47:50.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.458+0000 7f20d4e7c700 1 -- 172.21.15.150:0/1745524134 wait complete. 2022-08-10T17:47:50.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.459+0000 7f20d4e7c700 1 Processor -- start 2022-08-10T17:47:50.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.459+0000 7f20d4e7c700 1 -- start start 2022-08-10T17:47:50.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20d00c79e0 0x7f20d01ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d0150aa0 0x7f20d01e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d014ca50 con 0x7f20d00c80e0 2022-08-10T17:47:50.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d014bef0 con 0x7f20d00c79e0 2022-08-10T17:47:50.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20d4e7c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d014c1b0 con 0x7f20d0150aa0 2022-08-10T17:47:50.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20cdd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20cdd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d014ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41226/0 (socket says 172.21.15.150:41226) 2022-08-10T17:47:50.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20cdd9b700 1 -- 172.21.15.150:0/2344626608 learned_addr learned my addr 172.21.15.150:0/2344626608 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:50.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20d00c79e0 0x7f20d01ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.460+0000 7f20ced9d700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d0150aa0 0x7f20d01e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d0150aa0 msgr2=0x7f20d01e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d0150aa0 0x7f20d01e3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20d00c79e0 msgr2=0x7f20d01ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f20d00c79e0 0x7f20d01ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80093e0 con 0x7f20d00c80e0 2022-08-10T17:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20cdd9b700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d014ce60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009aa0 tx=0x7f20b80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003720 con 0x7f20d00c80e0 2022-08-10T17:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b801f070 con 0x7f20d00c80e0 2022-08-10T17:47:50.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d014c490 con 0x7f20d00c80e0 2022-08-10T17:47:50.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003ac0 con 0x7f20d00c80e0 2022-08-10T17:47:50.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.461+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01eb9a0 con 0x7f20d00c80e0 2022-08-10T17:47:50.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00673d0 con 0x7f20d01eedc0 2022-08-10T17:47:50.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2022-08-10T17:47:50.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:50.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:50.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:47:50.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.462+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f20b8017020 con 0x7f20d00c80e0 2022-08-10T17:47:50.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.463+0000 7f20c6ffd700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20b40650b0 0x7f20b4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:50.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.463+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f20b8021070 con 0x7f20d00c80e0 2022-08-10T17:47:50.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.463+0000 7f20ced9d700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20b40650b0 0x7f20b4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.463+0000 7f20ced9d700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20b40650b0 0x7f20b4067560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006a20 tx=0x7f20c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:50.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.663+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:50.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.663+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:47:50.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.663+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:50.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.663+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:50.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:50.663+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:47:51.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.064+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:51.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.064+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:47:51.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.064+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:51.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.064+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:51.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.064+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:47:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.865+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.865+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:47:51.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.865+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:47:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.865+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:47:51.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:51.865+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:47:53.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.467+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.467+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20d01eb800 con 0x7f20d01eedc0 2022-08-10T17:47:53.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.467+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20c000fad0 tx=0x7f20c000fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:53.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c000ed20 con 0x7f20d01eedc0 2022-08-10T17:47:53.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f20c000ee80 con 0x7f20d01eedc0 2022-08-10T17:47:53.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20c000fad0 tx=0x7f20c000fe90 comp rx=0 tx=0).stop 2022-08-10T17:47:53.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 msgr2=0x7f20d01ebb90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:53.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.468+0000 7f20c6ffd700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01eedc0 0x7f20d01ebb90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.482+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 0x7f20d014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.482+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0072890 con 0x7f20d01579a0 2022-08-10T17:47:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.484+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 0x7f20d014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.485+0000 7f20ce59c700 1 -- 172.21.15.150:0/2344626608 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f20d0157180 con 0x7f20d01579a0 2022-08-10T17:47:53.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.485+0000 7f20ce59c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 0x7f20d014ae30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20c000fad0 tx=0x7f20c0004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:53.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.485+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0019c40 con 0x7f20d01579a0 2022-08-10T17:47:53.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.486+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4376 (secure 0 0 0) 0x7f20c0019da0 con 0x7f20d01579a0 2022-08-10T17:47:53.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.486+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 msgr2=0x7f20d014ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.486+0000 7f20c6ffd700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 0x7f20d014ae30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20c000fad0 tx=0x7f20c0004950 comp rx=0 tx=0).stop 2022-08-10T17:47:53.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.486+0000 7f20c6ffd700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 msgr2=0x7f20d014ae30 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:47:53.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.486+0000 7f20c6ffd700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f20d01579a0 0x7f20d014ae30 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20c000fad0 tx=0x7f20c0004950 comp rx=0 tx=0).stop 2022-08-10T17:47:53.493 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:47:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:47:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:47:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:47:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:47:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:47:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:47:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 6, 2022-08-10T17:47:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:47:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:47:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:47:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:47:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:47:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:47:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:47:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:47:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:47:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:47:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:53.505 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:47:53.505 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:47:53.505 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:47:53.505 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:47:53.505 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:47:53.506 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:47:53.506 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:47:53.506 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:47:53.506 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:47:53.507 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:47:53.507 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:47:53.507 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:47:53.507 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:47:53.508 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:47:53.508 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:47:53.508 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:47:53.508 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:47:53.508 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:47:53.509 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:53.509 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:47:53.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.509 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:47:53.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.510 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:47:53.510 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:47:53.510 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:53.511 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:53.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.511 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:53.511 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:47:53.512 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.512 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:53.512 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:47:53.513 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.513 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.513 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.514 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:47:53.514 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:47:53.514 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:53.514 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:53.514 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:53.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.515 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:47:53.515 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:47:53.516 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:53.516 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:53.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.516 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:53.517 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:47:53.517 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.517 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:53.518 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:47:53.518 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.518 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.518 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.519 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:47:53.519 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:47:53.519 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:53.519 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:53.520 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:53.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.520 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:47:53.521 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:47:53.521 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:47:53.521 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:47:53.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.521 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:47:53.522 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:47:53.522 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:47:53.523 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:47:53.523 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:47:53.523 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.524 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.524 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:47:53.524 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:47:53.524 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:47:53.525 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:47:53.525 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:47:53.525 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.525 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.526 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:47:53.526 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:47:53.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.527 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:53.527 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:53.527 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:53.527 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.527 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:47:53.528 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:47:53.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:47:53.528 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:47:53.528 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:47:53.529 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:47:53.529 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:47:53.529 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:47:53.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:47:53.530 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:47:53.530 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:47:53.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.492+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20b40650b0 msgr2=0x7f20b4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.492+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f20b40650b0 0x7f20b4067560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006a20 tx=0x7f20c8008040 comp rx=0 tx=0).stop 2022-08-10T17:47:53.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.492+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 msgr2=0x7f20d014ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.492+0000 7f20d4e7c700 1 --2- 172.21.15.150:0/2344626608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20d00c80e0 0x7f20d014ce60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009aa0 tx=0x7f20b80045d0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20ced9d700 1 -- 172.21.15.150:0/2344626608 reap_dead start 2022-08-10T17:47:53.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20ced9d700 1 -- 172.21.15.150:0/2344626608 reap_dead start 2022-08-10T17:47:53.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 shutdown_connections 2022-08-10T17:47:53.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 >> 172.21.15.150:0/2344626608 conn(0x7f20d0068d60 msgr2=0x7f20d00c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:53.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 shutdown_connections 2022-08-10T17:47:53.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.493+0000 7f20d4e7c700 1 -- 172.21.15.150:0/2344626608 wait complete. 2022-08-10T17:47:53.534 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:47:53.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:47:53.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.683+0000 7ff532699700 1 Processor -- start 2022-08-10T17:47:53.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.683+0000 7ff532699700 1 -- start start 2022-08-10T17:47:53.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.684+0000 7ff532699700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c0c8af0 0x7ff52c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.684+0000 7ff532699700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c06e070 con 0x7ff52c0c96b0 2022-08-10T17:47:53.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.684+0000 7ff532699700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0701c0 con 0x7ff52c0c3340 2022-08-10T17:47:53.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.684+0000 7ff532699700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c0c37e0 con 0x7ff52c0c8af0 2022-08-10T17:47:53.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.685+0000 7ff530c36700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7ff52c0c3340 0x7ff52c167340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40288/0 (socket says 172.21.15.150:40288) 2022-08-10T17:47:53.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.685+0000 7ff530c36700 1 -- 172.21.15.150:0/2719362488 learned_addr learned my addr 172.21.15.150:0/2719362488 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:47:53.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.685+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436563997 0 0) 0x7ff52c0701c0 con 0x7ff52c0c3340 2022-08-10T17:47:53.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.685+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff518003430 con 0x7ff52c0c3340 2022-08-10T17:47:53.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.685+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523009396 0 0) 0x7ff518003430 con 0x7ff52c0c3340 2022-08-10T17:47:53.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c0c8af0 msgr2=0x7ff52c0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:53.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c0c8af0 0x7ff52c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c0c8af0 0x7ff52c0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 >> v1:172.21.15.150:6789/0 conn(0x7ff52c0c96b0 legacy=0x7ff52c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:53.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c06da60 con 0x7ff52c0c3340 2022-08-10T17:47:53.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7ff524001690 con 0x7ff52c0c3340 2022-08-10T17:47:53.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 >> v1:172.21.15.197:6789/0 conn(0x7ff52c0c3340 legacy=0x7ff52c167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff518003880 0x7ff518003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180046d0 0x7ff518004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5180050d0 0x7ff51800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51800bf60 con 0x7ff5180046d0 2022-08-10T17:47:53.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51800c0a0 con 0x7ff518003880 2022-08-10T17:47:53.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51800c260 con 0x7ff5180050d0 2022-08-10T17:47:53.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c0c8af0 0x7ff52c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:47:53.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5180050d0 0x7ff51800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff518003880 0x7ff518003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 -- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff518003880 msgr2=0x7ff518003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:53.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff518003880 0x7ff518003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 -- 172.21.15.150:0/2719362488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180046d0 msgr2=0x7ff518004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:47:53.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180046d0 0x7ff518004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff530c36700 1 -- 172.21.15.150:0/2719362488 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c06da60 con 0x7ff5180050d0 2022-08-10T17:47:53.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.686+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff518003880 0x7ff518003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:47:53.699 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.687+0000 7ff530c36700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5180050d0 0x7ff51800b890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff524001f70 tx=0x7ff518005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416372ea4a8e3f4f server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:53.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.687+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400db30 con 0x7ff5180050d0 2022-08-10T17:47:53.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.687+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400dc90 con 0x7ff5180050d0 2022-08-10T17:47:53.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.687+0000 7ff52affd700 1 -- 172.21.15.150:0/2719362488 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240020c0 con 0x7ff5180050d0 2022-08-10T17:47:53.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.688+0000 7ff532699700 1 -- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5180050d0 msgr2=0x7ff51800b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.688+0000 7ff532699700 1 --2- 172.21.15.150:0/2719362488 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5180050d0 0x7ff51800b890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff524001f70 tx=0x7ff518005700 comp rx=0 tx=0).stop 2022-08-10T17:47:53.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.688+0000 7ff530c36700 1 -- 172.21.15.150:0/2719362488 reap_dead start 2022-08-10T17:47:53.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.688+0000 7ff532699700 1 -- 172.21.15.150:0/2719362488 shutdown_connections 2022-08-10T17:47:53.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.688+0000 7ff532699700 1 -- 172.21.15.150:0/2719362488 >> 172.21.15.150:0/2719362488 conn(0x7ff52c06b500 msgr2=0x7ff52c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:53.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.690+0000 7ff532699700 1 -- 172.21.15.150:0/2719362488 shutdown_connections 2022-08-10T17:47:53.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.691+0000 7ff532699700 1 -- 172.21.15.150:0/2719362488 wait complete. 2022-08-10T17:47:53.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.693+0000 7ff532699700 1 Processor -- start 2022-08-10T17:47:53.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.693+0000 7ff532699700 1 -- start start 2022-08-10T17:47:53.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff52c0bc4c0 0x7ff52c163620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c1ef7e0 0x7ff52c0bd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c163040 con 0x7ff5180050d0 2022-08-10T17:47:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c1fa510 con 0x7ff52c0bc4c0 2022-08-10T17:47:53.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff532699700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c163260 con 0x7ff52c1ef7e0 2022-08-10T17:47:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41264/0 (socket says 172.21.15.150:41264) 2022-08-10T17:47:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff52bfff700 1 -- 172.21.15.150:0/2956430540 learned_addr learned my addr 172.21.15.150:0/2956430540 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:47:53.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.694+0000 7ff52b7fe700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff52c0bc4c0 0x7ff52c163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 -- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c1ef7e0 msgr2=0x7ff52c0bd740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:47:53.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c1ef7e0 0x7ff52c0bd740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 -- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff52c0bc4c0 msgr2=0x7ff52c163620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:53.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff52c0bc4c0 0x7ff52c163620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:53.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 -- 172.21.15.150:0/2956430540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c1f9900 con 0x7ff5180050d0 2022-08-10T17:47:53.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff52bfff700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00f890 tx=0x7ff51c00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:53.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00dac0 con 0x7ff5180050d0 2022-08-10T17:47:53.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00c040 con 0x7ff5180050d0 2022-08-10T17:47:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.695+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00de20 con 0x7ff5180050d0 2022-08-10T17:47:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.696+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c1f9be0 con 0x7ff5180050d0 2022-08-10T17:47:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.696+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c1fa1a0 con 0x7ff5180050d0 2022-08-10T17:47:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.697+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c073340 con 0x7ff5180050d0 2022-08-10T17:47:53.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.699+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff51c025470 con 0x7ff5180050d0 2022-08-10T17:47:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.699+0000 7ff528ff9700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 0x7ff50c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:47:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.699+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff51c082b00 con 0x7ff5180050d0 2022-08-10T17:47:53.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.700+0000 7ff52b7fe700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 0x7ff50c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:47:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.701+0000 7ff52b7fe700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 0x7ff50c067590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff52c162ab0 tx=0x7ff520009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:47:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:53.705+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff51c050a10 con 0x7ff5180050d0 2022-08-10T17:47:54.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.052+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff52c072890 con 0x7ff5180050d0 2022-08-10T17:47:54.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.055+0000 7ff528ff9700 1 -- 172.21.15.150:0/2956430540 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff51c054030 con 0x7ff5180050d0 2022-08-10T17:47:54.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.057+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 msgr2=0x7ff50c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:54.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.057+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 0x7ff50c067590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff52c162ab0 tx=0x7ff520009040 comp rx=0 tx=0).stop 2022-08-10T17:47:54.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.057+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 msgr2=0x7ff52c162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:47:54.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.057+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00f890 tx=0x7ff51c00fc50 comp rx=0 tx=0).stop 2022-08-10T17:47:54.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 shutdown_connections 2022-08-10T17:47:54.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff50c0650e0 0x7ff50c067590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:54.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff52c1ef7e0 0x7ff52c0bd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:54.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180050d0 0x7ff52c162b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:54.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 --2- 172.21.15.150:0/2956430540 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff52c0bc4c0 0x7ff52c163620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:47:54.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.058+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 >> 172.21.15.150:0/2956430540 conn(0x7ff52c06b500 msgr2=0x7ff52c1666e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:47:54.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.061+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 shutdown_connections 2022-08-10T17:47:54.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:47:54.061+0000 7ff532699700 1 -- 172.21.15.150:0/2956430540 wait complete. 2022-08-10T17:47:54.082 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:48:04.084 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:48:04.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:04.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.211+0000 7f47a5ed2700 1 Processor -- start 2022-08-10T17:48:04.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.213+0000 7f47a5ed2700 1 -- start start 2022-08-10T17:48:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.214+0000 7f47a5ed2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47a00c3b80 0x7f47a006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.214+0000 7f47a5ed2700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f47a00c4420 0x7f47a00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.214+0000 7f47a5ed2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a006fa10 con 0x7f47a00c9a80 2022-08-10T17:48:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.214+0000 7f47a5ed2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a0154020 con 0x7f47a00c3b80 2022-08-10T17:48:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.214+0000 7f47a5ed2700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a006f0e0 con 0x7f47a00c4420 2022-08-10T17:48:04.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.217+0000 7f479ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f47a00c9a80 0x7f47a0153420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:53988/0 (socket says 172.21.15.150:53988) 2022-08-10T17:48:04.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.218+0000 7f479ffff700 1 -- 172.21.15.150:0/2325407780 learned_addr learned my addr 172.21.15.150:0/2325407780 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:04.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 --2- 172.21.15.150:0/2325407780 >> v2:172.21.15.197:3300/0 conn(0x7f47a00c4420 0x7f47a00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f479effd700 1 -- 172.21.15.150:0/2325407780 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067981758 0 0) 0x7f47a006fa10 con 0x7f47a00c9a80 2022-08-10T17:48:04.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f479effd700 1 -- 172.21.15.150:0/2325407780 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4780003430 con 0x7f47a00c9a80 2022-08-10T17:48:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 -- 172.21.15.150:0/2325407780 >> v2:172.21.15.150:3300/0 conn(0x7f47a00c3b80 msgr2=0x7f47a006fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 --2- 172.21.15.150:0/2325407780 >> v2:172.21.15.150:3300/0 conn(0x7f47a00c3b80 0x7f47a006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 -- 172.21.15.150:0/2325407780 >> v1:172.21.15.150:6789/0 conn(0x7f47a00c9a80 legacy=0x7f47a0153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 -- 172.21.15.150:0/2325407780 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a006f3c0 con 0x7f47a00c4420 2022-08-10T17:48:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f4796ffd700 1 --2- 172.21.15.150:0/2325407780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c4420 0x7f47a00703e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47a006e090 tx=0x7f4790009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230d4fbff1a8b31b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f479effd700 1 -- 172.21.15.150:0/2325407780 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900107b0 con 0x7f47a00c4420 2022-08-10T17:48:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f479effd700 1 -- 172.21.15.150:0/2325407780 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790010910 con 0x7f47a00c4420 2022-08-10T17:48:04.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.221+0000 7f479effd700 1 -- 172.21.15.150:0/2325407780 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790010ca0 con 0x7f47a00c4420 2022-08-10T17:48:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.222+0000 7f47a5ed2700 1 -- 172.21.15.150:0/2325407780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c4420 msgr2=0x7f47a00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.222+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/2325407780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c4420 0x7f47a00703e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47a006e090 tx=0x7f4790009990 comp rx=0 tx=0).stop 2022-08-10T17:48:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.224+0000 7f47a5ed2700 1 -- 172.21.15.150:0/2325407780 shutdown_connections 2022-08-10T17:48:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.224+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/2325407780 >> v2:172.21.15.150:3300/0 conn(0x7f47a00c3b80 0x7f47a006fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.224+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/2325407780 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c4420 0x7f47a00703e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.224+0000 7f47a5ed2700 1 -- 172.21.15.150:0/2325407780 >> 172.21.15.150:0/2325407780 conn(0x7f47a006abc0 msgr2=0x7f47a006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:04.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.225+0000 7f47a5ed2700 1 -- 172.21.15.150:0/2325407780 shutdown_connections 2022-08-10T17:48:04.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.226+0000 7f47a5ed2700 1 -- 172.21.15.150:0/2325407780 wait complete. 2022-08-10T17:48:04.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.227+0000 7f47a5ed2700 1 Processor -- start 2022-08-10T17:48:04.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.227+0000 7f47a5ed2700 1 -- start start 2022-08-10T17:48:04.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.228+0000 7f47a5ed2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f47a5ed2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47a00c4420 0x7f47a00bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f47a5ed2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c9a80 0x7f47a014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f47a5ed2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0156840 con 0x7f47a00c3b80 2022-08-10T17:48:04.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f47a5ed2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00beb00 con 0x7f47a00c9a80 2022-08-10T17:48:04.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f47a5ed2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0156a30 con 0x7f47a00c4420 2022-08-10T17:48:04.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41314/0 (socket says 172.21.15.150:41314) 2022-08-10T17:48:04.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 -- 172.21.15.150:0/709799836 learned_addr learned my addr 172.21.15.150:0/709799836 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:04.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f4796ffd700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47a00c4420 0x7f47a00bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479ffff700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c9a80 0x7f47a014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 -- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47a00c4420 msgr2=0x7f47a00bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47a00c4420 0x7f47a00bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 -- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c9a80 msgr2=0x7f47a014f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c9a80 0x7f47a014f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 -- 172.21.15.150:0/709799836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790009310 con 0x7f47a00c3b80 2022-08-10T17:48:04.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.229+0000 7f479f7fe700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f478800b3f0 tx=0x7f478800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.230+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011620 con 0x7f47a00c3b80 2022-08-10T17:48:04.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.230+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788011780 con 0x7f47a00c3b80 2022-08-10T17:48:04.238 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.230+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0156d10 con 0x7f47a00c3b80 2022-08-10T17:48:04.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.230+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011b30 con 0x7f47a00c3b80 2022-08-10T17:48:04.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.230+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a01572d0 con 0x7f47a00c3b80 2022-08-10T17:48:04.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.231+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a014f300 con 0x7f47a00c3b80 2022-08-10T17:48:04.239 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.231+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4788021070 con 0x7f47a00c3b80 2022-08-10T17:48:04.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.231+0000 7f479cff9700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 0x7f4784067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.232+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4788081e80 con 0x7f47a00c3b80 2022-08-10T17:48:04.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.232+0000 7f4796ffd700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 0x7f4784067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.232+0000 7f4796ffd700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 0x7f4784067590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4790009fd0 tx=0x7f4790008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.237+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f478804fe60 con 0x7f47a00c3b80 2022-08-10T17:48:04.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.614+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f47a014f0d0 con 0x7f47a00c3b80 2022-08-10T17:48:04.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.614+0000 7f479cff9700 1 -- 172.21.15.150:0/709799836 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f4788015020 con 0x7f47a00c3b80 2022-08-10T17:48:04.617 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:04.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 msgr2=0x7f4784067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 0x7f4784067590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4790009fd0 tx=0x7f4790008030 comp rx=0 tx=0).stop 2022-08-10T17:48:04.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 msgr2=0x7f47a00c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f478800b3f0 tx=0x7f478800b700 comp rx=0 tx=0).stop 2022-08-10T17:48:04.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 shutdown_connections 2022-08-10T17:48:04.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47a00c9a80 0x7f47a014f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a00c3b80 0x7f47a00c7f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f47840650e0 0x7f4784067590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 --2- 172.21.15.150:0/709799836 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47a00c4420 0x7f47a00bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 >> 172.21.15.150:0/709799836 conn(0x7f47a006abc0 msgr2=0x7f47a00c48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:04.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 shutdown_connections 2022-08-10T17:48:04.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.616+0000 7f47a5ed2700 1 -- 172.21.15.150:0/709799836 wait complete. 2022-08-10T17:48:04.631 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:48:04.631 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:48:04.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:48:04.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.779+0000 7f71082ad700 1 Processor -- start 2022-08-10T17:48:04.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.779+0000 7f71082ad700 1 -- start start 2022-08-10T17:48:04.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f71082ad700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f71000c96b0 0x7f71000c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f71082ad700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 0x7f71000c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f71082ad700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710006e070 con 0x7f71000c8af0 2022-08-10T17:48:04.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f71082ad700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710006ec10 con 0x7f71000c96b0 2022-08-10T17:48:04.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f71082ad700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c37c0 con 0x7f71000c3340 2022-08-10T17:48:04.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f7106049700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f71000c8af0 0x7f710006e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54006/0 (socket says 172.21.15.150:54006) 2022-08-10T17:48:04.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f7106049700 1 -- 172.21.15.150:0/2116021321 learned_addr learned my addr 172.21.15.150:0/2116021321 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:04.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f7105848700 1 --2- 172.21.15.150:0/2116021321 >> v2:172.21.15.197:3300/0 conn(0x7f71000c96b0 0x7f71000c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f710684a700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 0x7f71000c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.780+0000 7f7105047700 1 -- 172.21.15.150:0/2116021321 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241035864 0 0) 0x7f710006e070 con 0x7f71000c8af0 2022-08-10T17:48:04.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.806+0000 7f7105047700 1 -- 172.21.15.150:0/2116021321 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec007840 con 0x7f71000c8af0 2022-08-10T17:48:04.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.807+0000 7f7105848700 1 -- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 msgr2=0x7f71000c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:04.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.807+0000 7f7105848700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 0x7f71000c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.807+0000 7f7105848700 1 -- 172.21.15.150:0/2116021321 >> v1:172.21.15.150:6789/0 conn(0x7f71000c8af0 legacy=0x7f710006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.807+0000 7f7105848700 1 -- 172.21.15.150:0/2116021321 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000701c0 con 0x7f71000c96b0 2022-08-10T17:48:04.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.807+0000 7f710684a700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 0x7f71000c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.808+0000 7f7105848700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c96b0 0x7f71000c8ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006fd0 tx=0x7f70f0009a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d74abc517a776e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.808+0000 7f7105047700 1 -- 172.21.15.150:0/2116021321 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010870 con 0x7f71000c96b0 2022-08-10T17:48:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.808+0000 7f7105047700 1 -- 172.21.15.150:0/2116021321 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000a040 con 0x7f71000c96b0 2022-08-10T17:48:04.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.808+0000 7f7105047700 1 -- 172.21.15.150:0/2116021321 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010c30 con 0x7f71000c96b0 2022-08-10T17:48:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 -- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c96b0 msgr2=0x7f71000c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c96b0 0x7f71000c8ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006fd0 tx=0x7f70f0009a50 comp rx=0 tx=0).stop 2022-08-10T17:48:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 -- 172.21.15.150:0/2116021321 shutdown_connections 2022-08-10T17:48:04.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c3340 0x7f71000c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 --2- 172.21.15.150:0/2116021321 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c96b0 0x7f71000c8ec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 -- 172.21.15.150:0/2116021321 >> 172.21.15.150:0/2116021321 conn(0x7f710006b500 msgr2=0x7f710006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 -- 172.21.15.150:0/2116021321 shutdown_connections 2022-08-10T17:48:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.809+0000 7f71082ad700 1 -- 172.21.15.150:0/2116021321 wait complete. 2022-08-10T17:48:04.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.811+0000 7f71082ad700 1 Processor -- start 2022-08-10T17:48:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.811+0000 7f71082ad700 1 -- start start 2022-08-10T17:48:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 0x7f71001f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000c8af0 0x7f71000c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c96b0 0x7f710015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b6630 con 0x7f71000c8af0 2022-08-10T17:48:04.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100162450 con 0x7f71000c3340 2022-08-10T17:48:04.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f71082ad700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b7bf0 con 0x7f71000c96b0 2022-08-10T17:48:04.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f7106049700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 0x7f71001f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f7105848700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000c8af0 0x7f71000c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f7106049700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 0x7f71001f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51924/0 (socket says 172.21.15.150:51924) 2022-08-10T17:48:04.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.812+0000 7f7106049700 1 -- 172.21.15.150:0/1581680927 learned_addr learned my addr 172.21.15.150:0/1581680927 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:04.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f710684a700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c96b0 0x7f710015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c96b0 msgr2=0x7f710015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f71000c96b0 0x7f710015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000c8af0 msgr2=0x7f71000c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000c8af0 0x7f71000c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8007720 con 0x7f71000c3340 2022-08-10T17:48:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7105848700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000c8af0 0x7f71000c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f7106049700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 0x7f71001f9180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c370 tx=0x7f70fc00c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0072d0 con 0x7f71000c3340 2022-08-10T17:48:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc007430 con 0x7f71000c3340 2022-08-10T17:48:04.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0057c0 con 0x7f71000c3340 2022-08-10T17:48:04.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f00093d0 con 0x7f71000c3340 2022-08-10T17:48:04.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.813+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000b7e90 con 0x7f71000c3340 2022-08-10T17:48:04.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.814+0000 7f71082ad700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 0x7f710015f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.814+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000673d0 con 0x7f71000899c0 2022-08-10T17:48:04.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.814+0000 7f7105848700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 0x7f710015f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.814+0000 7f7105848700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71000c1f80 con 0x7f71000899c0 2022-08-10T17:48:04.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f7105848700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 0x7f710015f800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fd0 tx=0x7f70f0004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f70fc019030 con 0x7f71000c3340 2022-08-10T17:48:04.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f70e8065080 0x7f70e8067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f70fc081400 con 0x7f71000c3340 2022-08-10T17:48:04.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f710684a700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f70e8065080 0x7f70e8067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0020050 con 0x7f71000899c0 2022-08-10T17:48:04.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f70f0021040 con 0x7f71000899c0 2022-08-10T17:48:04.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 msgr2=0x7f710015f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 0x7f710015f800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fd0 tx=0x7f70f0004640 comp rx=0 tx=0).stop 2022-08-10T17:48:04.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 msgr2=0x7f710015f800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:04.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.815+0000 7f70f6ffd700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000899c0 0x7f710015f800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.816+0000 7f710684a700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f70e8065080 0x7f70e8067530 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007bb0 tx=0x7f70f800d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.823+0000 7f71082ad700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 0x7f71001f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.823+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100072890 con 0x7f71000b5f10 2022-08-10T17:48:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.824+0000 7f7105848700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 0x7f71001f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.824+0000 7f7105848700 1 -- 172.21.15.150:0/1581680927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f71000c4110 con 0x7f71000b5f10 2022-08-10T17:48:04.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.824+0000 7f7105848700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 0x7f71001f8870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009a90 tx=0x7f70f00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010e10 con 0x7f71000b5f10 2022-08-10T17:48:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4549 (secure 0 0 0) 0x7f70f0032660 con 0x7f71000b5f10 2022-08-10T17:48:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 msgr2=0x7f71001f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 0x7f71001f8870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009a90 tx=0x7f70f00045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 msgr2=0x7f71001f8870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:04.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.825+0000 7f70f6ffd700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71000b5f10 0x7f71001f8870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:04.837 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:04.837 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:04.838 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:04.838 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:48:04.838 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:48:04.838 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:04.839 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:48:04.839 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:04.839 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:04.839 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:04.839 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 17, 2022-08-10T17:48:04.840 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:04.840 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:04.840 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:04.840 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:04.841 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:04.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:04.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:04.841 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:04.841 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:04.842 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:04.842 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:04.842 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:04.842 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:04.843 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:04.843 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:04.843 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:04.843 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:04.843 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:04.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:04.844 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:04.844 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:04.844 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:04.845 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:04.845 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:04.845 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.845 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.845 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:04.846 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:04.846 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:04.846 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:04.846 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:04.846 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:04.847 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:04.847 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:04.847 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:04.847 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:04.848 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:04.848 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:04.848 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:04.848 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:04.848 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:04.849 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:04.849 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:04.849 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:04.849 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:04.850 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:04.850 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:04.850 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:04.851 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:04.851 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:04.851 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:04.851 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:04.852 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:04.852 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.852 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:04.852 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.852 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:04.853 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:04.853 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:04.853 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:04.853 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.854 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:04.854 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:04.854 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.854 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.854 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.855 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:04.855 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:04.855 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.855 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.856 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.856 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.856 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:04.856 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:04.856 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:04.857 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:04.857 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:04.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.858 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:04.858 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:04.858 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:04.858 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:04.858 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.859 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:04.859 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:04.859 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:04.860 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:04.860 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.860 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.861 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.861 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:04.861 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:04.861 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:04.862 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:04.862 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:04.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.862 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.863 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:04.863 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:04.863 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:04.863 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:04.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.864 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:04.864 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:04.864 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.865 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:04.865 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:04.865 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:04.865 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.866 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.866 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:04.866 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:04.866 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:04.867 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:04.867 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:04.867 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.867 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.868 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.868 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:04.868 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:04.868 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.868 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:04.869 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:04.869 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:04.869 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.869 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:04.870 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:48:04.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.870 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:04.870 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:04.870 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:48:04.871 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.871 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:04.871 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:04.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:04.873 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:04.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f70e8065080 msgr2=0x7f70e8067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f70e8065080 0x7f70e8067530 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007bb0 tx=0x7f70f800d040 comp rx=0 tx=0).stop 2022-08-10T17:48:04.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 msgr2=0x7f71001f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 --2- 172.21.15.150:0/1581680927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f71000c3340 0x7f71001f9180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c370 tx=0x7f70fc00c680 comp rx=0 tx=0).stop 2022-08-10T17:48:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f710684a700 1 -- 172.21.15.150:0/1581680927 reap_dead start 2022-08-10T17:48:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f710684a700 1 -- 172.21.15.150:0/1581680927 reap_dead start 2022-08-10T17:48:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 shutdown_connections 2022-08-10T17:48:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 >> 172.21.15.150:0/1581680927 conn(0x7f710006b500 msgr2=0x7f7100164970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:04.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 shutdown_connections 2022-08-10T17:48:04.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:04.826+0000 7f71082ad700 1 -- 172.21.15.150:0/1581680927 wait complete. 2022-08-10T17:48:04.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:48:05.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 Processor -- start 2022-08-10T17:48:05.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 -- start start 2022-08-10T17:48:05.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8150e60 0x7fa0a8069840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.063 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0a8156950 0x7fa0a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a8156de0 con 0x7fa0a806b430 2022-08-10T17:48:05.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a8157940 con 0x7fa0a8156950 2022-08-10T17:48:05.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0ae119700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81570a0 con 0x7fa0a8150e60 2022-08-10T17:48:05.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0a6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0a8156950 0x7fa0a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0a7fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa0a806b430 0x7fa0a80c5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54028/0 (socket says 172.21.15.150:54028) 2022-08-10T17:48:05.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.054+0000 7fa0a7fff700 1 -- 172.21.15.150:0/1620142498 learned_addr learned my addr 172.21.15.150:0/1620142498 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:05.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8150e60 0x7fa0a8069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/1620142498 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8150e60 msgr2=0x7fa0a8069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:05.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a6ffd700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8150e60 0x7fa0a8069840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/1620142498 >> v1:172.21.15.150:6789/0 conn(0x7fa0a806b430 legacy=0x7fa0a80c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a67fc700 1 -- 172.21.15.150:0/1620142498 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123822018 0 0) 0x7fa0a8156de0 con 0x7fa0a806b430 2022-08-10T17:48:05.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/1620142498 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8157380 con 0x7fa0a8156950 2022-08-10T17:48:05.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a6ffd700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8156950 0x7fa0a8069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0096b0 tx=0x7fa09c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65d699fe40fde71 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a67fc700 1 -- 172.21.15.150:0/1620142498 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0107b0 con 0x7fa0a8156950 2022-08-10T17:48:05.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a67fc700 1 -- 172.21.15.150:0/1620142498 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c010910 con 0x7fa0a8156950 2022-08-10T17:48:05.067 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.055+0000 7fa0a67fc700 1 -- 172.21.15.150:0/1620142498 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c010cc0 con 0x7fa0a8156950 2022-08-10T17:48:05.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 -- 172.21.15.150:0/1620142498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8156950 msgr2=0x7fa0a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8156950 0x7fa0a8069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0096b0 tx=0x7fa09c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 -- 172.21.15.150:0/1620142498 shutdown_connections 2022-08-10T17:48:05.068 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8150e60 0x7fa0a8069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 --2- 172.21.15.150:0/1620142498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8156950 0x7fa0a8069d80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 -- 172.21.15.150:0/1620142498 >> 172.21.15.150:0/1620142498 conn(0x7fa0a806d730 msgr2=0x7fa0a806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 -- 172.21.15.150:0/1620142498 shutdown_connections 2022-08-10T17:48:05.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.056+0000 7fa0ae119700 1 -- 172.21.15.150:0/1620142498 wait complete. 2022-08-10T17:48:05.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 Processor -- start 2022-08-10T17:48:05.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 -- start start 2022-08-10T17:48:05.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a806b430 0x7fa0a806e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8156950 0x7fa0a814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81eba30 con 0x7fa0a8150e60 2022-08-10T17:48:05.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a814c990 con 0x7fa0a806b430 2022-08-10T17:48:05.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.057+0000 7fa0ae119700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81ebcb0 con 0x7fa0a8156950 2022-08-10T17:48:05.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41356/0 (socket says 172.21.15.150:41356) 2022-08-10T17:48:05.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/2964143316 learned_addr learned my addr 172.21.15.150:0/2964143316 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:05.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a7fff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8156950 0x7fa0a814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a806b430 0x7fa0a806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8156950 msgr2=0x7fa0a814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa0a8156950 0x7fa0a814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a806b430 msgr2=0x7fa0a806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a806b430 0x7fa0a806e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009310 con 0x7fa0a8150e60 2022-08-10T17:48:05.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0a6ffd700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa09c013040 tx=0x7fa09c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c004220 con 0x7fa0a8150e60 2022-08-10T17:48:05.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c0043a0 con 0x7fa0a8150e60 2022-08-10T17:48:05.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a81ebf90 con 0x7fa0a8150e60 2022-08-10T17:48:05.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c003760 con 0x7fa0a8150e60 2022-08-10T17:48:05.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.058+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a81ec550 con 0x7fa0a8150e60 2022-08-10T17:48:05.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.059+0000 7fa0ae119700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 0x7fa0a80c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.059+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80673d0 con 0x7fa0a80c4c00 2022-08-10T17:48:05.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.059+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 0x7fa0a80c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.059+0000 7fa0a77fe700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0a81ebe20 con 0x7fa0a80c4c00 2022-08-10T17:48:05.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.059+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa09c00f070 con 0x7fa0a8150e60 2022-08-10T17:48:05.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 0x7fa0a80c3f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa098011890 tx=0x7fa098011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa0880650b0 0x7fa088067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa09c082da0 con 0x7fa0a8150e60 2022-08-10T17:48:05.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa0a7fff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa0880650b0 0x7fa088067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098004240 con 0x7fa0a80c4c00 2022-08-10T17:48:05.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fa0980043a0 con 0x7fa0a80c4c00 2022-08-10T17:48:05.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 msgr2=0x7fa0a80c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 0x7fa0a80c3f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa098011890 tx=0x7fa098011c50 comp rx=0 tx=0).stop 2022-08-10T17:48:05.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 msgr2=0x7fa0a80c3f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:05.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa08ffff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c4c00 0x7fa0a80c3f60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.060+0000 7fa0a7fff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa0880650b0 0x7fa088067560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00012e0 tx=0x7fa0a0007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.067+0000 7fa0ae119700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 0x7fa0a814be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.067+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80c48a0 con 0x7fa0a80c44a0 2022-08-10T17:48:05.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.067+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 0x7fa0a814be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.067+0000 7fa0a77fe700 1 -- 172.21.15.150:0/2964143316 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa0a8072890 con 0x7fa0a80c44a0 2022-08-10T17:48:05.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0a77fe700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 0x7fa0a814be00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa098011890 tx=0x7fa0980045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098003ea0 con 0x7fa0a80c44a0 2022-08-10T17:48:05.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7fa098024040 con 0x7fa0a80c44a0 2022-08-10T17:48:05.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 msgr2=0x7fa0a814be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 0x7fa0a814be00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa098011890 tx=0x7fa0980045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 msgr2=0x7fa0a814be00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:05.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa08ffff700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa0a80c44a0 0x7fa0a814be00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:05.085 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:05.085 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:05.086 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:48:05.086 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:48:05.086 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:05.086 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:48:05.087 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:05.087 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:05.087 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.087 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 17, 2022-08-10T17:48:05.088 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:05.088 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:05.088 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:05.089 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.089 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.089 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.089 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.090 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.090 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.090 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.090 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.091 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.091 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.091 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:05.091 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:05.092 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.092 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.092 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.092 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.093 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.093 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.093 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.093 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.094 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.094 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.094 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.094 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:05.095 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:05.095 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:05.095 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:05.095 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:05.096 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:05.096 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:05.096 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:05.096 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:05.097 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:05.097 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:05.097 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:05.097 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:05.098 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:05.098 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:05.098 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:05.098 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.099 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.099 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.099 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.099 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.100 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.100 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.100 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.101 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.101 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.101 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:05.101 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:05.103 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.103 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.103 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.104 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:05.104 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:48:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:48:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:48:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:48:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:48:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:48:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:48:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:48:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:05.131 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa0880650b0 msgr2=0x7fa088067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa0880650b0 0x7fa088067560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00012e0 tx=0x7fa0a0007f60 comp rx=0 tx=0).stop 2022-08-10T17:48:05.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 msgr2=0x7fa0a814dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa09c013040 tx=0x7fa09c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0a7fff700 1 -- 172.21.15.150:0/2964143316 reap_dead start 2022-08-10T17:48:05.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 shutdown_connections 2022-08-10T17:48:05.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 --2- 172.21.15.150:0/2964143316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0a8150e60 0x7fa0a814dd00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.068+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 >> 172.21.15.150:0/2964143316 conn(0x7fa0a806d730 msgr2=0x7fa0a8068110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.069+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 shutdown_connections 2022-08-10T17:48:05.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.069+0000 7fa0ae119700 1 -- 172.21.15.150:0/2964143316 wait complete. 2022-08-10T17:48:05.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:48:05.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.280+0000 7f3b983f8700 1 Processor -- start 2022-08-10T17:48:05.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.280+0000 7f3b983f8700 1 -- start start 2022-08-10T17:48:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b983f8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3b900c3410 0x7f3b900c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b983f8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b90068110 0x7f3b90155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b983f8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b90158dc0 con 0x7f3b900c37e0 2022-08-10T17:48:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b983f8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b90070580 con 0x7f3b90068110 2022-08-10T17:48:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b983f8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9006fd90 con 0x7f3b900c3410 2022-08-10T17:48:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b90068110 0x7f3b90155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b90068110 0x7f3b90155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41366/0 (socket says 172.21.15.150:41366) 2022-08-10T17:48:05.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 -- 172.21.15.150:0/1316282177 learned_addr learned my addr 172.21.15.150:0/1316282177 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:05.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b96194700 1 --2- 172.21.15.150:0/1316282177 >> v2:172.21.15.197:3300/0 conn(0x7f3b900c3410 0x7f3b900c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 -- 172.21.15.150:0/1316282177 >> v2:172.21.15.197:3300/0 conn(0x7f3b900c3410 msgr2=0x7f3b900c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:05.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 --2- 172.21.15.150:0/1316282177 >> v2:172.21.15.197:3300/0 conn(0x7f3b900c3410 0x7f3b900c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 -- 172.21.15.150:0/1316282177 >> v1:172.21.15.197:6789/0 conn(0x7f3b900c37e0 legacy=0x7f3b90153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95993700 1 -- 172.21.15.150:0/1316282177 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90158240 con 0x7f3b90068110 2022-08-10T17:48:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.281+0000 7f3b95192700 1 -- 172.21.15.150:0/1316282177 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069258349 0 0) 0x7f3b90158dc0 con 0x7f3b900c37e0 2022-08-10T17:48:05.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b95993700 1 --2- 172.21.15.150:0/1316282177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b90155060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3de0 tx=0x7f3b80009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e62838051c67e1e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b95192700 1 -- 172.21.15.150:0/1316282177 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004230 con 0x7f3b90068110 2022-08-10T17:48:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b95192700 1 -- 172.21.15.150:0/1316282177 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80004390 con 0x7f3b90068110 2022-08-10T17:48:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b95192700 1 -- 172.21.15.150:0/1316282177 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011850 con 0x7f3b90068110 2022-08-10T17:48:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 -- 172.21.15.150:0/1316282177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 msgr2=0x7f3b90155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 --2- 172.21.15.150:0/1316282177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b90155060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3de0 tx=0x7f3b80009a60 comp rx=0 tx=0).stop 2022-08-10T17:48:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 -- 172.21.15.150:0/1316282177 shutdown_connections 2022-08-10T17:48:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 --2- 172.21.15.150:0/1316282177 >> v2:172.21.15.197:3300/0 conn(0x7f3b900c3410 0x7f3b900c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 --2- 172.21.15.150:0/1316282177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b90155060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 -- 172.21.15.150:0/1316282177 >> 172.21.15.150:0/1316282177 conn(0x7f3b9006d0d0 msgr2=0x7f3b900c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 -- 172.21.15.150:0/1316282177 shutdown_connections 2022-08-10T17:48:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.282+0000 7f3b983f8700 1 -- 172.21.15.150:0/1316282177 wait complete. 2022-08-10T17:48:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.283+0000 7f3b983f8700 1 Processor -- start 2022-08-10T17:48:05.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 -- start start 2022-08-10T17:48:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b901ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3b900c3410 0x7f3b9014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c37e0 0x7f3b901502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901ec5c0 con 0x7f3b90068110 2022-08-10T17:48:05.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900ca6c0 con 0x7f3b900c3410 2022-08-10T17:48:05.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b983f8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900c1bd0 con 0x7f3b900c37e0 2022-08-10T17:48:05.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b96194700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b901ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b96194700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b901ecb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41372/0 (socket says 172.21.15.150:41372) 2022-08-10T17:48:05.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b96194700 1 -- 172.21.15.150:0/2019609837 learned_addr learned my addr 172.21.15.150:0/2019609837 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:05.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3b900c3410 0x7f3b9014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.284+0000 7f3b96995700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c37e0 0x7f3b901502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c37e0 msgr2=0x7f3b901502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c37e0 0x7f3b901502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3b900c3410 msgr2=0x7f3b9014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3b900c3410 0x7f3b9014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800093e0 con 0x7f3b90068110 2022-08-10T17:48:05.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3b900c3410 0x7f3b9014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:05.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b96194700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b901ecb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00e820 tx=0x7f3b8c00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c009580 con 0x7f3b90068110 2022-08-10T17:48:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c013680 con 0x7f3b90068110 2022-08-10T17:48:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b900c1eb0 con 0x7f3b90068110 2022-08-10T17:48:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0139f0 con 0x7f3b90068110 2022-08-10T17:48:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.285+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900c2470 con 0x7f3b90068110 2022-08-10T17:48:05.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.286+0000 7f3b983f8700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 0x7f3b901eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.286+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900672f0 con 0x7f3b900c2c70 2022-08-10T17:48:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.286+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3b8c023070 con 0x7f3b90068110 2022-08-10T17:48:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.286+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 0x7f3b901eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b95993700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b90072890 con 0x7f3b900c2c70 2022-08-10T17:48:05.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3b700650b0 0x7f3b70067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3b8c0822e0 con 0x7f3b90068110 2022-08-10T17:48:05.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 0x7f3b901eec30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3de0 tx=0x7f3b800045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b96995700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3b700650b0 0x7f3b70067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80020070 con 0x7f3b900c2c70 2022-08-10T17:48:05.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3b80003730 con 0x7f3b900c2c70 2022-08-10T17:48:05.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 msgr2=0x7f3b901eec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 0x7f3b901eec30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3de0 tx=0x7f3b800045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 msgr2=0x7f3b901eec30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b7effd700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c2c70 0x7f3b901eec30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.287+0000 7f3b96995700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3b700650b0 0x7f3b70067560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3b880012e0 tx=0x7f3b88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.294+0000 7f3b983f8700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 0x7f3b900c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.294+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900c2040 con 0x7f3b900c5a80 2022-08-10T17:48:05.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.294+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 0x7f3b900c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b95993700 1 -- 172.21.15.150:0/2019609837 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b90156d10 con 0x7f3b900c5a80 2022-08-10T17:48:05.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b95993700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 0x7f3b900c2660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b80000c00 tx=0x7f3b80011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8002c5a0 con 0x7f3b900c5a80 2022-08-10T17:48:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f3b8002c700 con 0x7f3b900c5a80 2022-08-10T17:48:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 msgr2=0x7f3b900c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 0x7f3b900c2660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b80000c00 tx=0x7f3b80011000 comp rx=0 tx=0).stop 2022-08-10T17:48:05.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 msgr2=0x7f3b900c2660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:05.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.295+0000 7f3b7effd700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3b900c5a80 0x7f3b900c2660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.310 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:05.311 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:05.311 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:05.311 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:48:05.311 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 96, 2022-08-10T17:48:05.312 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:05.312 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:48:05.312 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:05.312 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:05.312 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.313 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 17, 2022-08-10T17:48:05.313 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:05.313 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:05.313 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:05.314 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.314 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.314 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.314 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.315 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.315 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.315 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.316 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.316 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.316 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.316 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:05.317 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:05.317 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.317 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.317 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.318 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.318 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.318 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.318 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:05.320 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:05.320 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:05.320 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:05.320 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:05.321 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:05.321 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:05.321 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:05.321 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:05.321 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:05.322 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:05.322 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:05.322 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:05.322 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:05.323 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:05.323 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:05.323 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:05.323 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:05.323 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:05.324 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:05.324 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:05.324 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:05.325 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:05.325 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:05.325 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.325 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:05.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.326 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:05.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.326 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:05.326 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:05.327 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.327 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.327 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.327 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:05.328 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.328 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.329 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:05.329 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.329 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.329 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.330 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:05.330 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:05.330 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.330 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.331 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.331 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:05.331 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:05.332 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.332 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.332 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.333 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:05.333 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.334 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.334 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:05.334 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.334 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.335 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.335 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:05.335 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:05.336 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.336 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.336 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.337 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:05.337 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:05.337 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:05.337 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:05.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.338 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:05.338 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:05.338 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.339 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:05.339 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:05.339 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:05.339 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.340 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.340 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:05.340 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:05.341 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:05.341 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:05.341 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:05.341 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.342 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.342 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:05.342 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:05.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.343 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.343 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.343 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:05.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.344 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:05.344 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:05.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:05.344 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:05.345 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:05.345 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:05.345 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:05.345 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:05.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:05.346 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:05.346 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:05.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3b700650b0 msgr2=0x7f3b70067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3b700650b0 0x7f3b70067560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3b880012e0 tx=0x7f3b88009040 comp rx=0 tx=0).stop 2022-08-10T17:48:05.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 msgr2=0x7f3b901ecb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 --2- 172.21.15.150:0/2019609837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b90068110 0x7f3b901ecb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00e820 tx=0x7f3b8c00eb30 comp rx=0 tx=0).stop 2022-08-10T17:48:05.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b96995700 1 -- 172.21.15.150:0/2019609837 reap_dead start 2022-08-10T17:48:05.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b96995700 1 -- 172.21.15.150:0/2019609837 reap_dead start 2022-08-10T17:48:05.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 shutdown_connections 2022-08-10T17:48:05.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 >> 172.21.15.150:0/2019609837 conn(0x7f3b9006d0d0 msgr2=0x7f3b90154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 shutdown_connections 2022-08-10T17:48:05.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.296+0000 7f3b983f8700 1 -- 172.21.15.150:0/2019609837 wait complete. 2022-08-10T17:48:05.351 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:48:05.351 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:48:05.351 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:48:05.352 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:48:05.352 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:48:05.352 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:48:05.365 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:48:05.365 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:48:05.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:05.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.540+0000 7f441faee700 1 Processor -- start 2022-08-10T17:48:05.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 -- start start 2022-08-10T17:48:05.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f44180bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 0x7f44180c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44180ba910 con 0x7f44180cb6a0 2022-08-10T17:48:05.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44180c6900 con 0x7f4418156800 2022-08-10T17:48:05.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441faee700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418157750 con 0x7f44180c6530 2022-08-10T17:48:05.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441d089700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 msgr2=0x7f44180c5460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:05.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.541+0000 7f441d089700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 0x7f44180c5460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:05.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f44180bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441e08b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441e08b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51982/0 (socket says 172.21.15.150:51982) 2022-08-10T17:48:05.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441e08b700 1 -- 172.21.15.150:0/510370952 learned_addr learned my addr 172.21.15.150:0/510370952 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:05.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 -- 172.21.15.150:0/510370952 >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 msgr2=0x7f441806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:05.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 --2- 172.21.15.150:0/510370952 >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 -- 172.21.15.150:0/510370952 >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 msgr2=0x7f44180c5460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:05.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 --2- 172.21.15.150:0/510370952 >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 0x7f44180c5460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 -- 172.21.15.150:0/510370952 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180c59a0 con 0x7f44180c6530 2022-08-10T17:48:05.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441e08b700 1 --2- 172.21.15.150:0/510370952 >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:05.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441d88a700 1 --2- 172.21.15.150:0/510370952 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f44180bae80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f440c0096b0 tx=0x7f440c0099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3190409aa4c2724c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441c888700 1 -- 172.21.15.150:0/510370952 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0107b0 con 0x7f44180c6530 2022-08-10T17:48:05.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441c888700 1 -- 172.21.15.150:0/510370952 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c010910 con 0x7f44180c6530 2022-08-10T17:48:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.542+0000 7f441c888700 1 -- 172.21.15.150:0/510370952 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c010cc0 con 0x7f44180c6530 2022-08-10T17:48:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 -- 172.21.15.150:0/510370952 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 msgr2=0x7f44180bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 --2- 172.21.15.150:0/510370952 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f44180bae80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f440c0096b0 tx=0x7f440c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 -- 172.21.15.150:0/510370952 shutdown_connections 2022-08-10T17:48:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 --2- 172.21.15.150:0/510370952 >> v2:172.21.15.197:3300/0 conn(0x7f4418156800 0x7f441806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 --2- 172.21.15.150:0/510370952 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f44180bae80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 --2- 172.21.15.150:0/510370952 >> v2:172.21.15.150:3300/0 conn(0x7f44180cb6a0 0x7f44180c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 -- 172.21.15.150:0/510370952 >> 172.21.15.150:0/510370952 conn(0x7f441806fae0 msgr2=0x7f441806fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 -- 172.21.15.150:0/510370952 shutdown_connections 2022-08-10T17:48:05.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.543+0000 7f441faee700 1 -- 172.21.15.150:0/510370952 wait complete. 2022-08-10T17:48:05.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.544+0000 7f441faee700 1 Processor -- start 2022-08-10T17:48:05.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.544+0000 7f441faee700 1 -- start start 2022-08-10T17:48:05.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 0x7f44181df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44181525e0 con 0x7f4418156800 2022-08-10T17:48:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418153890 con 0x7f44180cb6a0 2022-08-10T17:48:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441faee700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44181ebd50 con 0x7f44180c6530 2022-08-10T17:48:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441e08b700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 msgr2=0x7f44181df9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441e08b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 0x7f44181df9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:05.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d88a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:51986/0 (socket says 172.21.15.150:51986) 2022-08-10T17:48:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d88a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55614/0 (socket says 172.21.15.150:55614) 2022-08-10T17:48:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 -- 172.21.15.150:0/3918699057 learned_addr learned my addr 172.21.15.150:0/3918699057 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:05.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 -- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 msgr2=0x7f4418155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 -- 172.21.15.150:0/3918699057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 msgr2=0x7f44181df9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 0x7f44181df9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d089700 1 -- 172.21.15.150:0/3918699057 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009b30 con 0x7f44180cb6a0 2022-08-10T17:48:05.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.545+0000 7f441d88a700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:05.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f441d089700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f441400b440 tx=0x7f441400b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414003ca0 con 0x7f44180cb6a0 2022-08-10T17:48:05.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414003e20 con 0x7f44180cb6a0 2022-08-10T17:48:05.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414005310 con 0x7f44180cb6a0 2022-08-10T17:48:05.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c009310 con 0x7f44180cb6a0 2022-08-10T17:48:05.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.546+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44181ec310 con 0x7f44180cb6a0 2022-08-10T17:48:05.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.547+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44180c7fd0 con 0x7f44180cb6a0 2022-08-10T17:48:05.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.547+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f441400f070 con 0x7f44180cb6a0 2022-08-10T17:48:05.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.547+0000 7f440a7fc700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 0x7f43f8067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:05.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.548+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4414081b70 con 0x7f44180cb6a0 2022-08-10T17:48:05.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.548+0000 7f441d88a700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 0x7f43f8067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:05.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.548+0000 7f441d88a700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 0x7f43f8067510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f440c0090b0 tx=0x7f440c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:05.565 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.552+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f441404f9e0 con 0x7f44180cb6a0 2022-08-10T17:48:05.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.933+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f441806e4a0 con 0x7f44180cb6a0 2022-08-10T17:48:05.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.934+0000 7f440a7fc700 1 -- 172.21.15.150:0/3918699057 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f4414053000 con 0x7f44180cb6a0 2022-08-10T17:48:05.939 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:05.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.937+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 msgr2=0x7f43f8067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.937+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 0x7f43f8067510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f440c0090b0 tx=0x7f440c01c040 comp rx=0 tx=0).stop 2022-08-10T17:48:05.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.937+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 msgr2=0x7f44181df490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:05.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.937+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f441400b440 tx=0x7f441400b750 comp rx=0 tx=0).stop 2022-08-10T17:48:05.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 shutdown_connections 2022-08-10T17:48:05.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4418156800 0x7f44181df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f43f8065060 0x7f43f8067510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f44180c6530 0x7f4418155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 --2- 172.21.15.150:0/3918699057 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f44180cb6a0 0x7f44181df490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:05.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.947+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 >> 172.21.15.150:0/3918699057 conn(0x7f441806fae0 msgr2=0x7f4418069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:05.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.948+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 shutdown_connections 2022-08-10T17:48:05.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:05.948+0000 7f441faee700 1 -- 172.21.15.150:0/3918699057 wait complete. 2022-08-10T17:48:08.972 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:09.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.131+0000 7f39abc41700 1 Processor -- start 2022-08-10T17:48:09.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.131+0000 7f39abc41700 1 -- start start 2022-08-10T17:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39abc41700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f39a4089aa0 0x7f39a4166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:09.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39abc41700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a406b310 con 0x7f39a40c5050 2022-08-10T17:48:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39abc41700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a40c3aa0 con 0x7f39a40896d0 2022-08-10T17:48:09.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39abc41700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a406bf00 con 0x7f39a4089aa0 2022-08-10T17:48:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39a91dc700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f39a40c5050 legacy=0x7f39a415d570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:48:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39a99dd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f39a40896d0 0x7f39a40c32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40446/0 (socket says 172.21.15.150:40446) 2022-08-10T17:48:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39a99dd700 1 -- 172.21.15.150:0/4208269416 learned_addr learned my addr 172.21.15.150:0/4208269416 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.132+0000 7f39aa1de700 1 --2- 172.21.15.150:0/4208269416 >> v2:172.21.15.197:3300/0 conn(0x7f39a4089aa0 0x7f39a4166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.133+0000 7f39a89db700 1 -- 172.21.15.150:0/4208269416 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762173566 0 0) 0x7f39a40c3aa0 con 0x7f39a40896d0 2022-08-10T17:48:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39a89db700 1 -- 172.21.15.150:0/4208269416 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3990003410 con 0x7f39a40896d0 2022-08-10T17:48:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39aa1de700 1 -- 172.21.15.150:0/4208269416 >> v1:172.21.15.197:6789/0 conn(0x7f39a40896d0 legacy=0x7f39a40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39aa1de700 1 -- 172.21.15.150:0/4208269416 >> v1:172.21.15.150:6789/0 conn(0x7f39a40c5050 legacy=0x7f39a415d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39aa1de700 1 -- 172.21.15.150:0/4208269416 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a406b560 con 0x7f39a4089aa0 2022-08-10T17:48:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39aa1de700 1 --2- 172.21.15.150:0/4208269416 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4089aa0 0x7f39a4166c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f399c009c80 tx=0x7f399c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=159e2193aae4c89c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39a89db700 1 -- 172.21.15.150:0/4208269416 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00b8b0 con 0x7f39a4089aa0 2022-08-10T17:48:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39a89db700 1 -- 172.21.15.150:0/4208269416 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00ba10 con 0x7f39a4089aa0 2022-08-10T17:48:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.134+0000 7f39a89db700 1 -- 172.21.15.150:0/4208269416 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00bd80 con 0x7f39a4089aa0 2022-08-10T17:48:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.135+0000 7f39abc41700 1 -- 172.21.15.150:0/4208269416 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4089aa0 msgr2=0x7f39a4166c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.135+0000 7f39abc41700 1 --2- 172.21.15.150:0/4208269416 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4089aa0 0x7f39a4166c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f399c009c80 tx=0x7f399c009f90 comp rx=0 tx=0).stop 2022-08-10T17:48:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.135+0000 7f39abc41700 1 -- 172.21.15.150:0/4208269416 shutdown_connections 2022-08-10T17:48:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.135+0000 7f39abc41700 1 --2- 172.21.15.150:0/4208269416 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4089aa0 0x7f39a4166c20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.135+0000 7f39abc41700 1 -- 172.21.15.150:0/4208269416 >> 172.21.15.150:0/4208269416 conn(0x7f39a40c8a10 msgr2=0x7f39a40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.137+0000 7f39abc41700 1 -- 172.21.15.150:0/4208269416 shutdown_connections 2022-08-10T17:48:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.137+0000 7f39abc41700 1 -- 172.21.15.150:0/4208269416 wait complete. 2022-08-10T17:48:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.138+0000 7f39abc41700 1 Processor -- start 2022-08-10T17:48:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.138+0000 7f39abc41700 1 -- start start 2022-08-10T17:48:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 0x7f39a4162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 0x7f39a4163b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 0x7f39a4165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41fdfb0 con 0x7f39a4089aa0 2022-08-10T17:48:09.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41643f0 con 0x7f39a4154650 2022-08-10T17:48:09.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39abc41700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41634d0 con 0x7f39a40896d0 2022-08-10T17:48:09.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39a91dc700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 msgr2=0x7f39a4163b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:09.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39a91dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 0x7f39a4163b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:09.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39a99dd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 0x7f39a4162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:09.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39aa1de700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 0x7f39a4165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:09.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39a99dd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 0x7f39a4162f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55640/0 (socket says 172.21.15.150:55640) 2022-08-10T17:48:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39a99dd700 1 -- 172.21.15.150:0/3492032800 learned_addr learned my addr 172.21.15.150:0/3492032800 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39aa1de700 1 -- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 msgr2=0x7f39a4162f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.139+0000 7f39aa1de700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 0x7f39a4162f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39aa1de700 1 -- 172.21.15.150:0/3492032800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 msgr2=0x7f39a4163b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39aa1de700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 0x7f39a4163b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39aa1de700 1 -- 172.21.15.150:0/3492032800 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c00d040 con 0x7f39a4154650 2022-08-10T17:48:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39aa1de700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 0x7f39a4165bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39a40bc5d0 tx=0x7f399c004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c004230 con 0x7f39a4154650 2022-08-10T17:48:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c01f070 con 0x7f39a4154650 2022-08-10T17:48:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a41fe190 con 0x7f39a4154650 2022-08-10T17:48:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0045d0 con 0x7f39a4154650 2022-08-10T17:48:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.140+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a41624b0 con 0x7f39a4154650 2022-08-10T17:48:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.141+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3980005170 con 0x7f39a4154650 2022-08-10T17:48:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.141+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f399c017020 con 0x7f39a4154650 2022-08-10T17:48:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.142+0000 7f399a7fc700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 0x7f398c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.142+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f399c0841a0 con 0x7f39a4154650 2022-08-10T17:48:09.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.142+0000 7f39a99dd700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 0x7f398c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:09.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.142+0000 7f39a99dd700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 0x7f398c067540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007fd0 tx=0x7f39a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:09.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.147+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f399c052100 con 0x7f39a4154650 2022-08-10T17:48:09.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.503+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f39800059a0 con 0x7f39a4154650 2022-08-10T17:48:09.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.503+0000 7f399a7fc700 1 -- 172.21.15.150:0/3492032800 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f399c055720 con 0x7f39a4154650 2022-08-10T17:48:09.507 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:09.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 msgr2=0x7f398c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:09.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 0x7f398c067540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007fd0 tx=0x7f39a0009040 comp rx=0 tx=0).stop 2022-08-10T17:48:09.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 msgr2=0x7f39a4165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:09.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 0x7f39a4165bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39a40bc5d0 tx=0x7f399c004950 comp rx=0 tx=0).stop 2022-08-10T17:48:09.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 shutdown_connections 2022-08-10T17:48:09.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39a4154650 0x7f39a4165bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f398c065090 0x7f398c067540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39a40896d0 0x7f39a4162f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 --2- 172.21.15.150:0/3492032800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39a4089aa0 0x7f39a4163b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:09.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 >> 172.21.15.150:0/3492032800 conn(0x7f39a40c8a10 msgr2=0x7f39a40c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:09.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 shutdown_connections 2022-08-10T17:48:09.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:09.506+0000 7f39abc41700 1 -- 172.21.15.150:0/3492032800 wait complete. 2022-08-10T17:48:12.526 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:12.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.671+0000 7f7fcf033700 1 Processor -- start 2022-08-10T17:48:12.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.671+0000 7f7fcf033700 1 -- start start 2022-08-10T17:48:12.682 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcf033700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 0x7f7fc80c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcf033700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcf033700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc806faf0 con 0x7f7fc8068910 2022-08-10T17:48:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcf033700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80c1480 con 0x7f7fc806cf70 2022-08-10T17:48:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcf033700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80684f0 con 0x7f7fc806d340 2022-08-10T17:48:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fcd5d0700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f7fc8068910 legacy=0x7f7fc8068d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:48:12.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fccdcf700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 msgr2=0x7f7fc80c2d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:12.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fccdcf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 0x7f7fc80c2d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:12.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:12.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55674/0 (socket says 172.21.15.150:55674) 2022-08-10T17:48:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.672+0000 7f7fc7fff700 1 -- 172.21.15.150:0/2918984971 learned_addr learned my addr 172.21.15.150:0/2918984971 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc7fff700 1 -- 172.21.15.150:0/2918984971 >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 msgr2=0x7f7fc80c2d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc7fff700 1 --2- 172.21.15.150:0/2918984971 >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 0x7f7fc80c2d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc7fff700 1 -- 172.21.15.150:0/2918984971 >> v1:172.21.15.150:6789/0 conn(0x7f7fc8068910 legacy=0x7f7fc8068d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc7fff700 1 -- 172.21.15.150:0/2918984971 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc806fd90 con 0x7f7fc806d340 2022-08-10T17:48:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc7fff700 1 --2- 172.21.15.150:0/2918984971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006fd0 tx=0x7f7fb4009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52af55791f6cfb63 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc77fe700 1 -- 172.21.15.150:0/2918984971 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4011830 con 0x7f7fc806d340 2022-08-10T17:48:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc77fe700 1 -- 172.21.15.150:0/2918984971 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4011990 con 0x7f7fc806d340 2022-08-10T17:48:12.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.673+0000 7f7fc77fe700 1 -- 172.21.15.150:0/2918984971 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4011d40 con 0x7f7fc806d340 2022-08-10T17:48:12.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 -- 172.21.15.150:0/2918984971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 msgr2=0x7f7fc80c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:12.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 --2- 172.21.15.150:0/2918984971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006fd0 tx=0x7f7fb4009a60 comp rx=0 tx=0).stop 2022-08-10T17:48:12.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 -- 172.21.15.150:0/2918984971 shutdown_connections 2022-08-10T17:48:12.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 --2- 172.21.15.150:0/2918984971 >> v2:172.21.15.150:3300/0 conn(0x7f7fc806cf70 0x7f7fc80c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:12.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 --2- 172.21.15.150:0/2918984971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc806d340 0x7f7fc80c32a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:12.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 -- 172.21.15.150:0/2918984971 >> 172.21.15.150:0/2918984971 conn(0x7f7fc80c7330 msgr2=0x7f7fc806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:12.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 -- 172.21.15.150:0/2918984971 shutdown_connections 2022-08-10T17:48:12.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.674+0000 7f7fcf033700 1 -- 172.21.15.150:0/2918984971 wait complete. 2022-08-10T17:48:12.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.675+0000 7f7fcf033700 1 Processor -- start 2022-08-10T17:48:12.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.675+0000 7f7fcf033700 1 -- start start 2022-08-10T17:48:12.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 0x7f7fc8152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7fc806d340 0x7f7fc814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814e400 con 0x7f7fc806cf70 2022-08-10T17:48:12.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81eb930 con 0x7f7fc806d340 2022-08-10T17:48:12.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcf033700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80c2460 con 0x7f7fc8068910 2022-08-10T17:48:12.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fc7fff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 msgr2=0x7f7fc8152140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:12.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 0x7f7fc8152140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:12.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:12.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55676/0 (socket says 172.21.15.150:55676) 2022-08-10T17:48:12.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 -- 172.21.15.150:0/345390297 learned_addr learned my addr 172.21.15.150:0/345390297 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:12.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fcd5d0700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7fc806d340 0x7f7fc814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:12.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 -- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7fc806d340 msgr2=0x7f7fc814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:12.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7fc806d340 0x7f7fc814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:12.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 -- 172.21.15.150:0/345390297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 msgr2=0x7f7fc8152140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:12.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 0x7f7fc8152140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:12.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.676+0000 7f7fccdcf700 1 -- 172.21.15.150:0/345390297 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40093e0 con 0x7f7fc8068910 2022-08-10T17:48:12.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fccdcf700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00b460 tx=0x7f7fbc00b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:12.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc003cd0 con 0x7f7fc8068910 2022-08-10T17:48:12.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc003e50 con 0x7f7fc8068910 2022-08-10T17:48:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc81db200 con 0x7f7fc8068910 2022-08-10T17:48:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0052b0 con 0x7f7fc8068910 2022-08-10T17:48:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.677+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc81eb2e0 con 0x7f7fc8068910 2022-08-10T17:48:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.678+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8070070 con 0x7f7fc8068910 2022-08-10T17:48:12.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.678+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7fbc00f070 con 0x7f7fc8068910 2022-08-10T17:48:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.678+0000 7f7fc57fa700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 0x7f7fb0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.678+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7fbc081b20 con 0x7f7fc8068910 2022-08-10T17:48:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.679+0000 7f7fc7fff700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 0x7f7fb0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:12.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.679+0000 7f7fc7fff700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 0x7f7fb0067510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80c2b90 tx=0x7f7fb4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:12.698 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:12.683+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7fbc04f9b0 con 0x7f7fc8068910 2022-08-10T17:48:13.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.006+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7fc8065b90 con 0x7f7fc8068910 2022-08-10T17:48:13.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.006+0000 7f7fc57fa700 1 -- 172.21.15.150:0/345390297 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f7fbc052fd0 con 0x7f7fc8068910 2022-08-10T17:48:13.011 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:13.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 msgr2=0x7f7fb0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:13.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 0x7f7fb0067510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80c2b90 tx=0x7f7fb4008030 comp rx=0 tx=0).stop 2022-08-10T17:48:13.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 msgr2=0x7f7fc81dacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:13.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00b460 tx=0x7f7fbc00b770 comp rx=0 tx=0).stop 2022-08-10T17:48:13.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 shutdown_connections 2022-08-10T17:48:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7fc806d340 0x7f7fc814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7fb0065060 0x7f7fb0067510 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7fc8068910 0x7f7fc81dacc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 --2- 172.21.15.150:0/345390297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fc806cf70 0x7f7fc8152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:13.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 >> 172.21.15.150:0/345390297 conn(0x7f7fc80c7330 msgr2=0x7f7fc81dd310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:13.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 shutdown_connections 2022-08-10T17:48:13.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:13.009+0000 7f7fcf033700 1 -- 172.21.15.150:0/345390297 wait complete. 2022-08-10T17:48:16.033 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:16.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.193+0000 7f0ca63bb700 1 Processor -- start 2022-08-10T17:48:16.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.193+0000 7f0ca63bb700 1 -- start start 2022-08-10T17:48:16.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0ca63bb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:16.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0ca63bb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:16.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0ca63bb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca0157870 con 0x7f0ca0068110 2022-08-10T17:48:16.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0ca63bb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0064b10 con 0x7f0ca0150c20 2022-08-10T17:48:16.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0ca63bb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca006e350 con 0x7f0ca0068560 2022-08-10T17:48:16.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.194+0000 7f0c9ffff700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 msgr2=0x7f0ca00c3c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:16.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0c9ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:16.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:16.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52074/0 (socket says 172.21.15.150:52074) 2022-08-10T17:48:16.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 learned_addr learned my addr 172.21.15.150:0/3952065683 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:16.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:16.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:16.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:16.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.195+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:16.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 msgr2=0x7f0ca00c3c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:16.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:48:16.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:16.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:16.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:16.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:16.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.396+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:48:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 msgr2=0x7f0ca00c3c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:48:16.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:16.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:16.797+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:48:17.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 msgr2=0x7f0ca00c3c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:17.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:48:17.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:17.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:17.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:17.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:17.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:17.598+0000 7f0ca4958700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:48:19.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.194+0000 7f0c9dffb700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 msgr2=0x7f0ca015a510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:19.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.194+0000 7f0c9dffb700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.197:3300/0 conn(0x7f0ca0068560 0x7f0ca015a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:19.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.194+0000 7f0c9dffb700 1 -- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 msgr2=0x7f0ca00c3c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:19.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.194+0000 7f0c9dffb700 1 --2- 172.21.15.150:0/3952065683 >> v2:172.21.15.150:3300/0 conn(0x7f0ca0150c20 0x7f0ca00c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:19.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.194+0000 7f0c9dffb700 1 -- 172.21.15.150:0/3952065683 >> v1:172.21.15.197:6789/0 conn(0x7f0ca0068110 legacy=0x7f0ca0159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:19.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9dffb700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:19.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9dffb700 1 -- 172.21.15.150:0/3952065683 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca006ff00 con 0x7f0c80006100 2022-08-10T17:48:19.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9dffb700 1 -- 172.21.15.150:0/3952065683 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0064b10 con 0x7f0c800035c0 2022-08-10T17:48:19.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9f7fe700 1 -- 172.21.15.150:0/3952065683 >> v1:172.21.15.150:6789/0 conn(0x7f0c80006100 legacy=0x7f0c800085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:48:19.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 msgr2=0x7f0c800059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:48:19.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 msgr2=0x7f0c800059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:19.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:19.203 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.195+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:19.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9f7fe700 1 -- 172.21.15.150:0/3952065683 >> v1:172.21.15.150:6789/0 conn(0x7f0c80006100 legacy=0x7f0c800085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:48:19.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 msgr2=0x7f0c800059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 msgr2=0x7f0c800059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:19.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.396+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:48:19.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.797+0000 7f0c9f7fe700 1 -- 172.21.15.150:0/3952065683 >> v1:172.21.15.150:6789/0 conn(0x7f0c80006100 legacy=0x7f0c800085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:48:19.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.798+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.798+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 >> v1:172.21.15.150:6789/0 conn(0x7f0c80006100 legacy=0x7f0c800085b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:19.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.798+0000 7f0c9ffff700 1 -- 172.21.15.150:0/3952065683 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8000aee0 con 0x7f0c800035c0 2022-08-10T17:48:19.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.798+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009db0 tx=0x7f0c90005330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd11b77938068eb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:19.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.798+0000 7f0c9effd700 1 -- 172.21.15.150:0/3952065683 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000b660 con 0x7f0c800035c0 2022-08-10T17:48:19.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0c9effd700 1 -- 172.21.15.150:0/3952065683 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90011040 con 0x7f0c800035c0 2022-08-10T17:48:19.804 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0c9effd700 1 -- 172.21.15.150:0/3952065683 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000b9e0 con 0x7f0c800035c0 2022-08-10T17:48:19.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 -- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 msgr2=0x7f0c800059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:19.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/3952065683 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0c800035c0 0x7f0c800059e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009db0 tx=0x7f0c90005330 comp rx=0 tx=0).stop 2022-08-10T17:48:19.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca4958700 1 -- 172.21.15.150:0/3952065683 reap_dead start 2022-08-10T17:48:19.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 -- 172.21.15.150:0/3952065683 shutdown_connections 2022-08-10T17:48:19.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 -- 172.21.15.150:0/3952065683 >> 172.21.15.150:0/3952065683 conn(0x7f0ca00c9350 msgr2=0x7f0ca00c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:19.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 -- 172.21.15.150:0/3952065683 shutdown_connections 2022-08-10T17:48:19.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.799+0000 7f0ca63bb700 1 -- 172.21.15.150:0/3952065683 wait complete. 2022-08-10T17:48:19.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.801+0000 7f0ca63bb700 1 Processor -- start 2022-08-10T17:48:19.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.801+0000 7f0ca63bb700 1 -- start start 2022-08-10T17:48:19.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:19.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 0x7f0ca00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:19.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 0x7f0ca0143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:19.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c46b0 con 0x7f0ca014cb90 2022-08-10T17:48:19.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c5540 con 0x7f0ca01e0340 2022-08-10T17:48:19.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca63bb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c4200 con 0x7f0ca01e0710 2022-08-10T17:48:19.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9f7fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 msgr2=0x7f0ca00c6600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:19.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 0x7f0ca00c6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:19.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52108/0 (socket says 172.21.15.150:52108) 2022-08-10T17:48:19.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 -- 172.21.15.150:0/1539161158 learned_addr learned my addr 172.21.15.150:0/1539161158 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:19.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca4958700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 0x7f0ca0143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 -- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 msgr2=0x7f0ca0143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:19.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 0x7f0ca0143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:19.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 -- 172.21.15.150:0/1539161158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 msgr2=0x7f0ca00c6600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:19.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 0x7f0ca00c6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:19.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 -- 172.21.15.150:0/1539161158 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009a90 con 0x7f0ca01e0340 2022-08-10T17:48:19.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0ca4958700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 0x7f0ca0143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:19.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.802+0000 7f0c9ffff700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c90018040 tx=0x7f0c90005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:19.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.803+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90003870 con 0x7f0ca01e0340 2022-08-10T17:48:19.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.803+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90009370 con 0x7f0ca01e0340 2022-08-10T17:48:19.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.803+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca014d2a0 con 0x7f0ca01e0340 2022-08-10T17:48:19.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.803+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90015840 con 0x7f0ca01e0340 2022-08-10T17:48:19.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.803+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca014d860 con 0x7f0ca01e0340 2022-08-10T17:48:19.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.804+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0070180 con 0x7f0ca01e0340 2022-08-10T17:48:19.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.804+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0c9002f070 con 0x7f0ca01e0340 2022-08-10T17:48:19.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.804+0000 7f0c9cff9700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 0x7f0c800682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:19.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.804+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0c90084280 con 0x7f0ca01e0340 2022-08-10T17:48:19.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.804+0000 7f0c9f7fe700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 0x7f0c800682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:19.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.805+0000 7f0c9f7fe700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 0x7f0c800682c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007fd0 tx=0x7f0c94007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:19.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:19.810+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f0c90052190 con 0x7f0ca01e0340 2022-08-10T17:48:20.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.125+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0ca00c37e0 con 0x7f0ca01e0340 2022-08-10T17:48:20.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.128+0000 7f0c9cff9700 1 -- 172.21.15.150:0/1539161158 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1512 (secure 0 0 0) 0x7f0c9002d600 con 0x7f0ca01e0340 2022-08-10T17:48:20.134 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:20.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 msgr2=0x7f0c800682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 0x7f0c800682c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007fd0 tx=0x7f0c94007900 comp rx=0 tx=0).stop 2022-08-10T17:48:20.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 msgr2=0x7f0ca00c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c90018040 tx=0x7f0c90005c50 comp rx=0 tx=0).stop 2022-08-10T17:48:20.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 shutdown_connections 2022-08-10T17:48:20.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0c80065e10 0x7f0c800682c0 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007fd0 tx=0x7f0c94007900 comp rx=0 tx=0).stop 2022-08-10T17:48:20.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ca01e0710 0x7f0ca0143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ca01e0340 0x7f0ca00c60c0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c90018040 tx=0x7f0c90005c50 comp rx=0 tx=0).stop 2022-08-10T17:48:20.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 --2- 172.21.15.150:0/1539161158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca014cb90 0x7f0ca00c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 >> 172.21.15.150:0/1539161158 conn(0x7f0ca00c9350 msgr2=0x7f0ca0150310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:20.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 shutdown_connections 2022-08-10T17:48:20.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.135+0000 7f0ca63bb700 1 -- 172.21.15.150:0/1539161158 wait complete. 2022-08-10T17:48:20.154 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:48:20.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:48:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.319+0000 7fc7147cf700 1 Processor -- start 2022-08-10T17:48:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.319+0000 7fc7147cf700 1 -- start start 2022-08-10T17:48:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc7147cf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 0x7fc70c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc7147cf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 0x7fc70c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc7147cf700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c0c6100 con 0x7fc70c1544c0 2022-08-10T17:48:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc7147cf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0c5270 con 0x7fc70c068820 2022-08-10T17:48:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc7147cf700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c5e00 con 0x7fc70c1540f0 2022-08-10T17:48:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc712d6c700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 msgr2=0x7fc70c0718b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc712d6c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 0x7fc70c0718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc71256b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 0x7fc70c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc711d6a700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fc70c1544c0 0x7fc70c068110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40558/0 (socket says 172.21.15.150:40558) 2022-08-10T17:48:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.320+0000 7fc711d6a700 1 -- 172.21.15.150:0/872312431 learned_addr learned my addr 172.21.15.150:0/872312431 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc711569700 1 -- 172.21.15.150:0/872312431 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624189869 0 0) 0x7fc70c0c6100 con 0x7fc70c1544c0 2022-08-10T17:48:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc711569700 1 -- 172.21.15.150:0/872312431 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f4003430 con 0x7fc70c1544c0 2022-08-10T17:48:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc71256b700 1 -- 172.21.15.150:0/872312431 >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 msgr2=0x7fc70c0718b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc71256b700 1 --2- 172.21.15.150:0/872312431 >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 0x7fc70c0718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc71256b700 1 -- 172.21.15.150:0/872312431 >> v1:172.21.15.197:6789/0 conn(0x7fc70c1544c0 legacy=0x7fc70c068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc71256b700 1 -- 172.21.15.150:0/872312431 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c06eb00 con 0x7fc70c1540f0 2022-08-10T17:48:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc71256b700 1 --2- 172.21.15.150:0/872312431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 0x7fc70c071370 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7080096b0 tx=0x7fc7080099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f6009ed76d82b75 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc711569700 1 -- 172.21.15.150:0/872312431 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080107b0 con 0x7fc70c1540f0 2022-08-10T17:48:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc711569700 1 -- 172.21.15.150:0/872312431 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708010910 con 0x7fc70c1540f0 2022-08-10T17:48:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.321+0000 7fc711569700 1 -- 172.21.15.150:0/872312431 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708010ca0 con 0x7fc70c1540f0 2022-08-10T17:48:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 -- 172.21.15.150:0/872312431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 msgr2=0x7fc70c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 --2- 172.21.15.150:0/872312431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 0x7fc70c071370 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7080096b0 tx=0x7fc7080099c0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 -- 172.21.15.150:0/872312431 shutdown_connections 2022-08-10T17:48:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 --2- 172.21.15.150:0/872312431 >> v2:172.21.15.150:3300/0 conn(0x7fc70c068820 0x7fc70c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 --2- 172.21.15.150:0/872312431 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1540f0 0x7fc70c071370 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 -- 172.21.15.150:0/872312431 >> 172.21.15.150:0/872312431 conn(0x7fc70c06d0d0 msgr2=0x7fc70c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 -- 172.21.15.150:0/872312431 shutdown_connections 2022-08-10T17:48:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.322+0000 7fc7147cf700 1 -- 172.21.15.150:0/872312431 wait complete. 2022-08-10T17:48:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.324+0000 7fc7147cf700 1 Processor -- start 2022-08-10T17:48:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.324+0000 7fc7147cf700 1 -- start start 2022-08-10T17:48:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.324+0000 7fc7147cf700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 0x7fc70c1eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.324+0000 7fc7147cf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c1540f0 0x7fc70c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1544c0 0x7fc70c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c157a30 con 0x7fc70c1540f0 2022-08-10T17:48:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c155f40 con 0x7fc70c068820 2022-08-10T17:48:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c0170 con 0x7fc70c1544c0 2022-08-10T17:48:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc711d6a700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c1540f0 msgr2=0x7fc70c154910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc711d6a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c1540f0 0x7fc70c154910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc71256b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 0x7fc70c1eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc71256b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 0x7fc70c1eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52122/0 (socket says 172.21.15.150:52122) 2022-08-10T17:48:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc71256b700 1 -- 172.21.15.150:0/4228990260 learned_addr learned my addr 172.21.15.150:0/4228990260 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1544c0 0x7fc70c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 msgr2=0x7fc70c1eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 0x7fc70c1eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c1540f0 msgr2=0x7fc70c154910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c1540f0 0x7fc70c154910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708009310 con 0x7fc70c1544c0 2022-08-10T17:48:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc71256b700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c068820 0x7fc70c1eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc712d6c700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1544c0 0x7fc70c152640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc70400bd90 tx=0x7fc704009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040060d0 con 0x7fc70c1544c0 2022-08-10T17:48:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704006230 con 0x7fc70c1544c0 2022-08-10T17:48:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c1ec5c0 con 0x7fc70c1544c0 2022-08-10T17:48:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040065e0 con 0x7fc70c1544c0 2022-08-10T17:48:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.325+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c0bfb60 con 0x7fc70c1544c0 2022-08-10T17:48:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.326+0000 7fc7147cf700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 0x7fc70c1ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.326+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0672f0 con 0x7fc70c152b80 2022-08-10T17:48:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.326+0000 7fc71256b700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 0x7fc70c1ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc71256b700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc70c1ec750 con 0x7fc70c152b80 2022-08-10T17:48:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc71256b700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 0x7fc70c1ebe60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc7080045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc70401d070 con 0x7fc70c1544c0 2022-08-10T17:48:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6ec065000 0x7fc6ec0674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc704082a20 con 0x7fc70c1544c0 2022-08-10T17:48:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc711d6a700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6ec065000 0x7fc6ec0674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708020070 con 0x7fc70c152b80 2022-08-10T17:48:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fc7080118a0 con 0x7fc70c152b80 2022-08-10T17:48:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 msgr2=0x7fc70c1ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 0x7fc70c1ebe60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc7080045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 msgr2=0x7fc70c1ebe60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.327+0000 7fc6faffd700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c152b80 0x7fc70c1ebe60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.328+0000 7fc711d6a700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6ec065000 0x7fc6ec0674b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc70c071d70 tx=0x7fc6fc007880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.334+0000 7fc7147cf700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 0x7fc70c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.335+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c1ec3a0 con 0x7fc70c151870 2022-08-10T17:48:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.335+0000 7fc71256b700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 0x7fc70c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.335+0000 7fc71256b700 1 -- 172.21.15.150:0/4228990260 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc70c072890 con 0x7fc70c151870 2022-08-10T17:48:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.335+0000 7fc71256b700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 0x7fc70c1551a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc70801c000 tx=0x7fc708010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.335+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70802e040 con 0x7fc70c151870 2022-08-10T17:48:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5020 (secure 0 0 0) 0x7fc708006360 con 0x7fc70c151870 2022-08-10T17:48:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 msgr2=0x7fc70c1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc6faffd700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 0x7fc70c1551a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc70801c000 tx=0x7fc708010000 comp rx=0 tx=0).stop 2022-08-10T17:48:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc6faffd700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 msgr2=0x7fc70c1551a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc6faffd700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc70c151870 0x7fc70c1551a0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc70801c000 tx=0x7fc708010000 comp rx=0 tx=0).stop 2022-08-10T17:48:20.351 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:20.352 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:20.352 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:20.352 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:48:20.352 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 98, 2022-08-10T17:48:20.353 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:20.353 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:20.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:20.353 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.354 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:48:20.354 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:20.354 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:20.354 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:20.354 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.355 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.355 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.355 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.355 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.356 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.356 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.356 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.356 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.356 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.357 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:20.357 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:20.357 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.357 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.358 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.358 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.358 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.358 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.359 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.359 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.359 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.360 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:20.360 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:20.360 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:20.360 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:20.360 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:20.361 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:20.361 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:20.361 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:20.361 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:20.362 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:20.362 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:20.362 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:20.363 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:20.363 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:20.363 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:20.363 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:20.364 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.364 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.364 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.364 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.365 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.365 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.365 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.365 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.366 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.366 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.366 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:20.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.366 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:20.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.367 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:20.367 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:20.367 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.368 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.368 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:20.369 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.369 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.369 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:20.370 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.370 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.370 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.371 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:20.371 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:20.371 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.372 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.372 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.373 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:20.373 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:20.373 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.373 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.374 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.374 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:20.374 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.375 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.375 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:20.375 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.375 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.376 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.376 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:20.376 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:20.376 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.377 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.377 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.378 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:20.378 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:20.378 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.379 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.379 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.379 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:20.380 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.380 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:20.381 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.381 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.381 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.382 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:20.382 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:20.382 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.382 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.382 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.383 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.383 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:20.384 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:20.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.384 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.384 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.384 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:20.385 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.385 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.385 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:48:20.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.385 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.386 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.386 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:48:20.386 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.386 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.387 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:48:20.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.387 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.387 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.387 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:48:20.388 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.388 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.388 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:20.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.389 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:48:20.389 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.389 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:20.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.390 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.390 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.390 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:48:20.390 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.391 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.391 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:48:20.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.391 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.391 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.392 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:48:20.392 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.392 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.393 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:20.393 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:20.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6ec065000 msgr2=0x7fc6ec0674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc6ec065000 0x7fc6ec0674b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc70c071d70 tx=0x7fc6fc007880 comp rx=0 tx=0).stop 2022-08-10T17:48:20.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1544c0 msgr2=0x7fc70c152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 --2- 172.21.15.150:0/4228990260 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc70c1544c0 0x7fc70c152640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc70400bd90 tx=0x7fc704009eb0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc712d6c700 1 -- 172.21.15.150:0/4228990260 reap_dead start 2022-08-10T17:48:20.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc712d6c700 1 -- 172.21.15.150:0/4228990260 reap_dead start 2022-08-10T17:48:20.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 shutdown_connections 2022-08-10T17:48:20.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 >> 172.21.15.150:0/4228990260 conn(0x7fc70c06d0d0 msgr2=0x7fc70c0c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:20.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 shutdown_connections 2022-08-10T17:48:20.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.336+0000 7fc7147cf700 1 -- 172.21.15.150:0/4228990260 wait complete. 2022-08-10T17:48:20.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:48:20.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.526+0000 7f6dab620700 1 Processor -- start 2022-08-10T17:48:20.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.526+0000 7f6dab620700 1 -- start start 2022-08-10T17:48:20.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 0x7f6da40c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40c6080 con 0x7f6da406b1b0 2022-08-10T17:48:20.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da406ae80 con 0x7f6da406ea90 2022-08-10T17:48:20.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6dab620700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c3600 con 0x7f6da40c3230 2022-08-10T17:48:20.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da8bbb700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 msgr2=0x7f6da40c4cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:20.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da8bbb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 0x7f6da40c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:20.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da9bbd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da93bc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da9bbd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52138/0 (socket says 172.21.15.150:52138) 2022-08-10T17:48:20.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da9bbd700 1 -- 172.21.15.150:0/397545862 learned_addr learned my addr 172.21.15.150:0/397545862 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:20.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.527+0000 7f6da93bc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55764/0 (socket says 172.21.15.150:55764) 2022-08-10T17:48:20.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 -- 172.21.15.150:0/397545862 >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 msgr2=0x7f6da40c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:20.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 --2- 172.21.15.150:0/397545862 >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 -- 172.21.15.150:0/397545862 >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 msgr2=0x7f6da40c4cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:20.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 --2- 172.21.15.150:0/397545862 >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 0x7f6da40c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 -- 172.21.15.150:0/397545862 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40c5900 con 0x7f6da40c3230 2022-08-10T17:48:20.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da9bbd700 1 --2- 172.21.15.150:0/397545862 >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6da93bc700 1 --2- 172.21.15.150:0/397545862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c44d0 tx=0x7f6da00099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd22889ad7e59d00 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6d93fff700 1 -- 172.21.15.150:0/397545862 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00107b0 con 0x7f6da40c3230 2022-08-10T17:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6d93fff700 1 -- 172.21.15.150:0/397545862 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0010910 con 0x7f6da40c3230 2022-08-10T17:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6d93fff700 1 -- 172.21.15.150:0/397545862 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0010cc0 con 0x7f6da40c3230 2022-08-10T17:48:20.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 -- 172.21.15.150:0/397545862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 msgr2=0x7f6da40ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 --2- 172.21.15.150:0/397545862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c44d0 tx=0x7f6da00099c0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 -- 172.21.15.150:0/397545862 shutdown_connections 2022-08-10T17:48:20.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 --2- 172.21.15.150:0/397545862 >> v2:172.21.15.197:3300/0 conn(0x7f6da406ea90 0x7f6da40c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 --2- 172.21.15.150:0/397545862 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40ca420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 --2- 172.21.15.150:0/397545862 >> v2:172.21.15.150:3300/0 conn(0x7f6da406b1b0 0x7f6da40c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.528+0000 7f6dab620700 1 -- 172.21.15.150:0/397545862 >> 172.21.15.150:0/397545862 conn(0x7f6da4068110 msgr2=0x7f6da4068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:20.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.529+0000 7f6dab620700 1 -- 172.21.15.150:0/397545862 shutdown_connections 2022-08-10T17:48:20.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.529+0000 7f6dab620700 1 -- 172.21.15.150:0/397545862 wait complete. 2022-08-10T17:48:20.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.530+0000 7f6dab620700 1 Processor -- start 2022-08-10T17:48:20.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.530+0000 7f6dab620700 1 -- start start 2022-08-10T17:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6da406b1b0 0x7f6da414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 0x7f6da40aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40bfb30 con 0x7f6da406b1b0 2022-08-10T17:48:20.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40bfe10 con 0x7f6da406ea90 2022-08-10T17:48:20.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6dab620700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c00f0 con 0x7f6da40c3230 2022-08-10T17:48:20.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da93bc700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6da406b1b0 msgr2=0x7f6da414f2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:48:20.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da93bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6da406b1b0 0x7f6da414f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:20.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da9bbd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da8bbb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 0x7f6da40aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da8bbb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 0x7f6da40aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52140/0 (socket says 172.21.15.150:52140) 2022-08-10T17:48:20.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da9bbd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40bdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:55774/0 (socket says 172.21.15.150:55774) 2022-08-10T17:48:20.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.531+0000 7f6da8bbb700 1 -- 172.21.15.150:0/1214053481 learned_addr learned my addr 172.21.15.150:0/1214053481 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:20.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 msgr2=0x7f6da40bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c3230 0x7f6da40bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6da406b1b0 msgr2=0x7f6da414f2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:20.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6da406b1b0 0x7f6da414f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009b30 con 0x7f6da406ea90 2022-08-10T17:48:20.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6da8bbb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 0x7f6da40aeb00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400b3e0 tx=0x7f6d9400b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400bea0 con 0x7f6da406ea90 2022-08-10T17:48:20.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94003ca0 con 0x7f6da406ea90 2022-08-10T17:48:20.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da0009310 con 0x7f6da406ea90 2022-08-10T17:48:20.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94005310 con 0x7f6da406ea90 2022-08-10T17:48:20.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.532+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40af4b0 con 0x7f6da406ea90 2022-08-10T17:48:20.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6dab620700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 0x7f6da40be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4072890 con 0x7f6da40af040 2022-08-10T17:48:20.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6da93bc700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 0x7f6da40be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6da93bc700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6da406a7b0 con 0x7f6da40af040 2022-08-10T17:48:20.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6d9400f070 con 0x7f6da406ea90 2022-08-10T17:48:20.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.533+0000 7f6da93bc700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 0x7f6da40be120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c44d0 tx=0x7f6da00045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d84065090 0x7f6d84067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6d940819e0 con 0x7f6da406ea90 2022-08-10T17:48:20.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6da9bbd700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d84065090 0x7f6d84067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0010f10 con 0x7f6da40af040 2022-08-10T17:48:20.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f6da0004230 con 0x7f6da40af040 2022-08-10T17:48:20.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 msgr2=0x7f6da40be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 0x7f6da40be120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c44d0 tx=0x7f6da00045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 msgr2=0x7f6da40be120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:20.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6d91ffb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40af040 0x7f6da40be120 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.534+0000 7f6da9bbd700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d84065090 0x7f6d84067540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0072e0 tx=0x7f6d9c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.541+0000 7f6dab620700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 0x7f6da4149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:20.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.541+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40bff50 con 0x7f6da40c8700 2022-08-10T17:48:20.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.541+0000 7f6da93bc700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 0x7f6da4149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:20.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6da93bc700 1 -- 172.21.15.150:0/1214053481 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6da40bd900 con 0x7f6da40c8700 2022-08-10T17:48:20.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6da93bc700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 0x7f6da4149a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6da40729d0 tx=0x7f6da0010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:20.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0028040 con 0x7f6da40c8700 2022-08-10T17:48:20.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4535 (secure 0 0 0) 0x7f6da0003990 con 0x7f6da40c8700 2022-08-10T17:48:20.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 msgr2=0x7f6da4149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.542+0000 7f6d91ffb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 0x7f6da4149a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6da40729d0 tx=0x7f6da0010000 comp rx=0 tx=0).stop 2022-08-10T17:48:20.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6d91ffb700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 msgr2=0x7f6da4149a40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:20.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6d91ffb700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6da40c8700 0x7f6da4149a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.561 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:20.561 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:20.562 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:20.562 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:48:20.562 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 98, 2022-08-10T17:48:20.562 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:48:20.563 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:20.564 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:20.564 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:20.564 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.564 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.565 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.565 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.565 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.565 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.566 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.566 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.566 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.566 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.567 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:20.567 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:20.567 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.567 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.568 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.568 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.568 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.568 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.568 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.569 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.569 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.569 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.570 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:20.570 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:20.570 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:20.570 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:20.571 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:20.571 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:20.571 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:20.571 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:20.571 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:20.572 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:20.572 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:20.572 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:20.572 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:20.573 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:20.573 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:20.573 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:20.573 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:20.573 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:20.574 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:20.574 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:20.574 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:20.574 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:20.575 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:20.575 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:20.575 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:20.575 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.576 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:20.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.576 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:20.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.576 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:20.577 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:20.577 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.577 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.578 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.578 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:20.578 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.579 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:20.579 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.579 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.580 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.580 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:20.580 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:20.581 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.581 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.581 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.583 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:20.583 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.584 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.584 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:20.584 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.585 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.585 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.585 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:20.586 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:20.586 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.586 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.586 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.587 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:20.587 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:20.587 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:20.588 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:20.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.588 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:20.588 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:20.588 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:20.589 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:20.590 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:20.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.591 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:20.591 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:20.591 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:20.591 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:20.591 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:20.592 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.592 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.592 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:20.593 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:20.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.593 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.593 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.593 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:20.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.594 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.594 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:48:20.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.595 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.595 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.595 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:48:20.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.596 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:20.596 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:20.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:20.596 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:20.596 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:20.597 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:20.597 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:20.597 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:20.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:20.598 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:20.598 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:20.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d84065090 msgr2=0x7f6d84067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6d84065090 0x7f6d84067540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0072e0 tx=0x7f6d9c00b040 comp rx=0 tx=0).stop 2022-08-10T17:48:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 msgr2=0x7f6da40aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 --2- 172.21.15.150:0/1214053481 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6da406ea90 0x7f6da40aeb00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400b3e0 tx=0x7f6d9400b6f0 comp rx=0 tx=0).stop 2022-08-10T17:48:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6da9bbd700 1 -- 172.21.15.150:0/1214053481 reap_dead start 2022-08-10T17:48:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6da9bbd700 1 -- 172.21.15.150:0/1214053481 reap_dead start 2022-08-10T17:48:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 shutdown_connections 2022-08-10T17:48:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 >> 172.21.15.150:0/1214053481 conn(0x7f6da4068110 msgr2=0x7f6da40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:20.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 shutdown_connections 2022-08-10T17:48:20.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:20.543+0000 7f6dab620700 1 -- 172.21.15.150:0/1214053481 wait complete. 2022-08-10T17:48:20.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:48:40.604 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:48:40.604 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:48:40.605 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:48:40.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:48:40.608 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:48:40.608 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:48:40.608 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:40.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 Processor -- start 2022-08-10T17:48:40.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 -- start start 2022-08-10T17:48:40.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 0x7f66040c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:40.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6604070620 con 0x7f6604150f50 2022-08-10T17:48:40.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040ca810 con 0x7f66041573d0 2022-08-10T17:48:40.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.757+0000 7f660a718700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040c5ac0 con 0x7f6604150b80 2022-08-10T17:48:40.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f66037fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6604150f50 0x7f6604156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54368/0 (socket says 172.21.15.150:54368) 2022-08-10T17:48:40.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f66037fe700 1 -- 172.21.15.150:0/373724653 learned_addr learned my addr 172.21.15.150:0/373724653 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:40.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6603fff700 1 --2- 172.21.15.150:0/373724653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 0x7f66040c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:40.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6602ffd700 1 -- 172.21.15.150:0/373724653 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710420184 0 0) 0x7f66040ca810 con 0x7f66041573d0 2022-08-10T17:48:40.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6602ffd700 1 -- 172.21.15.150:0/373724653 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f0003430 con 0x7f66041573d0 2022-08-10T17:48:40.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6603fff700 1 -- 172.21.15.150:0/373724653 >> v1:172.21.15.197:6789/0 conn(0x7f66041573d0 legacy=0x7f66041611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:40.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6603fff700 1 -- 172.21.15.150:0/373724653 >> v1:172.21.15.150:6789/0 conn(0x7f6604150f50 legacy=0x7f6604156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:40.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6603fff700 1 -- 172.21.15.150:0/373724653 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604070010 con 0x7f6604150b80 2022-08-10T17:48:40.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6603fff700 1 --2- 172.21.15.150:0/373724653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 0x7f66040c42a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65f40096e0 tx=0x7f65f40099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9747e50187c7e2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:40.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6602ffd700 1 -- 172.21.15.150:0/373724653 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40107b0 con 0x7f6604150b80 2022-08-10T17:48:40.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6602ffd700 1 -- 172.21.15.150:0/373724653 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4010910 con 0x7f6604150b80 2022-08-10T17:48:40.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.758+0000 7f6602ffd700 1 -- 172.21.15.150:0/373724653 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4010cc0 con 0x7f6604150b80 2022-08-10T17:48:40.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 -- 172.21.15.150:0/373724653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 msgr2=0x7f66040c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 --2- 172.21.15.150:0/373724653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 0x7f66040c42a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65f40096e0 tx=0x7f65f40099f0 comp rx=0 tx=0).stop 2022-08-10T17:48:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 -- 172.21.15.150:0/373724653 shutdown_connections 2022-08-10T17:48:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 --2- 172.21.15.150:0/373724653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6604150b80 0x7f66040c42a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 -- 172.21.15.150:0/373724653 >> 172.21.15.150:0/373724653 conn(0x7f6604071e40 msgr2=0x7f660406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:40.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 -- 172.21.15.150:0/373724653 shutdown_connections 2022-08-10T17:48:40.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.759+0000 7f660a718700 1 -- 172.21.15.150:0/373724653 wait complete. 2022-08-10T17:48:40.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.760+0000 7f660a718700 1 Processor -- start 2022-08-10T17:48:40.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 -- start start 2022-08-10T17:48:40.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 0x7f6604148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:40.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:40.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 0x7f66041ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:40.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66041ebee0 con 0x7f6604150f50 2022-08-10T17:48:40.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604148f20 con 0x7f6604150b80 2022-08-10T17:48:40.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.761+0000 7f660a718700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6604068e80 con 0x7f66041573d0 2022-08-10T17:48:40.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:40.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41694/0 (socket says 172.21.15.150:41694) 2022-08-10T17:48:40.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 -- 172.21.15.150:0/186158210 learned_addr learned my addr 172.21.15.150:0/186158210 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:40.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 0x7f6604148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:40.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6608cb5700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 0x7f66041ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:40.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 msgr2=0x7f66041488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:48:40.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 msgr2=0x7f66041488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:48:40.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:40.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f66037fe700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:40.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 msgr2=0x7f66041ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:40.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 0x7f66041ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:40.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 msgr2=0x7f66041488b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:40.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:40.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 -- 172.21.15.150:0/186158210 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009310 con 0x7f6604150b80 2022-08-10T17:48:40.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6608cb5700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 0x7f66041ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:40.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6603fff700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 0x7f6604148370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65f4015000 tx=0x7f65f40045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:40.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4010c80 con 0x7f6604150b80 2022-08-10T17:48:40.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4004030 con 0x7f6604150b80 2022-08-10T17:48:40.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66040690f0 con 0x7f6604150b80 2022-08-10T17:48:40.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40043c0 con 0x7f6604150b80 2022-08-10T17:48:40.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.762+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6604149170 con 0x7f6604150b80 2022-08-10T17:48:40.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.763+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66040cc7b0 con 0x7f6604150b80 2022-08-10T17:48:40.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.764+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f65f400f070 con 0x7f6604150b80 2022-08-10T17:48:40.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.764+0000 7f6600ff9700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 0x7f65e4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:40.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.764+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f65f4021030 con 0x7f6604150b80 2022-08-10T17:48:40.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.764+0000 7f66037fe700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 0x7f65e4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:40.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.764+0000 7f66037fe700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 0x7f65e4067590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f66040ccd00 tx=0x7f65f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:40.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:40.769+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f65f4051440 con 0x7f6604150b80 2022-08-10T17:48:41.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.080+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6604149d30 con 0x7f6604150b80 2022-08-10T17:48:41.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.081+0000 7f6600ff9700 1 -- 172.21.15.150:0/186158210 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f65f4054a60 con 0x7f6604150b80 2022-08-10T17:48:41.089 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":98,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:41.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 msgr2=0x7f65e4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:41.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 0x7f65e4067590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f66040ccd00 tx=0x7f65f8009040 comp rx=0 tx=0).stop 2022-08-10T17:48:41.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 msgr2=0x7f6604148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:41.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 0x7f6604148370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65f4015000 tx=0x7f65f40045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:41.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 shutdown_connections 2022-08-10T17:48:41.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f65e40650e0 0x7f65e4067590 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:41.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66041573d0 0x7f66041ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:41.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6604150b80 0x7f6604148370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:41.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 --2- 172.21.15.150:0/186158210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6604150f50 0x7f66041488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:41.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 >> 172.21.15.150:0/186158210 conn(0x7f6604071e40 msgr2=0x7f66040c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:41.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 shutdown_connections 2022-08-10T17:48:41.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:41.083+0000 7f660a718700 1 -- 172.21.15.150:0/186158210 wait complete. 2022-08-10T17:48:44.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:44.240 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.237+0000 7f2d19e12700 1 Processor -- start 2022-08-10T17:48:44.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.237+0000 7f2d19e12700 1 -- start start 2022-08-10T17:48:44.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d19e12700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:44.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d19e12700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d141521f0 con 0x7f2d14155400 2022-08-10T17:48:44.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d19e12700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d140c66c0 con 0x7f2d140c69b0 2022-08-10T17:48:44.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d19e12700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14154710 con 0x7f2d140c21d0 2022-08-10T17:48:44.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d13fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f2d140c69b0 0x7f2d1406d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40766/0 (socket says 172.21.15.150:40766) 2022-08-10T17:48:44.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.238+0000 7f2d13fff700 1 -- 172.21.15.150:0/1614251139 learned_addr learned my addr 172.21.15.150:0/1614251139 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:44.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.243+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:44.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.243+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:44.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.243+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:44.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.243+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:44.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.243+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:44.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.444+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:44.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.444+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:44.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.444+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:44.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.444+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:44.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.444+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:48:44.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.845+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:44.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.845+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:44.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.845+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:44.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.845+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:44.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:44.845+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:48:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:45.646+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:45.646+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:48:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:45.646+0000 7f2d137fe700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:45.646+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:45.646+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:48:46.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671499919 0 0) 0x7f2d140c66c0 con 0x7f2d140c69b0 2022-08-10T17:48:46.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d00003430 con 0x7f2d140c69b0 2022-08-10T17:48:46.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2721389111 0 0) 0x7f2d00003430 con 0x7f2d140c69b0 2022-08-10T17:48:46.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 msgr2=0x7f2d140caa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:46.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d140c21d0 0x7f2d140caa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.360+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 >> v1:172.21.15.150:6789/0 conn(0x7f2d14155400 legacy=0x7f2d140c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140c6e80 con 0x7f2d140c69b0 2022-08-10T17:48:46.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f2d0c0019f0 con 0x7f2d140c69b0 2022-08-10T17:48:46.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 >> v1:172.21.15.197:6789/0 conn(0x7f2d140c69b0 legacy=0x7f2d1406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00003880 0x7f2d00003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d000046d0 0x7f2d00004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d00005080 0x7f2d0000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14154710 con 0x7f2d000046d0 2022-08-10T17:48:46.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0000bf70 con 0x7f2d00003880 2022-08-10T17:48:46.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0000c130 con 0x7f2d00005080 2022-08-10T17:48:46.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d13fff700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d00005080 0x7f2d0000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.361+0000 7f2d137fe700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00003880 0x7f2d00003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.362+0000 7f2d13fff700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00003880 msgr2=0x7f2d00003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:46.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.362+0000 7f2d13fff700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00003880 0x7f2d00003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.362+0000 7f2d13fff700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d000046d0 msgr2=0x7f2d00004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:46.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.362+0000 7f2d13fff700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d000046d0 0x7f2d00004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.362+0000 7f2d13fff700 1 -- 172.21.15.150:0/1614251139 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140c6e80 con 0x7f2d00005080 2022-08-10T17:48:46.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.363+0000 7f2d13fff700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d00005080 0x7f2d0000b890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c002180 tx=0x7f2d00005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f102ff0733621660 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:46.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.363+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c005b60 con 0x7f2d00005080 2022-08-10T17:48:46.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.363+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c005cc0 con 0x7f2d00005080 2022-08-10T17:48:46.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.363+0000 7f2d127fc700 1 -- 172.21.15.150:0/1614251139 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c011760 con 0x7f2d00005080 2022-08-10T17:48:46.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.364+0000 7f2d19e12700 1 -- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d00005080 msgr2=0x7f2d0000b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.364+0000 7f2d19e12700 1 --2- 172.21.15.150:0/1614251139 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d00005080 0x7f2d0000b890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c002180 tx=0x7f2d00005700 comp rx=0 tx=0).stop 2022-08-10T17:48:46.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.364+0000 7f2d13fff700 1 -- 172.21.15.150:0/1614251139 reap_dead start 2022-08-10T17:48:46.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.366+0000 7f2d19e12700 1 -- 172.21.15.150:0/1614251139 shutdown_connections 2022-08-10T17:48:46.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.366+0000 7f2d19e12700 1 -- 172.21.15.150:0/1614251139 >> 172.21.15.150:0/1614251139 conn(0x7f2d1406fae0 msgr2=0x7f2d1406fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:46.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.368+0000 7f2d19e12700 1 -- 172.21.15.150:0/1614251139 shutdown_connections 2022-08-10T17:48:46.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.369+0000 7f2d19e12700 1 -- 172.21.15.150:0/1614251139 wait complete. 2022-08-10T17:48:46.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.371+0000 7f2d19e12700 1 Processor -- start 2022-08-10T17:48:46.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.371+0000 7f2d19e12700 1 -- start start 2022-08-10T17:48:46.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 0x7f2d140c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140cae30 con 0x7f2d140cb780 2022-08-10T17:48:46.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14155870 con 0x7f2d00005080 2022-08-10T17:48:46.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d19e12700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1414ba90 con 0x7f2d14155e70 2022-08-10T17:48:46.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d137fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 0x7f2d140c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d137fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 0x7f2d140c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52356/0 (socket says 172.21.15.150:52356) 2022-08-10T17:48:46.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d137fe700 1 -- 172.21.15.150:0/3599474284 learned_addr learned my addr 172.21.15.150:0/3599474284 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:46.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41766/0 (socket says 172.21.15.150:41766) 2022-08-10T17:48:46.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d13fff700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d13fff700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 msgr2=0x7f2d1414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:48:46.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d13fff700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 msgr2=0x7f2d1414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:48:46.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d13fff700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:46.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.372+0000 7f2d13fff700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:46.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 msgr2=0x7f2d1414cab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:46.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 msgr2=0x7f2d140c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 0x7f2d140c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 -- 172.21.15.150:0/3599474284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140ca4a0 con 0x7f2d140cb780 2022-08-10T17:48:46.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d12ffd700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d1406f210 tx=0x7f2d0800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:46.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08012620 con 0x7f2d140cb780 2022-08-10T17:48:46.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080127a0 con 0x7f2d140cb780 2022-08-10T17:48:46.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d14155aa0 con 0x7f2d140cb780 2022-08-10T17:48:46.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08012b50 con 0x7f2d140cb780 2022-08-10T17:48:46.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.373+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d140ca9d0 con 0x7f2d140cb780 2022-08-10T17:48:46.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.376+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1414c3c0 con 0x7f2d140cb780 2022-08-10T17:48:46.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.377+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2d08010050 con 0x7f2d140cb780 2022-08-10T17:48:46.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.378+0000 7f2cfbfff700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 0x7f2cf4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:46.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.378+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2d08081df0 con 0x7f2d140cb780 2022-08-10T17:48:46.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.381+0000 7f2d137fe700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 0x7f2cf4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:46.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.381+0000 7f2d137fe700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 0x7f2cf4067560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2d04003700 tx=0x7f2d04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:46.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.384+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2d0804fc60 con 0x7f2d140cb780 2022-08-10T17:48:46.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.721+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2d140c7fa0 con 0x7f2d140cb780 2022-08-10T17:48:46.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.722+0000 7f2cfbfff700 1 -- 172.21.15.150:0/3599474284 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f2d08053280 con 0x7f2d140cb780 2022-08-10T17:48:46.726 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":102,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:46.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.724+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 msgr2=0x7f2cf4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.724+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 0x7f2cf4067560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2d04003700 tx=0x7f2d04008040 comp rx=0 tx=0).stop 2022-08-10T17:48:46.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.724+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 msgr2=0x7f2d1414c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:46.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.724+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d1406f210 tx=0x7f2d0800c720 comp rx=0 tx=0).stop 2022-08-10T17:48:46.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 shutdown_connections 2022-08-10T17:48:46.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2cf40650b0 0x7f2cf4067560 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2d14155e70 0x7f2d1414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2d00005080 0x7f2d140c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 --2- 172.21.15.150:0/3599474284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d140cb780 0x7f2d1414c570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:46.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 >> 172.21.15.150:0/3599474284 conn(0x7f2d1406fae0 msgr2=0x7f2d140c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:46.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 shutdown_connections 2022-08-10T17:48:46.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:46.725+0000 7f2d19e12700 1 -- 172.21.15.150:0/3599474284 wait complete. 2022-08-10T17:48:49.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:49.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.873+0000 7f612b724700 1 Processor -- start 2022-08-10T17:48:49.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f612b724700 1 -- start start 2022-08-10T17:48:49.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f612b724700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f612b724700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612406b310 con 0x7f61240896d0 2022-08-10T17:48:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f612b724700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240c3aa0 con 0x7f6124089aa0 2022-08-10T17:48:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f612b724700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612406bf00 con 0x7f61240c5050 2022-08-10T17:48:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f61294c0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f61240896d0 0x7f61240c32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54460/0 (socket says 172.21.15.150:54460) 2022-08-10T17:48:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.874+0000 7f61294c0700 1 -- 172.21.15.150:0/3301022229 learned_addr learned my addr 172.21.15.150:0/3301022229 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.875+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.875+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.875+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.875+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:49.878+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:50.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.084+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:50.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.084+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:50.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.084+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:50.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.084+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:50.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.084+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:48:50.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.485+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:50.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.486+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:50.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.486+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:50.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.486+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:50.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:50.486+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:48:51.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:51.287+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:51.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:51.287+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:48:51.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:51.287+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:48:51.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:51.287+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:51.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:51.287+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:48:52.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687843698 0 0) 0x7f61240c3aa0 con 0x7f6124089aa0 2022-08-10T17:48:52.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110003430 con 0x7f6124089aa0 2022-08-10T17:48:52.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979569244 0 0) 0x7f6110003430 con 0x7f6124089aa0 2022-08-10T17:48:52.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 msgr2=0x7f612415d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:48:52.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 --2- 172.21.15.150:0/3301022229 >> v2:172.21.15.197:3300/0 conn(0x7f61240c5050 0x7f612415d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 >> v1:172.21.15.150:6789/0 conn(0x7f61240896d0 legacy=0x7f61240c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612406b560 con 0x7f6124089aa0 2022-08-10T17:48:52.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f611c0019f0 con 0x7f6124089aa0 2022-08-10T17:48:52.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 >> v1:172.21.15.197:6789/0 conn(0x7f6124089aa0 legacy=0x7f6124166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6110003880 0x7f6110003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 0x7f6110004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6110005080 0x7f611000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612406bf00 con 0x7f6110003880 2022-08-10T17:48:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611000c010 con 0x7f61100046d0 2022-08-10T17:48:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.342+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611000c1d0 con 0x7f6110005080 2022-08-10T17:48:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 0x7f6110004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6129cc1700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6110005080 0x7f611000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6110005080 msgr2=0x7f611000b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:52.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6110005080 0x7f611000b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6110003880 msgr2=0x7f6110003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:52.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6110003880 0x7f6110003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 -- 172.21.15.150:0/3301022229 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110003430 con 0x7f61100046d0 2022-08-10T17:48:52.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6129cc1700 1 -- 172.21.15.150:0/3301022229 reap_dead start 2022-08-10T17:48:52.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6128cbf700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 0x7f6110004b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6118006f20 tx=0x7f6110005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9af6696f6330f33a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:52.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118017070 con 0x7f61100046d0 2022-08-10T17:48:52.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800c040 con 0x7f61100046d0 2022-08-10T17:48:52.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.343+0000 7f6117fff700 1 -- 172.21.15.150:0/3301022229 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800fa80 con 0x7f61100046d0 2022-08-10T17:48:52.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.344+0000 7f612b724700 1 -- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 msgr2=0x7f6110004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.344+0000 7f612b724700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 0x7f6110004b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6118006f20 tx=0x7f6110005700 comp rx=0 tx=0).stop 2022-08-10T17:48:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.344+0000 7f612b724700 1 -- 172.21.15.150:0/3301022229 shutdown_connections 2022-08-10T17:48:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.344+0000 7f612b724700 1 --2- 172.21.15.150:0/3301022229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61100046d0 0x7f6110004b40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.344+0000 7f612b724700 1 -- 172.21.15.150:0/3301022229 >> 172.21.15.150:0/3301022229 conn(0x7f61240c8a10 msgr2=0x7f61240c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.345+0000 7f612b724700 1 -- 172.21.15.150:0/3301022229 shutdown_connections 2022-08-10T17:48:52.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.345+0000 7f612b724700 1 -- 172.21.15.150:0/3301022229 wait complete. 2022-08-10T17:48:52.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.346+0000 7f612b724700 1 Processor -- start 2022-08-10T17:48:52.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 -- start start 2022-08-10T17:48:52.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61240bce50 0x7f61240bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240ba800 con 0x7f61100046d0 2022-08-10T17:48:52.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124088f20 con 0x7f61240bce50 2022-08-10T17:48:52.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f612b724700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240bd8c0 con 0x7f61240bdab0 2022-08-10T17:48:52.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f61294c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f61294c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41814/0 (socket says 172.21.15.150:41814) 2022-08-10T17:48:52.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f61294c0700 1 -- 172.21.15.150:0/2921562470 learned_addr learned my addr 172.21.15.150:0/2921562470 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:52.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.347+0000 7f6128cbf700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61240bce50 0x7f61240bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f6129cc1700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f6129cc1700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 msgr2=0x7f61240bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:48:52.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f6129cc1700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 msgr2=0x7f61240bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:48:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f6129cc1700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:48:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f6129cc1700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:48:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 msgr2=0x7f61240bdf20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:48:52.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61240bce50 msgr2=0x7f61240bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61240bce50 0x7f61240bd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 -- 172.21.15.150:0/2921562470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240b9410 con 0x7f61100046d0 2022-08-10T17:48:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.348+0000 7f61294c0700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f612000c3f0 tx=0x7f612000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:52.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.349+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200072d0 con 0x7f61100046d0 2022-08-10T17:48:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.349+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61240b96f0 con 0x7f61100046d0 2022-08-10T17:48:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.349+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120007430 con 0x7f61100046d0 2022-08-10T17:48:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.349+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61240b9cb0 con 0x7f61100046d0 2022-08-10T17:48:52.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.349+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200057c0 con 0x7f61100046d0 2022-08-10T17:48:52.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.351+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6100005170 con 0x7f61100046d0 2022-08-10T17:48:52.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.351+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6120019030 con 0x7f61100046d0 2022-08-10T17:48:52.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.351+0000 7f6115ffb700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 0x7f610c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:52.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.351+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6120081310 con 0x7f61100046d0 2022-08-10T17:48:52.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.352+0000 7f6128cbf700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 0x7f610c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:52.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.352+0000 7f6128cbf700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 0x7f610c067560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:52.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.356+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f612004f2f0 con 0x7f61100046d0 2022-08-10T17:48:52.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.685+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f61000059a0 con 0x7f61100046d0 2022-08-10T17:48:52.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.686+0000 7f6115ffb700 1 -- 172.21.15.150:0/2921562470 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f6120017020 con 0x7f61100046d0 2022-08-10T17:48:52.691 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":106,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:52.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.689+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 msgr2=0x7f610c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.689+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 0x7f610c067560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118018000 comp rx=0 tx=0).stop 2022-08-10T17:48:52.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.689+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 msgr2=0x7f61240889e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:52.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.689+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f612000c3f0 tx=0x7f612000c700 comp rx=0 tx=0).stop 2022-08-10T17:48:52.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 shutdown_connections 2022-08-10T17:48:52.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f610c0650b0 0x7f610c067560 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f61240bdab0 0x7f61240bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61100046d0 0x7f61240889e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 --2- 172.21.15.150:0/2921562470 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f61240bce50 0x7f61240bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:52.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 >> 172.21.15.150:0/2921562470 conn(0x7f61240c8a10 msgr2=0x7f612406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:52.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 shutdown_connections 2022-08-10T17:48:52.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:52.691+0000 7f612b724700 1 -- 172.21.15.150:0/2921562470 wait complete. 2022-08-10T17:48:55.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:55.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.859+0000 7f595b1c2700 1 Processor -- start 2022-08-10T17:48:55.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.859+0000 7f595b1c2700 1 -- start start 2022-08-10T17:48:55.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f595b1c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5954150b80 0x7f59540c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:55.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f595b1c2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5954070620 con 0x7f59541573d0 2022-08-10T17:48:55.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f595b1c2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59540ca810 con 0x7f5954150f50 2022-08-10T17:48:55.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f595b1c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59540c5ac0 con 0x7f5954150b80 2022-08-10T17:48:55.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f5958f5e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5954150b80 0x7f59540c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:55.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f5958f5e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5954150b80 0x7f59540c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41840/0 (socket says 172.21.15.150:41840) 2022-08-10T17:48:55.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f595975f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f59541573d0 0x7f59541611e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54524/0 (socket says 172.21.15.150:54524) 2022-08-10T17:48:55.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.860+0000 7f5958f5e700 1 -- 172.21.15.150:0/3937910710 learned_addr learned my addr 172.21.15.150:0/3937910710 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:55.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f5958f5e700 1 -- 172.21.15.150:0/3937910710 >> v1:172.21.15.197:6789/0 conn(0x7f5954150f50 legacy=0x7f5954156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:55.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f5958f5e700 1 -- 172.21.15.150:0/3937910710 >> v1:172.21.15.150:6789/0 conn(0x7f59541573d0 legacy=0x7f59541611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:55.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f5958f5e700 1 -- 172.21.15.150:0/3937910710 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954070010 con 0x7f5954150b80 2022-08-10T17:48:55.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f59537fe700 1 -- 172.21.15.150:0/3937910710 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874188746 0 0) 0x7f5954070620 con 0x7f59541573d0 2022-08-10T17:48:55.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f5958f5e700 1 --2- 172.21.15.150:0/3937910710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59540c42a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5948006fd0 tx=0x7f5948009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b378df2abb479f1 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:55.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f59537fe700 1 -- 172.21.15.150:0/3937910710 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948004290 con 0x7f5954150b80 2022-08-10T17:48:55.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f59537fe700 1 -- 172.21.15.150:0/3937910710 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59480043f0 con 0x7f5954150b80 2022-08-10T17:48:55.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f59537fe700 1 -- 172.21.15.150:0/3937910710 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948011850 con 0x7f5954150b80 2022-08-10T17:48:55.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 -- 172.21.15.150:0/3937910710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 msgr2=0x7f59540c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:55.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3937910710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59540c42a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5948006fd0 tx=0x7f5948009a60 comp rx=0 tx=0).stop 2022-08-10T17:48:55.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 -- 172.21.15.150:0/3937910710 shutdown_connections 2022-08-10T17:48:55.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3937910710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59540c42a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:55.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 -- 172.21.15.150:0/3937910710 >> 172.21.15.150:0/3937910710 conn(0x7f5954071e40 msgr2=0x7f595406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:55.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 -- 172.21.15.150:0/3937910710 shutdown_connections 2022-08-10T17:48:55.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.861+0000 7f595b1c2700 1 -- 172.21.15.150:0/3937910710 wait complete. 2022-08-10T17:48:55.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 Processor -- start 2022-08-10T17:48:55.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 -- start start 2022-08-10T17:48:55.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:55.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 0x7f5954152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:55.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59541573d0 0x7f5954145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:55.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541517a0 con 0x7f5954150b80 2022-08-10T17:48:55.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595415a610 con 0x7f5954150f50 2022-08-10T17:48:55.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f595b1c2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59540caec0 con 0x7f59541573d0 2022-08-10T17:48:55.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f5958f5e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:55.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f5958f5e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41846/0 (socket says 172.21.15.150:41846) 2022-08-10T17:48:55.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f5958f5e700 1 -- 172.21.15.150:0/3316127391 learned_addr learned my addr 172.21.15.150:0/3316127391 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:55.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.863+0000 7f5953fff700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 0x7f5954152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:55.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f595975f700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59541573d0 0x7f5954145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:55.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 -- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59541573d0 msgr2=0x7f5954145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:55.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59541573d0 0x7f5954145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:55.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 -- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 msgr2=0x7f5954152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:55.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 0x7f5954152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 -- 172.21.15.150:0/3316127391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480093e0 con 0x7f5954150b80 2022-08-10T17:48:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5953fff700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 0x7f5954152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:48:55.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f5958f5e700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5948000c00 tx=0x7f59480045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948003520 con 0x7f5954150b80 2022-08-10T17:48:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59480036a0 con 0x7f5954150b80 2022-08-10T17:48:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59540cb1a0 con 0x7f5954150b80 2022-08-10T17:48:55.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948003a50 con 0x7f5954150b80 2022-08-10T17:48:55.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.864+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59540cc3d0 con 0x7f5954150b80 2022-08-10T17:48:55.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.865+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595414abf0 con 0x7f5954150b80 2022-08-10T17:48:55.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.865+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f594802d070 con 0x7f5954150b80 2022-08-10T17:48:55.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.866+0000 7f59517fa700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 0x7f593c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:55.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.866+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5948083050 con 0x7f5954150b80 2022-08-10T17:48:55.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.866+0000 7f5953fff700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 0x7f593c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:55.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.866+0000 7f5953fff700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 0x7f593c067560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f59541f0030 tx=0x7f5940009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:55.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:55.870+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5948051030 con 0x7f5954150b80 2022-08-10T17:48:56.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.193+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f595414a910 con 0x7f5954150b80 2022-08-10T17:48:56.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.193+0000 7f59517fa700 1 -- 172.21.15.150:0/3316127391 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f594802b070 con 0x7f5954150b80 2022-08-10T17:48:56.197 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":106,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:56.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 msgr2=0x7f593c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:56.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 0x7f593c067560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f59541f0030 tx=0x7f5940009040 comp rx=0 tx=0).stop 2022-08-10T17:48:56.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 msgr2=0x7f59541528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:56.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5948000c00 tx=0x7f59480045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:56.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 shutdown_connections 2022-08-10T17:48:56.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f593c0650b0 0x7f593c067560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:56.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59541573d0 0x7f5954145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:56.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5954150b80 0x7f59541528f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:56.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 --2- 172.21.15.150:0/3316127391 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5954150f50 0x7f5954152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:56.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 >> 172.21.15.150:0/3316127391 conn(0x7f5954071e40 msgr2=0x7f5954156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:56.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 shutdown_connections 2022-08-10T17:48:56.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:56.195+0000 7f595b1c2700 1 -- 172.21.15.150:0/3316127391 wait complete. 2022-08-10T17:48:59.213 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:48:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.363+0000 7f47babb2700 1 Processor -- start 2022-08-10T17:48:59.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.363+0000 7f47babb2700 1 -- start start 2022-08-10T17:48:59.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47babb2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b406cf70 0x7f47b40c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47babb2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47b4069020 0x7f47b40c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47babb2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b406faf0 con 0x7f47b406d340 2022-08-10T17:48:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47babb2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40c1480 con 0x7f47b4069020 2022-08-10T17:48:59.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47babb2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40684f0 con 0x7f47b406cf70 2022-08-10T17:48:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47b3fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f47b406d340 0x7f47b4068910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54552/0 (socket says 172.21.15.150:54552) 2022-08-10T17:48:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47b3fff700 1 -- 172.21.15.150:0/4144092302 learned_addr learned my addr 172.21.15.150:0/4144092302 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.364+0000 7f47b914f700 1 --2- 172.21.15.150:0/4144092302 >> v2:172.21.15.150:3300/0 conn(0x7f47b4069020 0x7f47b40c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b894e700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b406cf70 0x7f47b40c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b37fe700 1 -- 172.21.15.150:0/4144092302 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538539884 0 0) 0x7f47b406faf0 con 0x7f47b406d340 2022-08-10T17:48:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b37fe700 1 -- 172.21.15.150:0/4144092302 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4798003430 con 0x7f47b406d340 2022-08-10T17:48:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b914f700 1 -- 172.21.15.150:0/4144092302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b406cf70 msgr2=0x7f47b40c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:59.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b914f700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b406cf70 0x7f47b40c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b914f700 1 -- 172.21.15.150:0/4144092302 >> v1:172.21.15.150:6789/0 conn(0x7f47b406d340 legacy=0x7f47b4068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b914f700 1 -- 172.21.15.150:0/4144092302 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b406fd90 con 0x7f47b4069020 2022-08-10T17:48:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b914f700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b4069020 0x7f47b40c32a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009d90 tx=0x7f47ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3e35fe13a04b86 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b37fe700 1 -- 172.21.15.150:0/4144092302 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00e070 con 0x7f47b4069020 2022-08-10T17:48:59.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b37fe700 1 -- 172.21.15.150:0/4144092302 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac00bb20 con 0x7f47b4069020 2022-08-10T17:48:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.365+0000 7f47b37fe700 1 -- 172.21.15.150:0/4144092302 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac012430 con 0x7f47b4069020 2022-08-10T17:48:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 -- 172.21.15.150:0/4144092302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b4069020 msgr2=0x7f47b40c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b4069020 0x7f47b40c32a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009d90 tx=0x7f47ac00b330 comp rx=0 tx=0).stop 2022-08-10T17:48:59.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 -- 172.21.15.150:0/4144092302 shutdown_connections 2022-08-10T17:48:59.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b4069020 0x7f47b40c32a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 --2- 172.21.15.150:0/4144092302 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b406cf70 0x7f47b40c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 -- 172.21.15.150:0/4144092302 >> 172.21.15.150:0/4144092302 conn(0x7f47b40c7330 msgr2=0x7f47b406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:59.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 -- 172.21.15.150:0/4144092302 shutdown_connections 2022-08-10T17:48:59.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.366+0000 7f47babb2700 1 -- 172.21.15.150:0/4144092302 wait complete. 2022-08-10T17:48:59.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.367+0000 7f47babb2700 1 Processor -- start 2022-08-10T17:48:59.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.367+0000 7f47babb2700 1 -- start start 2022-08-10T17:48:59.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 0x7f47b41e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47b406cf70 0x7f47b414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41ebc80 con 0x7f47b406d340 2022-08-10T17:48:59.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41eb0d0 con 0x7f47b406cf70 2022-08-10T17:48:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41ec0a0 con 0x7f47b4069020 2022-08-10T17:48:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41880/0 (socket says 172.21.15.150:41880) 2022-08-10T17:48:59.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 -- 172.21.15.150:0/2225320603 learned_addr learned my addr 172.21.15.150:0/2225320603 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b3fff700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47b406cf70 0x7f47b414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b894e700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 0x7f47b41e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 -- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 msgr2=0x7f47b41e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 0x7f47b41e86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 -- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47b406cf70 msgr2=0x7f47b414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47b406cf70 0x7f47b414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 -- 172.21.15.150:0/2225320603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac009a70 con 0x7f47b406d340 2022-08-10T17:48:59.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b894e700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 0x7f47b41e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:48:59.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b914f700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47ac013000 tx=0x7f47ac004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004450 con 0x7f47b406d340 2022-08-10T17:48:59.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac020070 con 0x7f47b406d340 2022-08-10T17:48:59.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b414c130 con 0x7f47b406d340 2022-08-10T17:48:59.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0098f0 con 0x7f47b406d340 2022-08-10T17:48:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.368+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b41eb2e0 con 0x7f47b406d340 2022-08-10T17:48:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.369+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b41ebdc0 con 0x7f47b406d340 2022-08-10T17:48:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.370+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f47ac02e070 con 0x7f47b406d340 2022-08-10T17:48:59.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.370+0000 7f47b17fa700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 0x7f479c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.370+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f47ac022070 con 0x7f47b406d340 2022-08-10T17:48:59.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.370+0000 7f47b894e700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 0x7f479c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.370+0000 7f47b894e700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 0x7f479c067560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47a800bc70 tx=0x7f47a800b2f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.376+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f47b41ebdc0 con 0x7f47b406d340 2022-08-10T17:48:59.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.718+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f47b41ebdc0 con 0x7f47b406d340 2022-08-10T17:48:59.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.721+0000 7f47b17fa700 1 -- 172.21.15.150:0/2225320603 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f47b41ebdc0 con 0x7f47b406d340 2022-08-10T17:48:59.723 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:48:59.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.723+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 msgr2=0x7f479c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.723+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 0x7f479c067560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47a800bc70 tx=0x7f47a800b2f0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.723+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 msgr2=0x7f47b41da390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.723+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47ac013000 tx=0x7f47ac004950 comp rx=0 tx=0).stop 2022-08-10T17:48:59.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 shutdown_connections 2022-08-10T17:48:59.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47b406d340 0x7f47b41da390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f479c0650b0 0x7f479c067560 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f47b4069020 0x7f47b41e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 --2- 172.21.15.150:0/2225320603 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f47b406cf70 0x7f47b414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.725+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 >> 172.21.15.150:0/2225320603 conn(0x7f47b40c7330 msgr2=0x7f47b4063cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:59.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.726+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 shutdown_connections 2022-08-10T17:48:59.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.726+0000 7f47babb2700 1 -- 172.21.15.150:0/2225320603 wait complete. 2022-08-10T17:48:59.743 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:48:59.743 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:48:59.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.887+0000 7f8b50d4c700 1 Processor -- start 2022-08-10T17:48:59.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 -- start start 2022-08-10T17:48:59.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8b4c0bd4b0 0x7f8b4c068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0c6100 con 0x7f8b4c071920 2022-08-10T17:48:59.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0c5270 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b50d4c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0c5e00 con 0x7f8b4c071550 2022-08-10T17:48:59.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.888+0000 7f8b49d9b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8b4c0bd4b0 0x7f8b4c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4ad9d700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f8b4c071920 0x7f8b4c15a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:40922/0 (socket says 172.21.15.150:40922) 2022-08-10T17:48:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8b4c0bd4b0 0x7f8b4c068650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52478/0 (socket says 172.21.15.150:52478) 2022-08-10T17:48:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56108/0 (socket says 172.21.15.150:56108) 2022-08-10T17:48:59.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4ad9d700 1 -- 172.21.15.150:0/2652353771 learned_addr learned my addr 172.21.15.150:0/2652353771 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:48:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 -- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 msgr2=0x7f8b4c068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:48:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 -- 172.21.15.150:0/2652353771 >> v1:172.21.15.197:6789/0 conn(0x7f8b4c071920 legacy=0x7f8b4c15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 -- 172.21.15.150:0/2652353771 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c06eb00 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4a59c700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:48:59.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c068650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b40017fd0 tx=0x7f8b4001a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=177ce26731f4c22a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4959a700 1 -- 172.21.15.150:0/2652353771 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40004230 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4959a700 1 -- 172.21.15.150:0/2652353771 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40004390 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.889+0000 7f8b4959a700 1 -- 172.21.15.150:0/2652353771 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400217f0 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 -- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 msgr2=0x7f8b4c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c068650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b40017fd0 tx=0x7f8b4001a9b0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 -- 172.21.15.150:0/2652353771 shutdown_connections 2022-08-10T17:48:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071550 0x7f8b4c068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/2652353771 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c068650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 -- 172.21.15.150:0/2652353771 >> 172.21.15.150:0/2652353771 conn(0x7f8b4c06d0d0 msgr2=0x7f8b4c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:59.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 -- 172.21.15.150:0/2652353771 shutdown_connections 2022-08-10T17:48:59.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.890+0000 7f8b50d4c700 1 -- 172.21.15.150:0/2652353771 wait complete. 2022-08-10T17:48:59.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.893+0000 7f8b50d4c700 1 Processor -- start 2022-08-10T17:48:59.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.893+0000 7f8b50d4c700 1 -- start start 2022-08-10T17:48:59.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 0x7f8b4c1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071920 0x7f8b4c0bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0bff40 con 0x7f8b4c071550 2022-08-10T17:48:59.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0becf0 con 0x7f8b4c0bd4b0 2022-08-10T17:48:59.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b50d4c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0afcb0 con 0x7f8b4c071920 2022-08-10T17:48:59.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 0x7f8b4c1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 0x7f8b4c1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41892/0 (socket says 172.21.15.150:41892) 2022-08-10T17:48:59.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 -- 172.21.15.150:0/1613391283 learned_addr learned my addr 172.21.15.150:0/1613391283 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:48:59.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4ad9d700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071920 0x7f8b4c0bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071920 msgr2=0x7f8b4c0bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8b4c071920 0x7f8b4c0bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 msgr2=0x7f8b4c150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8b4c0bd4b0 0x7f8b4c150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009310 con 0x7f8b4c071550 2022-08-10T17:48:59.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.894+0000 7f8b4a59c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 0x7f8b4c1572f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00e9b0 tx=0x7f8b3c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00c640 con 0x7f8b4c071550 2022-08-10T17:48:59.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00c7a0 con 0x7f8b4c071550 2022-08-10T17:48:59.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00cb30 con 0x7f8b4c071550 2022-08-10T17:48:59.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4001a330 con 0x7f8b4c071550 2022-08-10T17:48:59.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c0ca7f0 con 0x7f8b4c071550 2022-08-10T17:48:59.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 0x7f8b4c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0672f0 con 0x7f8b4c0af5d0 2022-08-10T17:48:59.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.895+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 0x7f8b4c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b49d9b700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b4c0bee30 con 0x7f8b4c0af5d0 2022-08-10T17:48:59.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 0x7f8b4c151390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06faa0 tx=0x7f8b40004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8b3c023070 con 0x7f8b4c071550 2022-08-10T17:48:59.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b3affd700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8b280650e0 0x7f8b28067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8b3c0823d0 con 0x7f8b4c071550 2022-08-10T17:48:59.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b4ad9d700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8b280650e0 0x7f8b28067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000c050 con 0x7f8b4c0af5d0 2022-08-10T17:48:59.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.896+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f8b4000d040 con 0x7f8b4c0af5d0 2022-08-10T17:48:59.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.897+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 msgr2=0x7f8b4c151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.897+0000 7f8b3affd700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 0x7f8b4c151390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06faa0 tx=0x7f8b40004640 comp rx=0 tx=0).stop 2022-08-10T17:48:59.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.897+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 msgr2=0x7f8b4c151390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:59.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.897+0000 7f8b3affd700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0af5d0 0x7f8b4c151390 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.897+0000 7f8b4ad9d700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8b280650e0 0x7f8b28067590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005b10 tx=0x7f8b44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.903+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 0x7f8b4c1eae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:48:59.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.903+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c072890 con 0x7f8b4c0be640 2022-08-10T17:48:59.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.903+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 0x7f8b4c1eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:48:59.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b49d9b700 1 -- 172.21.15.150:0/1613391283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8b4c0c6dc0 con 0x7f8b4c0be640 2022-08-10T17:48:59.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b49d9b700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 0x7f8b4c1eae70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b4001a9f0 tx=0x7f8b400045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:48:59.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40007700 con 0x7f8b4c0be640 2022-08-10T17:48:59.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4549 (secure 0 0 0) 0x7f8b40021660 con 0x7f8b4c0be640 2022-08-10T17:48:59.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 msgr2=0x7f8b4c1eae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 0x7f8b4c1eae70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b4001a9f0 tx=0x7f8b400045d0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 msgr2=0x7f8b4c1eae70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:48:59.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b3affd700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c0be640 0x7f8b4c1eae70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.922 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:48:59.922 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:59.922 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:59.923 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:48:59.923 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:48:59.923 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:48:59.923 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:48:59.924 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:48:59.924 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:48:59.924 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:59.925 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:48:59.925 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:59.925 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:48:59.926 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:48:59.926 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:59.926 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:59.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:59.927 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:59.927 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:59.928 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:59.928 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:59.928 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:59.928 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:59.929 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:59.929 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:48:59.929 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:48:59.930 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:59.930 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:59.930 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:59.930 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:59.931 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:59.931 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:59.931 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:59.931 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:59.932 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:59.932 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.933 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:48:59.933 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:48:59.933 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:48:59.933 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:48:59.934 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:48:59.934 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:48:59.934 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:59.935 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:48:59.935 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:48:59.935 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:48:59.935 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:48:59.936 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:48:59.936 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:48:59.936 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:48:59.936 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:48:59.937 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:48:59.937 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:48:59.937 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:48:59.938 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:48:59.938 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:48:59.938 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:48:59.938 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:48:59.939 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:48:59.939 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:48:59.939 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:48:59.939 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:59.940 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:48:59.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.940 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:48:59.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.941 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:48:59.941 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:48:59.941 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:59.942 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:59.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.942 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:59.943 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:48:59.943 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.944 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:59.944 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:48:59.944 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.945 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.945 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:48:59.946 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:48:59.946 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:59.946 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:59.947 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:59.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.947 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:48:59.948 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:48:59.948 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:59.948 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:59.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.949 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:59.949 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:48:59.949 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.950 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:59.950 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:48:59.951 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.951 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.951 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.952 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:48:59.952 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:48:59.952 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:59.953 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:59.953 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:59.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.954 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:48:59.954 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:48:59.954 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:48:59.954 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:48:59.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:48:59.955 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:48:59.956 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.956 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:48:59.957 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:48:59.957 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:48:59.957 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.958 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.958 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:48:59.958 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:48:59.959 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:48:59.959 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:48:59.960 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:48:59.960 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.961 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.961 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:48:59.962 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:48:59.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.963 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:59.963 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:59.963 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:59.963 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.964 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:59.964 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:48:59.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.965 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:59.965 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:59.965 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:48:59.965 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.966 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:48:59.966 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:48:59.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:48:59.967 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:48:59.967 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:48:59.967 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:48:59.968 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:48:59.968 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:48:59.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:48:59.968 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:48:59.969 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:48:59.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8b280650e0 msgr2=0x7f8b28067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8b280650e0 0x7f8b28067590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005b10 tx=0x7f8b44009040 comp rx=0 tx=0).stop 2022-08-10T17:48:59.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 msgr2=0x7f8b4c1572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:48:59.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 --2- 172.21.15.150:0/1613391283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c071550 0x7f8b4c1572f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00e9b0 tx=0x7f8b3c00ecc0 comp rx=0 tx=0).stop 2022-08-10T17:48:59.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b4ad9d700 1 -- 172.21.15.150:0/1613391283 reap_dead start 2022-08-10T17:48:59.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b4ad9d700 1 -- 172.21.15.150:0/1613391283 reap_dead start 2022-08-10T17:48:59.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 shutdown_connections 2022-08-10T17:48:59.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 >> 172.21.15.150:0/1613391283 conn(0x7f8b4c06d0d0 msgr2=0x7f8b4c1550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:48:59.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 shutdown_connections 2022-08-10T17:48:59.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:48:59.904+0000 7f8b50d4c700 1 -- 172.21.15.150:0/1613391283 wait complete. 2022-08-10T17:48:59.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:49:00.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.142+0000 7fe3fe4f4700 1 Processor -- start 2022-08-10T17:49:00.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.142+0000 7fe3fe4f4700 1 -- start start 2022-08-10T17:49:00.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3fe4f4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 0x7fe3f806e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3fe4f4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 0x7fe3f80c5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3fe4f4700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80c40f0 con 0x7fe3f80c4b20 2022-08-10T17:49:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3fe4f4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f8070010 con 0x7fe3f8154fc0 2022-08-10T17:49:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3fe4f4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c9b60 con 0x7fe3f80c45d0 2022-08-10T17:49:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3f7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 0x7fe3f806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3f7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 0x7fe3f806e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41908/0 (socket says 172.21.15.150:41908) 2022-08-10T17:49:00.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.143+0000 7fe3f7fff700 1 -- 172.21.15.150:0/1203261163 learned_addr learned my addr 172.21.15.150:0/1203261163 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.144+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/1203261163 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 0x7fe3f80c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.144+0000 7fe3f77fe700 1 -- 172.21.15.150:0/1203261163 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 msgr2=0x7fe3f806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:00.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.144+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/1203261163 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 0x7fe3f806e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.144+0000 7fe3f77fe700 1 -- 172.21.15.150:0/1203261163 >> v1:172.21.15.197:6789/0 conn(0x7fe3f80c4b20 legacy=0x7fe3f8068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:00.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.144+0000 7fe3f77fe700 1 -- 172.21.15.150:0/1203261163 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c9e40 con 0x7fe3f80c45d0 2022-08-10T17:49:00.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.145+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/1203261163 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 0x7fe3f80c5040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80096b0 tx=0x7fe3e80099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4ddfb353fc958e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.145+0000 7fe3f6ffd700 1 -- 172.21.15.150:0/1203261163 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004230 con 0x7fe3f80c45d0 2022-08-10T17:49:00.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.145+0000 7fe3f6ffd700 1 -- 172.21.15.150:0/1203261163 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8004390 con 0x7fe3f80c45d0 2022-08-10T17:49:00.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.145+0000 7fe3f6ffd700 1 -- 172.21.15.150:0/1203261163 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80107d0 con 0x7fe3f80c45d0 2022-08-10T17:49:00.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.146+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/1203261163 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 msgr2=0x7fe3f80c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.146+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/1203261163 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 0x7fe3f80c5040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80096b0 tx=0x7fe3e80099c0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.147+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/1203261163 shutdown_connections 2022-08-10T17:49:00.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.147+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/1203261163 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154fc0 0x7fe3f806e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.147+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/1203261163 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c45d0 0x7fe3f80c5040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.147+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/1203261163 >> 172.21.15.150:0/1203261163 conn(0x7fe3f806aac0 msgr2=0x7fe3f80c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.147+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/1203261163 shutdown_connections 2022-08-10T17:49:00.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.149+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/1203261163 wait complete. 2022-08-10T17:49:00.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.151+0000 7fe3fe4f4700 1 Processor -- start 2022-08-10T17:49:00.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.151+0000 7fe3fe4f4700 1 -- start start 2022-08-10T17:49:00.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 0x7fe3f815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154fc0 0x7fe3f80c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f815a4f0 0x7fe3f814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c29f0 con 0x7fe3f8154fc0 2022-08-10T17:49:00.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81f1da0 con 0x7fe3f815a4f0 2022-08-10T17:49:00.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fe4f4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f815ac50 con 0x7fe3f80c4b20 2022-08-10T17:49:00.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 0x7fe3f815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 0x7fe3f815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56134/0 (socket says 172.21.15.150:56134) 2022-08-10T17:49:00.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3f7fff700 1 -- 172.21.15.150:0/4290200046 learned_addr learned my addr 172.21.15.150:0/4290200046 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.152+0000 7fe3fca91700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f815a4f0 0x7fe3f814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f815a4f0 msgr2=0x7fe3f814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f815a4f0 0x7fe3f814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154fc0 msgr2=0x7fe3f80c1f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:00.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154fc0 0x7fe3f80c1f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009310 con 0x7fe3f80c4b20 2022-08-10T17:49:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.153+0000 7fe3f7fff700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 0x7fe3f815aec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00e8d0 tx=0x7fe3ec00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.154+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec013680 con 0x7fe3f80c4b20 2022-08-10T17:49:00.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.154+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0137e0 con 0x7fe3f80c4b20 2022-08-10T17:49:00.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.154+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec013b50 con 0x7fe3f80c4b20 2022-08-10T17:49:00.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.154+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f815a970 con 0x7fe3f80c4b20 2022-08-10T17:49:00.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.154+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81f1750 con 0x7fe3f80c4b20 2022-08-10T17:49:00.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.155+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 0x7fe3f814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.155+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8071e00 con 0x7fe3f81f1940 2022-08-10T17:49:00.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.155+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 0x7fe3f814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.155+0000 7fe3f77fe700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3f81f1ee0 con 0x7fe3f81f1940 2022-08-10T17:49:00.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.156+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe3ec019030 con 0x7fe3f80c4b20 2022-08-10T17:49:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.156+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 0x7fe3f814eb00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80096b0 tx=0x7fe3e80045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.156+0000 7fe3f4ff9700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3d80650b0 0x7fe3d8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.156+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe3ec081ff0 con 0x7fe3f80c4b20 2022-08-10T17:49:00.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3fca91700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3d80650b0 0x7fe3d8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8003720 con 0x7fe3f81f1940 2022-08-10T17:49:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe3e8003880 con 0x7fe3f81f1940 2022-08-10T17:49:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 msgr2=0x7fe3f814eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 0x7fe3f814eb00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80096b0 tx=0x7fe3e80045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 msgr2=0x7fe3f814eb00 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3f4ff9700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f81f1940 0x7fe3f814eb00 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80096b0 tx=0x7fe3e80045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.157+0000 7fe3fca91700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3d80650b0 0x7fe3d8067560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0001d80 tx=0x7fe3f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.172+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 0x7fe3f81f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.172+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8072890 con 0x7fe3f806aac0 2022-08-10T17:49:00.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.175+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 0x7fe3f81f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f77fe700 1 -- 172.21.15.150:0/4290200046 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe3f80c32f0 con 0x7fe3f806aac0 2022-08-10T17:49:00.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f77fe700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 0x7fe3f81f2080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80726b0 tx=0x7fe3e80090e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e802b070 con 0x7fe3f806aac0 2022-08-10T17:49:00.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7fe3e8031460 con 0x7fe3f806aac0 2022-08-10T17:49:00.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 msgr2=0x7fe3f81f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 0x7fe3f81f2080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80726b0 tx=0x7fe3e80090e0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 msgr2=0x7fe3f81f2080 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:00.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.176+0000 7fe3f4ff9700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe3f806aac0 0x7fe3f81f2080 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80726b0 tx=0x7fe3e80090e0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.182 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:00.182 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:00.182 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:00.184 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:00.184 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:00.184 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.184 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:49:00.185 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:00.185 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:00.185 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:00.185 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.186 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.186 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.186 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.187 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.187 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.187 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.188 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.188 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.188 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.188 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:00.189 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:00.189 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.189 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.189 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.190 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.190 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.190 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.190 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.191 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.191 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.191 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.192 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:00.192 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:00.192 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:00.192 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:00.193 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:00.193 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:00.193 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:00.194 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:00.194 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:00.194 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:00.194 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:00.195 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:00.195 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:00.195 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:00.196 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:00.196 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:00.196 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.197 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.197 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.197 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.197 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.198 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.198 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.198 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.198 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.199 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.199 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:00.199 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.200 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:00.200 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.200 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:00.200 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:00.201 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.201 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.201 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.201 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.202 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:00.202 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.202 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.203 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.203 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.203 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:00.203 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.204 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.204 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.205 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:00.205 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:00.205 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.205 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.206 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.206 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.206 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.207 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:00.207 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:00.207 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.207 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.208 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.208 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.208 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:00.208 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.209 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.209 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.209 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:00.210 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.210 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.210 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.210 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.211 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:00.211 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:00.211 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.212 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.212 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.212 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.212 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.213 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:00.213 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:00.213 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.213 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.214 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.214 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.214 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:00.214 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.215 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.215 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.215 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.216 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:00.216 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.216 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.216 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.217 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:00.217 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:00.217 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.218 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.218 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.218 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.218 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.219 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.219 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:00.219 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:00.219 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.220 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.220 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.220 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:00.220 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.221 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.221 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:49:00.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.221 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.222 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.222 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:00.222 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.222 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.223 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:00.223 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.223 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.224 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.224 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:00.224 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.224 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.225 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:00.225 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.225 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:49:00.226 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.226 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:00.226 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.226 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.227 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.227 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.227 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:49:00.228 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.228 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.228 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:49:00.228 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.229 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.229 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.229 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:49:00.230 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.230 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.230 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.230 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:00.231 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:00.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.177+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3d80650b0 msgr2=0x7fe3d8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.177+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3d80650b0 0x7fe3d8067560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0001d80 tx=0x7fe3f0009040 comp rx=0 tx=0).stop 2022-08-10T17:49:00.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.177+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 msgr2=0x7fe3f815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.177+0000 7fe3fe4f4700 1 --2- 172.21.15.150:0/4290200046 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3f80c4b20 0x7fe3f815aec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00e8d0 tx=0x7fe3ec00ebe0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fca91700 1 -- 172.21.15.150:0/4290200046 reap_dead start 2022-08-10T17:49:00.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fca91700 1 -- 172.21.15.150:0/4290200046 reap_dead start 2022-08-10T17:49:00.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 shutdown_connections 2022-08-10T17:49:00.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 >> 172.21.15.150:0/4290200046 conn(0x7fe3f80c45d0 msgr2=0x7fe3f80c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 shutdown_connections 2022-08-10T17:49:00.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.178+0000 7fe3fe4f4700 1 -- 172.21.15.150:0/4290200046 wait complete. 2022-08-10T17:49:00.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:49:00.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.374+0000 7ff0b64d7700 1 Processor -- start 2022-08-10T17:49:00.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.374+0000 7ff0b64d7700 1 -- start start 2022-08-10T17:49:00.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.374+0000 7ff0b64d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0b006d480 0x7ff0b00c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0b64d7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b00c4410 0x7ff0b00c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0b64d7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b00c39a0 con 0x7ff0b006d850 2022-08-10T17:49:00.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0b64d7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b00c4dd0 con 0x7ff0b006d480 2022-08-10T17:49:00.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0b64d7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00b0ff0 con 0x7ff0b00c4410 2022-08-10T17:49:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0b006d480 0x7ff0b00c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0b006d480 0x7ff0b00c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41924/0 (socket says 172.21.15.150:41924) 2022-08-10T17:49:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 -- 172.21.15.150:0/2424470152 learned_addr learned my addr 172.21.15.150:0/2424470152 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0b4a74700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b00c4410 0x7ff0b00c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 -- 172.21.15.150:0/2424470152 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b00c4410 msgr2=0x7ff0b00c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b00c4410 0x7ff0b00c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 -- 172.21.15.150:0/2424470152 >> v1:172.21.15.197:6789/0 conn(0x7ff0b006d850 legacy=0x7ff0b00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 -- 172.21.15.150:0/2424470152 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b006e120 con 0x7ff0b006d480 2022-08-10T17:49:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0affff700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b00c1f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0006fd0 tx=0x7ff0a0009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42da147feb887686 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0aeffd700 1 -- 172.21.15.150:0/2424470152 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004230 con 0x7ff0b006d480 2022-08-10T17:49:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0aeffd700 1 -- 172.21.15.150:0/2424470152 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0004390 con 0x7ff0b006d480 2022-08-10T17:49:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.375+0000 7ff0aeffd700 1 -- 172.21.15.150:0/2424470152 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0011830 con 0x7ff0b006d480 2022-08-10T17:49:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2424470152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 msgr2=0x7ff0b00c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b00c1f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0006fd0 tx=0x7ff0a0009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2424470152 shutdown_connections 2022-08-10T17:49:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b00c4410 0x7ff0b00c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2424470152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b00c1f60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2424470152 >> 172.21.15.150:0/2424470152 conn(0x7ff0b006b3b0 msgr2=0x7ff0b006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2424470152 shutdown_connections 2022-08-10T17:49:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.376+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2424470152 wait complete. 2022-08-10T17:49:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.377+0000 7ff0b64d7700 1 Processor -- start 2022-08-10T17:49:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.377+0000 7ff0b64d7700 1 -- start start 2022-08-10T17:49:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b0068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b006d850 0x7ff0b00c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0b00c4410 0x7ff0b0069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0068c80 con 0x7ff0b006d480 2022-08-10T17:49:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b014ede0 con 0x7ff0b00c4410 2022-08-10T17:49:00.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0154970 con 0x7ff0b006d850 2022-08-10T17:49:00.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b0068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b0068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41930/0 (socket says 172.21.15.150:41930) 2022-08-10T17:49:00.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b4a74700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0b00c4410 0x7ff0b0069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 -- 172.21.15.150:0/2335141970 learned_addr learned my addr 172.21.15.150:0/2335141970 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0af7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b006d850 0x7ff0b00c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b006d850 msgr2=0x7ff0b00c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b006d850 0x7ff0b00c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0b00c4410 msgr2=0x7ff0b0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff0b00c4410 0x7ff0b0069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00093e0 con 0x7ff0b006d480 2022-08-10T17:49:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0affff700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b0068110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0000c00 tx=0x7ff0a00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0011ce0 con 0x7ff0b006d480 2022-08-10T17:49:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b0152890 con 0x7ff0b006d480 2022-08-10T17:49:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.378+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a001f070 con 0x7ff0b006d480 2022-08-10T17:49:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.379+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0003720 con 0x7ff0b006d480 2022-08-10T17:49:00.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.379+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b0152e50 con 0x7ff0b006d480 2022-08-10T17:49:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.379+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 0x7ff0b01ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.379+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01de010 con 0x7ff0b01de2b0 2022-08-10T17:49:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.379+0000 7ff0af7fe700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 0x7ff0b01ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0af7fe700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0b0072890 con 0x7ff0b01de2b0 2022-08-10T17:49:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff0a002a020 con 0x7ff0b006d480 2022-08-10T17:49:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0af7fe700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 0x7ff0b01ef300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00caa70 tx=0x7ff0a400f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff090065080 0x7ff090067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff0a0083570 con 0x7ff0b006d480 2022-08-10T17:49:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0b4a74700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff090065080 0x7ff090067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400fed0 con 0x7ff0b01de2b0 2022-08-10T17:49:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff0a40052e0 con 0x7ff0b01de2b0 2022-08-10T17:49:00.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 msgr2=0x7ff0b01ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 0x7ff0b01ef300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00caa70 tx=0x7ff0a400f8d0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 msgr2=0x7ff0b01ef300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:00.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.380+0000 7ff0acff9700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b01de2b0 0x7ff0b01ef300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.381+0000 7ff0b4a74700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff090065080 0x7ff090067530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80113e0 tx=0x7ff0a800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.387+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 0x7ff0b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.387+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00673d0 con 0x7ff0b0069980 2022-08-10T17:49:00.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.387+0000 7ff0af7fe700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 0x7ff0b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0af7fe700 1 -- 172.21.15.150:0/2335141970 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff0b00ca4e0 con 0x7ff0b0069980 2022-08-10T17:49:00.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0af7fe700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 0x7ff0b0068dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00c74e0 tx=0x7ff0a4001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a401cbb0 con 0x7ff0b0069980 2022-08-10T17:49:00.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4547 (secure 0 0 0) 0x7ff0a401cd10 con 0x7ff0b0069980 2022-08-10T17:49:00.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 msgr2=0x7ff0b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 0x7ff0b0068dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00c74e0 tx=0x7ff0a4001120 comp rx=0 tx=0).stop 2022-08-10T17:49:00.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 msgr2=0x7ff0b0068dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:00.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.388+0000 7ff0acff9700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff0b0069980 0x7ff0b0068dc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.405 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:00.405 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:00.405 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:00.405 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:00.406 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:49:00.406 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:00.406 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:00.407 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:00.407 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:00.407 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.407 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:49:00.408 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:00.408 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:00.408 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:00.408 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.409 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.409 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.409 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.409 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.410 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.410 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.410 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.410 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.411 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.411 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:00.411 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:00.411 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.412 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.412 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.412 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.413 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.413 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.413 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.413 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.414 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.414 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.414 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:00.415 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:00.415 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:00.415 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:00.415 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:00.416 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:00.416 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:00.416 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:00.416 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:00.417 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:00.417 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:00.417 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:00.417 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:00.418 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:00.418 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:00.418 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:00.419 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:00.419 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:00.419 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:00.419 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:00.420 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:00.420 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:00.420 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:00.420 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:00.421 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:00.421 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.421 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:00.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.422 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:00.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.422 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:00.423 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:00.423 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.423 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.424 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.424 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:00.424 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.425 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:00.425 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.425 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.426 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.426 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:00.426 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:00.427 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.427 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.427 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.428 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:00.428 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:00.428 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:00.430 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.430 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.431 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:00.431 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.431 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.431 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.433 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.433 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.434 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:00.434 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:00.434 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:00.434 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:00.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.435 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:00.435 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:00.435 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.436 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:00.436 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:00.437 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:00.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.437 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.437 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:00.438 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:00.438 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:00.438 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:00.439 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:00.439 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.439 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.439 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:00.440 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:00.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.440 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.440 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.441 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:00.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.441 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.441 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:00.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.442 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.442 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.442 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:00.443 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.443 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:00.443 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:00.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:00.444 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:00.444 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:00.444 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:00.444 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:00.445 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:00.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:00.445 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:00.445 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:00.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff090065080 msgr2=0x7ff090067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff090065080 0x7ff090067530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80113e0 tx=0x7ff0a800b040 comp rx=0 tx=0).stop 2022-08-10T17:49:00.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 msgr2=0x7ff0b0068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 --2- 172.21.15.150:0/2335141970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0b006d480 0x7ff0b0068110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0000c00 tx=0x7ff0a00045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.448 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b4a74700 1 -- 172.21.15.150:0/2335141970 reap_dead start 2022-08-10T17:49:00.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b4a74700 1 -- 172.21.15.150:0/2335141970 reap_dead start 2022-08-10T17:49:00.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 shutdown_connections 2022-08-10T17:49:00.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 >> 172.21.15.150:0/2335141970 conn(0x7ff0b006b3b0 msgr2=0x7ff0b00c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 shutdown_connections 2022-08-10T17:49:00.449 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.389+0000 7ff0b64d7700 1 -- 172.21.15.150:0/2335141970 wait complete. 2022-08-10T17:49:00.450 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:49:00.450 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:49:00.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.590+0000 7fc9d6c38700 1 Processor -- start 2022-08-10T17:49:00.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.590+0000 7fc9d6c38700 1 -- start start 2022-08-10T17:49:00.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d6c38700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9d00c2000 0x7fc9d00c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d6c38700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d6c38700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00c2ef0 con 0x7fc9d00c5090 2022-08-10T17:49:00.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d6c38700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00c26e0 con 0x7fc9d00c2000 2022-08-10T17:49:00.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d6c38700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c98c0 con 0x7fc9d00c3e30 2022-08-10T17:49:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9d00c2000 0x7fc9d00c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9d00c2000 0x7fc9d00c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41942/0 (socket says 172.21.15.150:41942) 2022-08-10T17:49:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 -- 172.21.15.150:0/1589409499 learned_addr learned my addr 172.21.15.150:0/1589409499 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d51d5700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 -- 172.21.15.150:0/1589409499 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 msgr2=0x7fc9d00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d00c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 -- 172.21.15.150:0/1589409499 >> v1:172.21.15.197:6789/0 conn(0x7fc9d00c5090 legacy=0x7fc9d00c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 -- 172.21.15.150:0/1589409499 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0154270 con 0x7fc9d00c2000 2022-08-10T17:49:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9cf7fe700 1 -- 172.21.15.150:0/1589409499 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866571008 0 0) 0x7fc9bc001110 con 0x7fc9d00c5090 2022-08-10T17:49:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.591+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c2000 0x7fc9d00c8910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006fd0 tx=0x7fc9c4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9070c17f73c8182 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9cf7fe700 1 -- 172.21.15.150:0/1589409499 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004230 con 0x7fc9d00c2000 2022-08-10T17:49:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9cf7fe700 1 -- 172.21.15.150:0/1589409499 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4004390 con 0x7fc9d00c2000 2022-08-10T17:49:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9cf7fe700 1 -- 172.21.15.150:0/1589409499 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4011830 con 0x7fc9d00c2000 2022-08-10T17:49:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 -- 172.21.15.150:0/1589409499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c2000 msgr2=0x7fc9d00c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c2000 0x7fc9d00c8910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006fd0 tx=0x7fc9c4009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 -- 172.21.15.150:0/1589409499 shutdown_connections 2022-08-10T17:49:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d00c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/1589409499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c2000 0x7fc9d00c8910 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 -- 172.21.15.150:0/1589409499 >> 172.21.15.150:0/1589409499 conn(0x7fc9d006b500 msgr2=0x7fc9d006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.592+0000 7fc9d6c38700 1 -- 172.21.15.150:0/1589409499 shutdown_connections 2022-08-10T17:49:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.593+0000 7fc9d6c38700 1 -- 172.21.15.150:0/1589409499 wait complete. 2022-08-10T17:49:00.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.594+0000 7fc9d6c38700 1 Processor -- start 2022-08-10T17:49:00.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.594+0000 7fc9d6c38700 1 -- start start 2022-08-10T17:49:00.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.594+0000 7fc9d6c38700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 0x7fc9d0143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.594+0000 7fc9d6c38700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d0147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.594+0000 7fc9d6c38700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d6c38700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0146b20 con 0x7fc9d00c5090 2022-08-10T17:49:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d6c38700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0147660 con 0x7fc9d00c2000 2022-08-10T17:49:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d6c38700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01521b0 con 0x7fc9d00c3e30 2022-08-10T17:49:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41952/0 (socket says 172.21.15.150:41952) 2022-08-10T17:49:00.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 -- 172.21.15.150:0/2089320895 learned_addr learned my addr 172.21.15.150:0/2089320895 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:00.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 0x7fc9d0143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9cffff700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d0147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 -- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 msgr2=0x7fc9d0147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d0147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 -- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 msgr2=0x7fc9d0143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 0x7fc9d0143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 -- 172.21.15.150:0/2089320895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40093e0 con 0x7fc9d00c5090 2022-08-10T17:49:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 0x7fc9d0143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d51d5700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800efc0 tx=0x7fc9c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800cc30 con 0x7fc9d00c5090 2022-08-10T17:49:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800f040 con 0x7fc9d00c5090 2022-08-10T17:49:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8014480 con 0x7fc9d00c5090 2022-08-10T17:49:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d0145350 con 0x7fc9d00c5090 2022-08-10T17:49:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.595+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0147010 con 0x7fc9d00c5090 2022-08-10T17:49:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.596+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0072890 con 0x7fc9d00c5090 2022-08-10T17:49:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.597+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc9c80145e0 con 0x7fc9d00c5090 2022-08-10T17:49:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.597+0000 7fc9cd7fa700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 0x7fc9b8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.597+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc9c8083120 con 0x7fc9d00c5090 2022-08-10T17:49:00.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.597+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 0x7fc9b8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:00.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.598+0000 7fc9d49d4700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 0x7fc9b8067590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009aa0 tx=0x7fc9c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:00.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.601+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc9c8051100 con 0x7fc9d00c5090 2022-08-10T17:49:00.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.974+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fc9d0154550 con 0x7fc9d00c5090 2022-08-10T17:49:00.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.975+0000 7fc9cd7fa700 1 -- 172.21.15.150:0/2089320895 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fc9c8054720 con 0x7fc9d00c5090 2022-08-10T17:49:00.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.977+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 msgr2=0x7fc9b8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.977+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 0x7fc9b8067590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009aa0 tx=0x7fc9c4008030 comp rx=0 tx=0).stop 2022-08-10T17:49:00.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.977+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 msgr2=0x7fc9d0148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:00.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.977+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800efc0 tx=0x7fc9c800c3a0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 shutdown_connections 2022-08-10T17:49:00.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9d00c5090 0x7fc9d0148030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc9d00c2000 0x7fc9d0143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc9b80650e0 0x7fc9b8067590 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009aa0 tx=0x7fc9c4008030 comp rx=0 tx=0).stop 2022-08-10T17:49:00.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 --2- 172.21.15.150:0/2089320895 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc9d00c3e30 0x7fc9d0147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:00.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.978+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 >> 172.21.15.150:0/2089320895 conn(0x7fc9d006b500 msgr2=0x7fc9d01518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:00.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.979+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 shutdown_connections 2022-08-10T17:49:00.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:00.979+0000 7fc9d6c38700 1 -- 172.21.15.150:0/2089320895 wait complete. 2022-08-10T17:49:01.000 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:49:11.002 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:49:11.003 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:11.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.146+0000 7f4c7ea4f700 1 Processor -- start 2022-08-10T17:49:11.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.146+0000 7f4c7ea4f700 1 -- start start 2022-08-10T17:49:11.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.147+0000 7f4c7ea4f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4c78150b80 0x7f4c780c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.147+0000 7f4c7ea4f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c78070620 con 0x7f4c78150f50 2022-08-10T17:49:11.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.147+0000 7f4c7ea4f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780ca810 con 0x7f4c781573d0 2022-08-10T17:49:11.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.147+0000 7f4c7ea4f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c780c5ac0 con 0x7f4c78150b80 2022-08-10T17:49:11.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4c78150b80 0x7f4c780c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f4c78150b80 0x7f4c780c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52608/0 (socket says 172.21.15.150:52608) 2022-08-10T17:49:11.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 -- 172.21.15.150:0/4241450507 learned_addr learned my addr 172.21.15.150:0/4241450507 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:11.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 -- 172.21.15.150:0/4241450507 >> v1:172.21.15.197:6789/0 conn(0x7f4c781573d0 legacy=0x7f4c781611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:11.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 -- 172.21.15.150:0/4241450507 >> v1:172.21.15.150:6789/0 conn(0x7f4c78150f50 legacy=0x7f4c78156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 -- 172.21.15.150:0/4241450507 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78070010 con 0x7f4c78150b80 2022-08-10T17:49:11.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.148+0000 7f4c77fff700 1 --2- 172.21.15.150:0/4241450507 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150b80 0x7f4c780c42a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c68006fd0 tx=0x7f4c68009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55085e2cdc9d9dd4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.151+0000 7f4c76ffd700 1 -- 172.21.15.150:0/4241450507 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011830 con 0x7f4c78150b80 2022-08-10T17:49:11.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.151+0000 7f4c76ffd700 1 -- 172.21.15.150:0/4241450507 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c68011990 con 0x7f4c78150b80 2022-08-10T17:49:11.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.151+0000 7f4c76ffd700 1 -- 172.21.15.150:0/4241450507 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011d20 con 0x7f4c78150b80 2022-08-10T17:49:11.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/4241450507 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150b80 msgr2=0x7f4c780c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/4241450507 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150b80 0x7f4c780c42a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c68006fd0 tx=0x7f4c68009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:11.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/4241450507 shutdown_connections 2022-08-10T17:49:11.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/4241450507 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150b80 0x7f4c780c42a0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c68006fd0 tx=0x7f4c68009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:11.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/4241450507 >> 172.21.15.150:0/4241450507 conn(0x7f4c78071e40 msgr2=0x7f4c7806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/4241450507 shutdown_connections 2022-08-10T17:49:11.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.152+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/4241450507 wait complete. 2022-08-10T17:49:11.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.154+0000 7f4c7ea4f700 1 Processor -- start 2022-08-10T17:49:11.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.155+0000 7f4c7ea4f700 1 -- start start 2022-08-10T17:49:11.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 0x7f4c781580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c781573d0 0x7f4c780c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7814cdc0 con 0x7f4c78157ad0 2022-08-10T17:49:11.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7814c090 con 0x7f4c78150f50 2022-08-10T17:49:11.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7ea4f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7814c930 con 0x7f4c781573d0 2022-08-10T17:49:11.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 0x7f4c781580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.156+0000 7f4c7cfec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 0x7f4c781580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52614/0 (socket says 172.21.15.150:52614) 2022-08-10T17:49:11.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42024/0 (socket says 172.21.15.150:42024) 2022-08-10T17:49:11.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c77fff700 1 -- 172.21.15.150:0/2088850069 learned_addr learned my addr 172.21.15.150:0/2088850069 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:11.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 -- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c781573d0 msgr2=0x7f4c780c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c781573d0 0x7f4c780c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 -- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 msgr2=0x7f4c781580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 0x7f4c781580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 -- 172.21.15.150:0/2088850069 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680093e0 con 0x7f4c78157ad0 2022-08-10T17:49:11.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7cfec700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009360 tx=0x7f4c6c009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c011640 con 0x7f4c78157ad0 2022-08-10T17:49:11.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0117c0 con 0x7f4c78157ad0 2022-08-10T17:49:11.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c011b70 con 0x7f4c78157ad0 2022-08-10T17:49:11.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c781585e0 con 0x7f4c78157ad0 2022-08-10T17:49:11.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.157+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c78158cb0 con 0x7f4c78157ad0 2022-08-10T17:49:11.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.159+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7814cae0 con 0x7f4c78157ad0 2022-08-10T17:49:11.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.159+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4c6c00f070 con 0x7f4c78157ad0 2022-08-10T17:49:11.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.160+0000 7f4c74ff9700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 0x7f4c58067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.160+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4c6c081b90 con 0x7f4c78157ad0 2022-08-10T17:49:11.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.160+0000 7f4c77fff700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 0x7f4c58067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.161+0000 7f4c77fff700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 0x7f4c58067590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.168+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4c7814cae0 con 0x7f4c78157ad0 2022-08-10T17:49:11.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.481+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4c7814cae0 con 0x7f4c78157ad0 2022-08-10T17:49:11.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.482+0000 7f4c74ff9700 1 -- 172.21.15.150:0/2088850069 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f4c7814cae0 con 0x7f4c78157ad0 2022-08-10T17:49:11.489 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:11.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 msgr2=0x7f4c58067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 0x7f4c58067590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68010000 comp rx=0 tx=0).stop 2022-08-10T17:49:11.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 msgr2=0x7f4c781ef8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009360 tx=0x7f4c6c009670 comp rx=0 tx=0).stop 2022-08-10T17:49:11.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 shutdown_connections 2022-08-10T17:49:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c78157ad0 0x7f4c781ef8b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4c78150f50 0x7f4c781580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4c580650e0 0x7f4c58067590 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 --2- 172.21.15.150:0/2088850069 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4c781573d0 0x7f4c780c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.487+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 >> 172.21.15.150:0/2088850069 conn(0x7f4c78071e40 msgr2=0x7f4c7814e070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.488+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 shutdown_connections 2022-08-10T17:49:11.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.488+0000 7f4c7ea4f700 1 -- 172.21.15.150:0/2088850069 wait complete. 2022-08-10T17:49:11.505 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:49:11.505 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:49:11.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:49:11.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.671+0000 7fad63f49700 1 Processor -- start 2022-08-10T17:49:11.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.671+0000 7fad63f49700 1 -- start start 2022-08-10T17:49:11.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad63f49700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad5c167a50 0x7fad5c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad63f49700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c06e070 con 0x7fad5c0c96b0 2022-08-10T17:49:11.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad63f49700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0701c0 con 0x7fad5c0c8af0 2022-08-10T17:49:11.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad63f49700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c06ec10 con 0x7fad5c167a50 2022-08-10T17:49:11.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad624e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad5c167a50 0x7fad5c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad624e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad5c167a50 0x7fad5c0c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42040/0 (socket says 172.21.15.150:42040) 2022-08-10T17:49:11.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad624e6700 1 -- 172.21.15.150:0/2062171516 learned_addr learned my addr 172.21.15.150:0/2062171516 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:11.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.672+0000 7fad61ce5700 1 --1- 172.21.15.150:0/2062171516 >> v1:172.21.15.197:6789/0 conn(0x7fad5c0c8af0 0x7fad5c06e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41070/0 (socket says 172.21.15.150:41070) 2022-08-10T17:49:11.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.683+0000 7fad624e6700 1 -- 172.21.15.150:0/2062171516 >> v1:172.21.15.197:6789/0 conn(0x7fad5c0c8af0 legacy=0x7fad5c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.673+0000 7fad60ce3700 1 -- 172.21.15.150:0/2062171516 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000808037 0 0) 0x7fad5c0701c0 con 0x7fad5c0c8af0 2022-08-10T17:49:11.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.683+0000 7fad624e6700 1 -- 172.21.15.150:0/2062171516 >> v1:172.21.15.150:6789/0 conn(0x7fad5c0c96b0 legacy=0x7fad5c167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.683+0000 7fad624e6700 1 -- 172.21.15.150:0/2062171516 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c06da60 con 0x7fad5c167a50 2022-08-10T17:49:11.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.683+0000 7fad624e6700 1 --2- 172.21.15.150:0/2062171516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c0c8ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad54009a00 tx=0x7fad5400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd605297ab1dcc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.684+0000 7fad60ce3700 1 -- 172.21.15.150:0/2062171516 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54003aa0 con 0x7fad5c167a50 2022-08-10T17:49:11.700 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.684+0000 7fad60ce3700 1 -- 172.21.15.150:0/2062171516 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54003c00 con 0x7fad5c167a50 2022-08-10T17:49:11.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.684+0000 7fad60ce3700 1 -- 172.21.15.150:0/2062171516 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004030 con 0x7fad5c167a50 2022-08-10T17:49:11.701 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 -- 172.21.15.150:0/2062171516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 msgr2=0x7fad5c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 --2- 172.21.15.150:0/2062171516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c0c8ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad54009a00 tx=0x7fad5400bbc0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 -- 172.21.15.150:0/2062171516 shutdown_connections 2022-08-10T17:49:11.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 --2- 172.21.15.150:0/2062171516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c0c8ec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 -- 172.21.15.150:0/2062171516 >> 172.21.15.150:0/2062171516 conn(0x7fad5c06b500 msgr2=0x7fad5c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 -- 172.21.15.150:0/2062171516 shutdown_connections 2022-08-10T17:49:11.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.685+0000 7fad63f49700 1 -- 172.21.15.150:0/2062171516 wait complete. 2022-08-10T17:49:11.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.687+0000 7fad63f49700 1 Processor -- start 2022-08-10T17:49:11.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.687+0000 7fad63f49700 1 -- start start 2022-08-10T17:49:11.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fad5c0c8af0 0x7fad5c0bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fad5c0c96b0 0x7fad5c203630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 0x7fad5c203b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c164310 con 0x7fad5c0bd010 2022-08-10T17:49:11.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c2031a0 con 0x7fad5c0c8af0 2022-08-10T17:49:11.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.688+0000 7fad63f49700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c2028b0 con 0x7fad5c0c96b0 2022-08-10T17:49:11.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 0x7fad5c203b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 0x7fad5c203b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42044/0 (socket says 172.21.15.150:42044) 2022-08-10T17:49:11.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 learned_addr learned my addr 172.21.15.150:0/2652073984 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:11.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fad5c0c96b0 msgr2=0x7fad5c203630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:49:11.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fad5c0c96b0 0x7fad5c203630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fad5c0c8af0 msgr2=0x7fad5c0bcad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:11.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fad5c0c8af0 0x7fad5c0bcad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540096b0 con 0x7fad5c0bd010 2022-08-10T17:49:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.689+0000 7fad624e6700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 0x7fad5c203b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad54009ad0 tx=0x7fad54004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.691+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004230 con 0x7fad5c0bd010 2022-08-10T17:49:11.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.691+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54004390 con 0x7fad5c0bd010 2022-08-10T17:49:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.691+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004700 con 0x7fad5c0bd010 2022-08-10T17:49:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.693+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c0bf1e0 con 0x7fad5c0bd010 2022-08-10T17:49:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.693+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c202e30 con 0x7fad5c0bd010 2022-08-10T17:49:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.696+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fad5402c070 con 0x7fad5c0bd010 2022-08-10T17:49:11.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.696+0000 7fad527fc700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fad440651b0 0x7fad44067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.696+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fad5400e070 con 0x7fad5c0bd010 2022-08-10T17:49:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.697+0000 7fad63f49700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c204af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.697+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0673d0 con 0x7fad5c167a50 2022-08-10T17:49:11.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.699+0000 7fad614e4700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c204af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.699+0000 7fad61ce5700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fad440651b0 0x7fad44067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.699+0000 7fad614e4700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad5c073340 con 0x7fad5c167a50 2022-08-10T17:49:11.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.699+0000 7fad61ce5700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fad440651b0 0x7fad44067660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad58001420 tx=0x7fad58007870 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.699+0000 7fad614e4700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c204af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0647e0 tx=0x7fad4c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0052d0 con 0x7fad5c167a50 2022-08-10T17:49:11.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fad4c003500 con 0x7fad5c167a50 2022-08-10T17:49:11.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 msgr2=0x7fad5c204af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c204af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0647e0 tx=0x7fad4c00c6a0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 msgr2=0x7fad5c204af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:11.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.700+0000 7fad527fc700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c167a50 0x7fad5c204af0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0647e0 tx=0x7fad4c00c6a0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.707+0000 7fad63f49700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 0x7fad5c163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.707+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c203310 con 0x7fad5c205030 2022-08-10T17:49:11.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.708+0000 7fad614e4700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 0x7fad5c163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.708+0000 7fad614e4700 1 -- 172.21.15.150:0/2652073984 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fad5c072890 con 0x7fad5c205030 2022-08-10T17:49:11.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.708+0000 7fad614e4700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 0x7fad5c163270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007c70 tx=0x7fad4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.708+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c012ad0 con 0x7fad5c205030 2022-08-10T17:49:11.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.708+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4550 (secure 0 0 0) 0x7fad4c003e30 con 0x7fad5c205030 2022-08-10T17:49:11.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 msgr2=0x7fad5c163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad527fc700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 0x7fad5c163270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007c70 tx=0x7fad4c000ed0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad527fc700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 msgr2=0x7fad5c163270 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:11.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad527fc700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c205030 0x7fad5c163270 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fad4c007c70 tx=0x7fad4c000ed0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.721 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:11.721 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:11.722 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:11.722 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:49:11.722 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:49:11.722 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:11.723 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:11.723 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:11.723 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:11.723 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.724 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:49:11.724 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:11.724 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:11.724 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:11.724 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.725 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.725 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.725 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.725 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.726 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.726 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.726 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.726 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.727 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.727 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:11.727 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:11.727 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.728 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.728 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.728 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.728 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.729 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.729 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.729 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.729 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.729 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.730 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:11.730 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:11.730 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:11.731 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:11.731 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:11.731 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:11.731 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:11.732 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:11.732 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:11.732 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:11.732 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:11.733 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:11.733 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:11.733 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:11.733 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:11.733 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:11.734 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.734 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.734 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.734 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.735 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.735 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.735 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.735 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.736 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.736 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.736 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:11.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.736 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:11.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.737 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:11.737 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:11.737 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.738 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.738 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.738 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:11.739 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.739 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.739 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:11.740 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.740 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.740 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.741 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:11.741 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:11.741 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.741 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.742 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.742 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:11.743 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:11.743 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.743 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.743 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.744 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:11.744 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.745 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.745 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:11.745 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.745 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.746 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.746 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:11.746 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:11.747 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.747 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.747 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.748 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:11.748 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:11.748 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.749 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.749 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.749 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:11.749 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.750 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.750 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:11.751 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.751 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.751 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.751 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.751 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:11.752 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:11.752 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.752 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.752 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.753 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.753 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.753 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.753 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:11.754 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:11.754 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.754 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.754 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.755 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:11.755 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.755 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.755 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:11.756 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.756 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.756 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.756 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:11.756 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.757 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.757 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:11.757 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.757 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.758 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.758 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:49:11.759 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.759 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.759 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.759 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:11.760 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:11.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fad440651b0 msgr2=0x7fad44067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad63f49700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fad440651b0 0x7fad44067660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad58001420 tx=0x7fad58007870 comp rx=0 tx=0).stop 2022-08-10T17:49:11.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 msgr2=0x7fad5c203b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.709+0000 7fad63f49700 1 --2- 172.21.15.150:0/2652073984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad5c0bd010 0x7fad5c203b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad54009ad0 tx=0x7fad54004950 comp rx=0 tx=0).stop 2022-08-10T17:49:11.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 reap_dead start 2022-08-10T17:49:11.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad624e6700 1 -- 172.21.15.150:0/2652073984 reap_dead start 2022-08-10T17:49:11.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 shutdown_connections 2022-08-10T17:49:11.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 >> 172.21.15.150:0/2652073984 conn(0x7fad5c06b500 msgr2=0x7fad5c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 shutdown_connections 2022-08-10T17:49:11.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.712+0000 7fad63f49700 1 -- 172.21.15.150:0/2652073984 wait complete. 2022-08-10T17:49:11.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:49:11.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.899+0000 7fd2e217b700 1 Processor -- start 2022-08-10T17:49:11.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.899+0000 7fd2e217b700 1 -- start start 2022-08-10T17:49:11.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2e217b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd2dc1540f0 0x7fd2dc071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2e217b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc0c6100 con 0x7fd2dc068820 2022-08-10T17:49:11.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2e217b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc0c5e00 con 0x7fd2dc1544c0 2022-08-10T17:49:11.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2e217b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc0c5270 con 0x7fd2dc1540f0 2022-08-10T17:49:11.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2db7fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd2dc1540f0 0x7fd2dc071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2dbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd2dc068820 0x7fd2dc161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54736/0 (socket says 172.21.15.150:54736) 2022-08-10T17:49:11.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.900+0000 7fd2dbfff700 1 -- 172.21.15.150:0/3925180265 learned_addr learned my addr 172.21.15.150:0/3925180265 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:11.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2da7fc700 1 -- 172.21.15.150:0/3925180265 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353167179 0 0) 0x7fd2dc0c6100 con 0x7fd2dc068820 2022-08-10T17:49:11.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2da7fc700 1 -- 172.21.15.150:0/3925180265 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c8003430 con 0x7fd2dc068820 2022-08-10T17:49:11.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2db7fe700 1 -- 172.21.15.150:0/3925180265 >> v1:172.21.15.197:6789/0 conn(0x7fd2dc1544c0 legacy=0x7fd2dc068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:11.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2db7fe700 1 -- 172.21.15.150:0/3925180265 >> v1:172.21.15.150:6789/0 conn(0x7fd2dc068820 legacy=0x7fd2dc161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2db7fe700 1 -- 172.21.15.150:0/3925180265 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc06eb00 con 0x7fd2dc1540f0 2022-08-10T17:49:11.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2db7fe700 1 --2- 172.21.15.150:0/3925180265 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc1540f0 0x7fd2dc071370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0096b0 tx=0x7fd2cc0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3ffdb95d57a194 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2da7fc700 1 -- 172.21.15.150:0/3925180265 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0107b0 con 0x7fd2dc1540f0 2022-08-10T17:49:11.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2da7fc700 1 -- 172.21.15.150:0/3925180265 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc010910 con 0x7fd2dc1540f0 2022-08-10T17:49:11.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.901+0000 7fd2da7fc700 1 -- 172.21.15.150:0/3925180265 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc010cc0 con 0x7fd2dc1540f0 2022-08-10T17:49:11.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.902+0000 7fd2e217b700 1 -- 172.21.15.150:0/3925180265 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc1540f0 msgr2=0x7fd2dc071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.902+0000 7fd2e217b700 1 --2- 172.21.15.150:0/3925180265 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc1540f0 0x7fd2dc071370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0096b0 tx=0x7fd2cc0099c0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.902+0000 7fd2e217b700 1 -- 172.21.15.150:0/3925180265 shutdown_connections 2022-08-10T17:49:11.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.902+0000 7fd2e217b700 1 --2- 172.21.15.150:0/3925180265 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc1540f0 0x7fd2dc071370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.902+0000 7fd2e217b700 1 -- 172.21.15.150:0/3925180265 >> 172.21.15.150:0/3925180265 conn(0x7fd2dc06d0d0 msgr2=0x7fd2dc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.903+0000 7fd2e217b700 1 -- 172.21.15.150:0/3925180265 shutdown_connections 2022-08-10T17:49:11.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.903+0000 7fd2e217b700 1 -- 172.21.15.150:0/3925180265 wait complete. 2022-08-10T17:49:11.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.904+0000 7fd2e217b700 1 Processor -- start 2022-08-10T17:49:11.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.904+0000 7fd2e217b700 1 -- start start 2022-08-10T17:49:11.915 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc068820 0x7fd2dc0bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2dc1540f0 0x7fd2dc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc1544c0 0x7fd2dc14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc0bdf90 con 0x7fd2dc1544c0 2022-08-10T17:49:11.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1ed120 con 0x7fd2dc068820 2022-08-10T17:49:11.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2e217b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1ecbc0 con 0x7fd2dc1540f0 2022-08-10T17:49:11.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2dbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc1544c0 0x7fd2dc14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2db7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc068820 0x7fd2dc0bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2db7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc068820 0x7fd2dc0bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52650/0 (socket says 172.21.15.150:52650) 2022-08-10T17:49:11.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2daffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2dc1540f0 0x7fd2dc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2db7fe700 1 -- 172.21.15.150:0/2723818197 learned_addr learned my addr 172.21.15.150:0/2723818197 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:11.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.905+0000 7fd2dbfff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2dc1540f0 msgr2=0x7fd2dc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2dbfff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd2dc1540f0 0x7fd2dc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2dbfff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc068820 msgr2=0x7fd2dc0bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2dbfff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc068820 0x7fd2dc0bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2dbfff700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc009310 con 0x7fd2dc1544c0 2022-08-10T17:49:11.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2dbfff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc1544c0 0x7fd2dc14dd70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c700 tx=0x7fd2d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40070d0 con 0x7fd2dc1544c0 2022-08-10T17:49:11.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4007230 con 0x7fd2dc1544c0 2022-08-10T17:49:11.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc0c95d0 con 0x7fd2dc1544c0 2022-08-10T17:49:11.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40075a0 con 0x7fd2dc1544c0 2022-08-10T17:49:11.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.906+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc0c0940 con 0x7fd2dc1544c0 2022-08-10T17:49:11.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2e217b700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 0x7fd2dc14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1572f0 con 0x7fd2dc156f20 2022-08-10T17:49:11.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2db7fe700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 0x7fd2dc14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2db7fe700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2dc0be0d0 con 0x7fd2dc156f20 2022-08-10T17:49:11.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd2d4019030 con 0x7fd2dc1544c0 2022-08-10T17:49:11.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.907+0000 7fd2db7fe700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 0x7fd2dc14e2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009a00 tx=0x7fd2cc0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2bc0650b0 0x7fd2bc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd2d4081500 con 0x7fd2dc1544c0 2022-08-10T17:49:11.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2daffd700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2bc0650b0 0x7fd2bc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc020070 con 0x7fd2dc156f20 2022-08-10T17:49:11.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd2cc011500 con 0x7fd2dc156f20 2022-08-10T17:49:11.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 msgr2=0x7fd2dc14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 0x7fd2dc14e2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009a00 tx=0x7fd2cc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 msgr2=0x7fd2dc14e2b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:11.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2c3fff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc156f20 0x7fd2dc14e2b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.908+0000 7fd2daffd700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2bc0650b0 0x7fd2bc067560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c35c0 tx=0x7fd2d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.915+0000 7fd2e217b700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 0x7fd2dc0be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:11.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.915+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc0672f0 con 0x7fd2dc0be3b0 2022-08-10T17:49:11.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.915+0000 7fd2db7fe700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 0x7fd2dc0be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:11.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2db7fe700 1 -- 172.21.15.150:0/2723818197 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd2dc0c6dc0 con 0x7fd2dc0be3b0 2022-08-10T17:49:11.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2db7fe700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 0x7fd2dc0be7b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc025000 tx=0x7fd2cc010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:11.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc038070 con 0x7fd2dc0be3b0 2022-08-10T17:49:11.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7fd2cc026630 con 0x7fd2dc0be3b0 2022-08-10T17:49:11.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 msgr2=0x7fd2dc0be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 0x7fd2dc0be7b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc025000 tx=0x7fd2cc010000 comp rx=0 tx=0).stop 2022-08-10T17:49:11.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 msgr2=0x7fd2dc0be7b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:11.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2c3fff700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd2dc0be3b0 0x7fd2dc0be7b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:11.928 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:11.929 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:11.929 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:11.929 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:11.929 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:49:11.930 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:11.930 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:11.930 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:11.930 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:11.931 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.931 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:49:11.931 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:11.931 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:11.931 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:11.932 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.932 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.932 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.932 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.933 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.933 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.933 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.933 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.933 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.934 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.934 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:11.934 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:11.934 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.935 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.935 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.935 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.935 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.936 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.936 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.936 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.936 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.936 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.937 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:11.937 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:11.937 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:11.938 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:11.938 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:11.938 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:11.938 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:49:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:49:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.966 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:11.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.966 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.967 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.967 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:49:11.967 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.967 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:11.967 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:49:11.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:11.968 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:11.968 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:11.968 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:49:11.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:11.969 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:11.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:11.969 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:11.969 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2bc0650b0 msgr2=0x7fd2bc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd2bc0650b0 0x7fd2bc067560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c35c0 tx=0x7fd2d0009040 comp rx=0 tx=0).stop 2022-08-10T17:49:11.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc1544c0 msgr2=0x7fd2dc14dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:11.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 --2- 172.21.15.150:0/2723818197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2dc1544c0 0x7fd2dc14dd70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c700 tx=0x7fd2d400ca10 comp rx=0 tx=0).stop 2022-08-10T17:49:11.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2dbfff700 1 -- 172.21.15.150:0/2723818197 reap_dead start 2022-08-10T17:49:11.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2dbfff700 1 -- 172.21.15.150:0/2723818197 reap_dead start 2022-08-10T17:49:11.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 shutdown_connections 2022-08-10T17:49:11.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.916+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 >> 172.21.15.150:0/2723818197 conn(0x7fd2dc06d0d0 msgr2=0x7fd2dc1e0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:11.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.917+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 shutdown_connections 2022-08-10T17:49:11.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:11.917+0000 7fd2e217b700 1 -- 172.21.15.150:0/2723818197 wait complete. 2022-08-10T17:49:11.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:49:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.126+0000 7fdddd867700 1 Processor -- start 2022-08-10T17:49:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.126+0000 7fdddd867700 1 -- start start 2022-08-10T17:49:12.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fdddd867700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fddd8150e20 0x7fddd8156c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fdddd867700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 0x7fddd80c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fdddd867700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8157bd0 con 0x7fddd81511f0 2022-08-10T17:49:12.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fdddd867700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd8157150 con 0x7fddd8150e20 2022-08-10T17:49:12.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fdddd867700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8157330 con 0x7fddd80c6950 2022-08-10T17:49:12.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd67fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fddd81511f0 0x7fddd815ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54750/0 (socket says 172.21.15.150:54750) 2022-08-10T17:49:12.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd67fc700 1 -- 172.21.15.150:0/953234730 learned_addr learned my addr 172.21.15.150:0/953234730 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:12.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/953234730 >> v2:172.21.15.197:3300/0 conn(0x7fddd8150e20 0x7fddd8156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd77fe700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 0x7fddd80c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd5ffb700 1 -- 172.21.15.150:0/953234730 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371495892 0 0) 0x7fddc8001110 con 0x7fddd81511f0 2022-08-10T17:49:12.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd5ffb700 1 -- 172.21.15.150:0/953234730 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc4003430 con 0x7fddd81511f0 2022-08-10T17:49:12.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd6ffd700 1 -- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 msgr2=0x7fddd80c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:12.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 0x7fddd80c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.127+0000 7fddd6ffd700 1 -- 172.21.15.150:0/953234730 >> v1:172.21.15.150:6789/0 conn(0x7fddd81511f0 legacy=0x7fddd815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd6ffd700 1 -- 172.21.15.150:0/953234730 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8157610 con 0x7fddd8150e20 2022-08-10T17:49:12.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd77fe700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 0x7fddd80c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:12.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd8150e20 0x7fddd8156c10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0096b0 tx=0x7fddcc0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1559f574349be8bb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd5ffb700 1 -- 172.21.15.150:0/953234730 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0107b0 con 0x7fddd8150e20 2022-08-10T17:49:12.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd5ffb700 1 -- 172.21.15.150:0/953234730 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc010910 con 0x7fddd8150e20 2022-08-10T17:49:12.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fddd5ffb700 1 -- 172.21.15.150:0/953234730 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc010cc0 con 0x7fddd8150e20 2022-08-10T17:49:12.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fdddd867700 1 -- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd8150e20 msgr2=0x7fddd8156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.128+0000 7fdddd867700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd8150e20 0x7fddd8156c10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0096b0 tx=0x7fddcc0099c0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.129+0000 7fdddd867700 1 -- 172.21.15.150:0/953234730 shutdown_connections 2022-08-10T17:49:12.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.129+0000 7fdddd867700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c6950 0x7fddd80c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.129+0000 7fdddd867700 1 --2- 172.21.15.150:0/953234730 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd8150e20 0x7fddd8156c10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.129+0000 7fdddd867700 1 -- 172.21.15.150:0/953234730 >> 172.21.15.150:0/953234730 conn(0x7fddd8071370 msgr2=0x7fddd8071770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:12.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.130+0000 7fdddd867700 1 -- 172.21.15.150:0/953234730 shutdown_connections 2022-08-10T17:49:12.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.130+0000 7fdddd867700 1 -- 172.21.15.150:0/953234730 wait complete. 2022-08-10T17:49:12.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.131+0000 7fdddd867700 1 Processor -- start 2022-08-10T17:49:12.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.131+0000 7fdddd867700 1 -- start start 2022-08-10T17:49:12.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 0x7fddd80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd8150e20 0x7fddd8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd81511f0 0x7fddd80c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80b2a80 con 0x7fddd80c6950 2022-08-10T17:49:12.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80892f0 con 0x7fddd81511f0 2022-08-10T17:49:12.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.132+0000 7fdddd867700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8154770 con 0x7fddd8150e20 2022-08-10T17:49:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 0x7fddd80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 0x7fddd80c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42074/0 (socket says 172.21.15.150:42074) 2022-08-10T17:49:12.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd6ffd700 1 -- 172.21.15.150:0/93627798 learned_addr learned my addr 172.21.15.150:0/93627798 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd81511f0 0x7fddd80c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd67fc700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd8150e20 0x7fddd8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd8150e20 msgr2=0x7fddd8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd8150e20 0x7fddd8154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 msgr2=0x7fddd80c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 0x7fddd80c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009a70 con 0x7fddd81511f0 2022-08-10T17:49:12.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd67fc700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd8150e20 0x7fddd8154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:49:12.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd80c6950 0x7fddd80c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:12.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddd77fe700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd81511f0 0x7fddd80c0d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddd000efc0 tx=0x7fddd000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0009e80 con 0x7fddd81511f0 2022-08-10T17:49:12.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000f040 con 0x7fddd81511f0 2022-08-10T17:49:12.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc009310 con 0x7fddd81511f0 2022-08-10T17:49:12.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000cd80 con 0x7fddd81511f0 2022-08-10T17:49:12.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.133+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd815ae90 con 0x7fddd81511f0 2022-08-10T17:49:12.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.134+0000 7fdddd867700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 0x7fddd8149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.134+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80673d0 con 0x7fddd80c12a0 2022-08-10T17:49:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.135+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 0x7fddd8149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.135+0000 7fddd6ffd700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddd8154c90 con 0x7fddd80c12a0 2022-08-10T17:49:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.135+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 0x7fddd8149bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009a00 tx=0x7fddcc0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.135+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc020070 con 0x7fddd80c12a0 2022-08-10T17:49:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.135+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fddd0014480 con 0x7fddd81511f0 2022-08-10T17:49:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fddb8065150 0x7fddb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fddd0082be0 con 0x7fddd81511f0 2022-08-10T17:49:12.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddd67fc700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fddb8065150 0x7fddb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fddcc010e70 con 0x7fddd80c12a0 2022-08-10T17:49:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 msgr2=0x7fddd8149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 0x7fddd8149bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009a00 tx=0x7fddcc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 msgr2=0x7fddd8149bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:12.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.136+0000 7fddbffff700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd80c12a0 0x7fddd8149bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.139+0000 7fddd67fc700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fddb8065150 0x7fddb8067600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddd8089b40 tx=0x7fddc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.148+0000 7fdddd867700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 0x7fddd814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.148+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8069790 con 0x7fddd814a100 2022-08-10T17:49:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.148+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 0x7fddd814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddd6ffd700 1 -- 172.21.15.150:0/93627798 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fddd8072890 con 0x7fddd814a100 2022-08-10T17:49:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddd6ffd700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 0x7fddd814a4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fddcc023000 tx=0x7fddcc010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc003dc0 con 0x7fddd814a100 2022-08-10T17:49:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7fddcc033430 con 0x7fddd814a100 2022-08-10T17:49:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 msgr2=0x7fddd814a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 0x7fddd814a4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fddcc023000 tx=0x7fddcc010000 comp rx=0 tx=0).stop 2022-08-10T17:49:12.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 msgr2=0x7fddd814a4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:12.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.149+0000 7fddbffff700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fddd814a100 0x7fddd814a4d0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fddcc023000 tx=0x7fddcc010000 comp rx=0 tx=0).stop 2022-08-10T17:49:12.158 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:12.158 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:12.159 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:12.159 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:12.159 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 110, 2022-08-10T17:49:12.159 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:12.160 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:12.160 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:12.160 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:12.160 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:49:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:12.161 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:12.162 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:12.162 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:12.162 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:12.162 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:12.163 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:12.163 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:12.163 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:12.163 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:12.164 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:12.164 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:12.164 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:12.164 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:12.165 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:12.165 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:12.165 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:12.165 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:12.166 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:12.166 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:12.166 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:12.166 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:12.166 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:12.167 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.167 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:12.167 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:12.168 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:12.168 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:12.168 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:12.168 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:12.169 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:12.169 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:12.169 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:12.169 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:12.170 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:12.170 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:12.170 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:12.170 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:12.171 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:12.171 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:12.171 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:12.171 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:12.172 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:12.172 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:12.172 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:12.172 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:12.173 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:12.173 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:12.173 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:12.173 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:12.173 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:12.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.174 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:12.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.174 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:12.175 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:12.175 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:12.175 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:12.175 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.176 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:12.176 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:12.176 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.177 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:12.177 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:12.177 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.178 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.178 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.178 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.178 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.180 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:12.180 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:12.180 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:12.181 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:12.181 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.181 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:12.181 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:12.182 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.182 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:12.183 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:12.183 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.183 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.183 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.184 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:12.184 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:12.184 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:12.184 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:12.185 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:12.185 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.185 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.185 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:12.186 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:12.186 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:12.186 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:12.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.187 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:12.187 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:12.187 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.188 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:12.188 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:12.188 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:12.189 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.189 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.189 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:12.189 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:12.190 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:12.190 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:12.190 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:12.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.191 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.191 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:12.191 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:12.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.192 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:12.192 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:12.192 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:12.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.193 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:12.193 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:12.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.193 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:12.194 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:12.194 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:12.194 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.194 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:12.195 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:12.195 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:12.195 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:12.195 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:12.196 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:12.196 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:12.196 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:12.196 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:12.197 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:12.197 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:12.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.151+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fddb8065150 msgr2=0x7fddb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.151+0000 7fdddd867700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fddb8065150 0x7fddb8067600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddd8089b40 tx=0x7fddc8009040 comp rx=0 tx=0).stop 2022-08-10T17:49:12.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.151+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd81511f0 msgr2=0x7fddd80c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.151+0000 7fdddd867700 1 --2- 172.21.15.150:0/93627798 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fddd81511f0 0x7fddd80c0d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddd000efc0 tx=0x7fddd000c3a0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.152+0000 7fddd77fe700 1 -- 172.21.15.150:0/93627798 reap_dead start 2022-08-10T17:49:12.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.152+0000 7fddd77fe700 1 -- 172.21.15.150:0/93627798 reap_dead start 2022-08-10T17:49:12.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.155+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 shutdown_connections 2022-08-10T17:49:12.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.155+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 >> 172.21.15.150:0/93627798 conn(0x7fddd8071370 msgr2=0x7fddd81e1690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:12.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.155+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 shutdown_connections 2022-08-10T17:49:12.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.155+0000 7fdddd867700 1 -- 172.21.15.150:0/93627798 wait complete. 2022-08-10T17:49:12.201 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:49:12.202 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:49:12.202 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:49:12.202 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:49:12.203 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:49:12.203 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:49:12.216 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:49:12.216 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:49:12.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:12.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.353+0000 7f60270b8700 1 Processor -- start 2022-08-10T17:49:12.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.353+0000 7f60270b8700 1 -- start start 2022-08-10T17:49:12.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f60270b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602006f0f0 0x7f602006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f60270b8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 0x7f6020156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f60270b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602006b960 con 0x7f60201541e0 2022-08-10T17:49:12.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f60270b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200c7280 con 0x7f602006f0f0 2022-08-10T17:49:12.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f60270b8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c5f50 con 0x7f60200c4420 2022-08-10T17:49:12.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f6025655700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 msgr2=0x7f6020156b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:12.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f6025655700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 0x7f6020156b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:12.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f601ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602006f0f0 0x7f602006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f6024e54700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f60201541e0 0x7f6020071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54768/0 (socket says 172.21.15.150:54768) 2022-08-10T17:49:12.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f601ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602006f0f0 0x7f602006ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42090/0 (socket says 172.21.15.150:42090) 2022-08-10T17:49:12.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.354+0000 7f6024e54700 1 -- 172.21.15.150:0/3344983937 learned_addr learned my addr 172.21.15.150:0/3344983937 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:12.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601ffff700 1 -- 172.21.15.150:0/3344983937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 msgr2=0x7f6020156b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:12.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601ffff700 1 --2- 172.21.15.150:0/3344983937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 0x7f6020156b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601ffff700 1 -- 172.21.15.150:0/3344983937 >> v1:172.21.15.150:6789/0 conn(0x7f60201541e0 legacy=0x7f6020071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601f7fe700 1 -- 172.21.15.150:0/3344983937 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616848050 0 0) 0x7f602006b960 con 0x7f60201541e0 2022-08-10T17:49:12.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601ffff700 1 -- 172.21.15.150:0/3344983937 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200c6fa0 con 0x7f602006f0f0 2022-08-10T17:49:12.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601ffff700 1 --2- 172.21.15.150:0/3344983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602006f0f0 0x7f602006ea50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f600c0096a0 tx=0x7f600c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140b23067e24c997 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601f7fe700 1 -- 172.21.15.150:0/3344983937 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c005cb0 con 0x7f602006f0f0 2022-08-10T17:49:12.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601f7fe700 1 -- 172.21.15.150:0/3344983937 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c005e10 con 0x7f602006f0f0 2022-08-10T17:49:12.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.355+0000 7f601f7fe700 1 -- 172.21.15.150:0/3344983937 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c004270 con 0x7f602006f0f0 2022-08-10T17:49:12.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 -- 172.21.15.150:0/3344983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602006f0f0 msgr2=0x7f602006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 --2- 172.21.15.150:0/3344983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602006f0f0 0x7f602006ea50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f600c0096a0 tx=0x7f600c0099b0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 -- 172.21.15.150:0/3344983937 shutdown_connections 2022-08-10T17:49:12.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 --2- 172.21.15.150:0/3344983937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f60200c4420 0x7f6020156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 --2- 172.21.15.150:0/3344983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602006f0f0 0x7f602006ea50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 -- 172.21.15.150:0/3344983937 >> 172.21.15.150:0/3344983937 conn(0x7f6020068be0 msgr2=0x7f60200c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:12.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 -- 172.21.15.150:0/3344983937 shutdown_connections 2022-08-10T17:49:12.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.356+0000 7f60270b8700 1 -- 172.21.15.150:0/3344983937 wait complete. 2022-08-10T17:49:12.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.357+0000 7f60270b8700 1 Processor -- start 2022-08-10T17:49:12.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.357+0000 7f60270b8700 1 -- start start 2022-08-10T17:49:12.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 0x7f60200c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f60201541e0 0x7f60200c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c8020 con 0x7f60200c4420 2022-08-10T17:49:12.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c8300 con 0x7f60201541e0 2022-08-10T17:49:12.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f60270b8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c85e0 con 0x7f602006f0f0 2022-08-10T17:49:12.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f6024e54700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 msgr2=0x7f60200c3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:12.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f6024e54700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 0x7f60200c3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:12.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42096/0 (socket says 172.21.15.150:42096) 2022-08-10T17:49:12.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 -- 172.21.15.150:0/3026348099 learned_addr learned my addr 172.21.15.150:0/3026348099 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:12.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f6025655700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f60201541e0 0x7f60200c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 -- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 msgr2=0x7f60200c3760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:12.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 0x7f60200c3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 -- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f60201541e0 msgr2=0x7f60200c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f60201541e0 0x7f60200c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 -- 172.21.15.150:0/3026348099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0092b0 con 0x7f60200c4420 2022-08-10T17:49:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601ffff700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f600c004000 tx=0x7f600c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.358+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c006390 con 0x7f60200c4420 2022-08-10T17:49:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.359+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c0064f0 con 0x7f60200c4420 2022-08-10T17:49:12.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.359+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60200c88c0 con 0x7f60200c4420 2022-08-10T17:49:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.359+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c003520 con 0x7f60200c4420 2022-08-10T17:49:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.359+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200c3240 con 0x7f60200c4420 2022-08-10T17:49:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.359+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200c61f0 con 0x7f60200c4420 2022-08-10T17:49:12.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.360+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f600c02d070 con 0x7f60200c4420 2022-08-10T17:49:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.360+0000 7f601d7fa700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 0x7f6008067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.361+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f600c0834c0 con 0x7f60200c4420 2022-08-10T17:49:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.361+0000 7f6024e54700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 0x7f6008067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:12.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.361+0000 7f6024e54700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 0x7f6008067540 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6014004720 tx=0x7f60140079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:12.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.369+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f600c0514a0 con 0x7f60200c4420 2022-08-10T17:49:12.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.676+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6020069120 con 0x7f60200c4420 2022-08-10T17:49:12.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.676+0000 7f601d7fa700 1 -- 172.21.15.150:0/3026348099 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f600c02b080 con 0x7f60200c4420 2022-08-10T17:49:12.681 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:12.683 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 msgr2=0x7f6008067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 0x7f6008067540 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6014004720 tx=0x7f60140079d0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 msgr2=0x7f6020158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:12.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f600c004000 tx=0x7f600c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 shutdown_connections 2022-08-10T17:49:12.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f60201541e0 0x7f60200c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6008065090 0x7f6008067540 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f602006f0f0 0x7f60200c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 --2- 172.21.15.150:0/3026348099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60200c4420 0x7f6020158e50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 >> 172.21.15.150:0/3026348099 conn(0x7f6020068be0 msgr2=0x7f6020155130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 shutdown_connections 2022-08-10T17:49:12.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:12.679+0000 7f60270b8700 1 -- 172.21.15.150:0/3026348099 wait complete. 2022-08-10T17:49:15.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:16.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.082+0000 7fc4833da700 1 Processor -- start 2022-08-10T17:49:16.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.082+0000 7fc4833da700 1 -- start start 2022-08-10T17:49:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc4833da700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 0x7fc47c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc4833da700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc47c0bc950 0x7fc47c15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc4833da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0692f0 con 0x7fc47c06c980 2022-08-10T17:49:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc4833da700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0c6450 con 0x7fc47c0bc950 2022-08-10T17:49:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc4833da700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0c4f10 con 0x7fc47c0bc580 2022-08-10T17:49:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481176700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 msgr2=0x7fc47c156e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481176700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 0x7fc47c156e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc47c0bc950 0x7fc47c15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc47c0bc950 0x7fc47c15d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52720/0 (socket says 172.21.15.150:52720) 2022-08-10T17:49:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 -- 172.21.15.150:0/3038141042 learned_addr learned my addr 172.21.15.150:0/3038141042 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 -- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 msgr2=0x7fc47c156e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 --2- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 0x7fc47c156e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 -- 172.21.15.150:0/3038141042 >> v1:172.21.15.150:6789/0 conn(0x7fc47c06c980 legacy=0x7fc47c14cf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.083+0000 7fc481977700 1 -- 172.21.15.150:0/3038141042 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c156620 con 0x7fc47c0bc950 2022-08-10T17:49:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.084+0000 7fc481977700 1 --2- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc950 0x7fc47c15d8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc478006fd0 tx=0x7fc478009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b674a750723473 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.084+0000 7fc46bfff700 1 -- 172.21.15.150:0/3038141042 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478011830 con 0x7fc47c0bc950 2022-08-10T17:49:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.084+0000 7fc46bfff700 1 -- 172.21.15.150:0/3038141042 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478011990 con 0x7fc47c0bc950 2022-08-10T17:49:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.084+0000 7fc46bfff700 1 -- 172.21.15.150:0/3038141042 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478011d40 con 0x7fc47c0bc950 2022-08-10T17:49:16.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 -- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc950 msgr2=0x7fc47c15d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:16.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 --2- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc950 0x7fc47c15d8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc478006fd0 tx=0x7fc478009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:16.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 -- 172.21.15.150:0/3038141042 shutdown_connections 2022-08-10T17:49:16.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 --2- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc950 0x7fc47c15d8b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 --2- 172.21.15.150:0/3038141042 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc580 0x7fc47c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 -- 172.21.15.150:0/3038141042 >> 172.21.15.150:0/3038141042 conn(0x7fc47c0c9d60 msgr2=0x7fc47c0c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:16.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 -- 172.21.15.150:0/3038141042 shutdown_connections 2022-08-10T17:49:16.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.085+0000 7fc4833da700 1 -- 172.21.15.150:0/3038141042 wait complete. 2022-08-10T17:49:16.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.087+0000 7fc4833da700 1 Processor -- start 2022-08-10T17:49:16.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.087+0000 7fc4833da700 1 -- start start 2022-08-10T17:49:16.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc580 0x7fc47c1ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc950 0x7fc47c1e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c064910 con 0x7fc47c14a3f0 2022-08-10T17:49:16.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1559c0 con 0x7fc47c0bc580 2022-08-10T17:49:16.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc4833da700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c155c80 con 0x7fc47c0bc950 2022-08-10T17:49:16.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc481977700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:16.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc481977700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42132/0 (socket says 172.21.15.150:42132) 2022-08-10T17:49:16.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.088+0000 7fc481977700 1 -- 172.21.15.150:0/1246150714 learned_addr learned my addr 172.21.15.150:0/1246150714 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:16.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 -- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc950 msgr2=0x7fc47c1e9240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:16.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc950 0x7fc47c1e9240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 -- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc580 msgr2=0x7fc47c1ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:16.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc580 0x7fc47c1ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 -- 172.21.15.150:0/1246150714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780093e0 con 0x7fc47c14a3f0 2022-08-10T17:49:16.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc481977700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc478009e60 tx=0x7fc4780045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:16.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478021070 con 0x7fc47c14a3f0 2022-08-10T17:49:16.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47801b890 con 0x7fc47c14a3f0 2022-08-10T17:49:16.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c155f60 con 0x7fc47c14a3f0 2022-08-10T17:49:16.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47801bc40 con 0x7fc47c14a3f0 2022-08-10T17:49:16.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.089+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c1ec780 con 0x7fc47c14a3f0 2022-08-10T17:49:16.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.091+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc47802d030 con 0x7fc47c14a3f0 2022-08-10T17:49:16.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.091+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c06be50 con 0x7fc47c14a3f0 2022-08-10T17:49:16.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.091+0000 7fc469ffb700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 0x7fc464067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:16.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.091+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc478083260 con 0x7fc47c14a3f0 2022-08-10T17:49:16.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.092+0000 7fc481176700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 0x7fc464067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:16.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.092+0000 7fc481176700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 0x7fc464067680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc46c003840 tx=0x7fc46c006c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:16.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.096+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc478054bf0 con 0x7fc47c14a3f0 2022-08-10T17:49:16.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.401+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc47c153d50 con 0x7fc47c14a3f0 2022-08-10T17:49:16.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.401+0000 7fc469ffb700 1 -- 172.21.15.150:0/1246150714 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fc47802b020 con 0x7fc47c14a3f0 2022-08-10T17:49:16.406 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:16.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 msgr2=0x7fc464067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:16.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 0x7fc464067680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc46c003840 tx=0x7fc46c006c00 comp rx=0 tx=0).stop 2022-08-10T17:49:16.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 msgr2=0x7fc47c144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:16.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc478009e60 tx=0x7fc4780045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 shutdown_connections 2022-08-10T17:49:16.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc47c14a3f0 0x7fc47c144330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc47c0bc580 0x7fc47c1ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc4640651d0 0x7fc464067680 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 --2- 172.21.15.150:0/1246150714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc47c0bc950 0x7fc47c1e9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:16.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 >> 172.21.15.150:0/1246150714 conn(0x7fc47c0c9d60 msgr2=0x7fc47c14aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:16.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.403+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 shutdown_connections 2022-08-10T17:49:16.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:16.404+0000 7fc4833da700 1 -- 172.21.15.150:0/1246150714 wait complete. 2022-08-10T17:49:19.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:19.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.571+0000 7f373b887700 1 Processor -- start 2022-08-10T17:49:19.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.571+0000 7f373b887700 1 -- start start 2022-08-10T17:49:19.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f373b887700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3734150b40 0x7f3734068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f373b887700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3734068650 0x7f373406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f373b887700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340bcfe0 con 0x7f37340644b0 2022-08-10T17:49:19.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f373b887700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373406f3e0 con 0x7f3734068650 2022-08-10T17:49:19.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f373b887700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3734069440 con 0x7f3734150b40 2022-08-10T17:49:19.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3734068650 0x7f373406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:19.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3734068650 0x7f373406fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42148/0 (socket says 172.21.15.150:42148) 2022-08-10T17:49:19.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 -- 172.21.15.150:0/3566823718 learned_addr learned my addr 172.21.15.150:0/3566823718 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:19.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3739623700 1 --2- 172.21.15.150:0/3566823718 >> v2:172.21.15.197:3300/0 conn(0x7f3734150b40 0x7f3734068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:19.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 -- 172.21.15.150:0/3566823718 >> v2:172.21.15.197:3300/0 conn(0x7f3734150b40 msgr2=0x7f3734068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:19.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 --2- 172.21.15.150:0/3566823718 >> v2:172.21.15.197:3300/0 conn(0x7f3734150b40 0x7f3734068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 -- 172.21.15.150:0/3566823718 >> v1:172.21.15.197:6789/0 conn(0x7f37340644b0 legacy=0x7f3734156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:19.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 -- 172.21.15.150:0/3566823718 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340c48f0 con 0x7f3734068650 2022-08-10T17:49:19.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.573+0000 7f3738e22700 1 --2- 172.21.15.150:0/3566823718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3734068650 0x7f373406fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f373406cae0 tx=0x7f3724009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99535e0bfb725b7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:19.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f3723fff700 1 -- 172.21.15.150:0/3566823718 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724004230 con 0x7f3734068650 2022-08-10T17:49:19.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f3723fff700 1 -- 172.21.15.150:0/3566823718 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724004390 con 0x7f3734068650 2022-08-10T17:49:19.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f3723fff700 1 -- 172.21.15.150:0/3566823718 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724011850 con 0x7f3734068650 2022-08-10T17:49:19.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 -- 172.21.15.150:0/3566823718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3734068650 msgr2=0x7f373406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:19.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 --2- 172.21.15.150:0/3566823718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3734068650 0x7f373406fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f373406cae0 tx=0x7f3724009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:19.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 -- 172.21.15.150:0/3566823718 shutdown_connections 2022-08-10T17:49:19.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 --2- 172.21.15.150:0/3566823718 >> v2:172.21.15.197:3300/0 conn(0x7f3734150b40 0x7f3734068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 --2- 172.21.15.150:0/3566823718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3734068650 0x7f373406fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.574+0000 7f373b887700 1 -- 172.21.15.150:0/3566823718 >> 172.21.15.150:0/3566823718 conn(0x7f37340c9320 msgr2=0x7f37340c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:19.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.575+0000 7f373b887700 1 -- 172.21.15.150:0/3566823718 shutdown_connections 2022-08-10T17:49:19.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.575+0000 7f373b887700 1 -- 172.21.15.150:0/3566823718 wait complete. 2022-08-10T17:49:19.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.576+0000 7f373b887700 1 Processor -- start 2022-08-10T17:49:19.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.576+0000 7f373b887700 1 -- start start 2022-08-10T17:49:19.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.577+0000 7f373b887700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 0x7f37340bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3734150b40 0x7f37340bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340bf650 con 0x7f37340644b0 2022-08-10T17:49:19.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37341deff0 con 0x7f3734150b40 2022-08-10T17:49:19.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340befb0 con 0x7f3734068650 2022-08-10T17:49:19.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3738e22700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 msgr2=0x7f37340bfa70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:19.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3738e22700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 0x7f37340bfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42152/0 (socket says 172.21.15.150:42152) 2022-08-10T17:49:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 -- 172.21.15.150:0/2305971875 learned_addr learned my addr 172.21.15.150:0/2305971875 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:19.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739e24700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3734150b40 0x7f37340bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 -- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 msgr2=0x7f37340bfa70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 0x7f37340bfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 -- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3734150b40 msgr2=0x7f37340bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3734150b40 0x7f37340bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 -- 172.21.15.150:0/2305971875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240093e0 con 0x7f37340644b0 2022-08-10T17:49:19.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3739623700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f373000e8a0 tx=0x7f373000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:19.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730009400 con 0x7f37340644b0 2022-08-10T17:49:19.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730013680 con 0x7f37340644b0 2022-08-10T17:49:19.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300139f0 con 0x7f37340644b0 2022-08-10T17:49:19.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37341dfd80 con 0x7f37340644b0 2022-08-10T17:49:19.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.578+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37340bf270 con 0x7f37340644b0 2022-08-10T17:49:19.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.580+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3730019030 con 0x7f37340644b0 2022-08-10T17:49:19.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.580+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734068ed0 con 0x7f37340644b0 2022-08-10T17:49:19.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.580+0000 7f3721ffb700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 0x7f3714067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:19.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.580+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3730081e90 con 0x7f37340644b0 2022-08-10T17:49:19.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.580+0000 7f3738e22700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 0x7f3714067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:19.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.581+0000 7f3738e22700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 0x7f3714067510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f373414eac0 tx=0x7f3724008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:19.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.584+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f373004fe70 con 0x7f37340644b0 2022-08-10T17:49:19.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.934+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3734072890 con 0x7f37340644b0 2022-08-10T17:49:19.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.935+0000 7f3721ffb700 1 -- 172.21.15.150:0/2305971875 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f3730021080 con 0x7f37340644b0 2022-08-10T17:49:19.939 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:19.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.942+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 msgr2=0x7f3714067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:19.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.942+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 0x7f3714067510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f373414eac0 tx=0x7f3724008030 comp rx=0 tx=0).stop 2022-08-10T17:49:19.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.942+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 msgr2=0x7f37340c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:19.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.942+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f373000e8a0 tx=0x7f373000ebb0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 shutdown_connections 2022-08-10T17:49:19.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3734150b40 0x7f37340bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37340644b0 0x7f37340c7400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3714065060 0x7f3714067510 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 --2- 172.21.15.150:0/2305971875 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3734068650 0x7f37340bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:19.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 >> 172.21.15.150:0/2305971875 conn(0x7f37340c9320 msgr2=0x7f373414ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:19.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 shutdown_connections 2022-08-10T17:49:19.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:19.943+0000 7f373b887700 1 -- 172.21.15.150:0/2305971875 wait complete. 2022-08-10T17:49:22.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:23.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.106+0000 7f5dd9fb7700 1 Processor -- start 2022-08-10T17:49:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.106+0000 7f5dd9fb7700 1 -- start start 2022-08-10T17:49:23.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd9fb7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd9fb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd9fb7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40699a0 con 0x7f5dd4150d10 2022-08-10T17:49:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd9fb7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd40c72f0 con 0x7f5dd406f080 2022-08-10T17:49:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd9fb7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd41510e0 con 0x7f5dd4156870 2022-08-10T17:49:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42182/0 (socket says 172.21.15.150:42182) 2022-08-10T17:49:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 learned_addr learned my addr 172.21.15.150:0/3994713380 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd2ffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:49:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.107+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.108+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.108+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.108+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.108+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:23.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.308+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.308+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:23.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.308+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.308+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.308+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:49:23.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.309+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.309+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:23.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.309+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.309+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.309+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:49:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.709+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.709+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.709+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.709+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.709+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:49:23.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.710+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:23.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.710+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:23.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.710+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:23.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.710+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:23.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:23.710+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:49:24.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.510+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:24.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.510+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:24.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.510+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:24.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.510+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:24.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.510+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:49:24.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.511+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:24.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.511+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:49:24.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.511+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:24.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.511+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:24.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:24.511+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:49:26.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 msgr2=0x7f5dd4071370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:26.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.197:3300/0 conn(0x7f5dd4156870 0x7f5dd4071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 -- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 msgr2=0x7f5dd40718b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:26.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 --2- 172.21.15.150:0/3994713380 >> v2:172.21.15.150:3300/0 conn(0x7f5dd406f080 0x7f5dd40718b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 -- 172.21.15.150:0/3994713380 >> v1:172.21.15.197:6789/0 conn(0x7f5dd4150d10 legacy=0x7f5dd415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 0x7f5db40059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 -- 172.21.15.150:0/3994713380 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40c6d30 con 0x7f5db4006100 2022-08-10T17:49:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd17fa700 1 -- 172.21.15.150:0/3994713380 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41510e0 con 0x7f5db40035a0 2022-08-10T17:49:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd37fe700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 msgr2=0x7f5db40059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:26.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.107+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 0x7f5db40059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:26.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.308+0000 7f5dd37fe700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 msgr2=0x7f5db40059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:26.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.308+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 0x7f5db40059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:49:26.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.709+0000 7f5dd37fe700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 msgr2=0x7f5db40059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:26.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.709+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 0x7f5db40059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:49:26.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330900803 0 0) 0x7f5dd40c6d30 con 0x7f5db4006100 2022-08-10T17:49:26.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc0003430 con 0x7f5db4006100 2022-08-10T17:49:26.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829533078 0 0) 0x7f5dc0003430 con 0x7f5db4006100 2022-08-10T17:49:26.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 msgr2=0x7f5db40059e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:26.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5db40035a0 0x7f5db40059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db400aec0 con 0x7f5db4006100 2022-08-10T17:49:26.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5dc800d500 con 0x7f5db4006100 2022-08-10T17:49:26.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 >> v1:172.21.15.150:6789/0 conn(0x7f5db4006100 legacy=0x7f5db4008590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:26.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 reap_dead start 2022-08-10T17:49:26.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dc0003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 0x7f5dc0004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 0x7f5dc000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41510e0 con 0x7f5dc00046d0 2022-08-10T17:49:26.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc000c0b0 con 0x7f5dc0003880 2022-08-10T17:49:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc000c270 con 0x7f5dc0005180 2022-08-10T17:49:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 0x7f5dc0004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:26.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd3fff700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 msgr2=0x7f5dc000b890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.797+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 0x7f5dc000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dc0003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 msgr2=0x7f5dc000b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:26.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 0x7f5dc000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 msgr2=0x7f5dc0003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:26.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dc0003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 -- 172.21.15.150:0/3994713380 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0003430 con 0x7f5dc00046d0 2022-08-10T17:49:26.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dc0003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:49:26.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd2ffd700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 0x7f5dc0004b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800dfd0 tx=0x7f5dc0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e58ce2c1739c2d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:26.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8012ba0 con 0x7f5dc00046d0 2022-08-10T17:49:26.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc8012d00 con 0x7f5dc00046d0 2022-08-10T17:49:26.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.798+0000 7f5dd27fc700 1 -- 172.21.15.150:0/3994713380 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8015450 con 0x7f5dc00046d0 2022-08-10T17:49:26.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 msgr2=0x7f5dc0004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:26.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 0x7f5dc0004b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800dfd0 tx=0x7f5dc0005700 comp rx=0 tx=0).stop 2022-08-10T17:49:26.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/3994713380 shutdown_connections 2022-08-10T17:49:26.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc0005180 0x7f5dc000b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00046d0 0x7f5dc0004b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/3994713380 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dc0003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/3994713380 >> 172.21.15.150:0/3994713380 conn(0x7f5dd40ca5a0 msgr2=0x7f5dd40c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:26.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/3994713380 shutdown_connections 2022-08-10T17:49:26.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.799+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/3994713380 wait complete. 2022-08-10T17:49:26.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.800+0000 7f5dd9fb7700 1 Processor -- start 2022-08-10T17:49:26.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.800+0000 7f5dd9fb7700 1 -- start start 2022-08-10T17:49:26.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dd4152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 0x7f5dd414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c1550 con 0x7f5dc0005180 2022-08-10T17:49:26.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4153480 con 0x7f5dc0003880 2022-08-10T17:49:26.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4153770 con 0x7f5dc00046d0 2022-08-10T17:49:26.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd2ffd700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 msgr2=0x7f5dd414db20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:26.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 0x7f5dd414db20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:26.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:26.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd37fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dd4152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:26.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42228/0 (socket says 172.21.15.150:42228) 2022-08-10T17:49:26.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 -- 172.21.15.150:0/2559270436 learned_addr learned my addr 172.21.15.150:0/2559270436 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:26.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 -- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 msgr2=0x7f5dd414db20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:26.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 0x7f5dd414db20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 -- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 msgr2=0x7f5dd4152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:26.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dd4152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:26.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 -- 172.21.15.150:0/2559270436 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40c12b0 con 0x7f5dc0005180 2022-08-10T17:49:26.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd3fff700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40693c0 tx=0x7f5dcc012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:26.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00b4e0 con 0x7f5dc0005180 2022-08-10T17:49:26.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00f040 con 0x7f5dc0005180 2022-08-10T17:49:26.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd41ec2e0 con 0x7f5dc0005180 2022-08-10T17:49:26.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.801+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009940 con 0x7f5dc0005180 2022-08-10T17:49:26.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.802+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd4153a10 con 0x7f5dc0005180 2022-08-10T17:49:26.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.802+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4072890 con 0x7f5dc0005180 2022-08-10T17:49:26.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.803+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5dcc009aa0 con 0x7f5dc0005180 2022-08-10T17:49:26.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.803+0000 7f5dbbfff700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 0x7f5db4067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:26.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.803+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5dcc081d00 con 0x7f5dc0005180 2022-08-10T17:49:26.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.803+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 0x7f5db4067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:26.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.804+0000 7f5dd37fe700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 0x7f5db4067dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c00 tx=0x7f5dc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:26.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:26.807+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5dcc085030 con 0x7f5dc0005180 2022-08-10T17:49:27.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.179+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5dd40c7440 con 0x7f5dc0005180 2022-08-10T17:49:27.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.179+0000 7f5dbbfff700 1 -- 172.21.15.150:0/2559270436 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5dcc01e020 con 0x7f5dc0005180 2022-08-10T17:49:27.183 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:27.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.181+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 msgr2=0x7f5db4067dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.181+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 0x7f5db4067dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c00 tx=0x7f5dc4009040 comp rx=0 tx=0).stop 2022-08-10T17:49:27.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.181+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 msgr2=0x7f5dd414e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.181+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40693c0 tx=0x7f5dcc012cb0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 shutdown_connections 2022-08-10T17:49:27.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc0005180 0x7f5dd414e060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5dc0003880 0x7f5dd4152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5db4065910 0x7f5db4067dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 --2- 172.21.15.150:0/2559270436 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5dc00046d0 0x7f5dd414db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 >> 172.21.15.150:0/2559270436 conn(0x7f5dd40ca5a0 msgr2=0x7f5dd41560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:27.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 shutdown_connections 2022-08-10T17:49:27.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.182+0000 7f5dd9fb7700 1 -- 172.21.15.150:0/2559270436 wait complete. 2022-08-10T17:49:27.199 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:49:27.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:49:27.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.338+0000 7f3be1c6f700 1 Processor -- start 2022-08-10T17:49:27.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.338+0000 7f3be1c6f700 1 -- start start 2022-08-10T17:49:27.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3be1c6f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bdc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3be1c6f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc069090 con 0x7f3bdc068bf0 2022-08-10T17:49:27.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3be1c6f700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0c1f40 con 0x7f3bdc158170 2022-08-10T17:49:27.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3be1c6f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c7d90 con 0x7f3bdc151290 2022-08-10T17:49:27.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bdb7fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 msgr2=0x7f3bdc0c7850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:27.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bdb7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bdc0c7850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:27.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bdbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3bdc068bf0 0x7f3bdc0c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:54920/0 (socket says 172.21.15.150:54920) 2022-08-10T17:49:27.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bdbfff700 1 -- 172.21.15.150:0/242371136 learned_addr learned my addr 172.21.15.150:0/242371136 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:27.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508695780 0 0) 0x7f3bdc069090 con 0x7f3bdc068bf0 2022-08-10T17:49:27.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc8003430 con 0x7f3bdc068bf0 2022-08-10T17:49:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127094148 0 0) 0x7f3bdc0c1f40 con 0x7f3bdc158170 2022-08-10T17:49:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc069090 con 0x7f3bdc158170 2022-08-10T17:49:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843471523 0 0) 0x7f3bc8003430 con 0x7f3bdc068bf0 2022-08-10T17:49:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 msgr2=0x7f3bdc0c7850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bdc0c7850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 >> v1:172.21.15.197:6789/0 conn(0x7f3bdc158170 legacy=0x7f3bdc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0c2220 con 0x7f3bdc068bf0 2022-08-10T17:49:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f3bd40019f0 con 0x7f3bdc068bf0 2022-08-10T17:49:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 >> v1:172.21.15.150:6789/0 conn(0x7f3bdc068bf0 legacy=0x7f3bdc0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bc8003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bc8003fc0 0x7f3bc80046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8004c60 0x7f3bc80050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c7d90 con 0x7f3bc8003fc0 2022-08-10T17:49:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800baa0 con 0x7f3bc8004c60 2022-08-10T17:49:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.339+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800bc60 con 0x7f3bdc151290 2022-08-10T17:49:27.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdb7fe700 1 -- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 msgr2=0x7f3bc8003a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:27.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdb7fe700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bc8003a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:27.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bc8003fc0 0x7f3bc80046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdbfff700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8004c60 0x7f3bc80050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 -- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 msgr2=0x7f3bc8003a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:27.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc151290 0x7f3bc8003a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 -- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8004c60 msgr2=0x7f3bc80050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:27.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8004c60 0x7f3bc80050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 -- 172.21.15.150:0/242371136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8003430 con 0x7f3bc8003fc0 2022-08-10T17:49:27.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bc8003fc0 0x7f3bc80046d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00017d0 tx=0x7f3bc8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d852048e82b80e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00052d0 con 0x7f3bc8003fc0 2022-08-10T17:49:27.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0007e50 con 0x7f3bc8003fc0 2022-08-10T17:49:27.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.340+0000 7f3bda7fc700 1 -- 172.21.15.150:0/242371136 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0003740 con 0x7f3bc8003fc0 2022-08-10T17:49:27.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 -- 172.21.15.150:0/242371136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bc8003fc0 msgr2=0x7f3bc80046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/242371136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bc8003fc0 0x7f3bc80046d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00017d0 tx=0x7f3bc8005700 comp rx=0 tx=0).stop 2022-08-10T17:49:27.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3bdbfff700 1 -- 172.21.15.150:0/242371136 reap_dead start 2022-08-10T17:49:27.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 -- 172.21.15.150:0/242371136 shutdown_connections 2022-08-10T17:49:27.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 -- 172.21.15.150:0/242371136 >> 172.21.15.150:0/242371136 conn(0x7f3bdc06f880 msgr2=0x7f3bdc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:27.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 -- 172.21.15.150:0/242371136 shutdown_connections 2022-08-10T17:49:27.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.341+0000 7f3be1c6f700 1 -- 172.21.15.150:0/242371136 wait complete. 2022-08-10T17:49:27.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.342+0000 7f3be1c6f700 1 Processor -- start 2022-08-10T17:49:27.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.342+0000 7f3be1c6f700 1 -- start start 2022-08-10T17:49:27.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc14b940 0x7f3bdc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc0c9a20 0x7f3bdc154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc152070 con 0x7f3bdc14b940 2022-08-10T17:49:27.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c77b0 con 0x7f3bc8003fc0 2022-08-10T17:49:27.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3be1c6f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc147110 con 0x7f3bdc0c9a20 2022-08-10T17:49:27.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdbfff700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc0c9a20 msgr2=0x7f3bdc154050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:27.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc0c9a20 0x7f3bdc154050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:27.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:52840/0 (socket says 172.21.15.150:52840) 2022-08-10T17:49:27.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 -- 172.21.15.150:0/3333862921 learned_addr learned my addr 172.21.15.150:0/3333862921 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:27.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc14b940 0x7f3bdc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc0c9a20 msgr2=0x7f3bdc154050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:27.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3bdc0c9a20 0x7f3bdc154050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc14b940 msgr2=0x7f3bdc153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc14b940 0x7f3bdc153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc1ed030 con 0x7f3bc8003fc0 2022-08-10T17:49:27.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.343+0000 7f3bdb7fe700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00b5b0 tx=0x7f3bcc00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.344+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc003db0 con 0x7f3bc8003fc0 2022-08-10T17:49:27.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.344+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc005070 con 0x7f3bc8003fc0 2022-08-10T17:49:27.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.344+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc153680 con 0x7f3bc8003fc0 2022-08-10T17:49:27.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.344+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc005420 con 0x7f3bc8003fc0 2022-08-10T17:49:27.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.344+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc1ecd50 con 0x7f3bc8003fc0 2022-08-10T17:49:27.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 0x7f3bdc153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0644b0 con 0x7f3bdc152d50 2022-08-10T17:49:27.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 0x7f3bdc153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bdaffd700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bdc071e10 con 0x7f3bdc152d50 2022-08-10T17:49:27.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3bcc00f070 con 0x7f3bc8003fc0 2022-08-10T17:49:27.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 0x7f3bdc153120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00017d0 tx=0x7f3bd00012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bc3fff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3bbc065090 0x7f3bbc067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.345+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3bcc0819e0 con 0x7f3bc8003fc0 2022-08-10T17:49:27.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bdbfff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3bbc065090 0x7f3bbc067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0003930 con 0x7f3bdc152d50 2022-08-10T17:49:27.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3bd0003a90 con 0x7f3bdc152d50 2022-08-10T17:49:27.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 msgr2=0x7f3bdc153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 0x7f3bdc153120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00017d0 tx=0x7f3bd00012b0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 msgr2=0x7f3bdc153120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:27.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bc3fff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc152d50 0x7f3bdc153120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.346+0000 7f3bdbfff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3bbc065090 0x7f3bbc067540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8003a10 tx=0x7f3bd4007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.352+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 0x7f3bdc0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.352+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc072890 con 0x7f3bdc0c5c80 2022-08-10T17:49:27.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 0x7f3bdc0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bdaffd700 1 -- 172.21.15.150:0/3333862921 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3bdc0c2500 con 0x7f3bdc0c5c80 2022-08-10T17:49:27.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bdaffd700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 0x7f3bdc0c6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc067540 tx=0x7f3bd0009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0012630 con 0x7f3bdc0c5c80 2022-08-10T17:49:27.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4538 (secure 0 0 0) 0x7f3bd0034460 con 0x7f3bdc0c5c80 2022-08-10T17:49:27.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 msgr2=0x7f3bdc0c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 0x7f3bdc0c6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc067540 tx=0x7f3bd0009030 comp rx=0 tx=0).stop 2022-08-10T17:49:27.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 msgr2=0x7f3bdc0c6080 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:27.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.353+0000 7f3bc3fff700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc0c5c80 0x7f3bdc0c6080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.379 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:27.379 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:27.379 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:27.379 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:49:27.380 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 114, 2022-08-10T17:49:27.380 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:27.380 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:27.380 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:49:27.381 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.381 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:49:27.381 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:27.381 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:27.382 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:27.382 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.382 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.382 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.383 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.383 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.383 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.383 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.384 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.384 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.384 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.384 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:27.385 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:27.385 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.386 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.386 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.386 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.386 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.387 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.387 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.387 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.387 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.388 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.388 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:27.388 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:27.389 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:27.389 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:27.389 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:27.389 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:27.390 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:27.390 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:27.390 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:27.391 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:27.391 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:27.391 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:27.391 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:27.392 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:27.392 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:27.392 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:27.392 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.393 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.393 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.393 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.393 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.394 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.394 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.394 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.396 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:27.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.396 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:27.397 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:27.397 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.398 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.399 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.399 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:27.400 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.401 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.401 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:27.402 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.402 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.403 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.404 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:27.404 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:27.405 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.405 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.406 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.407 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:27.408 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:27.408 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.409 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.409 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.410 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:27.410 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.412 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.412 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:27.413 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.413 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.413 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.414 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:27.414 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:27.414 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.415 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.415 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.416 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:27.416 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:27.416 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.416 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.417 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.417 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:27.417 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.418 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.418 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:27.419 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.419 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.419 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.420 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:27.420 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:27.420 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.420 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.420 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.421 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.421 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.421 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:27.422 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:27.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.422 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.422 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.423 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:27.423 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.423 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.423 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:27.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.424 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.424 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.424 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:27.425 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.425 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.425 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:27.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.426 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.426 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.426 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:27.426 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.427 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.427 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:27.427 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:27.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3bbc065090 msgr2=0x7f3bbc067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3bbc065090 0x7f3bbc067540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8003a10 tx=0x7f3bd4007f20 comp rx=0 tx=0).stop 2022-08-10T17:49:27.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 msgr2=0x7f3bdc146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00b5b0 tx=0x7f3bcc00b8c0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3bdbfff700 1 -- 172.21.15.150:0/3333862921 reap_dead start 2022-08-10T17:49:27.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 shutdown_connections 2022-08-10T17:49:27.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 --2- 172.21.15.150:0/3333862921 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3bc8003fc0 0x7f3bdc146bd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 >> 172.21.15.150:0/3333862921 conn(0x7f3bdc06f880 msgr2=0x7f3bdc14f820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:27.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 shutdown_connections 2022-08-10T17:49:27.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.354+0000 7f3be1c6f700 1 -- 172.21.15.150:0/3333862921 wait complete. 2022-08-10T17:49:27.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:49:27.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.577+0000 7f9680999700 1 Processor -- start 2022-08-10T17:49:27.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.577+0000 7f9680999700 1 -- start start 2022-08-10T17:49:27.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9680999700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f967c0c3230 0x7f967c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9680999700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 0x7f967c0c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9680999700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c0c3600 con 0x7f967c06ea90 2022-08-10T17:49:27.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9680999700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c0c6080 con 0x7f967c0c3230 2022-08-10T17:49:27.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9680999700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c06ae80 con 0x7f967c06b1b0 2022-08-10T17:49:27.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9679d9b700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 msgr2=0x7f967c0c4cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:27.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f9679d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 0x7f967c0c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:27.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f967c0c3230 0x7f967c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f967c0c3230 0x7f967c0ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42260/0 (socket says 172.21.15.150:42260) 2022-08-10T17:49:27.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 -- 172.21.15.150:0/1567563423 learned_addr learned my addr 172.21.15.150:0/1567563423 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:27.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 -- 172.21.15.150:0/1567563423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 msgr2=0x7f967c0c4cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:27.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 --2- 172.21.15.150:0/1567563423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 0x7f967c0c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 -- 172.21.15.150:0/1567563423 >> v1:172.21.15.197:6789/0 conn(0x7f967c06ea90 legacy=0x7f967c06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 -- 172.21.15.150:0/1567563423 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0c5900 con 0x7f967c0c3230 2022-08-10T17:49:27.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967959a700 1 -- 172.21.15.150:0/1567563423 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244582214 0 0) 0x7f967c0c3600 con 0x7f967c06ea90 2022-08-10T17:49:27.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967a59c700 1 --2- 172.21.15.150:0/1567563423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c0ca420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f966c009780 tx=0x7f966c009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ce7a71225bc8e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.578+0000 7f967959a700 1 -- 172.21.15.150:0/1567563423 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c004230 con 0x7f967c0c3230 2022-08-10T17:49:27.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f967959a700 1 -- 172.21.15.150:0/1567563423 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c004390 con 0x7f967c0c3230 2022-08-10T17:49:27.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f967959a700 1 -- 172.21.15.150:0/1567563423 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011870 con 0x7f967c0c3230 2022-08-10T17:49:27.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 -- 172.21.15.150:0/1567563423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 msgr2=0x7f967c0ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 --2- 172.21.15.150:0/1567563423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c0ca420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f966c009780 tx=0x7f966c009a90 comp rx=0 tx=0).stop 2022-08-10T17:49:27.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 -- 172.21.15.150:0/1567563423 shutdown_connections 2022-08-10T17:49:27.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 --2- 172.21.15.150:0/1567563423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c0ca420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 --2- 172.21.15.150:0/1567563423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06b1b0 0x7f967c0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 -- 172.21.15.150:0/1567563423 >> 172.21.15.150:0/1567563423 conn(0x7f967c068110 msgr2=0x7f967c068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:27.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 -- 172.21.15.150:0/1567563423 shutdown_connections 2022-08-10T17:49:27.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.579+0000 7f9680999700 1 -- 172.21.15.150:0/1567563423 wait complete. 2022-08-10T17:49:27.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 Processor -- start 2022-08-10T17:49:27.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 -- start start 2022-08-10T17:49:27.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c06b1b0 0x7f967c14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06ea90 0x7f967c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1483f0 con 0x7f967c0c3230 2022-08-10T17:49:27.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1509c0 con 0x7f967c06b1b0 2022-08-10T17:49:27.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9680999700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c14fdd0 con 0x7f967c06ea90 2022-08-10T17:49:27.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.581+0000 7f9679d9b700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06ea90 msgr2=0x7f967c150de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:27.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f9679d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06ea90 0x7f967c150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:27.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967a59c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c06b1b0 0x7f967c14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42270/0 (socket says 172.21.15.150:42270) 2022-08-10T17:49:27.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 learned_addr learned my addr 172.21.15.150:0/4263626106 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:27.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06ea90 msgr2=0x7f967c150de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:27.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f967c06ea90 0x7f967c150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c06b1b0 msgr2=0x7f967c14dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c06b1b0 0x7f967c14dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0093e0 con 0x7f967c0c3230 2022-08-10T17:49:27.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967a59c700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c06b1b0 0x7f967c14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:27.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f967ad9d700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c145010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f967400c7b0 tx=0x7f967400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674003cb0 con 0x7f967c0c3230 2022-08-10T17:49:27.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674003e10 con 0x7f967c0c3230 2022-08-10T17:49:27.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740052f0 con 0x7f967c0c3230 2022-08-10T17:49:27.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c146cc0 con 0x7f967c0c3230 2022-08-10T17:49:27.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.582+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c150300 con 0x7f967c0c3230 2022-08-10T17:49:27.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.583+0000 7f9680999700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 0x7f967c145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.583+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c150b00 con 0x7f967c14e140 2022-08-10T17:49:27.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.583+0000 7f967a59c700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 0x7f967c145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.584+0000 7f967a59c700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f967c072890 con 0x7f967c14e140 2022-08-10T17:49:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.584+0000 7f967a59c700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 0x7f967c145550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f966c009780 tx=0x7f966c0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.584+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c020070 con 0x7f967c14e140 2022-08-10T17:49:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.584+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9674019030 con 0x7f967c0c3230 2022-08-10T17:49:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.584+0000 7f966affd700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9658065180 0x7f9658067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9674081650 con 0x7f967c0c3230 2022-08-10T17:49:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f9679d9b700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9658065180 0x7f9658067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f966c0037b0 con 0x7f967c14e140 2022-08-10T17:49:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 msgr2=0x7f967c145550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 0x7f967c145550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f966c009780 tx=0x7f966c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 msgr2=0x7f967c145550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f966affd700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c14e140 0x7f967c145550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.585+0000 7f9679d9b700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9658065180 0x7f9658067630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f967c06f120 tx=0x7f9670006c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.591+0000 7f9680999700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 0x7f967c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.591+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0aff70 con 0x7f967c146790 2022-08-10T17:49:27.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f967a59c700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 0x7f967c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:27.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f967a59c700 1 -- 172.21.15.150:0/4263626106 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f967c0c4880 con 0x7f967c146790 2022-08-10T17:49:27.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f967a59c700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 0x7f967c1ed0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f967c150c40 tx=0x7f966c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:27.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c02c070 con 0x7f967c146790 2022-08-10T17:49:27.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5019 (secure 0 0 0) 0x7f966c02d040 con 0x7f967c146790 2022-08-10T17:49:27.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 msgr2=0x7f967c1ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 0x7f967c1ed0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f967c150c40 tx=0x7f966c011000 comp rx=0 tx=0).stop 2022-08-10T17:49:27.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 msgr2=0x7f967c1ed0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:27.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.592+0000 7f966affd700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f967c146790 0x7f967c1ed0e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.609 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:27.609 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:27.610 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:27.610 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:27.610 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 114, 2022-08-10T17:49:27.610 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:27.611 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:27.611 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:49:27.611 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.611 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:49:27.612 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:27.612 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:27.612 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:27.612 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.612 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.613 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.613 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.613 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:27.615 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:27.615 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.615 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.616 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.616 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.617 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.617 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.618 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.618 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.618 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.619 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:27.619 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:27.619 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:27.619 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:27.620 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:27.620 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:27.620 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:27.620 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:27.620 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:27.621 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:27.621 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:27.621 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:27.621 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:27.621 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:27.622 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:27.622 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:27.622 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:27.622 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:27.623 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:27.623 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:27.623 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:27.623 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:27.623 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.624 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:27.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.625 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:27.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.625 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:27.626 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:27.626 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.626 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.627 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.628 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:27.628 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.629 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.629 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:27.630 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.630 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.631 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:27.631 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:27.631 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.631 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.631 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.632 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:27.632 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:27.633 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.633 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.633 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.633 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:27.634 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.634 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.635 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:27.635 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.635 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.635 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.636 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:27.636 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:27.636 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.636 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.637 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.637 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:27.637 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:27.638 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:27.638 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:27.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.638 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:27.639 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:27.639 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.639 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:27.640 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:27.640 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:27.640 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.641 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.641 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:27.641 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:27.641 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:27.642 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:27.642 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:27.642 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.642 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.643 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:27.643 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:27.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.644 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.644 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.644 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:27.644 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.645 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.645 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:49:27.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.646 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.646 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.646 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:27.646 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.646 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.647 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:27.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.647 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.647 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.648 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:49:27.648 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.648 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.648 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:27.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.649 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:49:27.649 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.650 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:27.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.650 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.650 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.651 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:49:27.651 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.651 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:27.651 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:49:27.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:27.652 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:27.652 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:27.652 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:49:27.652 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:27.653 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:27.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:27.653 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:27.653 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:27.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9658065180 msgr2=0x7f9658067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9658065180 0x7f9658067630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f967c06f120 tx=0x7f9670006c40 comp rx=0 tx=0).stop 2022-08-10T17:49:27.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 msgr2=0x7f967c145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:27.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 --2- 172.21.15.150:0/4263626106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f967c0c3230 0x7f967c145010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f967400c7b0 tx=0x7f967400cac0 comp rx=0 tx=0).stop 2022-08-10T17:49:27.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 reap_dead start 2022-08-10T17:49:27.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f967ad9d700 1 -- 172.21.15.150:0/4263626106 reap_dead start 2022-08-10T17:49:27.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 shutdown_connections 2022-08-10T17:49:27.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 >> 172.21.15.150:0/4263626106 conn(0x7f967c068110 msgr2=0x7f967c0c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:27.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 shutdown_connections 2022-08-10T17:49:27.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:27.593+0000 7f9680999700 1 -- 172.21.15.150:0/4263626106 wait complete. 2022-08-10T17:49:27.658 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:49:47.659 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:49:47.660 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:49:47.660 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:49:47.661 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:49:47.664 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:49:47.664 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:49:47.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:47.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 Processor -- start 2022-08-10T17:49:47.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 -- start start 2022-08-10T17:49:47.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f02b014d080 0x7f02b006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02b00705d0 0x7f02b00c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b00c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00bf640 con 0x7f02b00705d0 2022-08-10T17:49:47.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b0156400 con 0x7f02b014d080 2022-08-10T17:49:47.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.817+0000 7f02b6f46700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01566e0 con 0x7f02b006c0e0 2022-08-10T17:49:47.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02b54e3700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 msgr2=0x7f02b00c4d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:47.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02b54e3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b00c4d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:47.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02b00705d0 0x7f02b00c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:47.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02b00705d0 0x7f02b00c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42362/0 (socket says 172.21.15.150:42362) 2022-08-10T17:49:47.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 -- 172.21.15.150:0/447998486 learned_addr learned my addr 172.21.15.150:0/447998486 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:47.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02b4ce2700 1 --2- 172.21.15.150:0/447998486 >> v2:172.21.15.197:3300/0 conn(0x7f02b014d080 0x7f02b006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:47.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 -- 172.21.15.150:0/447998486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 msgr2=0x7f02b00c4d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:47.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 --2- 172.21.15.150:0/447998486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b00c4d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 -- 172.21.15.150:0/447998486 >> v2:172.21.15.197:3300/0 conn(0x7f02b014d080 msgr2=0x7f02b006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:47.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 --2- 172.21.15.150:0/447998486 >> v2:172.21.15.197:3300/0 conn(0x7f02b014d080 0x7f02b006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 -- 172.21.15.150:0/447998486 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b01569c0 con 0x7f02b00705d0 2022-08-10T17:49:47.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02affff700 1 --2- 172.21.15.150:0/447998486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b00c47f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02b0068500 tx=0x7f02a400ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1266c4d3e994e0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:47.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02af7fe700 1 -- 172.21.15.150:0/447998486 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4004230 con 0x7f02b00705d0 2022-08-10T17:49:47.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02af7fe700 1 -- 172.21.15.150:0/447998486 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a4004390 con 0x7f02b00705d0 2022-08-10T17:49:47.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.818+0000 7f02af7fe700 1 -- 172.21.15.150:0/447998486 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400c940 con 0x7f02b00705d0 2022-08-10T17:49:47.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 -- 172.21.15.150:0/447998486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 msgr2=0x7f02b00c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:47.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 --2- 172.21.15.150:0/447998486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b00c47f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02b0068500 tx=0x7f02a400ac00 comp rx=0 tx=0).stop 2022-08-10T17:49:47.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 -- 172.21.15.150:0/447998486 shutdown_connections 2022-08-10T17:49:47.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 --2- 172.21.15.150:0/447998486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b00c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 --2- 172.21.15.150:0/447998486 >> v2:172.21.15.197:3300/0 conn(0x7f02b014d080 0x7f02b006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 --2- 172.21.15.150:0/447998486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b00c47f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 -- 172.21.15.150:0/447998486 >> 172.21.15.150:0/447998486 conn(0x7f02b00c8a10 msgr2=0x7f02b00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:47.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 -- 172.21.15.150:0/447998486 shutdown_connections 2022-08-10T17:49:47.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.819+0000 7f02b6f46700 1 -- 172.21.15.150:0/447998486 wait complete. 2022-08-10T17:49:47.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.820+0000 7f02b6f46700 1 Processor -- start 2022-08-10T17:49:47.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.820+0000 7f02b6f46700 1 -- start start 2022-08-10T17:49:47.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b0152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f02b014d080 0x7f02b01ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b9390 con 0x7f02b00705d0 2022-08-10T17:49:47.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b99a0 con 0x7f02b014d080 2022-08-10T17:49:47.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b6f46700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b0155e80 con 0x7f02b006c0e0 2022-08-10T17:49:47.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b4ce2700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 msgr2=0x7f02b0152ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:49:47.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b4ce2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b0152ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:47.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:47.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42368/0 (socket says 172.21.15.150:42368) 2022-08-10T17:49:47.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 -- 172.21.15.150:0/1243157823 learned_addr learned my addr 172.21.15.150:0/1243157823 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:47.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02b54e3700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f02b014d080 0x7f02b01ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:47.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 -- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 msgr2=0x7f02b0152ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:47.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b0152ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 -- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f02b014d080 msgr2=0x7f02b01ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:47.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.821+0000 7f02affff700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f02b014d080 0x7f02b01ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:47.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02affff700 1 -- 172.21.15.150:0/1243157823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a400a580 con 0x7f02b00705d0 2022-08-10T17:49:47.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02affff700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02a4004000 tx=0x7f02a40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:47.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a401e070 con 0x7f02b00705d0 2022-08-10T17:49:47.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400cea0 con 0x7f02b00705d0 2022-08-10T17:49:47.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4003950 con 0x7f02b00705d0 2022-08-10T17:49:47.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b0155ba0 con 0x7f02b00705d0 2022-08-10T17:49:47.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.822+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b01eb090 con 0x7f02b00705d0 2022-08-10T17:49:47.842 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.823+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0072890 con 0x7f02b00705d0 2022-08-10T17:49:47.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.823+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f02a4029030 con 0x7f02b00705d0 2022-08-10T17:49:47.843 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.824+0000 7f02ad7fa700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 0x7f0290067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:47.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.824+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f02a4083170 con 0x7f02b00705d0 2022-08-10T17:49:47.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.824+0000 7f02b4ce2700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 0x7f0290067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:47.844 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.824+0000 7f02b4ce2700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 0x7f0290067540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009a70 tx=0x7f02a000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:47.845 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:47.828+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f02a4051060 con 0x7f02b00705d0 2022-08-10T17:49:48.159 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:48.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.154+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f02b00c6240 con 0x7f02b00705d0 2022-08-10T17:49:48.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.154+0000 7f02ad7fa700 1 -- 172.21.15.150:0/1243157823 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7f02a4027020 con 0x7f02b00705d0 2022-08-10T17:49:48.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.158+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 msgr2=0x7f0290067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:48.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.158+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 0x7f0290067540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009a70 tx=0x7f02a000b040 comp rx=0 tx=0).stop 2022-08-10T17:49:48.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.158+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 msgr2=0x7f02b01ebb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:48.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.158+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02a4004000 tx=0x7f02a40045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:48.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 shutdown_connections 2022-08-10T17:49:48.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f02b014d080 0x7f02b01ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:48.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0290065090 0x7f0290067540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:48.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f02b006c0e0 0x7f02b0152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:48.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 --2- 172.21.15.150:0/1243157823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02b00705d0 0x7f02b01ebb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:48.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 >> 172.21.15.150:0/1243157823 conn(0x7f02b00c8a10 msgr2=0x7f02b01498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:48.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 shutdown_connections 2022-08-10T17:49:48.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:48.160+0000 7f02b6f46700 1 -- 172.21.15.150:0/1243157823 wait complete. 2022-08-10T17:49:51.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:51.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 Processor -- start 2022-08-10T17:49:51.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 -- start start 2022-08-10T17:49:51.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3440bc950 0x7fb34415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440692f0 con 0x7fb34406c980 2022-08-10T17:49:51.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440c6450 con 0x7fb3440bc950 2022-08-10T17:49:51.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.325+0000 7fb34a148700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440c4f10 con 0x7fb3440bc580 2022-08-10T17:49:51.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3440bc950 0x7fb34415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb342ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb34406c980 0x7fb34414cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55078/0 (socket says 172.21.15.150:55078) 2022-08-10T17:49:51.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb342ffd700 1 -- 172.21.15.150:0/1891617006 learned_addr learned my addr 172.21.15.150:0/1891617006 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:51.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 --2- 172.21.15.150:0/1891617006 >> v2:172.21.15.150:3300/0 conn(0x7fb3440bc950 0x7fb34415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42400/0 (socket says 172.21.15.150:42400) 2022-08-10T17:49:51.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3437fe700 1 -- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:49:51.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3437fe700 1 -- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:49:51.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:51.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 -- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:51.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:51.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 -- 172.21.15.150:0/1891617006 >> v1:172.21.15.150:6789/0 conn(0x7fb34406c980 legacy=0x7fb34414cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:51.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3427fc700 1 -- 172.21.15.150:0/1891617006 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259152574 0 0) 0x7fb3440692f0 con 0x7fb34406c980 2022-08-10T17:49:51.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 -- 172.21.15.150:0/1891617006 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344156620 con 0x7fb3440bc950 2022-08-10T17:49:51.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb343fff700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb34415d8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009d90 tx=0x7fb33c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1e00822f2a17b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:51.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3427fc700 1 -- 172.21.15.150:0/1891617006 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00e070 con 0x7fb3440bc950 2022-08-10T17:49:51.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3427fc700 1 -- 172.21.15.150:0/1891617006 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00bbd0 con 0x7fb3440bc950 2022-08-10T17:49:51.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.326+0000 7fb3427fc700 1 -- 172.21.15.150:0/1891617006 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c012430 con 0x7fb3440bc950 2022-08-10T17:49:51.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 -- 172.21.15.150:0/1891617006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 msgr2=0x7fb34415d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:51.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb34415d8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009d90 tx=0x7fb33c00b330 comp rx=0 tx=0).stop 2022-08-10T17:49:51.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 -- 172.21.15.150:0/1891617006 shutdown_connections 2022-08-10T17:49:51.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb34415d8b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 --2- 172.21.15.150:0/1891617006 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 -- 172.21.15.150:0/1891617006 >> 172.21.15.150:0/1891617006 conn(0x7fb3440c9d60 msgr2=0x7fb3440c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:51.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 -- 172.21.15.150:0/1891617006 shutdown_connections 2022-08-10T17:49:51.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.327+0000 7fb34a148700 1 -- 172.21.15.150:0/1891617006 wait complete. 2022-08-10T17:49:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.328+0000 7fb34a148700 1 Processor -- start 2022-08-10T17:49:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.328+0000 7fb34a148700 1 -- start start 2022-08-10T17:49:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34414aee0 0x7fb3440c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3441eb730 con 0x7fb3440bc950 2022-08-10T17:49:51.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440bd1d0 con 0x7fb34414aee0 2022-08-10T17:49:51.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb34a148700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440c76f0 con 0x7fb3440bc580 2022-08-10T17:49:51.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb3437fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42404/0 (socket says 172.21.15.150:42404) 2022-08-10T17:49:51.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 -- 172.21.15.150:0/1572346475 learned_addr learned my addr 172.21.15.150:0/1572346475 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:51.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb343fff700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34414aee0 0x7fb3440c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb3437fe700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:49:51.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb3437fe700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:49:51.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:49:51.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:49:51.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 msgr2=0x7fb344141f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:49:51.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34414aee0 msgr2=0x7fb3440c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:51.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34414aee0 0x7fb3440c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 -- 172.21.15.150:0/1572346475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c009a70 con 0x7fb3440bc950 2022-08-10T17:49:51.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.329+0000 7fb342ffd700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3e0 tx=0x7fb33800c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:51.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.330+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380072d0 con 0x7fb3440bc950 2022-08-10T17:49:51.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.330+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338007450 con 0x7fb3440bc950 2022-08-10T17:49:51.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.330+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380075c0 con 0x7fb3440bc950 2022-08-10T17:49:51.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.330+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3441eb910 con 0x7fb3440bc950 2022-08-10T17:49:51.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.330+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3440c70a0 con 0x7fb3440bc950 2022-08-10T17:49:51.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.331+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344072890 con 0x7fb3440bc950 2022-08-10T17:49:51.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.331+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb33801a020 con 0x7fb3440bc950 2022-08-10T17:49:51.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.331+0000 7fb32bfff700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 0x7fb324067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:51.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.331+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb338081dc0 con 0x7fb3440bc950 2022-08-10T17:49:51.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.332+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 0x7fb324067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:51.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.332+0000 7fb3437fe700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 0x7fb324067590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb334006ee0 tx=0x7fb334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:51.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.335+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb33804fda0 con 0x7fb3440bc950 2022-08-10T17:49:51.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.665+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb3440648f0 con 0x7fb3440bc950 2022-08-10T17:49:51.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.666+0000 7fb32bfff700 1 -- 172.21.15.150:0/1572346475 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7fb3380533c0 con 0x7fb3440bc950 2022-08-10T17:49:51.669 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 msgr2=0x7fb324067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:51.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 0x7fb324067590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb334006ee0 tx=0x7fb334008040 comp rx=0 tx=0).stop 2022-08-10T17:49:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 msgr2=0x7fb3440c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3e0 tx=0x7fb33800c6f0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 shutdown_connections 2022-08-10T17:49:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34414aee0 0x7fb3440c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb3240650e0 0x7fb324067590 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb3440bc580 0x7fb344141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 --2- 172.21.15.150:0/1572346475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3440bc950 0x7fb3440c7b80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 >> 172.21.15.150:0/1572346475 conn(0x7fb3440c9d60 msgr2=0x7fb34406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:51.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 shutdown_connections 2022-08-10T17:49:51.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:51.668+0000 7fb34a148700 1 -- 172.21.15.150:0/1572346475 wait complete. 2022-08-10T17:49:54.684 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:49:54.849 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.846+0000 7f0685830700 1 Processor -- start 2022-08-10T17:49:54.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.846+0000 7f0685830700 1 -- start start 2022-08-10T17:49:54.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f0685830700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f068006f170 0x7f06800ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f0685830700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800ca200 con 0x7f06801585f0 2022-08-10T17:49:54.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f0685830700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068006ea70 con 0x7f0680071550 2022-08-10T17:49:54.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f0685830700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800c53a0 con 0x7f068006f170 2022-08-10T17:49:54.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f067effd700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f0680071550 0x7f0680157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41462/0 (socket says 172.21.15.150:41462) 2022-08-10T17:49:54.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f067effd700 1 -- 172.21.15.150:0/4246258585 learned_addr learned my addr 172.21.15.150:0/4246258585 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:54.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483074960 0 0) 0x7f06800ca200 con 0x7f06801585f0 2022-08-10T17:49:54.853 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.848+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c003430 con 0x7f06801585f0 2022-08-10T17:49:54.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 --2- 172.21.15.150:0/4246258585 >> v2:172.21.15.197:3300/0 conn(0x7f068006f170 0x7f06800ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:54.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745234063 0 0) 0x7f066c003430 con 0x7f06801585f0 2022-08-10T17:49:54.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 >> v2:172.21.15.197:3300/0 conn(0x7f068006f170 msgr2=0x7f06800ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:54.854 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 --2- 172.21.15.150:0/4246258585 >> v2:172.21.15.197:3300/0 conn(0x7f068006f170 0x7f06800ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 >> v1:172.21.15.197:6789/0 conn(0x7f0680071550 legacy=0x7f0680157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068006ed50 con 0x7f06801585f0 2022-08-10T17:49:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f0670001670 con 0x7f06801585f0 2022-08-10T17:49:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 >> v1:172.21.15.150:6789/0 conn(0x7f06801585f0 legacy=0x7f0680163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c003880 0x7f066c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f066c0046d0 0x7f066c004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 0x7f066c00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c53a0 con 0x7f066c005080 2022-08-10T17:49:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00c010 con 0x7f066c003880 2022-08-10T17:49:54.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00c1d0 con 0x7f066c0046d0 2022-08-10T17:49:54.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 0x7f066c00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:54.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 -- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f066c0046d0 msgr2=0x7f066c004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:54.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f066c0046d0 0x7f066c004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 -- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c003880 msgr2=0x7f066c003c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:49:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c003880 0x7f066c003c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.849+0000 7f067f7fe700 1 -- 172.21.15.150:0/4246258585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c003430 con 0x7f066c005080 2022-08-10T17:49:54.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.850+0000 7f067f7fe700 1 -- 172.21.15.150:0/4246258585 reap_dead start 2022-08-10T17:49:54.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.850+0000 7f067f7fe700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 0x7f066c00b890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0678007330 tx=0x7f066c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c4874dc80d6312 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:54.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.853+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678007e50 con 0x7f066c005080 2022-08-10T17:49:54.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.853+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780038a0 con 0x7f066c005080 2022-08-10T17:49:54.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.853+0000 7f067dffb700 1 -- 172.21.15.150:0/4246258585 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678003c50 con 0x7f066c005080 2022-08-10T17:49:54.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.853+0000 7f0685830700 1 -- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 msgr2=0x7f066c00b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:54.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.853+0000 7f0685830700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 0x7f066c00b890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0678007330 tx=0x7f066c005700 comp rx=0 tx=0).stop 2022-08-10T17:49:54.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.854+0000 7f0685830700 1 -- 172.21.15.150:0/4246258585 shutdown_connections 2022-08-10T17:49:54.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.854+0000 7f0685830700 1 --2- 172.21.15.150:0/4246258585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f066c005080 0x7f066c00b890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.854+0000 7f0685830700 1 -- 172.21.15.150:0/4246258585 >> 172.21.15.150:0/4246258585 conn(0x7f068006c620 msgr2=0x7f068006c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:54.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.854+0000 7f0685830700 1 -- 172.21.15.150:0/4246258585 shutdown_connections 2022-08-10T17:49:54.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.854+0000 7f0685830700 1 -- 172.21.15.150:0/4246258585 wait complete. 2022-08-10T17:49:54.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.856+0000 7f0685830700 1 Processor -- start 2022-08-10T17:49:54.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.856+0000 7f0685830700 1 -- start start 2022-08-10T17:49:54.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0680157470 0x7f06801f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0680154be0 0x7f0680155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c8da0 con 0x7f0680157470 2022-08-10T17:49:54.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06801568e0 con 0x7f066c005080 2022-08-10T17:49:54.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f0685830700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068015b7c0 con 0x7f0680154be0 2022-08-10T17:49:54.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f067effd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:54.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f067effd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53032/0 (socket says 172.21.15.150:53032) 2022-08-10T17:49:54.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f067effd700 1 -- 172.21.15.150:0/327847160 learned_addr learned my addr 172.21.15.150:0/327847160 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:54.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.857+0000 7f067e7fc700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0680157470 0x7f06801f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:54.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 -- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0680154be0 msgr2=0x7f0680155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:54.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0680154be0 0x7f0680155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 -- 172.21.15.150:0/327847160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0680157470 msgr2=0x7f06801f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:54.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0680157470 0x7f06801f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:54.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 -- 172.21.15.150:0/327847160 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06801f0ee0 con 0x7f066c005080 2022-08-10T17:49:54.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f067effd700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f067400c370 tx=0x7f067400c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:54.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740072d0 con 0x7f066c005080 2022-08-10T17:49:54.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674007430 con 0x7f066c005080 2022-08-10T17:49:54.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0680155590 con 0x7f066c005080 2022-08-10T17:49:54.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400ce40 con 0x7f066c005080 2022-08-10T17:49:54.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.858+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800c8190 con 0x7f066c005080 2022-08-10T17:49:54.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.859+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0680154a30 con 0x7f066c005080 2022-08-10T17:49:54.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.860+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0674019030 con 0x7f066c005080 2022-08-10T17:49:54.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.860+0000 7f0667fff700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 0x7f0660067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:54.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.860+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0674081260 con 0x7f066c005080 2022-08-10T17:49:54.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.860+0000 7f067e7fc700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 0x7f0660067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:54.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.861+0000 7f067e7fc700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 0x7f0660067560 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f068014bdf0 tx=0x7f0670009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:54.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:54.866+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f067404f240 con 0x7f066c005080 2022-08-10T17:49:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.166+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f06801583d0 con 0x7f066c005080 2022-08-10T17:49:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.166+0000 7f0667fff700 1 -- 172.21.15.150:0/327847160 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f06801583d0 con 0x7f066c005080 2022-08-10T17:49:55.172 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:49:55.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.171+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 msgr2=0x7f0660067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.171+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 0x7f0660067560 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f068014bdf0 tx=0x7f0670009040 comp rx=0 tx=0).stop 2022-08-10T17:49:55.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.171+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 msgr2=0x7f068015b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.171+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f067400c370 tx=0x7f067400c680 comp rx=0 tx=0).stop 2022-08-10T17:49:55.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 shutdown_connections 2022-08-10T17:49:55.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f06600650b0 0x7f0660067560 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0680154be0 0x7f0680155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f066c005080 0x7f068015b280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 --2- 172.21.15.150:0/327847160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0680157470 0x7f06801f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 >> 172.21.15.150:0/327847160 conn(0x7f068006c620 msgr2=0x7f06801e51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 shutdown_connections 2022-08-10T17:49:55.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.173+0000 7f0685830700 1 -- 172.21.15.150:0/327847160 wait complete. 2022-08-10T17:49:55.191 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:49:55.191 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:49:55.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.340+0000 7f353ccb1700 1 Processor -- start 2022-08-10T17:49:55.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f353ccb1700 1 -- start start 2022-08-10T17:49:55.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f353ccb1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f353814e9e0 0x7f35380c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f353ccb1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380c9bf0 con 0x7f3538158880 2022-08-10T17:49:55.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f353ccb1700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380c0780 con 0x7f3538064560 2022-08-10T17:49:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f353ccb1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380c0a60 con 0x7f353814e9e0 2022-08-10T17:49:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f3536d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3538158880 0x7f35380c22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55136/0 (socket says 172.21.15.150:55136) 2022-08-10T17:49:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.341+0000 7f3536d9d700 1 -- 172.21.15.150:0/497252381 learned_addr learned my addr 172.21.15.150:0/497252381 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353659c700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f353814e9e0 0x7f35380c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761264455 0 0) 0x7f35380c9bf0 con 0x7f3538158880 2022-08-10T17:49:55.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c003430 con 0x7f3538158880 2022-08-10T17:49:55.365 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299715404 0 0) 0x7f351c003430 con 0x7f3538158880 2022-08-10T17:49:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f353814e9e0 msgr2=0x7f35380c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f353814e9e0 0x7f35380c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 >> v1:172.21.15.197:6789/0 conn(0x7f3538064560 legacy=0x7f35381546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380c0d40 con 0x7f3538158880 2022-08-10T17:49:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f35300019f0 con 0x7f3538158880 2022-08-10T17:49:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 >> v1:172.21.15.150:6789/0 conn(0x7f3538158880 legacy=0x7f35380c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f351c0038b0 0x7f351c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0046d0 0x7f351c004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f351c005080 0x7f351c00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380c0a60 con 0x7f351c0046d0 2022-08-10T17:49:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00bf60 con 0x7f351c005080 2022-08-10T17:49:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00c0d0 con 0x7f351c0038b0 2022-08-10T17:49:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353659c700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f353814e9e0 0x7f35380c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:49:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0046d0 0x7f351c004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3536d9d700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f351c005080 0x7f351c00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353659c700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f351c0038b0 0x7f351c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 -- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f351c0038b0 msgr2=0x7f351c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f351c0038b0 0x7f351c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 -- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f351c005080 msgr2=0x7f351c00b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f351c005080 0x7f351c00b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f3535d9b700 1 -- 172.21.15.150:0/497252381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c003430 con 0x7f351c0046d0 2022-08-10T17:49:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.342+0000 7f353659c700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f351c0038b0 0x7f351c003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:49:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f3535d9b700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0046d0 0x7f351c004b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f353806dd30 tx=0x7f351c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa58f774e45c39c0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0052d0 con 0x7f351c0046d0 2022-08-10T17:49:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c003500 con 0x7f351c0046d0 2022-08-10T17:49:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353559a700 1 -- 172.21.15.150:0/497252381 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0038b0 con 0x7f351c0046d0 2022-08-10T17:49:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 -- 172.21.15.150:0/497252381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0046d0 msgr2=0x7f351c004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 --2- 172.21.15.150:0/497252381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0046d0 0x7f351c004b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f353806dd30 tx=0x7f351c005700 comp rx=0 tx=0).stop 2022-08-10T17:49:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f3536d9d700 1 -- 172.21.15.150:0/497252381 reap_dead start 2022-08-10T17:49:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 -- 172.21.15.150:0/497252381 shutdown_connections 2022-08-10T17:49:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 -- 172.21.15.150:0/497252381 >> 172.21.15.150:0/497252381 conn(0x7f353806aac0 msgr2=0x7f35380c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 -- 172.21.15.150:0/497252381 shutdown_connections 2022-08-10T17:49:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.343+0000 7f353ccb1700 1 -- 172.21.15.150:0/497252381 wait complete. 2022-08-10T17:49:55.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.344+0000 7f353ccb1700 1 Processor -- start 2022-08-10T17:49:55.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.344+0000 7f353ccb1700 1 -- start start 2022-08-10T17:49:55.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 0x7f3538142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 0x7f35381ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806e160 0x7f35381ec490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538155820 con 0x7f353806e160 2022-08-10T17:49:55.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538144080 con 0x7f35381429d0 2022-08-10T17:49:55.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353ccb1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3538143680 con 0x7f35381564f0 2022-08-10T17:49:55.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f3536d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806e160 0x7f35381ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f3535d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 0x7f35381ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353659c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 0x7f3538142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f3535d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 0x7f35381ef0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56688/0 (socket says 172.21.15.150:56688) 2022-08-10T17:49:55.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f353659c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 0x7f3538142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53056/0 (socket says 172.21.15.150:53056) 2022-08-10T17:49:55.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.345+0000 7f3535d9b700 1 -- 172.21.15.150:0/2675966232 learned_addr learned my addr 172.21.15.150:0/2675966232 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:55.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 msgr2=0x7f35381ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 0x7f35381ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806e160 msgr2=0x7f35381ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806e160 0x7f35381ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35381442d0 con 0x7f35381429d0 2022-08-10T17:49:55.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f3536d9d700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806e160 0x7f35381ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f3535d9b700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35381564f0 0x7f35381ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353659c700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 0x7f3538142da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f353806cd10 tx=0x7f352800f770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528014660 con 0x7f35381429d0 2022-08-10T17:49:55.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280147c0 con 0x7f35381429d0 2022-08-10T17:49:55.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35381445b0 con 0x7f35381429d0 2022-08-10T17:49:55.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528014b30 con 0x7f35381429d0 2022-08-10T17:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.346+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3538155d10 con 0x7f35381429d0 2022-08-10T17:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.347+0000 7f353ccb1700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 0x7f3538147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.347+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353806e530 con 0x7f353806aac0 2022-08-10T17:49:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.347+0000 7f3535d9b700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 0x7f3538147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.347+0000 7f3535d9b700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35380c5bf0 con 0x7f353806aac0 2022-08-10T17:49:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.347+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3528024070 con 0x7f35381429d0 2022-08-10T17:49:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3535d9b700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 0x7f3538147b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3538157d70 tx=0x7f352c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35140650e0 0x7f3514067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f35280823e0 con 0x7f35381429d0 2022-08-10T17:49:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3536d9d700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35140650e0 0x7f3514067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c01f840 con 0x7f353806aac0 2022-08-10T17:49:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f352c003e10 con 0x7f353806aac0 2022-08-10T17:49:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 msgr2=0x7f3538147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 0x7f3538147b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3538157d70 tx=0x7f352c001120 comp rx=0 tx=0).stop 2022-08-10T17:49:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 msgr2=0x7f3538147b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.348+0000 7f3526ffd700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f353806aac0 0x7f3538147b30 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3538157d70 tx=0x7f352c001120 comp rx=0 tx=0).stop 2022-08-10T17:49:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.349+0000 7f3536d9d700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35140650e0 0x7f3514067590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3538070970 tx=0x7f3530001ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.355+0000 7f353ccb1700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 0x7f3538148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.355+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538071e00 con 0x7f3538155ea0 2022-08-10T17:49:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.355+0000 7f3535d9b700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 0x7f3538148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.356+0000 7f3535d9b700 1 -- 172.21.15.150:0/2675966232 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f35380c1820 con 0x7f3538155ea0 2022-08-10T17:49:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.356+0000 7f3535d9b700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 0x7f3538148070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f352c005040 tx=0x7f352c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.356+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c02f070 con 0x7f3538155ea0 2022-08-10T17:49:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.356+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4549 (secure 0 0 0) 0x7f352c02a7d0 con 0x7f3538155ea0 2022-08-10T17:49:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.357+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 msgr2=0x7f3538148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.357+0000 7f3526ffd700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 0x7f3538148070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f352c005040 tx=0x7f352c00a000 comp rx=0 tx=0).stop 2022-08-10T17:49:55.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.357+0000 7f3526ffd700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 msgr2=0x7f3538148070 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.357+0000 7f3526ffd700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538155ea0 0x7f3538148070 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f352c005040 tx=0x7f352c00a000 comp rx=0 tx=0).stop 2022-08-10T17:49:55.398 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:55.399 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:55.399 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:55.399 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:49:55.400 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:49:55.400 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:55.400 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:55.400 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:55.401 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:55.401 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.401 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:49:55.401 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.401 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:55.402 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:55.402 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.402 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.403 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.403 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.403 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.403 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.404 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.404 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.404 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.404 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:55.405 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:55.405 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.405 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.405 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.406 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.406 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.406 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.407 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.407 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.407 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.408 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:55.408 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:55.408 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:55.409 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:55.409 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:55.409 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:55.409 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.409 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.410 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:55.410 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:55.410 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:55.411 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:55.411 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:55.411 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:55.411 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.412 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:55.412 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.412 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.412 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.413 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.413 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.413 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.413 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.414 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.414 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.414 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.414 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:55.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.415 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:55.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.415 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:55.416 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:55.416 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.416 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.417 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.417 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:55.417 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.418 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.418 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:55.419 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.419 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.419 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.420 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.420 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.420 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.420 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.421 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.425 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:55.427 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:55.428 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.431 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.432 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.432 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.432 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.433 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:55.433 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:55.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.433 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.434 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.434 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.434 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.434 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.435 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:55.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.435 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.435 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.436 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.436 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.436 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.436 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:55.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.437 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.437 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.437 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.438 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.438 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:55.438 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:55.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35140650e0 msgr2=0x7f3514067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f353ccb1700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f35140650e0 0x7f3514067590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3538070970 tx=0x7f3530001ae0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 msgr2=0x7f3538142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f353ccb1700 1 --2- 172.21.15.150:0/2675966232 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35381429d0 0x7f3538142da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f353806cd10 tx=0x7f352800f770 comp rx=0 tx=0).stop 2022-08-10T17:49:55.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f3536d9d700 1 -- 172.21.15.150:0/2675966232 reap_dead start 2022-08-10T17:49:55.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.360+0000 7f3536d9d700 1 -- 172.21.15.150:0/2675966232 reap_dead start 2022-08-10T17:49:55.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.362+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 shutdown_connections 2022-08-10T17:49:55.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.362+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 >> 172.21.15.150:0/2675966232 conn(0x7f351c0046d0 msgr2=0x7f35380c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.362+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 shutdown_connections 2022-08-10T17:49:55.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.362+0000 7f353ccb1700 1 -- 172.21.15.150:0/2675966232 wait complete. 2022-08-10T17:49:55.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:49:55.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.599+0000 7f35c14fc700 1 Processor -- start 2022-08-10T17:49:55.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.599+0000 7f35c14fc700 1 -- start start 2022-08-10T17:49:55.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35c14fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35c14fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc158fa0 con 0x7f35bc0c2110 2022-08-10T17:49:55.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35c14fc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc158a00 con 0x7f35bc0c5660 2022-08-10T17:49:55.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35c14fc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc158cc0 con 0x7f35bc0b09e0 2022-08-10T17:49:55.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35bb7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f35bc0c2110 0x7f35bc15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55158/0 (socket says 172.21.15.150:55158) 2022-08-10T17:49:55.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.600+0000 7f35bb7fe700 1 -- 172.21.15.150:0/2964013268 learned_addr learned my addr 172.21.15.150:0/2964013268 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:55.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.601+0000 7f35baffd700 1 --2- 172.21.15.150:0/2964013268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.601+0000 7f35baffd700 1 -- 172.21.15.150:0/2964013268 >> v1:172.21.15.197:6789/0 conn(0x7f35bc0c5660 legacy=0x7f35bc0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.601+0000 7f35baffd700 1 -- 172.21.15.150:0/2964013268 >> v1:172.21.15.150:6789/0 conn(0x7f35bc0c2110 legacy=0x7f35bc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.601+0000 7f35baffd700 1 -- 172.21.15.150:0/2964013268 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0c4c50 con 0x7f35bc0b09e0 2022-08-10T17:49:55.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.601+0000 7f35baffd700 1 --2- 172.21.15.150:0/2964013268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06ab40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c3a40 tx=0x7f35ac0099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac6f9a10f43f5d8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.602+0000 7f35b9ffb700 1 -- 172.21.15.150:0/2964013268 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac004230 con 0x7f35bc0b09e0 2022-08-10T17:49:55.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.602+0000 7f35b9ffb700 1 -- 172.21.15.150:0/2964013268 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac004390 con 0x7f35bc0b09e0 2022-08-10T17:49:55.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.602+0000 7f35b9ffb700 1 -- 172.21.15.150:0/2964013268 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac003740 con 0x7f35bc0b09e0 2022-08-10T17:49:55.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.603+0000 7f35c14fc700 1 -- 172.21.15.150:0/2964013268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 msgr2=0x7f35bc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.603+0000 7f35c14fc700 1 --2- 172.21.15.150:0/2964013268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06ab40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c3a40 tx=0x7f35ac0099c0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.603+0000 7f35c14fc700 1 -- 172.21.15.150:0/2964013268 shutdown_connections 2022-08-10T17:49:55.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.603+0000 7f35c14fc700 1 --2- 172.21.15.150:0/2964013268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06ab40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.603+0000 7f35c14fc700 1 -- 172.21.15.150:0/2964013268 >> 172.21.15.150:0/2964013268 conn(0x7f35bc06fae0 msgr2=0x7f35bc06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.604+0000 7f35c14fc700 1 -- 172.21.15.150:0/2964013268 shutdown_connections 2022-08-10T17:49:55.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.604+0000 7f35c14fc700 1 -- 172.21.15.150:0/2964013268 wait complete. 2022-08-10T17:49:55.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.605+0000 7f35c14fc700 1 Processor -- start 2022-08-10T17:49:55.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.605+0000 7f35c14fc700 1 -- start start 2022-08-10T17:49:55.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0c2110 0x7f35bc156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 0x7f35bc14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc155e10 con 0x7f35bc156770 2022-08-10T17:49:55.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1ef970 con 0x7f35bc0c2110 2022-08-10T17:49:55.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35c14fc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc152c00 con 0x7f35bc0b09e0 2022-08-10T17:49:55.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35baffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35bb7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 0x7f35bc14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35ba7fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0c2110 0x7f35bc156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35bb7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 0x7f35bc14c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42486/0 (socket says 172.21.15.150:42486) 2022-08-10T17:49:55.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35baffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56704/0 (socket says 172.21.15.150:56704) 2022-08-10T17:49:55.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.606+0000 7f35bb7fe700 1 -- 172.21.15.150:0/3964861962 learned_addr learned my addr 172.21.15.150:0/3964861962 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:55.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 msgr2=0x7f35bc06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 msgr2=0x7f35bc14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 0x7f35bc14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac009310 con 0x7f35bc0c2110 2022-08-10T17:49:55.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35bb7fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35bc156770 0x7f35bc14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35baffd700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f35bc0b09e0 0x7f35bc06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35ba7fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0c2110 0x7f35bc156230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35bc070710 tx=0x7f35b000c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00052d0 con 0x7f35bc0c2110 2022-08-10T17:49:55.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000ce20 con 0x7f35bc0c2110 2022-08-10T17:49:55.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0003720 con 0x7f35bc0c2110 2022-08-10T17:49:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc152ee0 con 0x7f35bc0c2110 2022-08-10T17:49:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.607+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc158630 con 0x7f35bc0c2110 2022-08-10T17:49:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.608+0000 7f35c14fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 0x7f35bc0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.608+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0644b0 con 0x7f35bc14cd80 2022-08-10T17:49:55.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.608+0000 7f35baffd700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 0x7f35bc0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.608+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f35b0010070 con 0x7f35bc0c2110 2022-08-10T17:49:55.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.608+0000 7f35baffd700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35bc155f50 con 0x7f35bc14cd80 2022-08-10T17:49:55.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f359c0650b0 0x7f359c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f35b0080e00 con 0x7f35bc0c2110 2022-08-10T17:49:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35baffd700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 0x7f35bc0c5660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c3a40 tx=0x7f35ac0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35bb7fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f359c0650b0 0x7f359c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00fcb0 con 0x7f35bc14cd80 2022-08-10T17:49:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f35ac0041c0 con 0x7f35bc14cd80 2022-08-10T17:49:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 msgr2=0x7f35bc0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 0x7f35bc0c5660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c3a40 tx=0x7f35ac0045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 msgr2=0x7f35bc0c5660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35a37fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc14cd80 0x7f35bc0c5660 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.609+0000 7f35bb7fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f359c0650b0 0x7f359c067560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007eb0 tx=0x7f35b4007e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.620+0000 7f35c14fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 0x7f35bc14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.620+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc14cb80 con 0x7f35bc0b00c0 2022-08-10T17:49:55.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.621+0000 7f35baffd700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 0x7f35bc14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.621+0000 7f35baffd700 1 -- 172.21.15.150:0/3964861962 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f35bc072890 con 0x7f35bc0b00c0 2022-08-10T17:49:55.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.621+0000 7f35baffd700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 0x7f35bc14c640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00a010 tx=0x7f35ac010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac01ec90 con 0x7f35bc0b00c0 2022-08-10T17:49:55.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f35ac00fe10 con 0x7f35bc0b00c0 2022-08-10T17:49:55.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 msgr2=0x7f35bc14c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 0x7f35bc14c640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00a010 tx=0x7f35ac010000 comp rx=0 tx=0).stop 2022-08-10T17:49:55.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 msgr2=0x7f35bc14c640 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.622+0000 7f35a37fe700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0b00c0 0x7f35bc14c640 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00a010 tx=0x7f35ac010000 comp rx=0 tx=0).stop 2022-08-10T17:49:55.628 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:55.628 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:49:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:55.629 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:49:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.630 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.631 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.632 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:55.633 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.634 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.635 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.635 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.635 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.635 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.635 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.636 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.636 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:55.636 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:55.637 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:55.637 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:55.637 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:55.637 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:55.637 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.638 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.638 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:55.638 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:55.638 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:55.639 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:55.639 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:55.639 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:55.640 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.640 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:55.640 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.640 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.640 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.641 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.641 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.641 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.641 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.642 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.642 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.642 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.642 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:55.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.643 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:55.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.643 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:55.644 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:55.644 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.644 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.645 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.645 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:55.645 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.646 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.646 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:55.646 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.647 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.647 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.647 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.648 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.648 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.648 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.649 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.649 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:55.650 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:55.650 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.650 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.650 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.651 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:55.651 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.652 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.652 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:55.652 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.652 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.652 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.653 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.653 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.653 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.654 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.654 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.654 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.655 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:55.655 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:55.655 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.655 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.656 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.656 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:55.656 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.657 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.657 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:55.657 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.658 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.658 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.658 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.659 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.659 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.659 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.659 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.659 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.660 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.660 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:55.660 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:55.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.661 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.661 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.661 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.661 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.662 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.662 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:49:55.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.662 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.663 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.663 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:55.663 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.663 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.664 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:49:55.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.664 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.664 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.665 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:49:55.665 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.665 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.665 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:55.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.666 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:49:55.666 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.666 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.667 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.667 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.667 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:49:55.668 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.668 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.668 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:49:55.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.669 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.669 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.669 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:49:55.669 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.670 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.670 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:55.670 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f359c0650b0 msgr2=0x7f359c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f359c0650b0 0x7f359c067560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007eb0 tx=0x7f35b4007e00 comp rx=0 tx=0).stop 2022-08-10T17:49:55.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0c2110 msgr2=0x7f35bc156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 --2- 172.21.15.150:0/3964861962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f35bc0c2110 0x7f35bc156230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35bc070710 tx=0x7f35b000c6c0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35bb7fe700 1 -- 172.21.15.150:0/3964861962 reap_dead start 2022-08-10T17:49:55.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35bb7fe700 1 -- 172.21.15.150:0/3964861962 reap_dead start 2022-08-10T17:49:55.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 shutdown_connections 2022-08-10T17:49:55.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 >> 172.21.15.150:0/3964861962 conn(0x7f35bc06fae0 msgr2=0x7f35bc063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 shutdown_connections 2022-08-10T17:49:55.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.623+0000 7f35c14fc700 1 -- 172.21.15.150:0/3964861962 wait complete. 2022-08-10T17:49:55.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:49:55.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.901+0000 7f9ff02bb700 1 Processor -- start 2022-08-10T17:49:55.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.901+0000 7f9ff02bb700 1 -- start start 2022-08-10T17:49:55.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.901+0000 7f9ff02bb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.901+0000 7f9ff02bb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f9fe80c2110 0x7f9fe80c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.901+0000 7f9ff02bb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe8158fa0 con 0x7f9fe80b09e0 2022-08-10T17:49:55.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9ff02bb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80c4730 con 0x7f9fe80c2110 2022-08-10T17:49:55.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9ff02bb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8158a00 con 0x7f9fe80c5660 2022-08-10T17:49:55.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee057700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f9fe80b09e0 0x7f9fe80c3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41528/0 (socket says 172.21.15.150:41528) 2022-08-10T17:49:55.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f9fe80c2110 0x7f9fe80c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fed856700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee057700 1 -- 172.21.15.150:0/1190474019 learned_addr learned my addr 172.21.15.150:0/1190474019 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:49:55.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 -- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 msgr2=0x7f9fe806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:55.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 --2- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 -- 172.21.15.150:0/1190474019 >> v1:172.21.15.197:6789/0 conn(0x7f9fe80b09e0 legacy=0x7f9fe80c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fed055700 1 -- 172.21.15.150:0/1190474019 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282325728 0 0) 0x7f9fe0001490 con 0x7f9fe80b09e0 2022-08-10T17:49:55.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 -- 172.21.15.150:0/1190474019 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8158cc0 con 0x7f9fe80c2110 2022-08-10T17:49:55.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fee858700 1 --2- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe80c41f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40096b0 tx=0x7f9fe40099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2ece2745068ce6 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fed055700 1 -- 172.21.15.150:0/1190474019 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40107b0 con 0x7f9fe80c2110 2022-08-10T17:49:55.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fed055700 1 -- 172.21.15.150:0/1190474019 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4010910 con 0x7f9fe80c2110 2022-08-10T17:49:55.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.902+0000 7f9fed055700 1 -- 172.21.15.150:0/1190474019 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4010cc0 con 0x7f9fe80c2110 2022-08-10T17:49:55.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 -- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 msgr2=0x7f9fe80c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe80c41f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40096b0 tx=0x7f9fe40099c0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 -- 172.21.15.150:0/1190474019 shutdown_connections 2022-08-10T17:49:55.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe80c41f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/1190474019 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 -- 172.21.15.150:0/1190474019 >> 172.21.15.150:0/1190474019 conn(0x7f9fe806fae0 msgr2=0x7f9fe806fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 -- 172.21.15.150:0/1190474019 shutdown_connections 2022-08-10T17:49:55.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.903+0000 7f9ff02bb700 1 -- 172.21.15.150:0/1190474019 wait complete. 2022-08-10T17:49:55.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.904+0000 7f9ff02bb700 1 Processor -- start 2022-08-10T17:49:55.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.904+0000 7f9ff02bb700 1 -- start start 2022-08-10T17:49:55.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 0x7f9fe81effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fe8155c70 0x7f9fe81562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806e070 con 0x7f9fe8155c70 2022-08-10T17:49:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806a350 con 0x7f9fe80c2110 2022-08-10T17:49:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9ff02bb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe81f0500 con 0x7f9fe80b09e0 2022-08-10T17:49:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee057700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 0x7f9fe81effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fe8155c70 0x7f9fe81562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fed856700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee057700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 0x7f9fe81effc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56724/0 (socket says 172.21.15.150:56724) 2022-08-10T17:49:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee057700 1 -- 172.21.15.150:0/2437947756 learned_addr learned my addr 172.21.15.150:0/2437947756 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 msgr2=0x7f9fe81effc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 0x7f9fe81effc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 msgr2=0x7f9fe814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee858700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009310 con 0x7f9fe8155c70 2022-08-10T17:49:55.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fee057700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80b09e0 0x7f9fe81effc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.905+0000 7f9fed856700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9fe80c2110 0x7f9fe814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:49:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9fee858700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fe8155c70 0x7f9fe81562f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4015000 tx=0x7f9fe40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4011640 con 0x7f9fe8155c70 2022-08-10T17:49:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40117a0 con 0x7f9fe8155c70 2022-08-10T17:49:55.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80681b0 con 0x7f9fe8155c70 2022-08-10T17:49:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4011b50 con 0x7f9fe8155c70 2022-08-10T17:49:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe81ef7c0 con 0x7f9fe8155c70 2022-08-10T17:49:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 0x7f9fe80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.906+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80644b0 con 0x7f9fe8150060 2022-08-10T17:49:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.907+0000 7f9fee057700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 0x7f9fe80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.907+0000 7f9fee057700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fe81ef620 con 0x7f9fe8150060 2022-08-10T17:49:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.907+0000 7f9fee057700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 0x7f9fe80c7fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0002230 tx=0x7f9fe000f4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.907+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00078b0 con 0x7f9fe8150060 2022-08-10T17:49:55.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.907+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9fe402b030 con 0x7f9fe8155c70 2022-08-10T17:49:55.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fc8065150 0x7f9fc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9fe4083210 con 0x7f9fe8155c70 2022-08-10T17:49:55.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fed856700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fc8065150 0x7f9fc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f9fe000fc50 con 0x7f9fe8150060 2022-08-10T17:49:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 msgr2=0x7f9fe80c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 0x7f9fe80c7fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0002230 tx=0x7f9fe000f4b0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 msgr2=0x7f9fe80c7fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fd6ffd700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe8150060 0x7f9fe80c7fa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.908+0000 7f9fed856700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fc8065150 0x7f9fc8067600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80b0580 tx=0x7f9fd80090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.918+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe81ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:55.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.918+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8067100 con 0x7f9fe80c5660 2022-08-10T17:49:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.918+0000 7f9fee057700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe81ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fee057700 1 -- 172.21.15.150:0/2437947756 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9fe80686b0 con 0x7f9fe80c5660 2022-08-10T17:49:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fee057700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe81ef950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0002230 tx=0x7f9fe0007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0013a40 con 0x7f9fe80c5660 2022-08-10T17:49:55.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f9fe0013ba0 con 0x7f9fe80c5660 2022-08-10T17:49:55.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 msgr2=0x7f9fe81ef950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe81ef950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0002230 tx=0x7f9fe0007f90 comp rx=0 tx=0).stop 2022-08-10T17:49:55.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 msgr2=0x7f9fe81ef950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:49:55.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.919+0000 7f9fd6ffd700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9fe80c5660 0x7f9fe81ef950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.930 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:49:55.930 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:55.930 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:55.931 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:49:55.931 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:49:55.931 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:49:55.931 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:49:55.932 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:49:55.932 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:49:55.932 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.932 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:49:55.932 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.933 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:49:55.933 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:49:55.933 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.933 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.934 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.934 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.934 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.934 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.934 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.935 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.935 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.935 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.935 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:49:55.936 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:49:55.936 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.936 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.936 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.936 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.937 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.937 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.937 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.937 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.937 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.938 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.938 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:49:55.938 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:49:55.939 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:49:55.939 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:49:55.939 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:49:55.939 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:49:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:49:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:49:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:49:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:49:55.941 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:49:55.941 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:49:55.941 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:49:55.941 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:49:55.941 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:49:55.942 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:49:55.942 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:49:55.942 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:49:55.942 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:49:55.943 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:49:55.943 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:49:55.943 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:49:55.943 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:49:55.944 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:49:55.944 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.944 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:49:55.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.944 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:49:55.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.945 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:49:55.945 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:49:55.945 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.946 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.946 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:49:55.946 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.947 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.947 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:49:55.947 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.948 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.948 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.948 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.949 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:49:55.949 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.949 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.949 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.950 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:49:55.950 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:49:55.950 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.951 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.951 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:49:55.951 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.952 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.952 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:49:55.953 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.953 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.953 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.954 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:49:55.954 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.954 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.954 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.955 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:49:55.955 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:49:55.955 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:49:55.956 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:49:55.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.956 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:49:55.956 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:49:55.957 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.957 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:49:55.957 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:49:55.958 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:49:55.958 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.958 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.958 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.959 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:49:55.959 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:49:55.959 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:49:55.959 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:49:55.960 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.960 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.960 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:49:55.960 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:49:55.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.961 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.961 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.961 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.962 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.962 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:49:55.962 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:49:55.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:49:55.962 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:49:55.963 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:49:55.963 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:49:55.963 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:49:55.964 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:49:55.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:49:55.964 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:49:55.964 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:49:55.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fc8065150 msgr2=0x7f9fc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9fc8065150 0x7f9fc8067600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80b0580 tx=0x7f9fd80090e0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fe8155c70 msgr2=0x7f9fe81562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:55.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 --2- 172.21.15.150:0/2437947756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fe8155c70 0x7f9fe81562f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4015000 tx=0x7f9fe40045d0 comp rx=0 tx=0).stop 2022-08-10T17:49:55.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9fee858700 1 -- 172.21.15.150:0/2437947756 reap_dead start 2022-08-10T17:49:55.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9fee858700 1 -- 172.21.15.150:0/2437947756 reap_dead start 2022-08-10T17:49:55.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 shutdown_connections 2022-08-10T17:49:55.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 >> 172.21.15.150:0/2437947756 conn(0x7f9fe806fae0 msgr2=0x7f9fe80c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:55.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 shutdown_connections 2022-08-10T17:49:55.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:55.920+0000 7f9ff02bb700 1 -- 172.21.15.150:0/2437947756 wait complete. 2022-08-10T17:49:55.969 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:49:55.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:49:56.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.476+0000 7fda025fa700 1 Processor -- start 2022-08-10T17:49:56.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 -- start start 2022-08-10T17:49:56.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0c3410 0x7fd9fc154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0ca840 0x7fd9fc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc157f30 con 0x7fd9fc0c37e0 2022-08-10T17:49:56.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc1581d0 con 0x7fd9fc0c3410 2022-08-10T17:49:56.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.477+0000 7fda025fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1584b0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0c3410 0x7fd9fc154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0c3410 0x7fd9fc154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42514/0 (socket says 172.21.15.150:42514) 2022-08-10T17:49:56.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 -- 172.21.15.150:0/1095392816 learned_addr learned my addr 172.21.15.150:0/1095392816 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:56.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fb7fe700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0ca840 0x7fd9fc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 -- 172.21.15.150:0/1095392816 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0ca840 msgr2=0x7fd9fc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:49:56.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0ca840 0x7fd9fc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 -- 172.21.15.150:0/1095392816 >> v1:172.21.15.197:6789/0 conn(0x7fd9fc0c37e0 legacy=0x7fd9fc153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9faffd700 1 -- 172.21.15.150:0/1095392816 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608654801 0 0) 0x7fd9fc157f30 con 0x7fd9fc0c37e0 2022-08-10T17:49:56.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 -- 172.21.15.150:0/1095392816 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc158790 con 0x7fd9fc0c3410 2022-08-10T17:49:56.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9fbfff700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c3410 0x7fd9fc154ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec006fd0 tx=0x7fd9ec009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2a8d4c809d165 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:56.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9faffd700 1 -- 172.21.15.150:0/1095392816 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec004230 con 0x7fd9fc0c3410 2022-08-10T17:49:56.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9faffd700 1 -- 172.21.15.150:0/1095392816 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec004390 con 0x7fd9fc0c3410 2022-08-10T17:49:56.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.478+0000 7fd9faffd700 1 -- 172.21.15.150:0/1095392816 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec011830 con 0x7fd9fc0c3410 2022-08-10T17:49:56.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 -- 172.21.15.150:0/1095392816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c3410 msgr2=0x7fd9fc154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c3410 0x7fd9fc154ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec006fd0 tx=0x7fd9ec009a60 comp rx=0 tx=0).stop 2022-08-10T17:49:56.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 -- 172.21.15.150:0/1095392816 shutdown_connections 2022-08-10T17:49:56.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c3410 0x7fd9fc154ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 --2- 172.21.15.150:0/1095392816 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0ca840 0x7fd9fc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 -- 172.21.15.150:0/1095392816 >> 172.21.15.150:0/1095392816 conn(0x7fd9fc068110 msgr2=0x7fd9fc068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:56.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 -- 172.21.15.150:0/1095392816 shutdown_connections 2022-08-10T17:49:56.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.479+0000 7fda025fa700 1 -- 172.21.15.150:0/1095392816 wait complete. 2022-08-10T17:49:56.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.480+0000 7fda025fa700 1 Processor -- start 2022-08-10T17:49:56.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.480+0000 7fda025fa700 1 -- start start 2022-08-10T17:49:56.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 0x7fd9fc0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 0x7fd9fc1e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 0x7fd9fc157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc068af0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc150530 con 0x7fd9fc0c37e0 2022-08-10T17:49:56.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc150810 con 0x7fd9fc0c3410 2022-08-10T17:49:56.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 0x7fd9fc0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9fb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 0x7fd9fc1e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 0x7fd9fc157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 0x7fd9fc0c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56742/0 (socket says 172.21.15.150:56742) 2022-08-10T17:49:56.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9fbfff700 1 -- 172.21.15.150:0/708078877 learned_addr learned my addr 172.21.15.150:0/708078877 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:49:56.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9fb7fe700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 0x7fd9fc1e9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53114/0 (socket says 172.21.15.150:53114) 2022-08-10T17:49:56.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 -- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 msgr2=0x7fd9fc0c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 0x7fd9fc0c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 -- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 msgr2=0x7fd9fc1e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 0x7fd9fc1e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 -- 172.21.15.150:0/708078877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0093e0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda00b97700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 0x7fd9fc157480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c750 tx=0x7fd9f400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:56.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4003cb0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4003e10 con 0x7fd9fc0ca840 2022-08-10T17:49:56.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc150af0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.481+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4005310 con 0x7fd9fc0ca840 2022-08-10T17:49:56.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.482+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc0bfc20 con 0x7fd9fc0ca840 2022-08-10T17:49:56.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.482+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc072890 con 0x7fd9fc0ca840 2022-08-10T17:49:56.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.483+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd9f4019030 con 0x7fd9fc0ca840 2022-08-10T17:49:56.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.483+0000 7fd9f8ff9700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 0x7fd9dc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:49:56.500 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.483+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd9f40815a0 con 0x7fd9fc0ca840 2022-08-10T17:49:56.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.483+0000 7fd9fbfff700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 0x7fd9dc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:49:56.501 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.484+0000 7fd9fbfff700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 0x7fd9dc067590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0045a0 tx=0x7fd9ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:49:56.502 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.487+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd9f404f580 con 0x7fd9fc0ca840 2022-08-10T17:49:56.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.804+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fd9fc06ee20 con 0x7fd9fc0ca840 2022-08-10T17:49:56.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.805+0000 7fd9f8ff9700 1 -- 172.21.15.150:0/708078877 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fd9f4017020 con 0x7fd9fc0ca840 2022-08-10T17:49:56.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 msgr2=0x7fd9dc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 0x7fd9dc067590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0045a0 tx=0x7fd9ec008030 comp rx=0 tx=0).stop 2022-08-10T17:49:56.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 msgr2=0x7fd9fc157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:49:56.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 0x7fd9fc157480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c750 tx=0x7fd9f400ca60 comp rx=0 tx=0).stop 2022-08-10T17:49:56.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 shutdown_connections 2022-08-10T17:49:56.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0ca840 0x7fd9fc157480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd9dc0650e0 0x7fd9dc067590 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd9fc0c3410 0x7fd9fc0c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 --2- 172.21.15.150:0/708078877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd9fc0c37e0 0x7fd9fc1e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:49:56.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 >> 172.21.15.150:0/708078877 conn(0x7fd9fc068110 msgr2=0x7fd9fc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:49:56.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 shutdown_connections 2022-08-10T17:49:56.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:49:56.808+0000 7fda025fa700 1 -- 172.21.15.150:0/708078877 wait complete. 2022-08-10T17:49:56.828 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:50:06.829 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:50:06.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:06.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.969+0000 7f2c1db7f700 1 Processor -- start 2022-08-10T17:50:06.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.969+0000 7f2c1db7f700 1 -- start start 2022-08-10T17:50:06.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2c180896d0 0x7f2c180c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:06.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c180c5050 0x7f2c1815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:06.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 0x7f2c1815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:06.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1806bf00 con 0x7f2c180c5050 2022-08-10T17:50:06.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1806b310 con 0x7f2c180896d0 2022-08-10T17:50:06.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c1db7f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180c3830 con 0x7f2c18089aa0 2022-08-10T17:50:06.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c16ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c180c5050 0x7f2c1815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:06.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c16ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c180c5050 0x7f2c1815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42564/0 (socket says 172.21.15.150:42564) 2022-08-10T17:50:06.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c16ffd700 1 -- 172.21.15.150:0/1129255206 learned_addr learned my addr 172.21.15.150:0/1129255206 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:06.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c17fff700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 0x7f2c1815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:06.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.970+0000 7f2c177fe700 1 --2- 172.21.15.150:0/1129255206 >> v2:172.21.15.197:3300/0 conn(0x7f2c180896d0 0x7f2c180c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:06.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 -- 172.21.15.150:0/1129255206 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 msgr2=0x7f2c1815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:06.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 0x7f2c1815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:06.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 -- 172.21.15.150:0/1129255206 >> v2:172.21.15.197:3300/0 conn(0x7f2c180896d0 msgr2=0x7f2c180c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:06.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/1129255206 >> v2:172.21.15.197:3300/0 conn(0x7f2c180896d0 0x7f2c180c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:06.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 -- 172.21.15.150:0/1129255206 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180c3aa0 con 0x7f2c180c5050 2022-08-10T17:50:06.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c17fff700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 0x7f2c1815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:06.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.982+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c180c5050 0x7f2c1815d570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c180c65c0 tx=0x7f2c0800ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e917d57096f4a5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:06.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.983+0000 7f2c167fc700 1 -- 172.21.15.150:0/1129255206 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08004230 con 0x7f2c180c5050 2022-08-10T17:50:06.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.983+0000 7f2c167fc700 1 -- 172.21.15.150:0/1129255206 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08004390 con 0x7f2c180c5050 2022-08-10T17:50:06.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.983+0000 7f2c167fc700 1 -- 172.21.15.150:0/1129255206 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08003740 con 0x7f2c180c5050 2022-08-10T17:50:06.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.984+0000 7f2c1db7f700 1 -- 172.21.15.150:0/1129255206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c180c5050 msgr2=0x7f2c1815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:06.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.984+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c180c5050 0x7f2c1815d570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c180c65c0 tx=0x7f2c0800ab00 comp rx=0 tx=0).stop 2022-08-10T17:50:06.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.986+0000 7f2c1db7f700 1 -- 172.21.15.150:0/1129255206 shutdown_connections 2022-08-10T17:50:06.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.986+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c18089aa0 0x7f2c1815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:06.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.986+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/1129255206 >> v2:172.21.15.197:3300/0 conn(0x7f2c180896d0 0x7f2c180c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:06.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.986+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/1129255206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c180c5050 0x7f2c1815d570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:06.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.986+0000 7f2c1db7f700 1 -- 172.21.15.150:0/1129255206 >> 172.21.15.150:0/1129255206 conn(0x7f2c180c8a10 msgr2=0x7f2c180c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:06.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.989+0000 7f2c1db7f700 1 -- 172.21.15.150:0/1129255206 shutdown_connections 2022-08-10T17:50:06.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.989+0000 7f2c1db7f700 1 -- 172.21.15.150:0/1129255206 wait complete. 2022-08-10T17:50:06.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.991+0000 7f2c1db7f700 1 Processor -- start 2022-08-10T17:50:06.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.991+0000 7f2c1db7f700 1 -- start start 2022-08-10T17:50:06.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.991+0000 7f2c1db7f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 0x7f2c180be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:06.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.991+0000 7f2c1db7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:06.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c1db7f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c180c5050 0x7f2c18088ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c1db7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180b6110 con 0x7f2c18089aa0 2022-08-10T17:50:07.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c1db7f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180b63f0 con 0x7f2c180c5050 2022-08-10T17:50:07.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c1db7f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181f9080 con 0x7f2c180896d0 2022-08-10T17:50:07.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 0x7f2c180be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 0x7f2c180be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56792/0 (socket says 172.21.15.150:56792) 2022-08-10T17:50:07.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c177fe700 1 -- 172.21.15.150:0/984385200 learned_addr learned my addr 172.21.15.150:0/984385200 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:07.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42572/0 (socket says 172.21.15.150:42572) 2022-08-10T17:50:07.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 -- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 msgr2=0x7f2c180be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 0x7f2c180be8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 -- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c180c5050 msgr2=0x7f2c18088ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:07.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c180c5050 0x7f2c18088ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 -- 172.21.15.150:0/984385200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1000ea50 con 0x7f2c18089aa0 2022-08-10T17:50:07.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.992+0000 7f2c16ffd700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c180bc5d0 tx=0x7f2c080045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.993+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08010680 con 0x7f2c18089aa0 2022-08-10T17:50:07.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.993+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08003730 con 0x7f2c18089aa0 2022-08-10T17:50:07.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.993+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08010a00 con 0x7f2c18089aa0 2022-08-10T17:50:07.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.994+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0800a490 con 0x7f2c18089aa0 2022-08-10T17:50:07.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.994+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c181f9640 con 0x7f2c18089aa0 2022-08-10T17:50:07.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.995+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c18072890 con 0x7f2c18089aa0 2022-08-10T17:50:07.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.995+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2c0802a020 con 0x7f2c18089aa0 2022-08-10T17:50:07.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.996+0000 7f2c0ffff700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 0x7f2bfc067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.996+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2c080838b0 con 0x7f2c18089aa0 2022-08-10T17:50:07.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.996+0000 7f2c177fe700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 0x7f2bfc067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:06.996+0000 7f2c177fe700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 0x7f2bfc067590 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000cbc0 tx=0x7f2c0000e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.001+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2c08051890 con 0x7f2c18089aa0 2022-08-10T17:50:07.350 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.345+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2c1806b560 con 0x7f2c18089aa0 2022-08-10T17:50:07.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.347+0000 7f2c0ffff700 1 -- 172.21.15.150:0/984385200 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f2c0800b040 con 0x7f2c18089aa0 2022-08-10T17:50:07.353 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 msgr2=0x7f2bfc067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 0x7f2bfc067590 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000cbc0 tx=0x7f2c0000e040 comp rx=0 tx=0).stop 2022-08-10T17:50:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 msgr2=0x7f2c18088990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c180bc5d0 tx=0x7f2c080045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 shutdown_connections 2022-08-10T17:50:07.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2c180c5050 0x7f2c18088ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2bfc0650e0 0x7f2bfc067590 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2c180896d0 0x7f2c180be8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 --2- 172.21.15.150:0/984385200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18089aa0 0x7f2c18088990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 >> 172.21.15.150:0/984385200 conn(0x7f2c180c8a10 msgr2=0x7f2c18069500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:07.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 shutdown_connections 2022-08-10T17:50:07.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.351+0000 7f2c1db7f700 1 -- 172.21.15.150:0/984385200 wait complete. 2022-08-10T17:50:07.371 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:50:07.371 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:50:07.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:50:07.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 Processor -- start 2022-08-10T17:50:07.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 -- start start 2022-08-10T17:50:07.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f03200c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03200c3340 0x7f03200c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032006e070 con 0x7f03200c8af0 2022-08-10T17:50:07.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032006ec10 con 0x7f03200c3340 2022-08-10T17:50:07.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.510+0000 7f0326f75700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03200c37c0 con 0x7f03200c96b0 2022-08-10T17:50:07.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.511+0000 7f0325512700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03200c3340 0x7f03200c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.511+0000 7f0325512700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03200c3340 0x7f03200c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42586/0 (socket says 172.21.15.150:42586) 2022-08-10T17:50:07.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.511+0000 7f0325512700 1 -- 172.21.15.150:0/3393839910 learned_addr learned my addr 172.21.15.150:0/3393839910 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:07.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.511+0000 7f0324d11700 1 --1- 172.21.15.150:0/3393839910 >> v1:172.21.15.197:6789/0 conn(0x7f03200c8af0 0x7f032006e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41614/0 (socket says 172.21.15.150:41614) 2022-08-10T17:50:07.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.511+0000 7f031ffff700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f03200c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.637+0000 7f031f7fe700 1 -- 172.21.15.150:0/3393839910 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517408800 0 0) 0x7f032006e070 con 0x7f03200c8af0 2022-08-10T17:50:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f0325512700 1 -- 172.21.15.150:0/3393839910 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 msgr2=0x7f03200c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f0325512700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f03200c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f0325512700 1 -- 172.21.15.150:0/3393839910 >> v1:172.21.15.197:6789/0 conn(0x7f03200c8af0 legacy=0x7f032006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f0325512700 1 -- 172.21.15.150:0/3393839910 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200701c0 con 0x7f03200c3340 2022-08-10T17:50:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f031ffff700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f03200c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:50:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.640+0000 7f0325512700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c3340 0x7f03200c4f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e50 tx=0x7f031800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee66a3f56f99634 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.641+0000 7f031f7fe700 1 -- 172.21.15.150:0/3393839910 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800e070 con 0x7f03200c3340 2022-08-10T17:50:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.641+0000 7f031f7fe700 1 -- 172.21.15.150:0/3393839910 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031800b9c0 con 0x7f03200c3340 2022-08-10T17:50:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.641+0000 7f031f7fe700 1 -- 172.21.15.150:0/3393839910 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800bd30 con 0x7f03200c3340 2022-08-10T17:50:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.642+0000 7f0326f75700 1 -- 172.21.15.150:0/3393839910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c3340 msgr2=0x7f03200c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.642+0000 7f0326f75700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c3340 0x7f03200c4f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e50 tx=0x7f031800b330 comp rx=0 tx=0).stop 2022-08-10T17:50:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.644+0000 7f0326f75700 1 -- 172.21.15.150:0/3393839910 shutdown_connections 2022-08-10T17:50:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.644+0000 7f0326f75700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c3340 0x7f03200c4f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.644+0000 7f0326f75700 1 --2- 172.21.15.150:0/3393839910 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f03200c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.644+0000 7f0326f75700 1 -- 172.21.15.150:0/3393839910 >> 172.21.15.150:0/3393839910 conn(0x7f032006b500 msgr2=0x7f032006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.649+0000 7f0326f75700 1 -- 172.21.15.150:0/3393839910 shutdown_connections 2022-08-10T17:50:07.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.649+0000 7f0326f75700 1 -- 172.21.15.150:0/3393839910 wait complete. 2022-08-10T17:50:07.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.651+0000 7f0326f75700 1 Processor -- start 2022-08-10T17:50:07.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.651+0000 7f0326f75700 1 -- start start 2022-08-10T17:50:07.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 0x7f03200bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c8af0 0x7f03201edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f032015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201ebe20 con 0x7f03200c8af0 2022-08-10T17:50:07.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03200c03b0 con 0x7f03200c3340 2022-08-10T17:50:07.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0326f75700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03201f9400 con 0x7f03200c96b0 2022-08-10T17:50:07.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0324d11700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 0x7f03200bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0324d11700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 0x7f03200bfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53180/0 (socket says 172.21.15.150:53180) 2022-08-10T17:50:07.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.652+0000 7f0324d11700 1 -- 172.21.15.150:0/1012674494 learned_addr learned my addr 172.21.15.150:0/1012674494 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:07.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 msgr2=0x7f032015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f03200c96b0 0x7f032015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c8af0 msgr2=0x7f03201edd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200c8af0 0x7f03201edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0318009b30 con 0x7f03200c3340 2022-08-10T17:50:07.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f0324d11700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 0x7f03200bfe70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f03100011e0 tx=0x7f031000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100070d0 con 0x7f03200c3340 2022-08-10T17:50:07.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310007230 con 0x7f03200c3340 2022-08-10T17:50:07.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.653+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100075c0 con 0x7f03200c3340 2022-08-10T17:50:07.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.654+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03201f96c0 con 0x7f03200c3340 2022-08-10T17:50:07.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.654+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03200b88a0 con 0x7f03200c3340 2022-08-10T17:50:07.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.655+0000 7f0326f75700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 0x7f03201ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.655+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03200673d0 con 0x7f03200b8a60 2022-08-10T17:50:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.655+0000 7f031ffff700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 0x7f03201ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.656+0000 7f031ffff700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03202010d0 con 0x7f03200b8a60 2022-08-10T17:50:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.656+0000 7f031ffff700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 0x7f03201ec1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03200b8050 tx=0x7f031400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.656+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314011800 con 0x7f03200b8a60 2022-08-10T17:50:07.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.656+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f031001a020 con 0x7f03200c3340 2022-08-10T17:50:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0300065180 0x7f0300067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0310081ce0 con 0x7f03200c3340 2022-08-10T17:50:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f0325512700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0300065180 0x7f0300067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.665 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f031400ce40 con 0x7f03200b8a60 2022-08-10T17:50:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 msgr2=0x7f03201ec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 0x7f03201ec1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03200b8050 tx=0x7f031400c780 comp rx=0 tx=0).stop 2022-08-10T17:50:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 msgr2=0x7f03201ec1b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:07.666 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.657+0000 7f031d7fa700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b8a60 0x7f03201ec1b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.660+0000 7f0325512700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0300065180 0x7f0300067630 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f031800b370 tx=0x7f0318010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.664+0000 7f0326f75700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 0x7f0320209190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.664+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201ebf90 con 0x7f03200b80a0 2022-08-10T17:50:07.669 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.665+0000 7f031ffff700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 0x7f0320209190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.665+0000 7f031ffff700 1 -- 172.21.15.150:0/1012674494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0320072890 con 0x7f03200b80a0 2022-08-10T17:50:07.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031ffff700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 0x7f0320209190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0314017000 tx=0x7f0314006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031401f040 con 0x7f03200b80a0 2022-08-10T17:50:07.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4550 (secure 0 0 0) 0x7f0314011e40 con 0x7f03200b80a0 2022-08-10T17:50:07.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 msgr2=0x7f0320209190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 0x7f0320209190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0314017000 tx=0x7f0314006ae0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 msgr2=0x7f0320209190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:07.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f031d7fa700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03200b80a0 0x7f0320209190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.672 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:07.673 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:07.673 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:07.673 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:50:07.673 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:50:07.674 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:07.674 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:07.674 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:07.674 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:07.675 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.675 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:50:07.675 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:07.675 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:07.676 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:07.676 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.676 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.677 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.677 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.677 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.678 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.678 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.678 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.679 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.679 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.679 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:07.679 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:07.680 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.680 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.680 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.680 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.680 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.681 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.681 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.681 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.682 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.682 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.682 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:07.683 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:07.683 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:07.683 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:07.683 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:07.684 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:07.684 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:07.684 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:07.684 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:07.685 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:07.685 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:07.685 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:07.685 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:07.686 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:07.686 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:07.686 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:07.686 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.687 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.687 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.687 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.687 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.688 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.688 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.688 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.688 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.689 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.689 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:07.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.689 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:07.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.690 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:07.690 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:07.690 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.691 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.691 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.691 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:07.692 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:07.693 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.693 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.693 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.694 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:07.694 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:07.695 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.695 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.695 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.696 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:07.696 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:07.697 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.697 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.697 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.698 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:07.698 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.699 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:07.699 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.700 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:07.701 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:07.701 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.701 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.701 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.702 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:07.703 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:07.703 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.704 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:07.704 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.705 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.705 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:07.705 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.705 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.706 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.706 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:07.707 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:07.707 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.707 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.707 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.708 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.708 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.709 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:07.709 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:07.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.709 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.710 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.710 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:07.710 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.710 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.710 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:50:07.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.711 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.711 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.711 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:07.712 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.712 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.712 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:07.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.713 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.713 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.713 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:07.713 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.713 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.714 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.714 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:07.714 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0300065180 msgr2=0x7f0300067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f0326f75700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0300065180 0x7f0300067630 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f031800b370 tx=0x7f0318010000 comp rx=0 tx=0).stop 2022-08-10T17:50:07.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 msgr2=0x7f03200bfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f0326f75700 1 --2- 172.21.15.150:0/1012674494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f03200c3340 0x7f03200bfe70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f03100011e0 tx=0x7f031000c7e0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.666+0000 7f0325512700 1 -- 172.21.15.150:0/1012674494 reap_dead start 2022-08-10T17:50:07.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.667+0000 7f0325512700 1 -- 172.21.15.150:0/1012674494 reap_dead start 2022-08-10T17:50:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.667+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 shutdown_connections 2022-08-10T17:50:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.667+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 >> 172.21.15.150:0/1012674494 conn(0x7f032006b500 msgr2=0x7f0320164a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.667+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 shutdown_connections 2022-08-10T17:50:07.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.667+0000 7f0326f75700 1 -- 172.21.15.150:0/1012674494 wait complete. 2022-08-10T17:50:07.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:50:07.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.858+0000 7f392077a700 1 Processor -- start 2022-08-10T17:50:07.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.858+0000 7f392077a700 1 -- start start 2022-08-10T17:50:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.859+0000 7f392077a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3918154d20 0x7f39180c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.859+0000 7f392077a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180706a0 con 0x7f39180c3cd0 2022-08-10T17:50:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.859+0000 7f392077a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180c3820 con 0x7f39181550f0 2022-08-10T17:50:07.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.859+0000 7f392077a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391815ab50 con 0x7f3918154d20 2022-08-10T17:50:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3918154d20 0x7f39180c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3918154d20 0x7f39180c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42604/0 (socket says 172.21.15.150:42604) 2022-08-10T17:50:07.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 -- 172.21.15.150:0/3280645634 learned_addr learned my addr 172.21.15.150:0/3280645634 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:07.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47532799 0 0) 0x7f39180706a0 con 0x7f39180c3cd0 2022-08-10T17:50:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38fc003430 con 0x7f39180c3cd0 2022-08-10T17:50:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182345303 0 0) 0x7f39180c3820 con 0x7f39181550f0 2022-08-10T17:50:07.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39180706a0 con 0x7f39181550f0 2022-08-10T17:50:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 -- 172.21.15.150:0/3280645634 >> v1:172.21.15.197:6789/0 conn(0x7f39181550f0 legacy=0x7f39181653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 -- 172.21.15.150:0/3280645634 >> v1:172.21.15.150:6789/0 conn(0x7f39180c3cd0 legacy=0x7f391806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 -- 172.21.15.150:0/3280645634 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180c9ba0 con 0x7f3918154d20 2022-08-10T17:50:07.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.860+0000 7f391e516700 1 --2- 172.21.15.150:0/3280645634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3918154d20 0x7f39180c4980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3914006fd0 tx=0x7f3914009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b81f8acd5efb0c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.861+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140107b0 con 0x7f3918154d20 2022-08-10T17:50:07.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.861+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3914010910 con 0x7f3918154d20 2022-08-10T17:50:07.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.861+0000 7f391d514700 1 -- 172.21.15.150:0/3280645634 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914010cc0 con 0x7f3918154d20 2022-08-10T17:50:07.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.861+0000 7f392077a700 1 -- 172.21.15.150:0/3280645634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3918154d20 msgr2=0x7f39180c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.861+0000 7f392077a700 1 --2- 172.21.15.150:0/3280645634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3918154d20 0x7f39180c4980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3914006fd0 tx=0x7f3914009a60 comp rx=0 tx=0).stop 2022-08-10T17:50:07.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.863+0000 7f392077a700 1 -- 172.21.15.150:0/3280645634 shutdown_connections 2022-08-10T17:50:07.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.863+0000 7f392077a700 1 --2- 172.21.15.150:0/3280645634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3918154d20 0x7f39180c4980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.863+0000 7f392077a700 1 -- 172.21.15.150:0/3280645634 >> 172.21.15.150:0/3280645634 conn(0x7f391806aac0 msgr2=0x7f39180c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:07.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.867+0000 7f392077a700 1 -- 172.21.15.150:0/3280645634 shutdown_connections 2022-08-10T17:50:07.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.870+0000 7f392077a700 1 -- 172.21.15.150:0/3280645634 wait complete. 2022-08-10T17:50:07.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.872+0000 7f392077a700 1 Processor -- start 2022-08-10T17:50:07.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.872+0000 7f392077a700 1 -- start start 2022-08-10T17:50:07.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39181550f0 0x7f3918155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 0x7f39180b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39180b60f0 0x7f39180b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180b7e50 con 0x7f39181550f0 2022-08-10T17:50:07.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918150090 con 0x7f391814fc60 2022-08-10T17:50:07.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f392077a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39180c2440 con 0x7f39180b60f0 2022-08-10T17:50:07.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 0x7f39180b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 0x7f39180b7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53204/0 (socket says 172.21.15.150:53204) 2022-08-10T17:50:07.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 -- 172.21.15.150:0/2617858143 learned_addr learned my addr 172.21.15.150:0/2617858143 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:07.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39180b60f0 msgr2=0x7f39180b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f39180b60f0 0x7f39180b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39181550f0 msgr2=0x7f3918155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39181550f0 0x7f3918155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.873+0000 7f391dd15700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140093e0 con 0x7f391814fc60 2022-08-10T17:50:07.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f391dd15700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 0x7f39180b7910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f390800c3c0 tx=0x7f390800c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080052d0 con 0x7f391814fc60 2022-08-10T17:50:07.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39180c2160 con 0x7f391814fc60 2022-08-10T17:50:07.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908011590 con 0x7f391814fc60 2022-08-10T17:50:07.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908011940 con 0x7f391814fc60 2022-08-10T17:50:07.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.874+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391814f180 con 0x7f391814fc60 2022-08-10T17:50:07.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.875+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3908019030 con 0x7f391814fc60 2022-08-10T17:50:07.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.876+0000 7f390effd700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f39000650b0 0x7f3900067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.876+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3908081610 con 0x7f391814fc60 2022-08-10T17:50:07.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.876+0000 7f391e516700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f39000650b0 0x7f3900067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.876+0000 7f392077a700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 0x7f391814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.876+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918071e00 con 0x7f391806aac0 2022-08-10T17:50:07.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f391ed17700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 0x7f391814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f391e516700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f39000650b0 0x7f3900067560 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3914013040 tx=0x7f391400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f391ed17700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3918072890 con 0x7f391806aac0 2022-08-10T17:50:07.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f391ed17700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 0x7f391814f310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f39181554f0 tx=0x7f391000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910003cb0 con 0x7f391806aac0 2022-08-10T17:50:07.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3910003e10 con 0x7f391806aac0 2022-08-10T17:50:07.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 msgr2=0x7f391814f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.877+0000 7f390effd700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 0x7f391814f310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f39181554f0 tx=0x7f391000c7e0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.878+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 msgr2=0x7f391814f310 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:07.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.878+0000 7f390effd700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391806aac0 0x7f391814f310 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f39181554f0 tx=0x7f391000c7e0 comp rx=0 tx=0).stop 2022-08-10T17:50:07.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.885+0000 7f392077a700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 0x7f391820ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:07.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.885+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180c5c00 con 0x7f39180c3cd0 2022-08-10T17:50:07.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.886+0000 7f391ed17700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 0x7f391820ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:07.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.886+0000 7f391ed17700 1 -- 172.21.15.150:0/2617858143 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3918070100 con 0x7f39180c3cd0 2022-08-10T17:50:07.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.886+0000 7f391ed17700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 0x7f391820ce30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3910008fd0 tx=0x7f3910001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:07.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910025070 con 0x7f39180c3cd0 2022-08-10T17:50:07.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7f391001b040 con 0x7f39180c3cd0 2022-08-10T17:50:07.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 msgr2=0x7f391820ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 0x7f391820ce30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3910008fd0 tx=0x7f3910001330 comp rx=0 tx=0).stop 2022-08-10T17:50:07.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 msgr2=0x7f391820ce30 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:07.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.887+0000 7f390effd700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f39180c3cd0 0x7f391820ce30 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3910008fd0 tx=0x7f3910001330 comp rx=0 tx=0).stop 2022-08-10T17:50:07.894 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:07.894 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:07.895 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:07.895 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:50:07.895 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:50:07.895 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:07.896 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:07.896 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:07.896 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:07.896 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.896 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 15, 2022-08-10T17:50:07.897 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:07.897 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:07.897 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:07.897 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.898 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.898 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.898 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.898 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.899 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.899 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.899 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.900 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.900 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:07.900 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:07.900 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.900 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.901 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.901 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.901 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.901 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.902 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.902 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.902 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.902 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.903 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:07.903 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:07.903 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:07.903 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:07.904 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:07.904 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:07.904 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:07.904 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:07.905 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:07.905 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:07.905 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:07.905 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:07.906 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:07.906 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:07.906 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:07.906 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:07.906 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:07.907 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:07.907 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:07.907 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:07.907 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:07.908 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:07.908 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:07.908 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:07.908 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:07.908 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.909 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:07.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.909 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:07.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.910 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:07.910 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:07.910 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.910 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.911 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.911 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:07.911 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.912 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:07.912 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.913 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.913 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.913 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:07.914 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:07.914 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.914 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.914 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.915 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:07.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:07.915 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.916 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.916 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.916 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:07.917 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.917 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:07.918 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.918 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.918 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:07.919 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:07.919 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.919 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.920 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.920 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:07.920 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:07.921 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:07.921 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:07.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.921 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:07.922 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:07.922 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.922 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:07.923 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:07.923 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:07.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.923 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.924 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:07.924 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:07.924 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:07.924 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:07.925 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:07.925 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.925 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.926 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:07.926 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:07.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.926 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.927 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.927 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:07.927 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.927 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:50:07.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.928 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.928 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.928 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:07.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.929 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.929 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:50:07.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.930 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.930 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.930 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:50:07.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.930 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.931 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:07.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.931 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:50:07.931 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.932 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:07.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.932 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.933 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.933 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:07.933 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.933 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:07.933 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:50:07.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:07.934 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:07.934 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:07.934 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:50:07.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:07.935 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:07.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:07.935 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:07.935 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:07.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f39000650b0 msgr2=0x7f3900067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f39000650b0 0x7f3900067560 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3914013040 tx=0x7f391400f000 comp rx=0 tx=0).stop 2022-08-10T17:50:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 msgr2=0x7f39180b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 --2- 172.21.15.150:0/2617858143 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f391814fc60 0x7f39180b7910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f390800c3c0 tx=0x7f390800c780 comp rx=0 tx=0).stop 2022-08-10T17:50:07.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f391ed17700 1 -- 172.21.15.150:0/2617858143 reap_dead start 2022-08-10T17:50:07.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 shutdown_connections 2022-08-10T17:50:07.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 >> 172.21.15.150:0/2617858143 conn(0x7f3918154d20 msgr2=0x7f39180c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:07.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 shutdown_connections 2022-08-10T17:50:07.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:07.891+0000 7f392077a700 1 -- 172.21.15.150:0/2617858143 wait complete. 2022-08-10T17:50:07.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:50:08.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.108+0000 7fae85d79700 1 Processor -- start 2022-08-10T17:50:08.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.108+0000 7fae85d79700 1 -- start start 2022-08-10T17:50:08.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae85d79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae800c7220 0x7fae800c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae85d79700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800c2a60 con 0x7fae800c4d90 2022-08-10T17:50:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae85d79700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800699c0 con 0x7fae800c25c0 2022-08-10T17:50:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae85d79700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae800c5e10 con 0x7fae800c7220 2022-08-10T17:50:08.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae7f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fae800c4d90 0x7fae800c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55302/0 (socket says 172.21.15.150:55302) 2022-08-10T17:50:08.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae7f7fe700 1 -- 172.21.15.150:0/1178307908 learned_addr learned my addr 172.21.15.150:0/1178307908 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:08.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae7effd700 1 --2- 172.21.15.150:0/1178307908 >> v2:172.21.15.150:3300/0 conn(0x7fae800c7220 0x7fae800c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835730174 0 0) 0x7fae800c2a60 con 0x7fae800c4d90 2022-08-10T17:50:08.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.109+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c003430 con 0x7fae800c4d90 2022-08-10T17:50:08.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253666085 0 0) 0x7fae800699c0 con 0x7fae800c25c0 2022-08-10T17:50:08.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae800c2a60 con 0x7fae800c25c0 2022-08-10T17:50:08.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7effd700 1 -- 172.21.15.150:0/1178307908 >> v1:172.21.15.197:6789/0 conn(0x7fae800c25c0 legacy=0x7fae8006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7effd700 1 -- 172.21.15.150:0/1178307908 >> v1:172.21.15.150:6789/0 conn(0x7fae800c4d90 legacy=0x7fae800c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7effd700 1 -- 172.21.15.150:0/1178307908 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80068e40 con 0x7fae800c7220 2022-08-10T17:50:08.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7effd700 1 --2- 172.21.15.150:0/1178307908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c7220 0x7fae800c2080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae740096b0 tx=0x7fae740099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75af098f967ef2f0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740107b0 con 0x7fae800c7220 2022-08-10T17:50:08.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae74010910 con 0x7fae800c7220 2022-08-10T17:50:08.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.110+0000 7fae7e7fc700 1 -- 172.21.15.150:0/1178307908 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74010c80 con 0x7fae800c7220 2022-08-10T17:50:08.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 -- 172.21.15.150:0/1178307908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c7220 msgr2=0x7fae800c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 --2- 172.21.15.150:0/1178307908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c7220 0x7fae800c2080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae740096b0 tx=0x7fae740099c0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 -- 172.21.15.150:0/1178307908 shutdown_connections 2022-08-10T17:50:08.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 --2- 172.21.15.150:0/1178307908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c7220 0x7fae800c2080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 -- 172.21.15.150:0/1178307908 >> 172.21.15.150:0/1178307908 conn(0x7fae8006d0d0 msgr2=0x7fae800c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:08.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 -- 172.21.15.150:0/1178307908 shutdown_connections 2022-08-10T17:50:08.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.111+0000 7fae85d79700 1 -- 172.21.15.150:0/1178307908 wait complete. 2022-08-10T17:50:08.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.112+0000 7fae85d79700 1 Processor -- start 2022-08-10T17:50:08.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.112+0000 7fae85d79700 1 -- start start 2022-08-10T17:50:08.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 0x7fae8006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800c4d90 0x7fae8014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae800c7220 0x7fae8014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800bf1b0 con 0x7fae800c25c0 2022-08-10T17:50:08.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801f05e0 con 0x7fae800c7220 2022-08-10T17:50:08.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae85d79700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae801f45d0 con 0x7fae800c4d90 2022-08-10T17:50:08.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 0x7fae8006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 0x7fae8006fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42628/0 (socket says 172.21.15.150:42628) 2022-08-10T17:50:08.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 -- 172.21.15.150:0/4108656659 learned_addr learned my addr 172.21.15.150:0/4108656659 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:08.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7effd700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800c4d90 0x7fae8014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7ffff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae800c7220 0x7fae8014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800c4d90 msgr2=0x7fae8014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800c4d90 0x7fae8014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae800c7220 msgr2=0x7fae8014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fae800c7220 0x7fae8014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74009310 con 0x7fae800c25c0 2022-08-10T17:50:08.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.113+0000 7fae7f7fe700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 0x7fae8006fad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c3c0 tx=0x7fae70001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.114+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700072d0 con 0x7fae800c25c0 2022-08-10T17:50:08.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.114+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70007450 con 0x7fae800c25c0 2022-08-10T17:50:08.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.114+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae801f4890 con 0x7fae800c25c0 2022-08-10T17:50:08.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.114+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700057c0 con 0x7fae800c25c0 2022-08-10T17:50:08.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.114+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae800bf6e0 con 0x7fae800c25c0 2022-08-10T17:50:08.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.115+0000 7fae85d79700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 0x7fae801f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.115+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fae70019030 con 0x7fae800c25c0 2022-08-10T17:50:08.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.115+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800672f0 con 0x7fae801dcc50 2022-08-10T17:50:08.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.116+0000 7fae67fff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae600650e0 0x7fae60067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.116+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fae700813d0 con 0x7fae800c25c0 2022-08-10T17:50:08.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.116+0000 7fae7ffff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae600650e0 0x7fae60067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.116+0000 7fae7ffff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae600650e0 0x7fae60067590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae78001c90 tx=0x7fae78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.117+0000 7fae7effd700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 0x7fae801f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.117+0000 7fae7effd700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae800bf870 con 0x7fae801dcc50 2022-08-10T17:50:08.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.117+0000 7fae7effd700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 0x7fae801f0aa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fae740096b0 tx=0x7fae740045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.117+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74020070 con 0x7fae801dcc50 2022-08-10T17:50:08.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.118+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fae74011440 con 0x7fae801dcc50 2022-08-10T17:50:08.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.118+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 msgr2=0x7fae801f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.118+0000 7fae67fff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 0x7fae801f0aa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fae740096b0 tx=0x7fae740045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.118+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 msgr2=0x7fae801f0aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:08.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.118+0000 7fae67fff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae801dcc50 0x7fae801f0aa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.125+0000 7fae85d79700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 0x7fae801f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.125+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae80072890 con 0x7fae800aae90 2022-08-10T17:50:08.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.125+0000 7fae7effd700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 0x7fae801f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.125+0000 7fae7effd700 1 -- 172.21.15.150:0/4108656659 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fae800c2210 con 0x7fae800aae90 2022-08-10T17:50:08.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.125+0000 7fae7effd700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 0x7fae801f0fe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae74009a00 tx=0x7fae74010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7402c040 con 0x7fae800aae90 2022-08-10T17:50:08.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4378 (secure 0 0 0) 0x7fae74004370 con 0x7fae800aae90 2022-08-10T17:50:08.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 msgr2=0x7fae801f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 0x7fae801f0fe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae74009a00 tx=0x7fae74010000 comp rx=0 tx=0).stop 2022-08-10T17:50:08.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 msgr2=0x7fae801f0fe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:08.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae67fff700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fae800aae90 0x7fae801f0fe0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.137 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:08.137 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:08.137 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:08.137 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:50:08.138 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 116, 2022-08-10T17:50:08.138 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:08.138 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:08.138 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:08.139 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:08.139 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:08.139 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 15, 2022-08-10T17:50:08.139 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:08.140 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:08.140 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:08.140 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:08.140 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:08.140 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:08.141 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:08.141 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:08.141 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:08.141 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:08.142 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:08.142 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:08.142 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:08.142 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:08.143 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:08.143 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:08.143 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:08.143 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:08.143 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:08.144 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:08.144 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:08.144 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:08.144 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:08.145 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:08.145 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.145 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:08.145 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:08.146 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:08.146 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:08.146 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:08.146 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:08.147 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:08.147 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:08.147 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:08.147 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:08.148 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:08.148 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:08.148 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:08.148 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:08.149 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:08.149 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:08.149 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:08.149 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:08.150 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:08.150 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:08.150 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:08.150 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:08.151 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:08.151 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:08.151 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:08.151 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:08.152 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:08.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.152 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:08.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.152 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:08.153 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:08.153 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:08.153 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:08.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.154 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:08.154 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:08.154 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.155 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:08.155 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:08.155 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.155 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.156 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.156 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:08.156 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:08.157 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:08.157 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:08.157 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:08.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.158 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:08.158 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:08.158 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:08.158 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:08.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.159 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:08.159 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:08.159 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.160 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:08.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:08.160 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.161 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.161 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.161 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:08.161 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:08.162 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:08.162 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:08.162 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:08.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.163 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:08.163 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:08.163 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:08.164 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:08.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.164 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:08.164 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:08.165 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.165 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:08.165 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:08.166 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:08.166 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.166 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.167 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:08.167 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:08.167 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:08.167 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:08.167 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:08.168 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.168 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.168 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:08.169 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:08.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.169 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:08.169 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:08.169 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:08.170 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.170 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:08.170 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:08.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:08.171 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:08.171 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:08.171 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:08.171 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:08.171 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:08.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:08.172 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:08.172 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae600650e0 msgr2=0x7fae60067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fae600650e0 0x7fae60067590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae78001c90 tx=0x7fae78009040 comp rx=0 tx=0).stop 2022-08-10T17:50:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 msgr2=0x7fae8006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 --2- 172.21.15.150:0/4108656659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae800c25c0 0x7fae8006fad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c3c0 tx=0x7fae70001e70 comp rx=0 tx=0).stop 2022-08-10T17:50:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae7ffff700 1 -- 172.21.15.150:0/4108656659 reap_dead start 2022-08-10T17:50:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae7ffff700 1 -- 172.21.15.150:0/4108656659 reap_dead start 2022-08-10T17:50:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 shutdown_connections 2022-08-10T17:50:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 >> 172.21.15.150:0/4108656659 conn(0x7fae8006d0d0 msgr2=0x7fae801538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 shutdown_connections 2022-08-10T17:50:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.126+0000 7fae85d79700 1 -- 172.21.15.150:0/4108656659 wait complete. 2022-08-10T17:50:08.177 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:50:08.177 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:50:08.177 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:50:08.178 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:50:08.178 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:50:08.178 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:50:08.193 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:50:08.193 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:50:08.194 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:08.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.387+0000 7ff3c315b700 1 Processor -- start 2022-08-10T17:50:08.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.387+0000 7ff3c315b700 1 -- start start 2022-08-10T17:50:08.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.388+0000 7ff3c315b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc06ff60 0x7ff3bc06e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.388+0000 7ff3c315b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc152fc0 con 0x7ff3bc156d60 2022-08-10T17:50:08.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.388+0000 7ff3c315b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc157130 con 0x7ff3bc0bc590 2022-08-10T17:50:08.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.388+0000 7ff3c315b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc064bc0 con 0x7ff3bc06ff60 2022-08-10T17:50:08.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.388+0000 7ff3c0ef7700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7ff3bc156d60 legacy=0x7ff3bc153450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:08.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc06ff60 0x7ff3bc06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3c16f8700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7ff3bc0bc590 0x7ff3bc0644b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41680/0 (socket says 172.21.15.150:41680) 2022-08-10T17:50:08.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3c16f8700 1 -- 172.21.15.150:0/2867361583 learned_addr learned my addr 172.21.15.150:0/2867361583 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:08.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397094571 0 0) 0x7ff3bc157130 con 0x7ff3bc0bc590 2022-08-10T17:50:08.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a0003430 con 0x7ff3bc0bc590 2022-08-10T17:50:08.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1441951994 0 0) 0x7ff3a0003430 con 0x7ff3bc0bc590 2022-08-10T17:50:08.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc06ff60 msgr2=0x7ff3bc06e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:08.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc06ff60 0x7ff3bc06e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 >> v1:172.21.15.150:6789/0 conn(0x7ff3bc156d60 legacy=0x7ff3bc153450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:08.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc1561f0 con 0x7ff3bc0bc590 2022-08-10T17:50:08.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7ff3b40019f0 con 0x7ff3bc0bc590 2022-08-10T17:50:08.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 >> v1:172.21.15.197:6789/0 conn(0x7ff3bc0bc590 legacy=0x7ff3bc0644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3a0003880 0x7ff3a0003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3a00041f0 0x7ff3a00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0004eb0 0x7ff3a000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc064bc0 con 0x7ff3a0004eb0 2022-08-10T17:50:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a000bdd0 con 0x7ff3a00041f0 2022-08-10T17:50:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.389+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a000bf90 con 0x7ff3a0003880 2022-08-10T17:50:08.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.390+0000 7ff3c16f8700 1 -- 172.21.15.150:0/2867361583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0004eb0 msgr2=0x7ff3a000b890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.390+0000 7ff3c16f8700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0004eb0 0x7ff3a000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.390+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3a0003880 0x7ff3a0003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 -- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3a00041f0 msgr2=0x7ff3a00046d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3a00041f0 0x7ff3a00046d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 -- 172.21.15.150:0/2867361583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0004eb0 msgr2=0x7ff3a000b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:08.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0004eb0 0x7ff3a000b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 -- 172.21.15.150:0/2867361583 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0003430 con 0x7ff3a0003880 2022-08-10T17:50:08.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3a0003880 0x7ff3a0003c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009810 tx=0x7ff3a0005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82a0d73610a47ea server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0003ac0 con 0x7ff3a0003880 2022-08-10T17:50:08.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0003c20 con 0x7ff3a0003880 2022-08-10T17:50:08.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.391+0000 7ff3bb7fe700 1 -- 172.21.15.150:0/2867361583 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0005070 con 0x7ff3a0003880 2022-08-10T17:50:08.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 -- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3a0003880 msgr2=0x7ff3a0003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 --2- 172.21.15.150:0/2867361583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3a0003880 0x7ff3a0003c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009810 tx=0x7ff3a0005700 comp rx=0 tx=0).stop 2022-08-10T17:50:08.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c16f8700 1 -- 172.21.15.150:0/2867361583 reap_dead start 2022-08-10T17:50:08.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 -- 172.21.15.150:0/2867361583 shutdown_connections 2022-08-10T17:50:08.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 -- 172.21.15.150:0/2867361583 >> 172.21.15.150:0/2867361583 conn(0x7ff3bc0c92f0 msgr2=0x7ff3bc0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:08.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 -- 172.21.15.150:0/2867361583 shutdown_connections 2022-08-10T17:50:08.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.392+0000 7ff3c315b700 1 -- 172.21.15.150:0/2867361583 wait complete. 2022-08-10T17:50:08.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.393+0000 7ff3c315b700 1 Processor -- start 2022-08-10T17:50:08.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.393+0000 7ff3c315b700 1 -- start start 2022-08-10T17:50:08.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 0x7ff3bc0c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 0x7ff3bc142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc155250 con 0x7ff3a0003880 2022-08-10T17:50:08.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc135860 con 0x7ff3bc0c2380 2022-08-10T17:50:08.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c315b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc137d40 con 0x7ff3bc1547c0 2022-08-10T17:50:08.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c0ef7700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 msgr2=0x7ff3bc0c03c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:08.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.394+0000 7ff3c0ef7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 0x7ff3bc0c03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:08.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56878/0 (socket says 172.21.15.150:56878) 2022-08-10T17:50:08.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 0x7ff3bc142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 -- 172.21.15.150:0/1514215728 learned_addr learned my addr 172.21.15.150:0/1514215728 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:08.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 -- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 msgr2=0x7ff3bc142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 0x7ff3bc142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 -- 172.21.15.150:0/1514215728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 msgr2=0x7ff3bc0c03c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:08.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 0x7ff3bc0c03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 -- 172.21.15.150:0/1514215728 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0c8ca0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3bbfff700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 0x7ff3bc142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:08.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c16f8700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400ca70 tx=0x7ff3b400cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4004c70 con 0x7ff3bc1547c0 2022-08-10T17:50:08.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4004df0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4007350 con 0x7ff3bc1547c0 2022-08-10T17:50:08.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.395+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc0c8f80 con 0x7ff3bc1547c0 2022-08-10T17:50:08.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.396+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc1376f0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.396+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0bc3b0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.397+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff3b4010070 con 0x7ff3bc1547c0 2022-08-10T17:50:08.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.397+0000 7ff3b97fa700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 0x7ff3a4067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:08.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.398+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff3b40813e0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.398+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 0x7ff3a4067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:08.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.398+0000 7ff3c0ef7700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 0x7ff3a4067540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009810 tx=0x7ff3b0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:08.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.402+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff3b404f3c0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.710+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff3bc152c70 con 0x7ff3bc1547c0 2022-08-10T17:50:08.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.711+0000 7ff3b97fa700 1 -- 172.21.15.150:0/1514215728 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7ff3b40529e0 con 0x7ff3bc1547c0 2022-08-10T17:50:08.715 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:08.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 msgr2=0x7ff3a4067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 0x7ff3a4067540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009810 tx=0x7ff3b0008030 comp rx=0 tx=0).stop 2022-08-10T17:50:08.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 msgr2=0x7ff3bc135ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:08.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400ca70 tx=0x7ff3b400cd80 comp rx=0 tx=0).stop 2022-08-10T17:50:08.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 shutdown_connections 2022-08-10T17:50:08.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3a4065090 0x7ff3a4067540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3bc1547c0 0x7ff3bc135ce0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0003880 0x7ff3bc0c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 --2- 172.21.15.150:0/1514215728 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3bc0c2380 0x7ff3bc142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:08.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 >> 172.21.15.150:0/1514215728 conn(0x7ff3bc0c92f0 msgr2=0x7ff3bc06e080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:08.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 shutdown_connections 2022-08-10T17:50:08.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:08.713+0000 7ff3c315b700 1 -- 172.21.15.150:0/1514215728 wait complete. 2022-08-10T17:50:11.730 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:11.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.857+0000 7ff8fe44d700 1 Processor -- start 2022-08-10T17:50:11.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.858+0000 7ff8fe44d700 1 -- start start 2022-08-10T17:50:11.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff8f8150f50 0x7ff8f80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 0x7ff8f8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80c5ac0 con 0x7ff8f80c7d80 2022-08-10T17:50:11.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f815a860 con 0x7ff8f8150f50 2022-08-10T17:50:11.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fe44d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8070620 con 0x7ff8f8150b80 2022-08-10T17:50:11.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fc9ea700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 msgr2=0x7ff8f8156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:11.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8fc9ea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 0x7ff8f8156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:11.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:11.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56910/0 (socket says 172.21.15.150:56910) 2022-08-10T17:50:11.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.859+0000 7ff8f7fff700 1 -- 172.21.15.150:0/3930320239 learned_addr learned my addr 172.21.15.150:0/3930320239 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:11.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 -- 172.21.15.150:0/3930320239 >> v2:172.21.15.197:3300/0 conn(0x7ff8f8150f50 msgr2=0x7ff8f80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:11.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/3930320239 >> v2:172.21.15.197:3300/0 conn(0x7ff8f8150f50 0x7ff8f80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 -- 172.21.15.150:0/3930320239 >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 msgr2=0x7ff8f8156cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:11.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/3930320239 >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 0x7ff8f8156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 -- 172.21.15.150:0/3930320239 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80ca810 con 0x7ff8f8150b80 2022-08-10T17:50:11.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/3930320239 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8f808a160 tx=0x7ff8ec009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49fdf1b7d61a1809 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:11.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f6ffd700 1 -- 172.21.15.150:0/3930320239 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec004230 con 0x7ff8f8150b80 2022-08-10T17:50:11.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f6ffd700 1 -- 172.21.15.150:0/3930320239 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0043b0 con 0x7ff8f8150b80 2022-08-10T17:50:11.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.860+0000 7ff8f6ffd700 1 -- 172.21.15.150:0/3930320239 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011870 con 0x7ff8f8150b80 2022-08-10T17:50:11.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 -- 172.21.15.150:0/3930320239 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 msgr2=0x7ff8f80c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:11.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/3930320239 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8f808a160 tx=0x7ff8ec009a60 comp rx=0 tx=0).stop 2022-08-10T17:50:11.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 -- 172.21.15.150:0/3930320239 shutdown_connections 2022-08-10T17:50:11.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/3930320239 >> v2:172.21.15.150:3300/0 conn(0x7ff8f80c7d80 0x7ff8f8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/3930320239 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f8150b80 0x7ff8f80c42a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/3930320239 >> v2:172.21.15.197:3300/0 conn(0x7ff8f8150f50 0x7ff8f80c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 -- 172.21.15.150:0/3930320239 >> 172.21.15.150:0/3930320239 conn(0x7ff8f8071e40 msgr2=0x7ff8f806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:11.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 -- 172.21.15.150:0/3930320239 shutdown_connections 2022-08-10T17:50:11.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.861+0000 7ff8fe44d700 1 -- 172.21.15.150:0/3930320239 wait complete. 2022-08-10T17:50:11.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.863+0000 7ff8fe44d700 1 Processor -- start 2022-08-10T17:50:11.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.863+0000 7ff8fe44d700 1 -- start start 2022-08-10T17:50:11.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff8f8150b80 0x7ff8f814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 0x7ff8f81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f814dfc0 con 0x7ff8f8150f50 2022-08-10T17:50:11.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f814e380 con 0x7ff8f8150b80 2022-08-10T17:50:11.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.864+0000 7ff8fe44d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f814e8b0 con 0x7ff8f80c7d80 2022-08-10T17:50:11.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8fc9ea700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 msgr2=0x7ff8f81500a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:11.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8fc9ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 0x7ff8f81500a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:11.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:11.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:56918/0 (socket says 172.21.15.150:56918) 2022-08-10T17:50:11.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 -- 172.21.15.150:0/922494219 learned_addr learned my addr 172.21.15.150:0/922494219 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:11.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 -- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff8f8150b80 msgr2=0x7ff8f814fb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:11.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff8f8150b80 0x7ff8f814fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 -- 172.21.15.150:0/922494219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 msgr2=0x7ff8f81500a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:11.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 0x7ff8f81500a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:11.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.865+0000 7ff8f7fff700 1 -- 172.21.15.150:0/922494219 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0093e0 con 0x7ff8f80c7d80 2022-08-10T17:50:11.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8f7fff700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009aa0 tx=0x7ff8ec0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:11.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003720 con 0x7ff8f80c7d80 2022-08-10T17:50:11.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec027070 con 0x7ff8f80c7d80 2022-08-10T17:50:11.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f814db30 con 0x7ff8f80c7d80 2022-08-10T17:50:11.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81ed330 con 0x7ff8f80c7d80 2022-08-10T17:50:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.866+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003ae0 con 0x7ff8f80c7d80 2022-08-10T17:50:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.867+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d4005170 con 0x7ff8f80c7d80 2022-08-10T17:50:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.867+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff8ec032020 con 0x7ff8f80c7d80 2022-08-10T17:50:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.868+0000 7ff8f4ff9700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 0x7ff8d8067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:11.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.868+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff8ec08c8a0 con 0x7ff8f80c7d80 2022-08-10T17:50:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.868+0000 7ff8f77fe700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 0x7ff8d8067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.869+0000 7ff8f77fe700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 0x7ff8d8067510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8f814d180 tx=0x7ff8e8006a90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:11.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:11.873+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff8ec05a880 con 0x7ff8f80c7d80 2022-08-10T17:50:12.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.204+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff8d40059a0 con 0x7ff8f80c7d80 2022-08-10T17:50:12.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.204+0000 7ff8f4ff9700 1 -- 172.21.15.150:0/922494219 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7ff8ec05dea0 con 0x7ff8f80c7d80 2022-08-10T17:50:12.208 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:12.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 msgr2=0x7ff8d8067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:12.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 0x7ff8d8067510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8f814d180 tx=0x7ff8e8006a90 comp rx=0 tx=0).stop 2022-08-10T17:50:12.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 msgr2=0x7ff8f8159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:12.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009aa0 tx=0x7ff8ec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:12.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 shutdown_connections 2022-08-10T17:50:12.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8f8150f50 0x7ff8f81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:12.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8d8065060 0x7ff8d8067510 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:12.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff8f80c7d80 0x7ff8f8159ca0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:12.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 --2- 172.21.15.150:0/922494219 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff8f8150b80 0x7ff8f814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:12.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.206+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 >> 172.21.15.150:0/922494219 conn(0x7ff8f8071e40 msgr2=0x7ff8f80c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:12.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.207+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 shutdown_connections 2022-08-10T17:50:12.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:12.207+0000 7ff8fe44d700 1 -- 172.21.15.150:0/922494219 wait complete. 2022-08-10T17:50:15.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:15.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.372+0000 7f88ea4b7700 1 Processor -- start 2022-08-10T17:50:15.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.372+0000 7f88ea4b7700 1 -- start start 2022-08-10T17:50:15.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88ea4b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:15.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88ea4b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e4070620 con 0x7f88e4150b80 2022-08-10T17:50:15.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88ea4b7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40ca810 con 0x7f88e4150f50 2022-08-10T17:50:15.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88ea4b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e40c5ac0 con 0x7f88e41573d0 2022-08-10T17:50:15.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88e8a54700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 msgr2=0x7f88e41621f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:15.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88e8a54700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:15.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88e3fff700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f88e4150b80 legacy=0x7f88e40c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:15.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88e37fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f88e4150f50 0x7f88e4156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41750/0 (socket says 172.21.15.150:41750) 2022-08-10T17:50:15.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.373+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 learned_addr learned my addr 172.21.15.150:0/1547537229 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:15.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.574+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88e4150b80 legacy=0x7f88e40c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:15.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.574+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 msgr2=0x7f88e41621f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:15.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.574+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:50:15.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.975+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88e4150b80 legacy=0x7f88e40c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.975+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 msgr2=0x7f88e41621f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:15.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:15.975+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:50:16.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:16.776+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88e4150b80 legacy=0x7f88e40c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:16.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:16.776+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 msgr2=0x7f88e41621f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:16.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:16.776+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:50:18.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 msgr2=0x7f88e41621f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:18.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.150:3300/0 conn(0x7f88e41573d0 0x7f88e41621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.197:6789/0 conn(0x7f88e4150f50 legacy=0x7f88e4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88e4150b80 legacy=0x7f88e40c42a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e40c5ac0 con 0x7f88c4006130 2022-08-10T17:50:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4008c90 con 0x7f88c40035d0 2022-08-10T17:50:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:50:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.373+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:18.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:50:18.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:18.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:50:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.574+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:50:18.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:18.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:18.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:50:18.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:50:18.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:18.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:18.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:18.976+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:50:19.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:19.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:19.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:19.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:19.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:19.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:50:19.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:50:19.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:19.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:19.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:19.777+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:50:21.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 msgr2=0x7f88c4005a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c40035d0 0x7f88c4005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 msgr2=0x7f88c40085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> v2:172.21.15.197:3300/0 conn(0x7f88c4006130 0x7f88c40085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 reap_dead start 2022-08-10T17:50:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e4070010 con 0x7f88c4003a00 2022-08-10T17:50:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e4070620 con 0x7f88c4007cf0 2022-08-10T17:50:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e1ffb700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40c5ac0 con 0x7f88c400c070 2022-08-10T17:50:21.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88c4003a00 legacy=0x7f88c40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:21.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:21.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:50:21.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.373+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:21.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88c4003a00 legacy=0x7f88c40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:21.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:21.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:50:21.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:21.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:21.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.574+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:50:21.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88c4003a00 legacy=0x7f88c40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:21.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:21.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:21.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:21.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:21.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:21.975+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:50:22.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e3fff700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88c4003a00 legacy=0x7f88c40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:22.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:50:22.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:50:22.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:50:22.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.776+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:50:22.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.898+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419298369 0 0) 0x7f88e4070620 con 0x7f88c4007cf0 2022-08-10T17:50:22.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.898+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d0003430 con 0x7f88c4007cf0 2022-08-10T17:50:22.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033763258 0 0) 0x7f88d0003430 con 0x7f88c4007cf0 2022-08-10T17:50:22.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88c400e450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:22.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88c400e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:22.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.150:6789/0 conn(0x7f88c4003a00 legacy=0x7f88c40065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:22.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4010a50 con 0x7f88c4007cf0 2022-08-10T17:50:22.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f88d8001620 con 0x7f88c4007cf0 2022-08-10T17:50:22.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 >> v1:172.21.15.197:6789/0 conn(0x7f88c4007cf0 legacy=0x7f88c4008110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:22.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88d0003880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88d0003e90 0x7f88d00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d0004c10 0x7f88d0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40c5ac0 con 0x7f88d0004c10 2022-08-10T17:50:22.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d000ba50 con 0x7f88d0003e90 2022-08-10T17:50:22.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d000bc10 con 0x7f88c400c070 2022-08-10T17:50:22.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d0004c10 msgr2=0x7f88d0005080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:22.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e8a54700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d0004c10 0x7f88d0005080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:22.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88d0003e90 0x7f88d00046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.901+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88d0003880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 msgr2=0x7f88d0003880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:22.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88d0003880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:22.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d0004c10 msgr2=0x7f88d0005080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:22.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d0004c10 0x7f88d0005080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:22.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 -- 172.21.15.150:0/1547537229 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0003430 con 0x7f88d0003e90 2022-08-10T17:50:22.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e3fff700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88c400c070 0x7f88d0003880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:22.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.902+0000 7f88e37fe700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88d0003e90 0x7f88d00046d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88d8001d50 tx=0x7f88d0005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d13bc2a213889 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:22.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80047b0 con 0x7f88d0003e90 2022-08-10T17:50:22.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8004910 con 0x7f88d0003e90 2022-08-10T17:50:22.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88e2ffd700 1 -- 172.21.15.150:0/1547537229 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8004aa0 con 0x7f88d0003e90 2022-08-10T17:50:22.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 -- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88d0003e90 msgr2=0x7f88d00046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:22.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/1547537229 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88d0003e90 0x7f88d00046d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88d8001d50 tx=0x7f88d0005700 comp rx=0 tx=0).stop 2022-08-10T17:50:22.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88e8a54700 1 -- 172.21.15.150:0/1547537229 reap_dead start 2022-08-10T17:50:22.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 -- 172.21.15.150:0/1547537229 shutdown_connections 2022-08-10T17:50:22.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 -- 172.21.15.150:0/1547537229 >> 172.21.15.150:0/1547537229 conn(0x7f88e4071e40 msgr2=0x7f88e406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:22.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 -- 172.21.15.150:0/1547537229 shutdown_connections 2022-08-10T17:50:22.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.904+0000 7f88ea4b7700 1 -- 172.21.15.150:0/1547537229 wait complete. 2022-08-10T17:50:22.918 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.906+0000 7f88ea4b7700 1 Processor -- start 2022-08-10T17:50:22.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.906+0000 7f88ea4b7700 1 -- start start 2022-08-10T17:50:22.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 0x7f88e41480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 0x7f88e41485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41ef6d0 con 0x7f88e4154080 2022-08-10T17:50:22.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4154dc0 con 0x7f88e40682f0 2022-08-10T17:50:22.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88ea4b7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41eeac0 con 0x7f88e40686c0 2022-08-10T17:50:22.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e37fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 msgr2=0x7f88e41480b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:22.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 0x7f88e41480b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:22.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e3fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e8a54700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 0x7f88e41485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e3fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53380/0 (socket says 172.21.15.150:53380) 2022-08-10T17:50:22.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e8a54700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 0x7f88e41485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:57014/0 (socket says 172.21.15.150:57014) 2022-08-10T17:50:22.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.907+0000 7f88e3fff700 1 -- 172.21.15.150:0/415052946 learned_addr learned my addr 172.21.15.150:0/415052946 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:22.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 -- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 msgr2=0x7f88e41485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 0x7f88e41485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:22.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 -- 172.21.15.150:0/415052946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 msgr2=0x7f88e41480b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:22.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 0x7f88e41480b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:22.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 -- 172.21.15.150:0/415052946 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e41eeda0 con 0x7f88e40682f0 2022-08-10T17:50:22.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e3fff700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88d400bea0 tx=0x7f88d4005330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:22.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4019440 con 0x7f88e40682f0 2022-08-10T17:50:22.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4011070 con 0x7f88e40682f0 2022-08-10T17:50:22.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e41ef080 con 0x7f88e40682f0 2022-08-10T17:50:22.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4019800 con 0x7f88e40682f0 2022-08-10T17:50:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.908+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e4154810 con 0x7f88e40682f0 2022-08-10T17:50:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.909+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e41ef9b0 con 0x7f88e40682f0 2022-08-10T17:50:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.909+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f88d4019960 con 0x7f88e40682f0 2022-08-10T17:50:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.910+0000 7f88e0ff9700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 0x7f88c40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:22.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.910+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f88d4083a00 con 0x7f88e40682f0 2022-08-10T17:50:22.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.910+0000 7f88e37fe700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 0x7f88c40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:22.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.910+0000 7f88e37fe700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 0x7f88c40687d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88d801b000 tx=0x7f88d800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:22.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:22.916+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f88d4051890 con 0x7f88e40682f0 2022-08-10T17:50:23.260 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":118,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.251+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f88e41503a0 con 0x7f88e40682f0 2022-08-10T17:50:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.253+0000 7f88e0ff9700 1 -- 172.21.15.150:0/415052946 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f88d4058e60 con 0x7f88e40682f0 2022-08-10T17:50:23.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.259+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 msgr2=0x7f88c40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.259+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 0x7f88c40687d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88d801b000 tx=0x7f88d800a000 comp rx=0 tx=0).stop 2022-08-10T17:50:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.259+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 msgr2=0x7f88e41564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.259+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88d400bea0 tx=0x7f88d4005330 comp rx=0 tx=0).stop 2022-08-10T17:50:23.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 shutdown_connections 2022-08-10T17:50:23.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f88c4066320 0x7f88c40687d0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88d801b000 tx=0x7f88d800a000 comp rx=0 tx=0).stop 2022-08-10T17:50:23.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f88e40686c0 0x7f88e41485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f88e40682f0 0x7f88e41564f0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88d400bea0 tx=0x7f88d4005330 comp rx=0 tx=0).stop 2022-08-10T17:50:23.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 --2- 172.21.15.150:0/415052946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e4154080 0x7f88e41480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.260+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 >> 172.21.15.150:0/415052946 conn(0x7f88e4071e40 msgr2=0x7f88e40c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:23.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.261+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 shutdown_connections 2022-08-10T17:50:23.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.266+0000 7f88ea4b7700 1 -- 172.21.15.150:0/415052946 wait complete. 2022-08-10T17:50:23.289 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:50:23.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:50:23.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.443+0000 7ffb91e82700 1 Processor -- start 2022-08-10T17:50:23.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.443+0000 7ffb91e82700 1 -- start start 2022-08-10T17:50:23.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb91e82700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 0x7ffb8c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb91e82700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb91e82700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c06e070 con 0x7ffb8c0c8af0 2022-08-10T17:50:23.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb91e82700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c06ec10 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb91e82700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0c37c0 con 0x7ffb8c0c3340 2022-08-10T17:50:23.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8b7fe700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7ffb8c0c8af0 legacy=0x7ffb8c06e500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:23.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8affd700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 msgr2=0x7ffb8c0c8ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:23.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 0x7ffb8c0c8ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:23.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8bfff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8bfff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53394/0 (socket says 172.21.15.150:53394) 2022-08-10T17:50:23.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.444+0000 7ffb8bfff700 1 -- 172.21.15.150:0/980658348 learned_addr learned my addr 172.21.15.150:0/980658348 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:23.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8bfff700 1 -- 172.21.15.150:0/980658348 >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 msgr2=0x7ffb8c0c8ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:23.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8bfff700 1 --2- 172.21.15.150:0/980658348 >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 0x7ffb8c0c8ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8bfff700 1 -- 172.21.15.150:0/980658348 >> v1:172.21.15.150:6789/0 conn(0x7ffb8c0c8af0 legacy=0x7ffb8c06e500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:23.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8bfff700 1 -- 172.21.15.150:0/980658348 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0701c0 con 0x7ffb8c0c3340 2022-08-10T17:50:23.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8bfff700 1 --2- 172.21.15.150:0/980658348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06d760 tx=0x7ffb8400d480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff4eb475931c6421 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8a7fc700 1 -- 172.21.15.150:0/980658348 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840038a0 con 0x7ffb8c0c3340 2022-08-10T17:50:23.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8a7fc700 1 -- 172.21.15.150:0/980658348 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb84003a00 con 0x7ffb8c0c3340 2022-08-10T17:50:23.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.469+0000 7ffb8a7fc700 1 -- 172.21.15.150:0/980658348 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84003d90 con 0x7ffb8c0c3340 2022-08-10T17:50:23.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 -- 172.21.15.150:0/980658348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c3340 msgr2=0x7ffb8c0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 --2- 172.21.15.150:0/980658348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06d760 tx=0x7ffb8400d480 comp rx=0 tx=0).stop 2022-08-10T17:50:23.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 -- 172.21.15.150:0/980658348 shutdown_connections 2022-08-10T17:50:23.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 --2- 172.21.15.150:0/980658348 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0c4f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 --2- 172.21.15.150:0/980658348 >> v2:172.21.15.150:3300/0 conn(0x7ffb8c0c96b0 0x7ffb8c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 -- 172.21.15.150:0/980658348 >> 172.21.15.150:0/980658348 conn(0x7ffb8c06b500 msgr2=0x7ffb8c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:23.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 -- 172.21.15.150:0/980658348 shutdown_connections 2022-08-10T17:50:23.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.470+0000 7ffb91e82700 1 -- 172.21.15.150:0/980658348 wait complete. 2022-08-10T17:50:23.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.472+0000 7ffb91e82700 1 Processor -- start 2022-08-10T17:50:23.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.472+0000 7ffb91e82700 1 -- start start 2022-08-10T17:50:23.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb8c0c8af0 0x7ffb8c166410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 0x7ffb8c20d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0bda20 con 0x7ffb8c0c3340 2022-08-10T17:50:23.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c162fe0 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb91e82700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0c0570 con 0x7ffb8c0c8af0 2022-08-10T17:50:23.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb8b7fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c0c3340 msgr2=0x7ffb8c0bc9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:23.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.473+0000 7ffb8b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0bc9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:23.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 0x7ffb8c20d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb8c0c8af0 0x7ffb8c166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 0x7ffb8c20d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53400/0 (socket says 172.21.15.150:53400) 2022-08-10T17:50:23.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 learned_addr learned my addr 172.21.15.150:0/2536006026 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:23.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb8c0c8af0 msgr2=0x7ffb8c166410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb8c0c8af0 0x7ffb8c166410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c0c3340 msgr2=0x7ffb8c0bc9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:23.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c0c3340 0x7ffb8c0bc9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84007b10 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8affd700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ffb8c0c8af0 0x7ffb8c166410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:23.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb8bfff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 0x7ffb8c20d7f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb84004000 tx=0x7ffb84004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84026470 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb840265f0 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c1623d0 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.474+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840269a0 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.475+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c162990 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.475+0000 7ffb91e82700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 0x7ffb8c20dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.475+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0673d0 con 0x7ffb8c162b80 2022-08-10T17:50:23.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.476+0000 7ffb8b7fe700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 0x7ffb8c20dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.476+0000 7ffb8b7fe700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb8c163120 con 0x7ffb8c162b80 2022-08-10T17:50:23.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.476+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ffb84018020 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.476+0000 7ffb8b7fe700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 0x7ffb8c20dd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00b310 tx=0x7ffb7c00b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.476+0000 7ffb73fff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb6c065060 0x7ffb6c067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ffb84084de0 con 0x7ffb8c0c96b0 2022-08-10T17:50:23.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb8affd700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb6c065060 0x7ffb6c067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c003b20 con 0x7ffb8c162b80 2022-08-10T17:50:23.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ffb7c003c80 con 0x7ffb8c162b80 2022-08-10T17:50:23.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 msgr2=0x7ffb8c20dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 0x7ffb8c20dd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00b310 tx=0x7ffb7c00b6d0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 msgr2=0x7ffb8c20dd30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:23.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb73fff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c162b80 0x7ffb8c20dd30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.477+0000 7ffb8affd700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb6c065060 0x7ffb6c067510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0b9150 tx=0x7ffb80009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.484+0000 7ffb91e82700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 0x7ffb8c0be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.484+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c06de00 con 0x7ffb8c0c1ba0 2022-08-10T17:50:23.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.484+0000 7ffb8b7fe700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 0x7ffb8c0be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb8b7fe700 1 -- 172.21.15.150:0/2536006026 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ffb8c06d1c0 con 0x7ffb8c0c1ba0 2022-08-10T17:50:23.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb8b7fe700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 0x7ffb8c0be2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c013000 tx=0x7ffb7c005930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c011a70 con 0x7ffb8c0c1ba0 2022-08-10T17:50:23.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5021 (secure 0 0 0) 0x7ffb7c011bd0 con 0x7ffb8c0c1ba0 2022-08-10T17:50:23.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 msgr2=0x7ffb8c0be2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 0x7ffb8c0be2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c013000 tx=0x7ffb7c005930 comp rx=0 tx=0).stop 2022-08-10T17:50:23.499 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 msgr2=0x7ffb8c0be2d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:23.500 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:23.500 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:23.500 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:23.501 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:50:23.501 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 118, 2022-08-10T17:50:23.501 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:23.501 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:23.502 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:23.502 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.502 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:50:23.502 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:23.503 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:23.503 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:23.503 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.503 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.504 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.504 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.504 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.504 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.505 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.505 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.505 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.505 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.506 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:23.506 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:23.506 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.506 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.506 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.507 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.507 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.507 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.507 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.508 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.508 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.508 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.508 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:23.509 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:23.509 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:23.509 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:23.509 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:23.510 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:23.510 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:23.510 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:23.510 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:23.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:23.511 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:23.511 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:23.511 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:23.511 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:23.512 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:23.512 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:23.512 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.513 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.513 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.513 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.513 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.513 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.514 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.514 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.514 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.514 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.515 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:23.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.515 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:23.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.516 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:23.516 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:23.516 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.516 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.517 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.517 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:23.517 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.518 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.518 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:23.518 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.519 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.519 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.519 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:23.520 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:23.520 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.520 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.520 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.521 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:23.521 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:23.521 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.522 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.522 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.522 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:23.523 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.524 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:23.524 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.524 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.524 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.525 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:23.525 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:23.525 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.525 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.526 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.526 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:23.527 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:23.527 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.527 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.527 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.528 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:23.528 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.529 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:23.529 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.529 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.529 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.530 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:23.530 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:23.530 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.531 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.531 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.531 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.531 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.532 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:23.532 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:23.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.533 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.533 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.533 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:23.533 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.533 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.534 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:50:23.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.534 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.534 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.535 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:23.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.535 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.535 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:50:23.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.536 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.536 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.536 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:50:23.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.537 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.537 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:23.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.537 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:50:23.538 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.538 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:23.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.539 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.539 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.539 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:23.539 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.540 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.540 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:50:23.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.540 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.540 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.541 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:50:23.541 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.541 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.542 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:23.542 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:23.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.485+0000 7ffb73fff700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c1ba0 0x7ffb8c0be2d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb6c065060 msgr2=0x7ffb6c067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ffb6c065060 0x7ffb6c067510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0b9150 tx=0x7ffb80009060 comp rx=0 tx=0).stop 2022-08-10T17:50:23.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 msgr2=0x7ffb8c20d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 --2- 172.21.15.150:0/2536006026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ffb8c0c96b0 0x7ffb8c20d7f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb84004000 tx=0x7ffb84004950 comp rx=0 tx=0).stop 2022-08-10T17:50:23.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 reap_dead start 2022-08-10T17:50:23.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb8bfff700 1 -- 172.21.15.150:0/2536006026 reap_dead start 2022-08-10T17:50:23.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 shutdown_connections 2022-08-10T17:50:23.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 >> 172.21.15.150:0/2536006026 conn(0x7ffb8c06b500 msgr2=0x7ffb8c0c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:23.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 shutdown_connections 2022-08-10T17:50:23.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.486+0000 7ffb91e82700 1 -- 172.21.15.150:0/2536006026 wait complete. 2022-08-10T17:50:23.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:50:23.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.722+0000 7f6686cf8700 1 Processor -- start 2022-08-10T17:50:23.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.722+0000 7f6686cf8700 1 -- start start 2022-08-10T17:50:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6686cf8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6680151290 0x7f66800c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6686cf8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6686cf8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800c1f40 con 0x7f6680157780 2022-08-10T17:50:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6686cf8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800c7d90 con 0x7f6680151290 2022-08-10T17:50:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6686cf8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680069130 con 0x7f6680158170 2022-08-10T17:50:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6685295700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f6680157780 legacy=0x7f66800c2910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:23.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f667ffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6680151290 0x7f66800c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f667ffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:57042/0 (socket says 172.21.15.150:57042) 2022-08-10T17:50:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6680151290 0x7f66800c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53410/0 (socket says 172.21.15.150:53410) 2022-08-10T17:50:23.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f667ffff700 1 -- 172.21.15.150:0/3125182959 learned_addr learned my addr 172.21.15.150:0/3125182959 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 -- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 msgr2=0x7f6680068bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 -- 172.21.15.150:0/3125182959 >> v1:172.21.15.150:6789/0 conn(0x7f6680157780 legacy=0x7f66800c2910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:23.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 -- 172.21.15.150:0/3125182959 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c2220 con 0x7f6680151290 2022-08-10T17:50:23.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f667ffff700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:23.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.723+0000 7f6684a94700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680151290 0x7f66800c7850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66700096d0 tx=0x7f66700099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96385047bd5e7272 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f667f7fe700 1 -- 172.21.15.150:0/3125182959 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670005cb0 con 0x7f6680151290 2022-08-10T17:50:23.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f667f7fe700 1 -- 172.21.15.150:0/3125182959 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6670005e10 con 0x7f6680151290 2022-08-10T17:50:23.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f667f7fe700 1 -- 172.21.15.150:0/3125182959 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670004230 con 0x7f6680151290 2022-08-10T17:50:23.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 -- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680151290 msgr2=0x7f66800c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680151290 0x7f66800c7850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66700096d0 tx=0x7f66700099e0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 -- 172.21.15.150:0/3125182959 shutdown_connections 2022-08-10T17:50:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680151290 0x7f66800c7850 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 --2- 172.21.15.150:0/3125182959 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680158170 0x7f6680068bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 -- 172.21.15.150:0/3125182959 >> 172.21.15.150:0/3125182959 conn(0x7f668006f880 msgr2=0x7f668006fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:23.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 -- 172.21.15.150:0/3125182959 shutdown_connections 2022-08-10T17:50:23.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.724+0000 7f6686cf8700 1 -- 172.21.15.150:0/3125182959 wait complete. 2022-08-10T17:50:23.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.725+0000 7f6686cf8700 1 Processor -- start 2022-08-10T17:50:23.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.725+0000 7f6686cf8700 1 -- start start 2022-08-10T17:50:23.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680151290 0x7f668014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6680157780 0x7f66800cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800cc8c0 con 0x7f6680157780 2022-08-10T17:50:23.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800ccd00 con 0x7f6680158170 2022-08-10T17:50:23.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6686cf8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800cdba0 con 0x7f6680151290 2022-08-10T17:50:23.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f667ffff700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6680157780 msgr2=0x7f66800cba10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:23.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f667ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6680157780 0x7f66800cba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:23.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6685295700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6684a94700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680151290 0x7f668014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6684a94700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680151290 0x7f668014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:57046/0 (socket says 172.21.15.150:57046) 2022-08-10T17:50:23.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6685295700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53420/0 (socket says 172.21.15.150:53420) 2022-08-10T17:50:23.744 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.726+0000 7f6684a94700 1 -- 172.21.15.150:0/1259195192 learned_addr learned my addr 172.21.15.150:0/1259195192 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:23.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680151290 msgr2=0x7f668014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6680151290 0x7f668014a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6680157780 msgr2=0x7f66800cba10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:23.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6680157780 0x7f66800cba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680093e0 con 0x7f6680158170 2022-08-10T17:50:23.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6685295700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f667800bdf0 tx=0x7f6678009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780060d0 con 0x7f6680158170 2022-08-10T17:50:23.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678006250 con 0x7f6680158170 2022-08-10T17:50:23.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678006600 con 0x7f6680158170 2022-08-10T17:50:23.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700092b0 con 0x7f6680158170 2022-08-10T17:50:23.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.727+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66801edff0 con 0x7f6680158170 2022-08-10T17:50:23.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f6686cf8700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 0x7f66800c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800644b0 con 0x7f66801edba0 2022-08-10T17:50:23.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f6684a94700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 0x7f66800c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f6684a94700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66801ee180 con 0x7f66801edba0 2022-08-10T17:50:23.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f6684a94700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 0x7f66800c89c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6670015040 tx=0x7f66700045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.728+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f667801d070 con 0x7f6680158170 2022-08-10T17:50:23.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6664065090 0x7f6664067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f66780829d0 con 0x7f6680158170 2022-08-10T17:50:23.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667ffff700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6664065090 0x7f6664067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670003520 con 0x7f66801edba0 2022-08-10T17:50:23.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f6670003680 con 0x7f66801edba0 2022-08-10T17:50:23.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 msgr2=0x7f66800c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 0x7f66800c89c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6670015040 tx=0x7f66700045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 msgr2=0x7f66800c89c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:23.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667d7fa700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66801edba0 0x7f66800c89c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.729+0000 7f667ffff700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6664065090 0x7f6664067540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f668015aea0 tx=0x7f6668009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f6686cf8700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 0x7f6680157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:23.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680159a00 con 0x7f66800c7fc0 2022-08-10T17:50:23.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f6684a94700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 0x7f6680157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:23.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f6684a94700 1 -- 172.21.15.150:0/1259195192 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6680071e10 con 0x7f66800c7fc0 2022-08-10T17:50:23.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f6684a94700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 0x7f6680157110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6670023000 tx=0x7f6670008000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:23.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.736+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667002f070 con 0x7f66800c7fc0 2022-08-10T17:50:23.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4366 (secure 0 0 0) 0x7f66700129f0 con 0x7f66800c7fc0 2022-08-10T17:50:23.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 msgr2=0x7f6680157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f667d7fa700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 0x7f6680157110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6670023000 tx=0x7f6670008000 comp rx=0 tx=0).stop 2022-08-10T17:50:23.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f667d7fa700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 msgr2=0x7f6680157110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:23.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f667d7fa700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f66800c7fc0 0x7f6680157110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.754 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:23.754 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:23.755 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:23.755 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:50:23.755 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 118, 2022-08-10T17:50:23.755 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:23.756 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:23.756 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:23.756 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.756 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:50:23.756 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:23.757 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:23.757 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:23.757 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.757 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.758 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.758 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.758 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.758 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.759 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.759 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.759 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.759 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.760 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:23.760 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:23.760 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.760 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.761 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.761 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.761 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.761 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.761 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.762 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.762 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.762 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.762 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.763 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:23.763 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:23.763 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:23.763 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:23.764 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:23.764 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:23.764 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:23.764 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:23.765 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:23.765 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:23.765 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:23.765 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:23.765 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:23.766 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:23.766 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:23.766 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:23.766 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:23.767 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:23.767 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:23.767 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:23.767 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:23.767 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:23.768 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:23.768 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:23.768 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:23.768 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.769 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:23.769 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.769 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:23.769 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.770 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:23.770 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:23.770 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.770 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.771 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.771 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.771 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:23.771 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.771 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.772 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.772 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.772 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:23.772 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.773 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.773 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.773 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.773 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.774 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.775 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.775 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:23.775 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:23.775 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.776 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.776 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.776 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.776 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:23.776 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.777 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.777 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.777 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.777 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:23.778 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.778 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.778 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.778 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.779 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:23.779 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:23.779 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.779 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.779 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.780 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.780 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.780 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:23.780 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:23.781 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:23.781 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:23.781 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.781 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:23.781 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.782 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:23.783 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:23.783 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:23.783 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.783 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.783 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.784 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:23.784 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:23.784 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:23.784 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:23.785 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:23.785 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.785 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.785 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.785 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:23.786 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:23.786 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.786 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.786 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.787 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:23.787 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.787 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:23.787 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:23.787 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:23.788 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:23.788 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:23.788 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:23.788 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:23.789 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:23.789 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:23.789 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:23.789 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:23.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6664065090 msgr2=0x7f6664067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6664065090 0x7f6664067540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f668015aea0 tx=0x7f6668009190 comp rx=0 tx=0).stop 2022-08-10T17:50:23.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 msgr2=0x7f66800c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:23.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f667800bdf0 tx=0x7f6678009eb0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6685295700 1 -- 172.21.15.150:0/1259195192 reap_dead start 2022-08-10T17:50:23.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 shutdown_connections 2022-08-10T17:50:23.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 --2- 172.21.15.150:0/1259195192 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6680158170 0x7f66800c8480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:23.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 >> 172.21.15.150:0/1259195192 conn(0x7f668006f880 msgr2=0x7f66800c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:23.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 shutdown_connections 2022-08-10T17:50:23.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:23.737+0000 7f6686cf8700 1 -- 172.21.15.150:0/1259195192 wait complete. 2022-08-10T17:50:23.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:50:43.795 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:50:43.796 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:50:43.796 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:50:43.796 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:50:43.799 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:50:43.800 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:50:43.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:43.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.934+0000 7f0441937700 1 Processor -- start 2022-08-10T17:50:43.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.934+0000 7f0441937700 1 -- start start 2022-08-10T17:50:43.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.935+0000 7f0441937700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f043c0c3060 0x7f043c06ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:43.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.935+0000 7f0441937700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c06a3d0 con 0x7f043c0c7170 2022-08-10T17:50:43.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.935+0000 7f0441937700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c06fc90 con 0x7f043c06af70 2022-08-10T17:50:43.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.935+0000 7f0441937700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c070810 con 0x7f043c0c3060 2022-08-10T17:50:43.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.935+0000 7f043a7fc700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f043c0c7170 legacy=0x7f043c06a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:50:43.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043affd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f043c0c3060 0x7f043c06ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:43.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043b7fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f043c06af70 0x7f043c0c4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:41968/0 (socket says 172.21.15.150:41968) 2022-08-10T17:50:43.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043b7fe700 1 -- 172.21.15.150:0/210778129 learned_addr learned my addr 172.21.15.150:0/210778129 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:43.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043affd700 1 -- 172.21.15.150:0/210778129 >> v1:172.21.15.197:6789/0 conn(0x7f043c06af70 legacy=0x7f043c0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:43.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043affd700 1 -- 172.21.15.150:0/210778129 >> v1:172.21.15.150:6789/0 conn(0x7f043c0c7170 legacy=0x7f043c06a860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:50:43.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043affd700 1 -- 172.21.15.150:0/210778129 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c06ff70 con 0x7f043c0c3060 2022-08-10T17:50:43.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f043affd700 1 --2- 172.21.15.150:0/210778129 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c06ea50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f042c0096b0 tx=0x7f042c0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d123568509807875 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:43.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f0439ffb700 1 -- 172.21.15.150:0/210778129 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c004230 con 0x7f043c0c3060 2022-08-10T17:50:43.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f0439ffb700 1 -- 172.21.15.150:0/210778129 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c004390 con 0x7f043c0c3060 2022-08-10T17:50:43.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.936+0000 7f0439ffb700 1 -- 172.21.15.150:0/210778129 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c011870 con 0x7f043c0c3060 2022-08-10T17:50:43.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 -- 172.21.15.150:0/210778129 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 msgr2=0x7f043c06ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 --2- 172.21.15.150:0/210778129 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c06ea50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f042c0096b0 tx=0x7f042c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:50:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 -- 172.21.15.150:0/210778129 shutdown_connections 2022-08-10T17:50:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 --2- 172.21.15.150:0/210778129 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c06ea50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 -- 172.21.15.150:0/210778129 >> 172.21.15.150:0/210778129 conn(0x7f043c068be0 msgr2=0x7f043c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:43.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 -- 172.21.15.150:0/210778129 shutdown_connections 2022-08-10T17:50:43.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.937+0000 7f0441937700 1 -- 172.21.15.150:0/210778129 wait complete. 2022-08-10T17:50:43.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.938+0000 7f0441937700 1 Processor -- start 2022-08-10T17:50:43.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.938+0000 7f0441937700 1 -- start start 2022-08-10T17:50:43.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 0x7f043c148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0be980 con 0x7f043c0c7170 2022-08-10T17:50:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c151510 con 0x7f043c0c3060 2022-08-10T17:50:43.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c152590 con 0x7f043c06af70 2022-08-10T17:50:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043b7fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 msgr2=0x7f043c148680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:50:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 0x7f043c148680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:50:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:43.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043a7fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:43.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:57160/0 (socket says 172.21.15.150:57160) 2022-08-10T17:50:43.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 -- 172.21.15.150:0/2736459767 learned_addr learned my addr 172.21.15.150:0/2736459767 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:43.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 -- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 msgr2=0x7f043c148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:43.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:43.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 -- 172.21.15.150:0/2736459767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 msgr2=0x7f043c148680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:50:43.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 0x7f043c148680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:43.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 -- 172.21.15.150:0/2736459767 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c009310 con 0x7f043c06af70 2022-08-10T17:50:43.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043a7fc700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:43.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f043affd700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c011ea0 con 0x7f043c06af70 2022-08-10T17:50:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c01e070 con 0x7f043c06af70 2022-08-10T17:50:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0bf6d0 con 0x7f043c06af70 2022-08-10T17:50:43.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.939+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c003980 con 0x7f043c06af70 2022-08-10T17:50:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.940+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c150be0 con 0x7f043c06af70 2022-08-10T17:50:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.940+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c06f0a0 con 0x7f043c06af70 2022-08-10T17:50:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.941+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f042c02a020 con 0x7f043c06af70 2022-08-10T17:50:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.941+0000 7f0423fff700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 0x7f041c067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:43.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.941+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f042c083400 con 0x7f043c06af70 2022-08-10T17:50:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.941+0000 7f043a7fc700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 0x7f041c067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:43.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.942+0000 7f043a7fc700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 0x7f041c067540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f043c151990 tx=0x7f0430003af0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:43.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:43.946+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f042c0513e0 con 0x7f043c06af70 2022-08-10T17:50:44.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.325+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f043c069120 con 0x7f043c06af70 2022-08-10T17:50:44.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.326+0000 7f0423fff700 1 -- 172.21.15.150:0/2736459767 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7f042c020080 con 0x7f043c06af70 2022-08-10T17:50:44.330 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":118,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:44.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 msgr2=0x7f041c067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:44.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 0x7f041c067540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f043c151990 tx=0x7f0430003af0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 msgr2=0x7f043c1de5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:44.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 shutdown_connections 2022-08-10T17:50:44.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f043c0c7170 0x7f043c148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f041c065090 0x7f041c067540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f043c06af70 0x7f043c1de5f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 --2- 172.21.15.150:0/2736459767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f043c0c3060 0x7f043c148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:44.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 >> 172.21.15.150:0/2736459767 conn(0x7f043c068be0 msgr2=0x7f043c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:44.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 shutdown_connections 2022-08-10T17:50:44.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:44.328+0000 7f0441937700 1 -- 172.21.15.150:0/2736459767 wait complete. 2022-08-10T17:50:47.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:47.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 Processor -- start 2022-08-10T17:50:47.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 -- start start 2022-08-10T17:50:47.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f052806d850 0x7f05280c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05280c4410 0x7f05280c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280c39a0 con 0x7f052806d480 2022-08-10T17:50:47.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05280b0ff0 con 0x7f05280c4410 2022-08-10T17:50:47.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.473+0000 7f052e751700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052806e120 con 0x7f052806d850 2022-08-10T17:50:47.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05280c4410 0x7f05280c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0527fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f052806d480 0x7f05280b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55660/0 (socket says 172.21.15.150:55660) 2022-08-10T17:50:47.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0527fff700 1 -- 172.21.15.150:0/84305197 learned_addr learned my addr 172.21.15.150:0/84305197 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:47.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f05277fe700 1 --2- 172.21.15.150:0/84305197 >> v2:172.21.15.197:3300/0 conn(0x7f052806d850 0x7f05280c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 -- 172.21.15.150:0/84305197 >> v2:172.21.15.197:3300/0 conn(0x7f052806d850 msgr2=0x7f05280c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:47.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 --2- 172.21.15.150:0/84305197 >> v2:172.21.15.197:3300/0 conn(0x7f052806d850 0x7f05280c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 -- 172.21.15.150:0/84305197 >> v1:172.21.15.150:6789/0 conn(0x7f052806d480 legacy=0x7f05280b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 -- 172.21.15.150:0/84305197 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280c4d90 con 0x7f05280c4410 2022-08-10T17:50:47.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0526ffd700 1 -- 172.21.15.150:0/84305197 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378465479 0 0) 0x7f05280c39a0 con 0x7f052806d480 2022-08-10T17:50:47.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f052ccee700 1 --2- 172.21.15.150:0/84305197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05280c4410 0x7f05280c4850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f052806faf0 tx=0x7f052000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7096599f7b544256 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:47.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0526ffd700 1 -- 172.21.15.150:0/84305197 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000e070 con 0x7f05280c4410 2022-08-10T17:50:47.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0526ffd700 1 -- 172.21.15.150:0/84305197 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000bbd0 con 0x7f05280c4410 2022-08-10T17:50:47.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.474+0000 7f0526ffd700 1 -- 172.21.15.150:0/84305197 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520012430 con 0x7f05280c4410 2022-08-10T17:50:47.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 -- 172.21.15.150:0/84305197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05280c4410 msgr2=0x7f05280c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 --2- 172.21.15.150:0/84305197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05280c4410 0x7f05280c4850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f052806faf0 tx=0x7f052000b330 comp rx=0 tx=0).stop 2022-08-10T17:50:47.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 -- 172.21.15.150:0/84305197 shutdown_connections 2022-08-10T17:50:47.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 --2- 172.21.15.150:0/84305197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05280c4410 0x7f05280c4850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 --2- 172.21.15.150:0/84305197 >> v2:172.21.15.197:3300/0 conn(0x7f052806d850 0x7f05280c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 -- 172.21.15.150:0/84305197 >> 172.21.15.150:0/84305197 conn(0x7f052806b3b0 msgr2=0x7f052806fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:47.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 -- 172.21.15.150:0/84305197 shutdown_connections 2022-08-10T17:50:47.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.475+0000 7f052e751700 1 -- 172.21.15.150:0/84305197 wait complete. 2022-08-10T17:50:47.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 Processor -- start 2022-08-10T17:50:47.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 -- start start 2022-08-10T17:50:47.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f052806d850 0x7f052814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f05280c4410 0x7f05280690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052814ae60 con 0x7f052806d480 2022-08-10T17:50:47.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528150390 con 0x7f05280c4410 2022-08-10T17:50:47.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.476+0000 7f052e751700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0528150650 con 0x7f052806d850 2022-08-10T17:50:47.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42986/0 (socket says 172.21.15.150:42986) 2022-08-10T17:50:47.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 -- 172.21.15.150:0/4264575092 learned_addr learned my addr 172.21.15.150:0/4264575092 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:47.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f05277fe700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f052806d850 0x7f052814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 -- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f052806d850 msgr2=0x7f052814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f052806d850 0x7f052814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 -- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f05280c4410 msgr2=0x7f05280690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f052ccee700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f05280c4410 0x7f05280690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f05280c4410 0x7f05280690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 -- 172.21.15.150:0/4264575092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009a70 con 0x7f052806d480 2022-08-10T17:50:47.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0527fff700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f051800c410 tx=0x7f051800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:47.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180074e0 con 0x7f052806d480 2022-08-10T17:50:47.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05180046f0 con 0x7f052806d480 2022-08-10T17:50:47.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0528150930 con 0x7f052806d480 2022-08-10T17:50:47.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518004aa0 con 0x7f052806d480 2022-08-10T17:50:47.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.477+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0528150ef0 con 0x7f052806d480 2022-08-10T17:50:47.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.478+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0528072890 con 0x7f052806d480 2022-08-10T17:50:47.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.479+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f051801a020 con 0x7f052806d480 2022-08-10T17:50:47.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.479+0000 7f0524ff9700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 0x7f0508067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.479+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0518081de0 con 0x7f052806d480 2022-08-10T17:50:47.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.479+0000 7f05277fe700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 0x7f0508067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.480+0000 7f05277fe700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 0x7f0508067560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0528152320 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:47.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.484+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f051804fcd0 con 0x7f052806d480 2022-08-10T17:50:47.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.811+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f05280b0870 con 0x7f052806d480 2022-08-10T17:50:47.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.812+0000 7f0524ff9700 1 -- 172.21.15.150:0/4264575092 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f05180532f0 con 0x7f052806d480 2022-08-10T17:50:47.815 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:47.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.814+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 msgr2=0x7f0508067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.814+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 0x7f0508067560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0528152320 tx=0x7f051c008040 comp rx=0 tx=0).stop 2022-08-10T17:50:47.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.814+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 msgr2=0x7f0528068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.814+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f051800c410 tx=0x7f051800c7d0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 shutdown_connections 2022-08-10T17:50:47.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f05280c4410 0x7f05280690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f052806d480 0x7f0528068740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f05080650b0 0x7f0508067560 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 --2- 172.21.15.150:0/4264575092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f052806d850 0x7f052814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 >> 172.21.15.150:0/4264575092 conn(0x7f052806b3b0 msgr2=0x7f05280c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:47.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 shutdown_connections 2022-08-10T17:50:47.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.816+0000 7f052e751700 1 -- 172.21.15.150:0/4264575092 wait complete. 2022-08-10T17:50:47.832 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:50:47.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:50:47.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.965+0000 7fea82b17700 1 Processor -- start 2022-08-10T17:50:47.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.965+0000 7fea82b17700 1 -- start start 2022-08-10T17:50:47.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea82b17700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fea7c150c60 0x7fea7c0644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea82b17700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c06e220 con 0x7fea7c0c3c00 2022-08-10T17:50:47.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea82b17700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0682b0 con 0x7fea7c068f50 2022-08-10T17:50:47.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea82b17700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c068930 con 0x7fea7c150c60 2022-08-10T17:50:47.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea808b3700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fea7c150c60 0x7fea7c0644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea7bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fea7c0c3c00 0x7fea7c0c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55678/0 (socket says 172.21.15.150:55678) 2022-08-10T17:50:47.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea7bfff700 1 -- 172.21.15.150:0/743301436 learned_addr learned my addr 172.21.15.150:0/743301436 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:47.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.966+0000 7fea810b4700 1 --1- 172.21.15.150:0/743301436 >> v1:172.21.15.197:6789/0 conn(0x7fea7c068f50 0x7fea7c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:42026/0 (socket says 172.21.15.150:42026) 2022-08-10T17:50:47.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea7b7fe700 1 -- 172.21.15.150:0/743301436 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185040858 0 0) 0x7fea7c06e220 con 0x7fea7c0c3c00 2022-08-10T17:50:47.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea7b7fe700 1 -- 172.21.15.150:0/743301436 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea5c003430 con 0x7fea7c0c3c00 2022-08-10T17:50:47.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea808b3700 1 -- 172.21.15.150:0/743301436 >> v1:172.21.15.197:6789/0 conn(0x7fea7c068f50 legacy=0x7fea7c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:47.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea808b3700 1 -- 172.21.15.150:0/743301436 >> v1:172.21.15.150:6789/0 conn(0x7fea7c0c3c00 legacy=0x7fea7c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea808b3700 1 -- 172.21.15.150:0/743301436 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c06e750 con 0x7fea7c150c60 2022-08-10T17:50:47.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea808b3700 1 --2- 172.21.15.150:0/743301436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c0644b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea74009d90 tx=0x7fea7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c90ad9ccaa9e556 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:47.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea7b7fe700 1 -- 172.21.15.150:0/743301436 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400e070 con 0x7fea7c150c60 2022-08-10T17:50:47.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea7b7fe700 1 -- 172.21.15.150:0/743301436 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7400bae0 con 0x7fea7c150c60 2022-08-10T17:50:47.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.967+0000 7fea7b7fe700 1 -- 172.21.15.150:0/743301436 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400be90 con 0x7fea7c150c60 2022-08-10T17:50:47.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.968+0000 7fea82b17700 1 -- 172.21.15.150:0/743301436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 msgr2=0x7fea7c0644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.968+0000 7fea82b17700 1 --2- 172.21.15.150:0/743301436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c0644b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea74009d90 tx=0x7fea7400b330 comp rx=0 tx=0).stop 2022-08-10T17:50:47.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.982+0000 7fea82b17700 1 -- 172.21.15.150:0/743301436 shutdown_connections 2022-08-10T17:50:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.982+0000 7fea82b17700 1 --2- 172.21.15.150:0/743301436 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c0644b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.982+0000 7fea82b17700 1 -- 172.21.15.150:0/743301436 >> 172.21.15.150:0/743301436 conn(0x7fea7c0c9320 msgr2=0x7fea7c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:47.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.987+0000 7fea82b17700 1 -- 172.21.15.150:0/743301436 shutdown_connections 2022-08-10T17:50:47.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.987+0000 7fea82b17700 1 -- 172.21.15.150:0/743301436 wait complete. 2022-08-10T17:50:47.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.989+0000 7fea82b17700 1 Processor -- start 2022-08-10T17:50:47.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.989+0000 7fea82b17700 1 -- start start 2022-08-10T17:50:47.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea7c068f50 0x7fea7c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c13d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:47.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c156720 con 0x7fea7c0c3c00 2022-08-10T17:50:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c157f00 con 0x7fea7c150c60 2022-08-10T17:50:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea82b17700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c155ec0 con 0x7fea7c068f50 2022-08-10T17:50:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43006/0 (socket says 172.21.15.150:43006) 2022-08-10T17:50:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea7bfff700 1 -- 172.21.15.150:0/3228052187 learned_addr learned my addr 172.21.15.150:0/3228052187 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.990+0000 7fea810b4700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c13d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea7c068f50 msgr2=0x7fea7c142210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-08-10T17:50:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea7c068f50 0x7fea7c142210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 msgr2=0x7fea7c13d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c13d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea74009a70 con 0x7fea7c0c3c00 2022-08-10T17:50:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea810b4700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea7c150c60 0x7fea7c13d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:47.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea7bfff700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c390 tx=0x7fea64001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640072d0 con 0x7fea7c0c3c00 2022-08-10T17:50:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64007450 con 0x7fea7c0c3c00 2022-08-10T17:50:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640057c0 con 0x7fea7c0c3c00 2022-08-10T17:50:47.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c156160 con 0x7fea7c0c3c00 2022-08-10T17:50:48.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.991+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c157b90 con 0x7fea7c0c3c00 2022-08-10T17:50:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea82b17700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 0x7fea7c1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c071e00 con 0x7fea7c158290 2022-08-10T17:50:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea808b3700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 0x7fea7c1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fea64019030 con 0x7fea7c0c3c00 2022-08-10T17:50:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea808b3700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea7c158040 con 0x7fea7c158290 2022-08-10T17:50:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.993+0000 7fea808b3700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 0x7fea7c1f3a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea74009d90 tx=0x7fea74004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea600650b0 0x7fea60067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fea640814c0 con 0x7fea7c0c3c00 2022-08-10T17:50:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74004460 con 0x7fea7c158290 2022-08-10T17:50:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fea740045c0 con 0x7fea7c158290 2022-08-10T17:50:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 msgr2=0x7fea7c1f3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 0x7fea7c1f3a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea74009d90 tx=0x7fea74004950 comp rx=0 tx=0).stop 2022-08-10T17:50:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 msgr2=0x7fea7c1f3a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.994+0000 7fea797fa700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c158290 0x7fea7c1f3a20 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea74009d90 tx=0x7fea74004950 comp rx=0 tx=0).stop 2022-08-10T17:50:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.996+0000 7fea810b4700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea600650b0 0x7fea60067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:47.996+0000 7fea810b4700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea600650b0 0x7fea60067560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea6c006fd0 tx=0x7fea6c006e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.002+0000 7fea82b17700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 0x7fea7c14f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.002+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c1579f0 con 0x7fea7c142a60 2022-08-10T17:50:48.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.002+0000 7fea808b3700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 0x7fea7c14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.002+0000 7fea808b3700 1 -- 172.21.15.150:0/3228052187 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fea7c069c70 con 0x7fea7c142a60 2022-08-10T17:50:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea808b3700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 0x7fea7c14f110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea7c071140 tx=0x7fea74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7402c070 con 0x7fea7c142a60 2022-08-10T17:50:48.008 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7fea740047f0 con 0x7fea7c142a60 2022-08-10T17:50:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 msgr2=0x7fea7c14f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 0x7fea7c14f110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea7c071140 tx=0x7fea74009750 comp rx=0 tx=0).stop 2022-08-10T17:50:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 msgr2=0x7fea7c14f110 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.009 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea797fa700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c142a60 0x7fea7c14f110 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.010 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:48.010 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:48.010 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:48.010 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:50:48.011 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:50:48.011 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:48.011 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:48.011 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:48.012 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:48.012 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.012 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:50:48.012 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.012 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:48.013 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:48.013 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.013 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.014 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.014 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.014 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.015 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.015 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.016 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.016 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.016 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:48.017 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:48.017 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.018 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.019 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.019 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.019 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.020 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.020 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.020 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.021 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.021 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:48.022 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:48.022 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:48.023 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:48.023 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:48.023 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:48.023 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.024 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.024 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:48.024 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:48.024 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:48.024 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:48.025 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:48.025 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:48.025 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.026 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:48.026 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.026 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.026 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.027 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.027 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.027 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.027 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.028 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.028 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.028 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.028 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:48.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.029 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:48.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.029 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:48.030 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:48.030 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.030 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.031 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.031 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:48.031 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.032 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.032 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:48.032 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.033 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.033 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.033 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.033 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.034 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.034 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.034 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.035 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:48.035 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:48.035 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.036 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.036 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.036 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.036 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:48.036 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.037 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.037 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:48.038 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.038 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.038 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.038 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.039 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.039 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.039 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.039 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.040 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:48.040 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:48.041 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.041 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.041 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.041 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:48.042 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.042 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.043 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.044 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.046 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:48.046 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:48.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.046 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.046 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:48.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.048 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.048 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.048 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:50:48.048 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.049 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.049 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:48.049 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:48.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea600650b0 msgr2=0x7fea60067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea600650b0 0x7fea60067560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea6c006fd0 tx=0x7fea6c006e60 comp rx=0 tx=0).stop 2022-08-10T17:50:48.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 msgr2=0x7fea7c155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c390 tx=0x7fea64001e70 comp rx=0 tx=0).stop 2022-08-10T17:50:48.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea810b4700 1 -- 172.21.15.150:0/3228052187 reap_dead start 2022-08-10T17:50:48.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 shutdown_connections 2022-08-10T17:50:48.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 --2- 172.21.15.150:0/3228052187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea7c0c3c00 0x7fea7c155980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.003+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 >> 172.21.15.150:0/3228052187 conn(0x7fea7c0c9320 msgr2=0x7fea7c146140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.004+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 shutdown_connections 2022-08-10T17:50:48.053 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.004+0000 7fea82b17700 1 -- 172.21.15.150:0/3228052187 wait complete. 2022-08-10T17:50:48.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:50:48.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.193+0000 7f8a3229f700 1 Processor -- start 2022-08-10T17:50:48.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.193+0000 7f8a3229f700 1 -- start start 2022-08-10T17:50:48.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3229f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 0x7f8a2c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3229f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a2c0c3340 0x7f8a2c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3229f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c06e070 con 0x7f8a2c0c8af0 2022-08-10T17:50:48.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3229f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c06ec10 con 0x7f8a2c0c3340 2022-08-10T17:50:48.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3229f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c37c0 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a3083c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a2c0c3340 0x7f8a2c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a2bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a2c0c8af0 0x7f8a2c06e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55696/0 (socket says 172.21.15.150:55696) 2022-08-10T17:50:48.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a2bfff700 1 -- 172.21.15.150:0/2526987875 learned_addr learned my addr 172.21.15.150:0/2526987875 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:48.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/2526987875 >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 0x7f8a2c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.194+0000 7f8a2affd700 1 -- 172.21.15.150:0/2526987875 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171153090 0 0) 0x7f8a2c06e070 con 0x7f8a2c0c8af0 2022-08-10T17:50:48.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a2affd700 1 -- 172.21.15.150:0/2526987875 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a14003410 con 0x7f8a2c0c8af0 2022-08-10T17:50:48.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a3083c700 1 -- 172.21.15.150:0/2526987875 >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 msgr2=0x7f8a2c0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:48.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a3083c700 1 --2- 172.21.15.150:0/2526987875 >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 0x7f8a2c0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a3083c700 1 -- 172.21.15.150:0/2526987875 >> v1:172.21.15.150:6789/0 conn(0x7f8a2c0c8af0 legacy=0x7f8a2c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a3083c700 1 -- 172.21.15.150:0/2526987875 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0701c0 con 0x7f8a2c0c3340 2022-08-10T17:50:48.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/2526987875 >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 0x7f8a2c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-08-10T17:50:48.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.300+0000 7f8a3083c700 1 --2- 172.21.15.150:0/2526987875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c0c4f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06f5b0 tx=0x7f8a24009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1909c3743bd77883 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a2affd700 1 -- 172.21.15.150:0/2526987875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24015070 con 0x7f8a2c0c3340 2022-08-10T17:50:48.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a2affd700 1 -- 172.21.15.150:0/2526987875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2400aa20 con 0x7f8a2c0c3340 2022-08-10T17:50:48.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a2affd700 1 -- 172.21.15.150:0/2526987875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400abb0 con 0x7f8a2c0c3340 2022-08-10T17:50:48.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 -- 172.21.15.150:0/2526987875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 msgr2=0x7f8a2c0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 --2- 172.21.15.150:0/2526987875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c0c4f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06f5b0 tx=0x7f8a24009750 comp rx=0 tx=0).stop 2022-08-10T17:50:48.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 -- 172.21.15.150:0/2526987875 shutdown_connections 2022-08-10T17:50:48.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 --2- 172.21.15.150:0/2526987875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c0c4f10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 --2- 172.21.15.150:0/2526987875 >> v2:172.21.15.197:3300/0 conn(0x7f8a2c0c96b0 0x7f8a2c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.301+0000 7f8a3229f700 1 -- 172.21.15.150:0/2526987875 >> 172.21.15.150:0/2526987875 conn(0x7f8a2c06b500 msgr2=0x7f8a2c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.302+0000 7f8a3229f700 1 -- 172.21.15.150:0/2526987875 shutdown_connections 2022-08-10T17:50:48.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.302+0000 7f8a3229f700 1 -- 172.21.15.150:0/2526987875 wait complete. 2022-08-10T17:50:48.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.303+0000 7f8a3229f700 1 Processor -- start 2022-08-10T17:50:48.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.303+0000 7f8a3229f700 1 -- start start 2022-08-10T17:50:48.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c163df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a2c0c8af0 0x7f8a2c164330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 0x7f8a2c0bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0bbfa0 con 0x7f8a2c0c3340 2022-08-10T17:50:48.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c204280 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3229f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c203fb0 con 0x7f8a2c0c8af0 2022-08-10T17:50:48.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 0x7f8a2c0bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 0x7f8a2c0bc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53614/0 (socket says 172.21.15.150:53614) 2022-08-10T17:50:48.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 learned_addr learned my addr 172.21.15.150:0/4211444589 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:48.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a2bfff700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a2c0c8af0 0x7f8a2c164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a2c0c8af0 msgr2=0x7f8a2c164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a2c0c8af0 0x7f8a2c164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 msgr2=0x7f8a2c163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a2c0c3340 0x7f8a2c163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.304+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240099d0 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a3083c700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 0x7f8a2c0bc710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009fd0 tx=0x7f8a24004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24015030 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a24004450 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0b8de0 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240047e0 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.305+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0bc1f0 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.307+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8a24011450 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.307+0000 7f8a28ff9700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a0c0650b0 0x7f8a0c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8a24016070 con 0x7f8a2c0c96b0 2022-08-10T17:50:48.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a3229f700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 0x7f8a2c2046c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0673d0 con 0x7f8a2c0bcc50 2022-08-10T17:50:48.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 0x7f8a2c2046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a2b7fe700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a2c0bc410 con 0x7f8a2c0bcc50 2022-08-10T17:50:48.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.308+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 0x7f8a2c2046c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0c7ff0 tx=0x7f8a20009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a2bfff700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a0c0650b0 0x7f8a0c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20004230 con 0x7f8a2c0bcc50 2022-08-10T17:50:48.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f8a20004390 con 0x7f8a2c0bcc50 2022-08-10T17:50:48.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 msgr2=0x7f8a2c2046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 0x7f8a2c2046c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0c7ff0 tx=0x7f8a20009f20 comp rx=0 tx=0).stop 2022-08-10T17:50:48.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 msgr2=0x7f8a2c2046c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.309+0000 7f8a28ff9700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0bcc50 0x7f8a2c2046c0 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0c7ff0 tx=0x7f8a20009f20 comp rx=0 tx=0).stop 2022-08-10T17:50:48.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.312+0000 7f8a2bfff700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a0c0650b0 0x7f8a0c067560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0011e0 tx=0x7f8a1c007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a3229f700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 0x7f8a2c205000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b8f70 con 0x7f8a2c204c00 2022-08-10T17:50:48.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 0x7f8a2c205000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a2b7fe700 1 -- 172.21.15.150:0/4211444589 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8a2c072890 con 0x7f8a2c204c00 2022-08-10T17:50:48.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a2b7fe700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 0x7f8a2c205000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a20017000 tx=0x7f8a200045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.322+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20003bf0 con 0x7f8a2c204c00 2022-08-10T17:50:48.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f8a20003d50 con 0x7f8a2c204c00 2022-08-10T17:50:48.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 msgr2=0x7f8a2c205000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a28ff9700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 0x7f8a2c205000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a20017000 tx=0x7f8a200045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a28ff9700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 msgr2=0x7f8a2c205000 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a28ff9700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c204c00 0x7f8a2c205000 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a20017000 tx=0x7f8a200045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.345 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:48.346 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:48.346 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:48.346 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:50:48.347 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:50:48.347 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:48.347 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:48.348 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:48.348 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:48.348 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.349 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:50:48.349 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.349 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:48.350 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:48.350 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.351 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.351 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.351 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.352 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.352 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.353 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.353 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.354 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.354 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.355 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:48.355 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:48.356 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.356 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.356 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.357 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.357 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.358 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.358 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.359 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.359 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.360 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.360 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:48.360 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:48.361 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:48.361 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:48.361 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:48.361 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:48.362 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.362 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.362 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:48.362 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:48.363 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:48.363 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:48.363 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:48.363 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:48.364 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.364 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:48.364 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.364 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.365 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.365 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.365 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.365 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.365 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.366 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.366 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.366 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.366 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:48.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.367 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:48.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.367 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:48.367 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:48.368 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.368 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.369 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:48.369 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.370 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.370 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:48.370 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.370 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.370 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.371 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.372 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.372 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.372 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.372 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.373 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:48.373 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:48.373 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.374 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.374 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.375 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:48.375 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.376 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.376 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:48.376 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.376 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.377 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.377 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.377 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.378 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.378 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.378 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.379 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:48.379 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:48.380 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.380 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.380 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:48.381 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.381 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.382 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:48.382 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.382 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.382 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.383 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.383 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.383 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.383 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.384 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.384 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.384 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.385 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:48.385 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:48.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.385 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.385 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.386 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:48.386 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.386 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.386 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:50:48.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.387 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.387 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.387 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:48.388 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.388 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.388 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:50:48.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.388 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.389 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.389 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:50:48.389 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.389 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.390 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:48.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.390 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:50:48.390 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.391 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:48.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.391 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.391 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.392 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:50:48.392 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.392 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.392 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:50:48.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.393 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.393 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.393 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:50:48.394 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.394 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.394 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:48.395 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a0c0650b0 msgr2=0x7f8a0c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8a0c0650b0 0x7f8a0c067560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0011e0 tx=0x7f8a1c007c40 comp rx=0 tx=0).stop 2022-08-10T17:50:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 msgr2=0x7f8a2c0bc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 --2- 172.21.15.150:0/4211444589 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a2c0c96b0 0x7f8a2c0bc710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009fd0 tx=0x7f8a24004950 comp rx=0 tx=0).stop 2022-08-10T17:50:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 reap_dead start 2022-08-10T17:50:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3083c700 1 -- 172.21.15.150:0/4211444589 reap_dead start 2022-08-10T17:50:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 shutdown_connections 2022-08-10T17:50:48.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 >> 172.21.15.150:0/4211444589 conn(0x7f8a2c06b500 msgr2=0x7f8a2c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 shutdown_connections 2022-08-10T17:50:48.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.323+0000 7f8a3229f700 1 -- 172.21.15.150:0/4211444589 wait complete. 2022-08-10T17:50:48.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:50:48.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.547+0000 7f9685507700 1 Processor -- start 2022-08-10T17:50:48.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.547+0000 7f9685507700 1 -- start start 2022-08-10T17:50:48.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.548+0000 7f9685507700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f96800c4d90 0x7f96800c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.548+0000 7f9685507700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 0x7f96800c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.548+0000 7f9685507700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800699c0 con 0x7f96800c2080 2022-08-10T17:50:48.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.548+0000 7f9685507700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800c5e10 con 0x7f96800c7220 2022-08-10T17:50:48.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.548+0000 7f9685507700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800c1c30 con 0x7f96800c4d90 2022-08-10T17:50:48.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 0x7f96800c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f96800c2080 0x7f96800c2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55716/0 (socket says 172.21.15.150:55716) 2022-08-10T17:50:48.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967f7fe700 1 -- 172.21.15.150:0/3965949519 learned_addr learned my addr 172.21.15.150:0/3965949519 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:48.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 --2- 172.21.15.150:0/3965949519 >> v2:172.21.15.197:3300/0 conn(0x7f96800c4d90 0x7f96800c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 -- 172.21.15.150:0/3965949519 >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 msgr2=0x7f96800c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:48.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 --2- 172.21.15.150:0/3965949519 >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 0x7f96800c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 -- 172.21.15.150:0/3965949519 >> v1:172.21.15.150:6789/0 conn(0x7f96800c2080 legacy=0x7f96800c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 -- 172.21.15.150:0/3965949519 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680068e40 con 0x7f96800c4d90 2022-08-10T17:50:48.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967dffb700 1 -- 172.21.15.150:0/3965949519 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103337347 0 0) 0x7f96800699c0 con 0x7f96800c2080 2022-08-10T17:50:48.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967e7fc700 1 --2- 172.21.15.150:0/3965949519 >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 0x7f96800c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:50:48.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967effd700 1 --2- 172.21.15.150:0/3965949519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f96800c5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f968006e3f0 tx=0x7f9670009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2c313c8bfadf66 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.549+0000 7f967dffb700 1 -- 172.21.15.150:0/3965949519 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96700107b0 con 0x7f96800c4d90 2022-08-10T17:50:48.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f967dffb700 1 -- 172.21.15.150:0/3965949519 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670010910 con 0x7f96800c4d90 2022-08-10T17:50:48.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f967dffb700 1 -- 172.21.15.150:0/3965949519 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670010cc0 con 0x7f96800c4d90 2022-08-10T17:50:48.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 -- 172.21.15.150:0/3965949519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 msgr2=0x7f96800c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 --2- 172.21.15.150:0/3965949519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f96800c5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f968006e3f0 tx=0x7f9670009990 comp rx=0 tx=0).stop 2022-08-10T17:50:48.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 -- 172.21.15.150:0/3965949519 shutdown_connections 2022-08-10T17:50:48.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 --2- 172.21.15.150:0/3965949519 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f96800c5160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 --2- 172.21.15.150:0/3965949519 >> v2:172.21.15.150:3300/0 conn(0x7f96800c7220 0x7f96800c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.550+0000 7f9685507700 1 -- 172.21.15.150:0/3965949519 >> 172.21.15.150:0/3965949519 conn(0x7f968006d0d0 msgr2=0x7f96800c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.551+0000 7f9685507700 1 -- 172.21.15.150:0/3965949519 shutdown_connections 2022-08-10T17:50:48.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.551+0000 7f9685507700 1 -- 172.21.15.150:0/3965949519 wait complete. 2022-08-10T17:50:48.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.552+0000 7f9685507700 1 Processor -- start 2022-08-10T17:50:48.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.552+0000 7f9685507700 1 -- start start 2022-08-10T17:50:48.566 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 0x7f96801eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f968014c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96800c7220 0x7f96801568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.567 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96801eafb0 con 0x7f96800c2080 2022-08-10T17:50:48.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680155c40 con 0x7f96800c4d90 2022-08-10T17:50:48.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f9685507700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9680154de0 con 0x7f96800c7220 2022-08-10T17:50:48.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 0x7f96801eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 0x7f96801eaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43040/0 (socket says 172.21.15.150:43040) 2022-08-10T17:50:48.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 -- 172.21.15.150:0/146865290 learned_addr learned my addr 172.21.15.150:0/146865290 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:48.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967e7fc700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f968014c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967f7fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96800c7220 0x7f96801568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96800c7220 msgr2=0x7f96801568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f96800c7220 0x7f96801568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.570 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 msgr2=0x7f968014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f96800c4d90 0x7f968014c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.571 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.553+0000 7f967effd700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009310 con 0x7f96800c2080 2022-08-10T17:50:48.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f967effd700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 0x7f96801eaa70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9670013040 tx=0x7f96700045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670010a80 con 0x7f96800c2080 2022-08-10T17:50:48.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967001f070 con 0x7f96800c2080 2022-08-10T17:50:48.572 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9670009310 con 0x7f96800c2080 2022-08-10T17:50:48.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670004020 con 0x7f96800c2080 2022-08-10T17:50:48.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.554+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96801553a0 con 0x7f96800c2080 2022-08-10T17:50:48.573 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f9685507700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 0x7f9680156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9680157320 con 0x7f9680154880 2022-08-10T17:50:48.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f967e7fc700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 0x7f9680156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f967e7fc700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9680072890 con 0x7f9680154880 2022-08-10T17:50:48.574 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f967e7fc700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 0x7f9680156de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96800b5660 tx=0x7f9674011c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.555+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674004240 con 0x7f9680154880 2022-08-10T17:50:48.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f967000f070 con 0x7f96800c2080 2022-08-10T17:50:48.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96600650f0 0x7f96600675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.575 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9670021070 con 0x7f96800c2080 2022-08-10T17:50:48.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f967f7fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96600650f0 0x7f96600675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f96740043a0 con 0x7f9680154880 2022-08-10T17:50:48.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 msgr2=0x7f9680156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.576 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 0x7f9680156de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96800b5660 tx=0x7f9674011c80 comp rx=0 tx=0).stop 2022-08-10T17:50:48.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 msgr2=0x7f9680156de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.556+0000 7f96677fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680154880 0x7f9680156de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.557+0000 7f967f7fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96600650f0 0x7f96600675a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9680070200 tx=0x7f9678007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.565+0000 7f9685507700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 0x7f9680155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.565+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800672f0 con 0x7f9680155ea0 2022-08-10T17:50:48.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.565+0000 7f967e7fc700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 0x7f9680155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f967e7fc700 1 -- 172.21.15.150:0/146865290 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9680155a70 con 0x7f9680155ea0 2022-08-10T17:50:48.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f967e7fc700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 0x7f9680155530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96800b5660 tx=0x7f96740045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967401e450 con 0x7f9680155ea0 2022-08-10T17:50:48.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f9674024040 con 0x7f9680155ea0 2022-08-10T17:50:48.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 msgr2=0x7f9680155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 0x7f9680155530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96800b5660 tx=0x7f96740045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 msgr2=0x7f9680155530 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:48.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.566+0000 7f96677fe700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9680155ea0 0x7f9680155530 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96800b5660 tx=0x7f96740045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.582 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:48.582 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:48.582 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:48.583 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:50:48.583 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:50:48.583 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:48.583 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:48.584 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:48.584 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:48.584 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.584 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:50:48.584 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.585 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:48.585 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:48.585 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.585 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.586 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.586 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.586 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.586 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.587 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.587 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.587 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.587 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.588 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:48.588 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:48.588 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.588 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.588 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.589 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.589 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.589 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.589 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.590 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.590 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.591 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:48.591 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:48.591 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:48.592 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:48.592 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:48.592 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:48.592 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.593 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:48.593 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:48.594 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:48.594 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:48.595 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:48.595 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:48.595 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:48.595 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:48.596 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:48.596 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:48.596 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:48.597 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:48.597 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:48.597 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:48.597 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:48.597 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:48.598 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:48.598 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:48.598 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.599 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:48.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.599 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:48.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.600 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:48.600 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:48.600 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.600 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.601 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.601 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:48.601 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.602 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.602 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:48.603 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.603 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.603 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.604 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.604 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:48.604 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.604 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.604 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.605 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:48.606 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:48.606 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.606 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.607 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:48.607 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.608 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.608 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:48.608 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.608 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.609 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.609 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.609 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:48.610 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.610 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.610 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.611 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:48.611 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:48.611 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:48.612 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:48.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.612 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:48.612 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:48.613 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.613 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:48.614 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:48.614 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:48.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.614 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.615 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.615 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:48.615 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:48.615 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:48.616 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:48.616 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.616 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.617 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:48.617 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:48.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.617 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.617 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.618 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:48.618 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.618 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:48.619 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:48.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:48.619 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:48.619 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:48.620 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:48.620 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:48.620 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:48.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:48.621 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:48.621 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:48.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.567+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96600650f0 msgr2=0x7f96600675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.567+0000 7f9685507700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f96600650f0 0x7f96600675a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9680070200 tx=0x7f9678007f60 comp rx=0 tx=0).stop 2022-08-10T17:50:48.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.567+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 msgr2=0x7f96801eaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.567+0000 7f9685507700 1 --2- 172.21.15.150:0/146865290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96800c2080 0x7f96801eaa70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9670013040 tx=0x7f96700045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f967f7fe700 1 -- 172.21.15.150:0/146865290 reap_dead start 2022-08-10T17:50:48.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f967f7fe700 1 -- 172.21.15.150:0/146865290 reap_dead start 2022-08-10T17:50:48.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 shutdown_connections 2022-08-10T17:50:48.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 >> 172.21.15.150:0/146865290 conn(0x7f968006d0d0 msgr2=0x7f96800c2500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 shutdown_connections 2022-08-10T17:50:48.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.568+0000 7f9685507700 1 -- 172.21.15.150:0/146865290 wait complete. 2022-08-10T17:50:48.626 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:50:48.626 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:50:48.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.759+0000 7f083e44d700 1 Processor -- start 2022-08-10T17:50:48.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f083e44d700 1 -- start start 2022-08-10T17:50:48.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f083e44d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f083814ce90 0x7f0838156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f083e44d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08380c98f0 con 0x7f083806dc90 2022-08-10T17:50:48.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f083e44d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08380c4880 con 0x7f083806a760 2022-08-10T17:50:48.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f083e44d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08380c4e20 con 0x7f083814ce90 2022-08-10T17:50:48.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f0837fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f083814ce90 0x7f0838156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f08377fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f083806dc90 0x7f0838069910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55734/0 (socket says 172.21.15.150:55734) 2022-08-10T17:50:48.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.760+0000 7f08377fe700 1 -- 172.21.15.150:0/3804917324 learned_addr learned my addr 172.21.15.150:0/3804917324 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:48.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0837fff700 1 -- 172.21.15.150:0/3804917324 >> v1:172.21.15.197:6789/0 conn(0x7f083806a760 legacy=0x7f08380c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0837fff700 1 -- 172.21.15.150:0/3804917324 >> v1:172.21.15.150:6789/0 conn(0x7f083806dc90 legacy=0x7f0838069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0837fff700 1 -- 172.21.15.150:0/3804917324 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08380c4b40 con 0x7f083814ce90 2022-08-10T17:50:48.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0837fff700 1 --2- 172.21.15.150:0/3804917324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083814ce90 0x7f0838156b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f08200096b0 tx=0x7f08200099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832793ee2a25dedf server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0836ffd700 1 -- 172.21.15.150:0/3804917324 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820011830 con 0x7f083814ce90 2022-08-10T17:50:48.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0836ffd700 1 -- 172.21.15.150:0/3804917324 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820011990 con 0x7f083814ce90 2022-08-10T17:50:48.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f0836ffd700 1 -- 172.21.15.150:0/3804917324 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820011d40 con 0x7f083814ce90 2022-08-10T17:50:48.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f083e44d700 1 -- 172.21.15.150:0/3804917324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083814ce90 msgr2=0x7f0838156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f083e44d700 1 --2- 172.21.15.150:0/3804917324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083814ce90 0x7f0838156b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f08200096b0 tx=0x7f08200099c0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f083e44d700 1 -- 172.21.15.150:0/3804917324 shutdown_connections 2022-08-10T17:50:48.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f083e44d700 1 --2- 172.21.15.150:0/3804917324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083814ce90 0x7f0838156b60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.761+0000 7f083e44d700 1 -- 172.21.15.150:0/3804917324 >> 172.21.15.150:0/3804917324 conn(0x7f083806b500 msgr2=0x7f083806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:48.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.762+0000 7f083e44d700 1 -- 172.21.15.150:0/3804917324 shutdown_connections 2022-08-10T17:50:48.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.762+0000 7f083e44d700 1 -- 172.21.15.150:0/3804917324 wait complete. 2022-08-10T17:50:48.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.763+0000 7f083e44d700 1 Processor -- start 2022-08-10T17:50:48.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.763+0000 7f083e44d700 1 -- start start 2022-08-10T17:50:48.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f083806dc90 0x7f08381ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f083814ce90 0x7f08381e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083814f8a0 con 0x7f083806a760 2022-08-10T17:50:48.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08381e9bb0 con 0x7f083806dc90 2022-08-10T17:50:48.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083e44d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08381e6390 con 0x7f083814ce90 2022-08-10T17:50:48.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43060/0 (socket says 172.21.15.150:43060) 2022-08-10T17:50:48.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 -- 172.21.15.150:0/2705115720 learned_addr learned my addr 172.21.15.150:0/2705115720 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:48.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f08377fe700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f083806dc90 0x7f08381ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f083c9ea700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f083814ce90 0x7f08381e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 -- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f083814ce90 msgr2=0x7f08381e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f083814ce90 0x7f08381e6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 -- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f083806dc90 msgr2=0x7f08381ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:48.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f083806dc90 0x7f08381ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:48.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 -- 172.21.15.150:0/2705115720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009310 con 0x7f083806a760 2022-08-10T17:50:48.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0837fff700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08200090b0 tx=0x7f08200045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.764+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082001a7a0 con 0x7f083806a760 2022-08-10T17:50:48.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.765+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082001a900 con 0x7f083806a760 2022-08-10T17:50:48.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.765+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082001acb0 con 0x7f083806a760 2022-08-10T17:50:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.765+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08381e9860 con 0x7f083806a760 2022-08-10T17:50:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.765+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08381520d0 con 0x7f083806a760 2022-08-10T17:50:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.766+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08381e9e90 con 0x7f083806a760 2022-08-10T17:50:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.766+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f082002b030 con 0x7f083806a760 2022-08-10T17:50:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.766+0000 7f0834ff9700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 0x7f081c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.766+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f08200834d0 con 0x7f083806a760 2022-08-10T17:50:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.766+0000 7f08377fe700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 0x7f081c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.767+0000 7f08377fe700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 0x7f081c067560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f083814ce20 tx=0x7f0828009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:48.771+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f08200514b0 con 0x7f083806a760 2022-08-10T17:50:49.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.130+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0838072890 con 0x7f083806a760 2022-08-10T17:50:49.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.136+0000 7f0834ff9700 1 -- 172.21.15.150:0/2705115720 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f0820015080 con 0x7f083806a760 2022-08-10T17:50:49.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.141+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 msgr2=0x7f081c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:49.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.141+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 0x7f081c067560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f083814ce20 tx=0x7f0828009040 comp rx=0 tx=0).stop 2022-08-10T17:50:49.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.141+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 msgr2=0x7f083806e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:49.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.141+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08200090b0 tx=0x7f08200045d0 comp rx=0 tx=0).stop 2022-08-10T17:50:49.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 shutdown_connections 2022-08-10T17:50:49.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f081c0650b0 0x7f081c067560 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:49.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f083814ce90 0x7f08381e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:49.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f083806a760 0x7f083806e300 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:49.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 --2- 172.21.15.150:0/2705115720 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f083806dc90 0x7f08381ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:49.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 >> 172.21.15.150:0/2705115720 conn(0x7f083806b500 msgr2=0x7f08380c7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:49.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 shutdown_connections 2022-08-10T17:50:49.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:49.143+0000 7f083e44d700 1 -- 172.21.15.150:0/2705115720 wait complete. 2022-08-10T17:50:49.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:50:59.161 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:50:59.162 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:50:59.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.295+0000 7fd6d27a5700 1 Processor -- start 2022-08-10T17:50:59.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.295+0000 7fd6d27a5700 1 -- start start 2022-08-10T17:50:59.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d27a5700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd6cc0705d0 0x7fd6cc0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d27a5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d27a5700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0bf640 con 0x7fd6cc14d080 2022-08-10T17:50:59.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d27a5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc06c2b0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d27a5700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc156400 con 0x7fd6cc0705d0 2022-08-10T17:50:59.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43130/0 (socket says 172.21.15.150:43130) 2022-08-10T17:50:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 -- 172.21.15.150:0/2135679744 learned_addr learned my addr 172.21.15.150:0/2135679744 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6cb7fe700 1 --2- 172.21.15.150:0/2135679744 >> v2:172.21.15.197:3300/0 conn(0x7fd6cc0705d0 0x7fd6cc0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 -- 172.21.15.150:0/2135679744 >> v2:172.21.15.197:3300/0 conn(0x7fd6cc0705d0 msgr2=0x7fd6cc0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:50:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 --2- 172.21.15.150:0/2135679744 >> v2:172.21.15.197:3300/0 conn(0x7fd6cc0705d0 0x7fd6cc0c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 -- 172.21.15.150:0/2135679744 >> v1:172.21.15.197:6789/0 conn(0x7fd6cc14d080 legacy=0x7fd6cc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.296+0000 7fd6d0d42700 1 -- 172.21.15.150:0/2135679744 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc1566e0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d0d42700 1 --2- 172.21.15.150:0/2135679744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b92d0 tx=0x7fd6c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e28a28102e75ce0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6caffd700 1 -- 172.21.15.150:0/2135679744 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400e070 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6caffd700 1 -- 172.21.15.150:0/2135679744 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400b910 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6caffd700 1 -- 172.21.15.150:0/2135679744 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400bcc0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 -- 172.21.15.150:0/2135679744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c4d30 msgr2=0x7fd6cc0c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/2135679744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b92d0 tx=0x7fd6c400b330 comp rx=0 tx=0).stop 2022-08-10T17:50:59.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 -- 172.21.15.150:0/2135679744 shutdown_connections 2022-08-10T17:50:59.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/2135679744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc0c36d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/2135679744 >> v2:172.21.15.197:3300/0 conn(0x7fd6cc0705d0 0x7fd6cc0c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.310 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 -- 172.21.15.150:0/2135679744 >> 172.21.15.150:0/2135679744 conn(0x7fd6cc0c8a10 msgr2=0x7fd6cc0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:59.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 -- 172.21.15.150:0/2135679744 shutdown_connections 2022-08-10T17:50:59.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.297+0000 7fd6d27a5700 1 -- 172.21.15.150:0/2135679744 wait complete. 2022-08-10T17:50:59.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 Processor -- start 2022-08-10T17:50:59.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 -- start start 2022-08-10T17:50:59.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 0x7fd6cc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6cc14d080 0x7fd6cc149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14ccc0 con 0x7fd6cc0705d0 2022-08-10T17:50:59.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14ad80 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.299+0000 7fd6d27a5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14c9e0 con 0x7fd6cc14d080 2022-08-10T17:50:59.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 0x7fd6cc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 0x7fd6cc0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43132/0 (socket says 172.21.15.150:43132) 2022-08-10T17:50:59.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cbfff700 1 -- 172.21.15.150:0/3300455063 learned_addr learned my addr 172.21.15.150:0/3300455063 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:59.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6d0d42700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6cc14d080 0x7fd6cc149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 -- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6cc14d080 msgr2=0x7fd6cc149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6cc14d080 0x7fd6cc149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 -- 172.21.15.150:0/3300455063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 msgr2=0x7fd6cc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 0x7fd6cc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 -- 172.21.15.150:0/3300455063 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009b30 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6cb7fe700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc1494f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00e870 tx=0x7fd6bc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc013680 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0137e0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc013b50 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc14a450 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.300+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc14aa10 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.301+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc14abd0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.302+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd6bc019030 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.302+0000 7fd6c8ff9700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 0x7fd6ac067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.302+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd6bc081f10 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.302+0000 7fd6cbfff700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 0x7fd6ac067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.303+0000 7fd6cbfff700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 0x7fd6ac067560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001700 tx=0x7fd6c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.307+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd6bc04fef0 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.650+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd6cc072890 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.655 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:50:59.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.651+0000 7fd6c8ff9700 1 -- 172.21.15.150:0/3300455063 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fd6bc021020 con 0x7fd6cc0c4d30 2022-08-10T17:50:59.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 msgr2=0x7fd6ac067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 0x7fd6ac067560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001700 tx=0x7fd6c0009040 comp rx=0 tx=0).stop 2022-08-10T17:50:59.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 msgr2=0x7fd6cc1494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc1494f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00e870 tx=0x7fd6bc00eb80 comp rx=0 tx=0).stop 2022-08-10T17:50:59.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 shutdown_connections 2022-08-10T17:50:59.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6ac0650b0 0x7fd6ac067560 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6cc14d080 0x7fd6cc149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0705d0 0x7fd6cc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 --2- 172.21.15.150:0/3300455063 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6cc0c4d30 0x7fd6cc1494f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 >> 172.21.15.150:0/3300455063 conn(0x7fd6cc0c8a10 msgr2=0x7fd6cc0c4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:59.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 shutdown_connections 2022-08-10T17:50:59.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.653+0000 7fd6d27a5700 1 -- 172.21.15.150:0/3300455063 wait complete. 2022-08-10T17:50:59.669 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:50:59.670 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:50:59.670 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:50:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.808+0000 7fdef9266700 1 Processor -- start 2022-08-10T17:50:59.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.808+0000 7fdef9266700 1 -- start start 2022-08-10T17:50:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef9266700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fdef41572d0 0x7fdef4071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef9266700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40c89e0 con 0x7fdef40c80e0 2022-08-10T17:50:59.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef9266700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef40c8cc0 con 0x7fdef4150aa0 2022-08-10T17:50:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef9266700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef40c8fa0 con 0x7fdef41572d0 2022-08-10T17:50:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef27fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdef40c80e0 0x7fdef4156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55824/0 (socket says 172.21.15.150:55824) 2022-08-10T17:50:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef27fc700 1 -- 172.21.15.150:0/4075960718 learned_addr learned my addr 172.21.15.150:0/4075960718 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:50:59.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.809+0000 7fdef37fe700 1 --2- 172.21.15.150:0/4075960718 >> v2:172.21.15.197:3300/0 conn(0x7fdef41572d0 0x7fdef4071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef1ffb700 1 -- 172.21.15.150:0/4075960718 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105483935 0 0) 0x7fdef40c89e0 con 0x7fdef40c80e0 2022-08-10T17:50:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef1ffb700 1 -- 172.21.15.150:0/4075960718 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee0003430 con 0x7fdef40c80e0 2022-08-10T17:50:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef37fe700 1 -- 172.21.15.150:0/4075960718 >> v1:172.21.15.197:6789/0 conn(0x7fdef4150aa0 legacy=0x7fdef40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef37fe700 1 -- 172.21.15.150:0/4075960718 >> v1:172.21.15.150:6789/0 conn(0x7fdef40c80e0 legacy=0x7fdef4156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef37fe700 1 -- 172.21.15.150:0/4075960718 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40c9280 con 0x7fdef41572d0 2022-08-10T17:50:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef37fe700 1 --2- 172.21.15.150:0/4075960718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef41572d0 0x7fdef4071ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009d90 tx=0x7fdeec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a8a113792bdff4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef1ffb700 1 -- 172.21.15.150:0/4075960718 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00e070 con 0x7fdef41572d0 2022-08-10T17:50:59.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef1ffb700 1 -- 172.21.15.150:0/4075960718 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec00bb20 con 0x7fdef41572d0 2022-08-10T17:50:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.810+0000 7fdef1ffb700 1 -- 172.21.15.150:0/4075960718 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec012430 con 0x7fdef41572d0 2022-08-10T17:50:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 -- 172.21.15.150:0/4075960718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef41572d0 msgr2=0x7fdef4071ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 --2- 172.21.15.150:0/4075960718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef41572d0 0x7fdef4071ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009d90 tx=0x7fdeec00b330 comp rx=0 tx=0).stop 2022-08-10T17:50:59.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 -- 172.21.15.150:0/4075960718 shutdown_connections 2022-08-10T17:50:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 --2- 172.21.15.150:0/4075960718 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef41572d0 0x7fdef4071ba0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 -- 172.21.15.150:0/4075960718 >> 172.21.15.150:0/4075960718 conn(0x7fdef4068d60 msgr2=0x7fdef4071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 -- 172.21.15.150:0/4075960718 shutdown_connections 2022-08-10T17:50:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.811+0000 7fdef9266700 1 -- 172.21.15.150:0/4075960718 wait complete. 2022-08-10T17:50:59.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.812+0000 7fdef9266700 1 Processor -- start 2022-08-10T17:50:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.812+0000 7fdef9266700 1 -- start start 2022-08-10T17:50:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdef40c80e0 0x7fdef414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef4150aa0 0x7fdef414a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 0x7fdef4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40c51a0 con 0x7fdef41572d0 2022-08-10T17:50:59.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4157fd0 con 0x7fdef4150aa0 2022-08-10T17:50:59.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef9266700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4152fb0 con 0x7fdef40c80e0 2022-08-10T17:50:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 0x7fdef4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 0x7fdef4158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43152/0 (socket says 172.21.15.150:43152) 2022-08-10T17:50:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 learned_addr learned my addr 172.21.15.150:0/3293910050 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:50:59.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef27fc700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef4150aa0 0x7fdef414a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef2ffd700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdef40c80e0 0x7fdef414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdef40c80e0 msgr2=0x7fdef414a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdef40c80e0 0x7fdef414a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef4150aa0 msgr2=0x7fdef414a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdef4150aa0 0x7fdef414a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.813+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec009a70 con 0x7fdef41572d0 2022-08-10T17:50:59.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdef37fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 0x7fdef4158460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdef4070950 tx=0x7fdeec004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec004450 con 0x7fdef41572d0 2022-08-10T17:50:59.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec020070 con 0x7fdef41572d0 2022-08-10T17:50:59.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0047f0 con 0x7fdef41572d0 2022-08-10T17:50:59.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef41579a0 con 0x7fdef41572d0 2022-08-10T17:50:59.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.814+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef4153520 con 0x7fdef41572d0 2022-08-10T17:50:59.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdef9266700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 0x7fdef41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40673d0 con 0x7fdef41516d0 2022-08-10T17:50:59.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdef2ffd700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 0x7fdef41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdef2ffd700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdef41536b0 con 0x7fdef41516d0 2022-08-10T17:50:59.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdef2ffd700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 0x7fdef41589a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000f60 tx=0x7fdee400f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4017070 con 0x7fdef41516d0 2022-08-10T17:50:59.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.815+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdeec0125e0 con 0x7fdef41572d0 2022-08-10T17:50:59.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fded4065180 0x7fded4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdeec022070 con 0x7fdef41572d0 2022-08-10T17:50:59.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdef27fc700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fded4065180 0x7fded4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fdee40052e0 con 0x7fdef41516d0 2022-08-10T17:50:59.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 msgr2=0x7fdef41589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 0x7fdef41589a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000f60 tx=0x7fdee400f8d0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 msgr2=0x7fdef41589a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdedb7fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41516d0 0x7fdef41589a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.816+0000 7fdef27fc700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fded4065180 0x7fded4067630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdef40c0bd0 tx=0x7fdee8007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdef9266700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 0x7fdef4159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:50:59.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4158140 con 0x7fdef4157bc0 2022-08-10T17:50:59.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdef2ffd700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 0x7fdef4159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:50:59.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdef2ffd700 1 -- 172.21.15.150:0/3293910050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdef4072890 con 0x7fdef4157bc0 2022-08-10T17:50:59.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdef2ffd700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 0x7fdef4159a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdee4016000 tx=0x7fdee4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:50:59.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.823+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4006e70 con 0x7fdef4157bc0 2022-08-10T17:50:59.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4380 (secure 0 0 0) 0x7fdee4003710 con 0x7fdef4157bc0 2022-08-10T17:50:59.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 msgr2=0x7fdef4159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdedb7fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 0x7fdef4159a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdee4016000 tx=0x7fdee4001120 comp rx=0 tx=0).stop 2022-08-10T17:50:59.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdedb7fe700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 msgr2=0x7fdef4159a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:50:59.841 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdedb7fe700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef4157bc0 0x7fdef4159a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:50:59.841 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:50:59.841 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:50:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:50:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:50:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:50:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:50:59.843 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:50:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 13, 2022-08-10T17:50:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:59.844 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:50:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:50:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:59.845 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:59.846 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:59.847 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:50:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:50:59.848 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:59.849 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:59.850 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:50:59.851 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:50:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:50:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:50:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:50:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:50:59.852 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:50:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:50:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:50:59.853 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:50:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:50:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:50:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:50:59.854 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:50:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:50:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:50:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:50:59.855 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:50:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:50:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:50:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:50:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:50:59.856 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:50:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:50:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:50:59.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:50:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:50:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:50:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:59.859 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:50:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:50:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.861 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:50:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:50:59.862 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:50:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:50:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:59.864 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:50:59.865 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:50:59.866 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.867 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.867 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.867 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.867 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:50:59.868 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:50:59.868 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:59.868 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:59.868 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:59.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.869 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:50:59.869 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:50:59.870 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:50:59.870 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:50:59.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.870 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:50:59.870 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:50:59.871 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.871 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:50:59.872 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:50:59.872 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:50:59.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.872 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.872 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.873 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:50:59.873 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:50:59.873 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:50:59.873 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:50:59.874 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:50:59.874 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.874 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.875 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:50:59.875 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:50:59.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.875 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:59.875 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:59.876 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:50:59.876 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.876 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:50:59.876 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:50:59.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:50:59.877 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:50:59.877 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:50:59.877 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:50:59.878 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:50:59.878 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:50:59.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:50:59.878 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:50:59.878 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:50:59.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fded4065180 msgr2=0x7fded4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fded4065180 0x7fded4067630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdef40c0bd0 tx=0x7fdee8007c40 comp rx=0 tx=0).stop 2022-08-10T17:50:59.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 msgr2=0x7fdef4158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:50:59.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 --2- 172.21.15.150:0/3293910050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef41572d0 0x7fdef4158460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdef4070950 tx=0x7fdeec004950 comp rx=0 tx=0).stop 2022-08-10T17:50:59.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 reap_dead start 2022-08-10T17:50:59.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef37fe700 1 -- 172.21.15.150:0/3293910050 reap_dead start 2022-08-10T17:50:59.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 shutdown_connections 2022-08-10T17:50:59.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 >> 172.21.15.150:0/3293910050 conn(0x7fdef4068d60 msgr2=0x7fdef414c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:50:59.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 shutdown_connections 2022-08-10T17:50:59.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:50:59.824+0000 7fdef9266700 1 -- 172.21.15.150:0/3293910050 wait complete. 2022-08-10T17:50:59.883 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:51:00.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.037+0000 7fe129704700 1 Processor -- start 2022-08-10T17:51:00.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.037+0000 7fe129704700 1 -- start start 2022-08-10T17:51:00.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.038+0000 7fe129704700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe1240c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.038+0000 7fe129704700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe124153bd0 con 0x7fe12414d1c0 2022-08-10T17:51:00.070 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.038+0000 7fe129704700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe124153050 con 0x7fe1240c4b20 2022-08-10T17:51:00.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.038+0000 7fe129704700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe124153330 con 0x7fe12414cdf0 2022-08-10T17:51:00.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe1237fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe12414d1c0 0x7fe124156800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55844/0 (socket says 172.21.15.150:55844) 2022-08-10T17:51:00.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe1237fe700 1 -- 172.21.15.150:0/1743946502 learned_addr learned my addr 172.21.15.150:0/1743946502 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:51:00.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe122ffd700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe1240c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417762112 0 0) 0x7fe124153bd0 con 0x7fe12414d1c0 2022-08-10T17:51:00.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe110004540 con 0x7fe12414d1c0 2022-08-10T17:51:00.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187633715 0 0) 0x7fe124153050 con 0x7fe1240c4b20 2022-08-10T17:51:00.072 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe124153bd0 con 0x7fe1240c4b20 2022-08-10T17:51:00.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692108255 0 0) 0x7fe110004540 con 0x7fe12414d1c0 2022-08-10T17:51:00.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 msgr2=0x7fe1240c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:00.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe1240c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 >> v1:172.21.15.197:6789/0 conn(0x7fe1240c4b20 legacy=0x7fe1240c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.074 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124153610 con 0x7fe12414d1c0 2022-08-10T17:51:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fe11c0019f0 con 0x7fe12414d1c0 2022-08-10T17:51:00.075 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 >> v1:172.21.15.150:6789/0 conn(0x7fe12414d1c0 legacy=0x7fe124156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe110004b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1100050b0 0x7fe1100057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe110005d20 0x7fe110006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124153330 con 0x7fe110005d20 2022-08-10T17:51:00.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000cb30 con 0x7fe1100050b0 2022-08-10T17:51:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000ccc0 con 0x7fe12414cdf0 2022-08-10T17:51:00.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe122ffd700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe110004b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe1237fe700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe110005d20 0x7fe110006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.039+0000 7fe1227fc700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1100050b0 0x7fe1100057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 -- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1100050b0 msgr2=0x7fe1100057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1100050b0 0x7fe1100057e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 -- 172.21.15.150:0/1743946502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe110005d20 msgr2=0x7fe110006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:00.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe110005d20 0x7fe110006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 -- 172.21.15.150:0/1743946502 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110004540 con 0x7fe12414cdf0 2022-08-10T17:51:00.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe1237fe700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe110005d20 0x7fe110006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:51:00.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe122ffd700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe110004b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1140099d0 tx=0x7fe110006810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=634d66a54fe80a8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400e500 con 0x7fe12414cdf0 2022-08-10T17:51:00.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400e660 con 0x7fe12414cdf0 2022-08-10T17:51:00.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.040+0000 7fe121ffb700 1 -- 172.21.15.150:0/1743946502 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400e9f0 con 0x7fe12414cdf0 2022-08-10T17:51:00.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 -- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 msgr2=0x7fe110004b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 --2- 172.21.15.150:0/1743946502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414cdf0 0x7fe110004b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1140099d0 tx=0x7fe110006810 comp rx=0 tx=0).stop 2022-08-10T17:51:00.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe1237fe700 1 -- 172.21.15.150:0/1743946502 reap_dead start 2022-08-10T17:51:00.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 -- 172.21.15.150:0/1743946502 shutdown_connections 2022-08-10T17:51:00.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 -- 172.21.15.150:0/1743946502 >> 172.21.15.150:0/1743946502 conn(0x7fe12406aac0 msgr2=0x7fe1240c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:00.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 -- 172.21.15.150:0/1743946502 shutdown_connections 2022-08-10T17:51:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.041+0000 7fe129704700 1 -- 172.21.15.150:0/1743946502 wait complete. 2022-08-10T17:51:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.042+0000 7fe129704700 1 Processor -- start 2022-08-10T17:51:00.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.042+0000 7fe129704700 1 -- start start 2022-08-10T17:51:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 0x7fe1241e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe124148760 0x7fe1241e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414b300 0x7fe12414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12414bee0 con 0x7fe124148390 2022-08-10T17:51:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12414c6a0 con 0x7fe124148760 2022-08-10T17:51:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe129704700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12414bcb0 con 0x7fe12414b300 2022-08-10T17:51:00.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 0x7fe1241e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 0x7fe1241e5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43172/0 (socket says 172.21.15.150:43172) 2022-08-10T17:51:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe1227fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe124148760 0x7fe1241e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 -- 172.21.15.150:0/50252235 learned_addr learned my addr 172.21.15.150:0/50252235 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:00.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe1237fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414b300 0x7fe12414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414b300 msgr2=0x7fe12414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe12414b300 0x7fe12414b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe124148760 msgr2=0x7fe1241e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe124148760 0x7fe1241e5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1241efd00 con 0x7fe124148390 2022-08-10T17:51:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe1227fc700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe124148760 0x7fe1241e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:51:00.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.043+0000 7fe122ffd700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 0x7fe1241e5870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe11000ce50 tx=0x7fe114004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.044+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400e500 con 0x7fe124148390 2022-08-10T17:51:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.044+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114004430 con 0x7fe124148390 2022-08-10T17:51:00.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.044+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1241ef0f0 con 0x7fe124148390 2022-08-10T17:51:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.044+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114003950 con 0x7fe124148390 2022-08-10T17:51:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.044+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241ef6b0 con 0x7fe124148390 2022-08-10T17:51:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe129704700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 0x7fe1241ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12414bee0 con 0x7fe12406aac0 2022-08-10T17:51:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe1227fc700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 0x7fe1241ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe114019030 con 0x7fe124148390 2022-08-10T17:51:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe1227fc700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe124072890 con 0x7fe12406aac0 2022-08-10T17:51:00.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.045+0000 7fe1227fc700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 0x7fe1241ebab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe124068ee0 tx=0x7fe118012f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe1040650b0 0x7fe104067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe114082ee0 con 0x7fe124148390 2022-08-10T17:51:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe1237fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe1040650b0 0x7fe104067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118007030 con 0x7fe12406aac0 2022-08-10T17:51:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe118007190 con 0x7fe12406aac0 2022-08-10T17:51:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 msgr2=0x7fe1241ebab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 0x7fe1241ebab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe124068ee0 tx=0x7fe118012f60 comp rx=0 tx=0).stop 2022-08-10T17:51:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 msgr2=0x7fe1241ebab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe10b7fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe12406aac0 0x7fe1241ebab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.046+0000 7fe1237fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe1040650b0 0x7fe104067560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1240c9d50 tx=0x7fe11c007f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.057+0000 7fe129704700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 0x7fe1241ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.057+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124071e00 con 0x7fe1241ef870 2022-08-10T17:51:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.057+0000 7fe1227fc700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 0x7fe1241ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.057+0000 7fe1227fc700 1 -- 172.21.15.150:0/50252235 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe1240c14d0 con 0x7fe1241ef870 2022-08-10T17:51:00.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.057+0000 7fe1227fc700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 0x7fe1241ebff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe124071140 tx=0x7fe118007bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118006c50 con 0x7fe1241ef870 2022-08-10T17:51:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7fe118006db0 con 0x7fe1241ef870 2022-08-10T17:51:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 msgr2=0x7fe1241ebff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 0x7fe1241ebff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe124071140 tx=0x7fe118007bd0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 msgr2=0x7fe1241ebff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:00.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe10b7fe700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe1241ef870 0x7fe1241ebff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.099 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:00.100 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:00.100 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:00.100 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:51:00.101 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:51:00.101 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:00.101 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:00.101 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:51:00.102 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:51:00.102 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.102 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 13, 2022-08-10T17:51:00.102 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:00.103 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:00.103 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:00.104 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.104 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.104 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.104 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.105 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.105 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.105 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.105 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.106 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.106 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.107 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:00.107 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:00.108 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.108 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.109 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.109 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.109 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.109 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.109 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.110 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.110 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.110 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.111 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:00.111 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:00.111 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:00.111 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:00.112 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:00.112 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:00.112 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:00.112 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:00.113 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:00.115 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.115 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.115 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.115 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.115 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.116 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.116 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.116 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.116 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.117 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.117 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:00.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.117 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:00.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.118 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:00.118 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:00.118 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.118 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.119 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.119 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:00.119 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.120 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.120 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:00.121 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.121 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.121 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.121 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:00.122 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:00.122 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.122 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.122 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.123 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:00.123 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:00.124 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.124 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.124 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.125 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:00.125 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.126 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.126 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:00.126 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.126 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.126 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.127 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:00.127 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:00.127 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.128 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.128 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.129 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:00.129 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:00.129 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.129 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.130 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.130 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:00.130 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.131 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.131 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:00.131 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.132 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.132 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.132 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:00.133 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:00.133 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.133 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.133 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.133 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.134 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.134 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:00.134 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.136 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.136 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:51:00.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.136 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.137 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.137 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:51:00.137 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.137 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.138 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:00.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.138 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.138 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.138 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:51:00.139 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.139 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.139 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:00.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.140 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:51:00.140 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.140 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:00.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.141 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.141 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.141 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:51:00.141 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.142 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.142 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:51:00.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.143 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.143 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.143 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:51:00.144 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.144 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.144 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:00.145 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe1040650b0 msgr2=0x7fe104067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe1040650b0 0x7fe104067560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1240c9d50 tx=0x7fe11c007f40 comp rx=0 tx=0).stop 2022-08-10T17:51:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 msgr2=0x7fe1241e5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 --2- 172.21.15.150:0/50252235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe124148390 0x7fe1241e5870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe11000ce50 tx=0x7fe114004640 comp rx=0 tx=0).stop 2022-08-10T17:51:00.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe1237fe700 1 -- 172.21.15.150:0/50252235 reap_dead start 2022-08-10T17:51:00.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe1237fe700 1 -- 172.21.15.150:0/50252235 reap_dead start 2022-08-10T17:51:00.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 shutdown_connections 2022-08-10T17:51:00.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 >> 172.21.15.150:0/50252235 conn(0x7fe12414cdf0 msgr2=0x7fe1240c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:00.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 shutdown_connections 2022-08-10T17:51:00.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.058+0000 7fe129704700 1 -- 172.21.15.150:0/50252235 wait complete. 2022-08-10T17:51:00.149 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:51:00.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.315+0000 7f0d27e3b700 1 Processor -- start 2022-08-10T17:51:00.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.315+0000 7f0d27e3b700 1 -- start start 2022-08-10T17:51:00.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d27e3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0d20068820 0x7f0d20162370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d27e3b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200c6100 con 0x7f0d201544c0 2022-08-10T17:51:00.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d27e3b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200c5e00 con 0x7f0d201540f0 2022-08-10T17:51:00.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d27e3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200c5270 con 0x7f0d20068820 2022-08-10T17:51:00.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d253d6700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0d201544c0 0x7f0d20068110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:55866/0 (socket says 172.21.15.150:55866) 2022-08-10T17:51:00.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d253d6700 1 -- 172.21.15.150:0/2365498693 learned_addr learned my addr 172.21.15.150:0/2365498693 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:51:00.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.316+0000 7f0d263d8700 1 --2- 172.21.15.150:0/2365498693 >> v2:172.21.15.150:3300/0 conn(0x7f0d20068820 0x7f0d20162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063267356 0 0) 0x7f0d200c5e00 con 0x7f0d201540f0 2022-08-10T17:51:00.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003430 con 0x7f0d201540f0 2022-08-10T17:51:00.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d263d8700 1 -- 172.21.15.150:0/2365498693 >> v1:172.21.15.197:6789/0 conn(0x7f0d201540f0 legacy=0x7f0d20071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d263d8700 1 -- 172.21.15.150:0/2365498693 >> v1:172.21.15.150:6789/0 conn(0x7f0d201544c0 legacy=0x7f0d20068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222237536 0 0) 0x7f0d200c6100 con 0x7f0d201544c0 2022-08-10T17:51:00.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d263d8700 1 -- 172.21.15.150:0/2365498693 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006eb00 con 0x7f0d20068820 2022-08-10T17:51:00.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d263d8700 1 --2- 172.21.15.150:0/2365498693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d20068820 0x7f0d20162370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d90 tx=0x7f0d1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743d93379c23b405 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800e070 con 0x7f0d20068820 2022-08-10T17:51:00.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800bb20 con 0x7f0d20068820 2022-08-10T17:51:00.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.317+0000 7f0d24bd5700 1 -- 172.21.15.150:0/2365498693 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800bed0 con 0x7f0d20068820 2022-08-10T17:51:00.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 -- 172.21.15.150:0/2365498693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d20068820 msgr2=0x7f0d20162370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/2365498693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d20068820 0x7f0d20162370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d90 tx=0x7f0d1800b330 comp rx=0 tx=0).stop 2022-08-10T17:51:00.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 -- 172.21.15.150:0/2365498693 shutdown_connections 2022-08-10T17:51:00.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/2365498693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d20068820 0x7f0d20162370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 -- 172.21.15.150:0/2365498693 >> 172.21.15.150:0/2365498693 conn(0x7f0d2006d0d0 msgr2=0x7f0d200c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:00.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 -- 172.21.15.150:0/2365498693 shutdown_connections 2022-08-10T17:51:00.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.318+0000 7f0d27e3b700 1 -- 172.21.15.150:0/2365498693 wait complete. 2022-08-10T17:51:00.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.319+0000 7f0d27e3b700 1 Processor -- start 2022-08-10T17:51:00.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.319+0000 7f0d27e3b700 1 -- start start 2022-08-10T17:51:00.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d20068820 0x7f0d20150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 0x7f0d200c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d201544c0 0x7f0d2015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014fb90 con 0x7f0d201540f0 2022-08-10T17:51:00.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014eae0 con 0x7f0d201544c0 2022-08-10T17:51:00.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d27e3b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201500b0 con 0x7f0d20068820 2022-08-10T17:51:00.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 0x7f0d200c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 0x7f0d200c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43192/0 (socket says 172.21.15.150:43192) 2022-08-10T17:51:00.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 -- 172.21.15.150:0/3140446362 learned_addr learned my addr 172.21.15.150:0/3140446362 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:00.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d25bd7700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d20068820 0x7f0d20150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d263d8700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d201544c0 0x7f0d2015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d20068820 msgr2=0x7f0d20150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d20068820 0x7f0d20150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d201544c0 msgr2=0x7f0d2015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0d201544c0 0x7f0d2015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.320+0000 7f0d253d6700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18009a70 con 0x7f0d201540f0 2022-08-10T17:51:00.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d253d6700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 0x7f0d200c8b20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c410 tx=0x7f0d1000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100072d0 con 0x7f0d201540f0 2022-08-10T17:51:00.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10007450 con 0x7f0d201540f0 2022-08-10T17:51:00.336 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d200be770 con 0x7f0d201540f0 2022-08-10T17:51:00.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100075c0 con 0x7f0d201540f0 2022-08-10T17:51:00.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.321+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2014f010 con 0x7f0d201540f0 2022-08-10T17:51:00.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 0x7f0d201584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200672f0 con 0x7f0d2014f2f0 2022-08-10T17:51:00.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d25bd7700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 0x7f0d201584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d25bd7700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d20064640 con 0x7f0d2014f2f0 2022-08-10T17:51:00.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d25bd7700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 0x7f0d201584e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c001010 tx=0x7f0d1c00f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.322+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0d1001a020 con 0x7f0d201540f0 2022-08-10T17:51:00.338 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d00065050 0x7f0d00067500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0d10081c20 con 0x7f0d201540f0 2022-08-10T17:51:00.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d263d8700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d00065050 0x7f0d00067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00fed0 con 0x7f0d2014f2f0 2022-08-10T17:51:00.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f0d1c0052e0 con 0x7f0d2014f2f0 2022-08-10T17:51:00.339 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 msgr2=0x7f0d201584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 0x7f0d201584e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c001010 tx=0x7f0d1c00f8d0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 msgr2=0x7f0d201584e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:00.340 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.323+0000 7f0d0e7fc700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f2f0 0x7f0d201584e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.341 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.326+0000 7f0d263d8700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d00065050 0x7f0d00067500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0d20068c80 tx=0x7f0d1801e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.330+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 0x7f0d20158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:00.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.330+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20072890 con 0x7f0d2014f6c0 2022-08-10T17:51:00.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.331+0000 7f0d25bd7700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 0x7f0d20158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:00.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.331+0000 7f0d25bd7700 1 -- 172.21.15.150:0/3140446362 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0d200c7110 con 0x7f0d2014f6c0 2022-08-10T17:51:00.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.331+0000 7f0d25bd7700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 0x7f0d20158a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c017000 tx=0x7f0d1c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:00.343 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c01cb30 con 0x7f0d2014f6c0 2022-08-10T17:51:00.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7f0d1c01cc90 con 0x7f0d2014f6c0 2022-08-10T17:51:00.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 msgr2=0x7f0d20158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 0x7f0d20158a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c017000 tx=0x7f0d1c000ed0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 msgr2=0x7f0d20158a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:00.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.332+0000 7f0d0e7fc700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0d2014f6c0 0x7f0d20158a20 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c017000 tx=0x7f0d1c000ed0 comp rx=0 tx=0).stop 2022-08-10T17:51:00.345 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:00.345 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:00.345 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:00.346 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:51:00.346 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 122, 2022-08-10T17:51:00.346 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:00.346 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:51:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:51:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:51:00.348 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:00.348 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:00.348 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:00.348 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.348 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.349 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.349 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.349 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.349 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.350 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:00.351 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:00.351 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.351 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.351 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.352 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.352 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.352 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.352 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.353 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.353 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.353 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.354 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:00.354 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:00.354 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:00.355 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:00.355 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:00.355 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:00.355 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:00.356 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:00.356 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:00.356 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:00.356 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:00.356 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:00.357 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:00.357 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:00.357 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:00.357 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:00.358 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:00.358 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:00.358 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:00.358 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:00.359 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:00.359 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:00.359 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:00.359 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:00.359 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:00.360 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.360 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:00.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.360 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:00.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.361 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:00.361 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:00.361 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.362 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.362 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.362 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:00.363 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.363 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.364 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:00.364 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.364 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.364 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.366 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.367 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:00.367 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:00.367 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.367 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.368 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:00.368 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.370 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.370 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:00.371 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.371 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.372 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.373 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:00.373 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:00.373 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.374 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.374 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.375 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:00.375 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:00.375 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:00.376 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:00.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.376 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:00.376 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:00.376 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.377 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:00.377 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:00.378 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:00.378 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.378 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.378 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:00.379 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:00.379 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:00.379 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:00.379 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:00.380 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.380 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.380 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:00.380 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:00.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.381 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.381 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.381 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:00.382 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.382 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.382 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:00.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.382 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.383 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.383 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:00.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.383 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:00.384 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:00.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:00.384 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:00.384 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:00.384 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:00.385 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:00.385 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:00.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:00.385 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:00.385 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d00065050 msgr2=0x7f0d00067500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0d00065050 0x7f0d00067500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0d20068c80 tx=0x7f0d1801e040 comp rx=0 tx=0).stop 2022-08-10T17:51:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 msgr2=0x7f0d200c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 --2- 172.21.15.150:0/3140446362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d201540f0 0x7f0d200c8b20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c410 tx=0x7f0d1000c720 comp rx=0 tx=0).stop 2022-08-10T17:51:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d263d8700 1 -- 172.21.15.150:0/3140446362 reap_dead start 2022-08-10T17:51:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d263d8700 1 -- 172.21.15.150:0/3140446362 reap_dead start 2022-08-10T17:51:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 shutdown_connections 2022-08-10T17:51:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.334+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 >> 172.21.15.150:0/3140446362 conn(0x7f0d2006d0d0 msgr2=0x7f0d20151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:00.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.335+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 shutdown_connections 2022-08-10T17:51:00.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:00.335+0000 7f0d27e3b700 1 -- 172.21.15.150:0/3140446362 wait complete. 2022-08-10T17:51:00.390 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:51:00.391 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'b'] 2022-08-10T17:51:00.391 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:51:00.391 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:51:00.392 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:51:00.392 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:51:00.402 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:51:00.402 INFO:tasks.mon_thrash:Sending STOP to mon a 2022-08-10T17:51:00.403 INFO:tasks.ceph.mon.a:Sent signal 19 2022-08-10T17:51:00.403 INFO:tasks.mon_thrash:Sending STOP to mon b 2022-08-10T17:51:00.404 INFO:tasks.ceph.mon.b:Sent signal 19 2022-08-10T17:51:00.404 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:51:15.405 INFO:tasks.mon_thrash:Sending CONT to mon a 2022-08-10T17:51:15.407 INFO:tasks.ceph.mon.a:Sent signal 18 2022-08-10T17:51:15.407 INFO:tasks.mon_thrash:Sending CONT to mon b 2022-08-10T17:51:15.408 INFO:tasks.ceph.mon.b:Sent signal 18 2022-08-10T17:51:15.408 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:51:15.409 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:51:15.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.549+0000 7f27d59eb700 1 Processor -- start 2022-08-10T17:51:15.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.549+0000 7f27d59eb700 1 -- start start 2022-08-10T17:51:15.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27d59eb700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:15.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27d59eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:15.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27d59eb700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006b620 con 0x7f27d006ebd0 2022-08-10T17:51:15.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27d59eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d013c4e0 con 0x7f27d006c1c0 2022-08-10T17:51:15.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27d59eb700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d0152b90 con 0x7f27d0068110 2022-08-10T17:51:15.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:15.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27ceffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:15.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43324/0 (socket says 172.21.15.150:43324) 2022-08-10T17:51:15.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 learned_addr learned my addr 172.21.15.150:0/3042023088 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:15.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:51:15.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:15.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:15.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:51:15.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:15.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:15.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:15.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.550+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:15.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:15.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:15.850 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:51:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:15.851 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:51:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:51:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:15.852 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:15.751+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:51:16.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:16.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:16.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:51:16.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:16.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:16.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:51:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:51:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:16.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.152+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:51:16.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:16.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:16.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:51:16.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:16.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:16.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:51:16.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:51:16.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:16.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:16.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:16.953+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:51:18.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 msgr2=0x7f27d00684e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:18.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.197:3300/0 conn(0x7f27d0068110 0x7f27d00684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 -- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 msgr2=0x7f27d0068a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 --2- 172.21.15.150:0/3042023088 >> v2:172.21.15.150:3300/0 conn(0x7f27d006c1c0 0x7f27d0068a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 -- 172.21.15.150:0/3042023088 >> v1:172.21.15.197:6789/0 conn(0x7f27d006ebd0 legacy=0x7f27d006bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 -- 172.21.15.150:0/3042023088 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d0152e50 con 0x7f27b00035a0 2022-08-10T17:51:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ccff9700 1 -- 172.21.15.150:0/3042023088 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d013c4e0 con 0x7f27b0007250 2022-08-10T17:51:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 msgr2=0x7f27b00096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.550+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:18.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.751+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 msgr2=0x7f27b00096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:18.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:18.751+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:51:19.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:19.152+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 msgr2=0x7f27b00096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:19.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:19.152+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:51:19.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:19.953+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 msgr2=0x7f27b00096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:19.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:19.953+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:51:20.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421706056 0 0) 0x7f27d0152e50 con 0x7f27b00035a0 2022-08-10T17:51:20.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003430 con 0x7f27b00035a0 2022-08-10T17:51:20.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534821877 0 0) 0x7f27bc003430 con 0x7f27b00035a0 2022-08-10T17:51:20.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 msgr2=0x7f27b00096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:20.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27b0007250 0x7f27b00096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b000aea0 con 0x7f27b00035a0 2022-08-10T17:51:20.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f27c000f400 con 0x7f27b00035a0 2022-08-10T17:51:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 >> v1:172.21.15.150:6789/0 conn(0x7f27b00035a0 legacy=0x7f27b00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cf7fe700 1 -- 172.21.15.150:0/3042023088 reap_dead start 2022-08-10T17:51:20.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 0x7f27bc003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 0x7f27bc004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc005180 0x7f27bc00b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d013c4e0 con 0x7f27bc0046d0 2022-08-10T17:51:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc00c0b0 con 0x7f27bc005180 2022-08-10T17:51:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc00c270 con 0x7f27bc003880 2022-08-10T17:51:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ceffd700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 msgr2=0x7f27bc003c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ceffd700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 0x7f27bc003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 0x7f27bc004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27cf7fe700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc005180 0x7f27bc00b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 msgr2=0x7f27bc003c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 0x7f27bc003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc005180 msgr2=0x7f27bc00b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:20.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc005180 0x7f27bc00b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.449+0000 7f27ce7fc700 1 -- 172.21.15.150:0/3042023088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc003430 con 0x7f27bc0046d0 2022-08-10T17:51:20.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 0x7f27bc004b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007b30 tx=0x7f27bc005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e462015bab09f359 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40072d0 con 0x7f27bc0046d0 2022-08-10T17:51:20.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4007430 con 0x7f27bc0046d0 2022-08-10T17:51:20.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27cdffb700 1 -- 172.21.15.150:0/3042023088 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4005910 con 0x7f27bc0046d0 2022-08-10T17:51:20.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 -- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 msgr2=0x7f27bc004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 0x7f27bc004b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007b30 tx=0x7f27bc005700 comp rx=0 tx=0).stop 2022-08-10T17:51:20.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 -- 172.21.15.150:0/3042023088 shutdown_connections 2022-08-10T17:51:20.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc005180 0x7f27bc00b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc0046d0 0x7f27bc004b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 --2- 172.21.15.150:0/3042023088 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc003880 0x7f27bc003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.450+0000 7f27d59eb700 1 -- 172.21.15.150:0/3042023088 >> 172.21.15.150:0/3042023088 conn(0x7f27d00c9320 msgr2=0x7f27d00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:20.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.451+0000 7f27d59eb700 1 -- 172.21.15.150:0/3042023088 shutdown_connections 2022-08-10T17:51:20.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.451+0000 7f27d59eb700 1 -- 172.21.15.150:0/3042023088 wait complete. 2022-08-10T17:51:20.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.452+0000 7f27d59eb700 1 Processor -- start 2022-08-10T17:51:20.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 -- start start 2022-08-10T17:51:20.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 0x7f27d0137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc005180 0x7f27d0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c26c0 con 0x7f27bc005180 2022-08-10T17:51:20.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01e8c30 con 0x7f27bc003880 2022-08-10T17:51:20.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.453+0000 7f27d59eb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01e8020 con 0x7f27bc0046d0 2022-08-10T17:51:20.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.454+0000 7f27ce7fc700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 msgr2=0x7f27d0137140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:20.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.454+0000 7f27ce7fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 0x7f27d0137140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:20.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.454+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.454+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53964/0 (socket says 172.21.15.150:53964) 2022-08-10T17:51:20.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.454+0000 7f27ceffd700 1 -- 172.21.15.150:0/4197246925 learned_addr learned my addr 172.21.15.150:0/4197246925 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:20.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 -- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 msgr2=0x7f27d0137140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:51:20.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 0x7f27d0137140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 -- 172.21.15.150:0/4197246925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc005180 msgr2=0x7f27d0152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc005180 0x7f27d0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 -- 172.21.15.150:0/4197246925 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d01e8300 con 0x7f27bc003880 2022-08-10T17:51:20.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.455+0000 7f27ceffd700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c000e4d0 tx=0x7f27c000e890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.459+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000fe30 con 0x7f27bc003880 2022-08-10T17:51:20.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.459+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000c040 con 0x7f27bc003880 2022-08-10T17:51:20.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.459+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0018850 con 0x7f27bc003880 2022-08-10T17:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.459+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d01e85e0 con 0x7f27bc003880 2022-08-10T17:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.459+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d01e7cd0 con 0x7f27bc003880 2022-08-10T17:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.460+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0072890 con 0x7f27bc003880 2022-08-10T17:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.463+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f27c0028020 con 0x7f27bc003880 2022-08-10T17:51:20.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.464+0000 7f27b7fff700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 0x7f27b0067de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.464+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 0x7f27b0067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.464+0000 7f27ce7fc700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 0x7f27b0067de0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007b30 tx=0x7f27c400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.466+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f27c005cd40 con 0x7f27bc003880 2022-08-10T17:51:20.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.475+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f27c0058a50 con 0x7f27bc003880 2022-08-10T17:51:20.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.793+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f27d0157020 con 0x7f27bc003880 2022-08-10T17:51:20.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.794+0000 7f27b7fff700 1 -- 172.21.15.150:0/4197246925 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f27c005c070 con 0x7f27bc003880 2022-08-10T17:51:20.798 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":126,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:51:20.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 msgr2=0x7f27b0067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 0x7f27b0067de0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007b30 tx=0x7f27c400a000 comp rx=0 tx=0).stop 2022-08-10T17:51:20.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 msgr2=0x7f27d014f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c000e4d0 tx=0x7f27c000e890 comp rx=0 tx=0).stop 2022-08-10T17:51:20.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 shutdown_connections 2022-08-10T17:51:20.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27bc005180 0x7f27d0152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f27bc003880 0x7f27d014f9a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f27b0065930 0x7f27b0067de0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 --2- 172.21.15.150:0/4197246925 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f27bc0046d0 0x7f27d0137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 >> 172.21.15.150:0/4197246925 conn(0x7f27d00c9320 msgr2=0x7f27d00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:20.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 shutdown_connections 2022-08-10T17:51:20.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.796+0000 7f27d59eb700 1 -- 172.21.15.150:0/4197246925 wait complete. 2022-08-10T17:51:20.814 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:51:20.814 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:51:20.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.962+0000 7f884945d700 1 Processor -- start 2022-08-10T17:51:20.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.962+0000 7f884945d700 1 -- start start 2022-08-10T17:51:20.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.962+0000 7f884945d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8844151290 0x7f88440c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.962+0000 7f884945d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 0x7f88440c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f884945d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440c1f40 con 0x7f8844158170 2022-08-10T17:51:20.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f884945d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440c7d90 con 0x7f8844151290 2022-08-10T17:51:20.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f884945d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c2220 con 0x7f8844068bf0 2022-08-10T17:51:20.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f88437fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 msgr2=0x7f88440c2910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:20.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f88437fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 0x7f88440c2910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:20.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8844151290 0x7f88440c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8844151290 0x7f88440c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43382/0 (socket says 172.21.15.150:43382) 2022-08-10T17:51:20.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 -- 172.21.15.150:0/1256573714 learned_addr learned my addr 172.21.15.150:0/1256573714 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:20.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f88427fc700 1 --1- 172.21.15.150:0/1256573714 >> v1:172.21.15.197:6789/0 conn(0x7f8844158170 0x7f8844157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:42416/0 (socket says 172.21.15.150:42416) 2022-08-10T17:51:20.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8841ffb700 1 -- 172.21.15.150:0/1256573714 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621858421 0 0) 0x7f88440c1f40 con 0x7f8844158170 2022-08-10T17:51:20.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 -- 172.21.15.150:0/1256573714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 msgr2=0x7f88440c2910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:20.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 --2- 172.21.15.150:0/1256573714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 0x7f88440c2910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 -- 172.21.15.150:0/1256573714 >> v1:172.21.15.197:6789/0 conn(0x7f8844158170 legacy=0x7f8844157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 -- 172.21.15.150:0/1256573714 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440c2500 con 0x7f8844151290 2022-08-10T17:51:20.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8842ffd700 1 --2- 172.21.15.150:0/1256573714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844151290 0x7f88440c7850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8834009760 tx=0x7f8834009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363a3074f39e9bbe server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8841ffb700 1 -- 172.21.15.150:0/1256573714 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834005cb0 con 0x7f8844151290 2022-08-10T17:51:20.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8841ffb700 1 -- 172.21.15.150:0/1256573714 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834005e10 con 0x7f8844151290 2022-08-10T17:51:20.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.963+0000 7f8841ffb700 1 -- 172.21.15.150:0/1256573714 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834006250 con 0x7f8844151290 2022-08-10T17:51:20.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 -- 172.21.15.150:0/1256573714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844151290 msgr2=0x7f88440c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 --2- 172.21.15.150:0/1256573714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844151290 0x7f88440c7850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8834009760 tx=0x7f8834009a70 comp rx=0 tx=0).stop 2022-08-10T17:51:20.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 -- 172.21.15.150:0/1256573714 shutdown_connections 2022-08-10T17:51:20.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 --2- 172.21.15.150:0/1256573714 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844068bf0 0x7f88440c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 --2- 172.21.15.150:0/1256573714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844151290 0x7f88440c7850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 -- 172.21.15.150:0/1256573714 >> 172.21.15.150:0/1256573714 conn(0x7f884406f880 msgr2=0x7f884406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:20.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 -- 172.21.15.150:0/1256573714 shutdown_connections 2022-08-10T17:51:20.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.964+0000 7f884945d700 1 -- 172.21.15.150:0/1256573714 wait complete. 2022-08-10T17:51:20.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.966+0000 7f884945d700 1 Processor -- start 2022-08-10T17:51:20.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.966+0000 7f884945d700 1 -- start start 2022-08-10T17:51:20.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 0x7f88441f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844151290 0x7f88441e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8844158170 0x7f88440b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88441f4a80 con 0x7f8844068bf0 2022-08-10T17:51:20.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88441590d0 con 0x7f8844158170 2022-08-10T17:51:20.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f884945d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440b1b10 con 0x7f8844151290 2022-08-10T17:51:20.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f88427fc700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844151290 msgr2=0x7f88441e2880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:20.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f88427fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844151290 0x7f88441e2880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:20.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 0x7f88441f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 0x7f88441f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43388/0 (socket says 172.21.15.150:43388) 2022-08-10T17:51:20.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 -- 172.21.15.150:0/1636304312 learned_addr learned my addr 172.21.15.150:0/1636304312 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:20.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f88437fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8844158170 0x7f88440b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844151290 msgr2=0x7f88441e2880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:51:20.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8844151290 0x7f88441e2880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8844158170 msgr2=0x7f88440b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8844158170 0x7f88440b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.967+0000 7f8842ffd700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834009370 con 0x7f8844068bf0 2022-08-10T17:51:20.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f8842ffd700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 0x7f88441f4ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8844064f10 tx=0x7f88340045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834006400 con 0x7f8844068bf0 2022-08-10T17:51:20.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834006560 con 0x7f8844068bf0 2022-08-10T17:51:20.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88440b0fb0 con 0x7f8844068bf0 2022-08-10T17:51:20.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834003520 con 0x7f8844068bf0 2022-08-10T17:51:20.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.968+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88440b1270 con 0x7f8844068bf0 2022-08-10T17:51:20.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f884945d700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 0x7f88441e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440644b0 con 0x7f88440b2410 2022-08-10T17:51:20.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f88427fc700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 0x7f88441e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f88427fc700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88441f4bc0 con 0x7f88440b2410 2022-08-10T17:51:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f88427fc700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 0x7f88441e3620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88440c2dd0 tx=0x7f8838001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.969+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f883400f050 con 0x7f8844068bf0 2022-08-10T17:51:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8824065060 0x7f8824067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380072d0 con 0x7f88440b2410 2022-08-10T17:51:20.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f88437fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8824065060 0x7f8824067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8834083f60 con 0x7f8844068bf0 2022-08-10T17:51:20.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f8838007430 con 0x7f88440b2410 2022-08-10T17:51:20.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 msgr2=0x7f88441e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 0x7f88441e3620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88440c2dd0 tx=0x7f8838001e70 comp rx=0 tx=0).stop 2022-08-10T17:51:20.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 msgr2=0x7f88441e3620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:20.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f882b7fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88440b2410 0x7f88441e3620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.970+0000 7f88437fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8824065060 0x7f8824067510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f883c003bc0 tx=0x7f883c0095f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f884945d700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 0x7f88441e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:20.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844071e10 con 0x7f88441f0fb0 2022-08-10T17:51:20.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f88427fc700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 0x7f88441e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:20.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f88427fc700 1 -- 172.21.15.150:0/1636304312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8844072890 con 0x7f88441f0fb0 2022-08-10T17:51:20.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f88427fc700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 0x7f88441e3b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88440c9090 tx=0x7f883800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:20.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.977+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380075a0 con 0x7f88441f0fb0 2022-08-10T17:51:20.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4538 (secure 0 0 0) 0x7f883801b070 con 0x7f88441f0fb0 2022-08-10T17:51:20.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 msgr2=0x7f88441e3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:20.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f882b7fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 0x7f88441e3b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88440c9090 tx=0x7f883800f000 comp rx=0 tx=0).stop 2022-08-10T17:51:20.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f882b7fe700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 msgr2=0x7f88441e3b60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:20.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f882b7fe700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88441f0fb0 0x7f88441e3b60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:20.996 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:20.997 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:20.997 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:20.997 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:51:20.997 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 126, 2022-08-10T17:51:20.998 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:20.998 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:20.998 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:51:20.998 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:20.999 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:51:20.999 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:20.999 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:20.999 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:20.999 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.000 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.000 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.000 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.000 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.001 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.001 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.001 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.001 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.001 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.002 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:21.002 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:21.002 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.002 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.003 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.003 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.003 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.003 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.003 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.004 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.004 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.004 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.005 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:21.005 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:21.005 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:21.005 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:21.005 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:21.006 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:21.006 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:21.006 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:21.006 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:21.007 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:21.007 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:21.007 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:21.007 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:21.007 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:21.008 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:21.008 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:21.008 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.008 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.009 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.009 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.009 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.009 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.009 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.010 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.010 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.010 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.010 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:21.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.011 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:21.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.011 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:21.012 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:21.012 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.012 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.012 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.013 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:21.013 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.013 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.014 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:21.014 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.014 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.015 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:21.015 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:21.015 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.015 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.016 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.016 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:21.017 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:21.017 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.017 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.018 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.018 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:21.018 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.019 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.019 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:21.019 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.020 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.020 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:21.020 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:21.021 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.021 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.021 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.022 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:21.022 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:21.022 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.022 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.024 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.024 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:21.024 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.025 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.025 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.025 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:21.026 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:21.026 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.026 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.026 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.027 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.027 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.027 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:21.027 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:21.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.028 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.028 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.029 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:21.029 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.029 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.029 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:21.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.030 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.030 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.030 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:21.030 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.031 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.031 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:21.031 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.031 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.032 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.032 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:51:21.032 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.032 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.032 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.033 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:21.033 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:21.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8824065060 msgr2=0x7f8824067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8824065060 0x7f8824067510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f883c003bc0 tx=0x7f883c0095f0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 msgr2=0x7f88441f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 --2- 172.21.15.150:0/1636304312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8844068bf0 0x7f88441f4ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8844064f10 tx=0x7f88340045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f88437fe700 1 -- 172.21.15.150:0/1636304312 reap_dead start 2022-08-10T17:51:21.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f88437fe700 1 -- 172.21.15.150:0/1636304312 reap_dead start 2022-08-10T17:51:21.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 shutdown_connections 2022-08-10T17:51:21.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 >> 172.21.15.150:0/1636304312 conn(0x7f884406f880 msgr2=0x7f8844155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:21.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 shutdown_connections 2022-08-10T17:51:21.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:20.978+0000 7f884945d700 1 -- 172.21.15.150:0/1636304312 wait complete. 2022-08-10T17:51:21.037 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:51:21.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.179+0000 7ff907c6a700 1 Processor -- start 2022-08-10T17:51:21.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.179+0000 7ff907c6a700 1 -- start start 2022-08-10T17:51:21.185 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff907c6a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9000c7220 0x7ff9000c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff907c6a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff9000c25c0 0x7ff90006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff907c6a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9000c2a60 con 0x7ff9000c4d90 2022-08-10T17:51:21.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff907c6a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000c5e10 con 0x7ff9000c7220 2022-08-10T17:51:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff907c6a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000c1c30 con 0x7ff9000c25c0 2022-08-10T17:51:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff906207700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff9000c25c0 0x7ff90006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff906207700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff9000c25c0 0x7ff90006fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:53996/0 (socket says 172.21.15.150:53996) 2022-08-10T17:51:21.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.180+0000 7ff906207700 1 -- 172.21.15.150:0/2885247315 learned_addr learned my addr 172.21.15.150:0/2885247315 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff906207700 1 -- 172.21.15.150:0/2885247315 >> v2:172.21.15.150:3300/0 conn(0x7ff9000c7220 msgr2=0x7ff9000c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff906207700 1 --2- 172.21.15.150:0/2885247315 >> v2:172.21.15.150:3300/0 conn(0x7ff9000c7220 0x7ff9000c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff906207700 1 -- 172.21.15.150:0/2885247315 >> v1:172.21.15.150:6789/0 conn(0x7ff9000c4d90 legacy=0x7ff9000c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:21.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff906207700 1 -- 172.21.15.150:0/2885247315 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000699c0 con 0x7ff9000c25c0 2022-08-10T17:51:21.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff906207700 1 --2- 172.21.15.150:0/2885247315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c25c0 0x7ff90006fca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff900157e20 tx=0x7ff8f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c88f11572fb8fe server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:21.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff904a04700 1 -- 172.21.15.150:0/2885247315 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800e070 con 0x7ff9000c25c0 2022-08-10T17:51:21.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff904a04700 1 -- 172.21.15.150:0/2885247315 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f800b980 con 0x7ff9000c25c0 2022-08-10T17:51:21.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.181+0000 7ff904a04700 1 -- 172.21.15.150:0/2885247315 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800bd30 con 0x7ff9000c25c0 2022-08-10T17:51:21.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.182+0000 7ff907c6a700 1 -- 172.21.15.150:0/2885247315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c25c0 msgr2=0x7ff90006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.182+0000 7ff907c6a700 1 --2- 172.21.15.150:0/2885247315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c25c0 0x7ff90006fca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff900157e20 tx=0x7ff8f800b330 comp rx=0 tx=0).stop 2022-08-10T17:51:21.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.185+0000 7ff907c6a700 1 -- 172.21.15.150:0/2885247315 shutdown_connections 2022-08-10T17:51:21.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.185+0000 7ff907c6a700 1 --2- 172.21.15.150:0/2885247315 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c25c0 0x7ff90006fca0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.185+0000 7ff907c6a700 1 --2- 172.21.15.150:0/2885247315 >> v2:172.21.15.150:3300/0 conn(0x7ff9000c7220 0x7ff9000c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.185+0000 7ff907c6a700 1 -- 172.21.15.150:0/2885247315 >> 172.21.15.150:0/2885247315 conn(0x7ff90006d0d0 msgr2=0x7ff9000c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:21.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.193+0000 7ff907c6a700 1 -- 172.21.15.150:0/2885247315 shutdown_connections 2022-08-10T17:51:21.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.193+0000 7ff907c6a700 1 -- 172.21.15.150:0/2885247315 wait complete. 2022-08-10T17:51:21.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.195+0000 7ff907c6a700 1 Processor -- start 2022-08-10T17:51:21.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.195+0000 7ff907c6a700 1 -- start start 2022-08-10T17:51:21.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff9000c25c0 0x7ff900156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 0x7ff9000c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c7220 0x7ff9001de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff900149290 con 0x7ff9000c4d90 2022-08-10T17:51:21.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90014a5f0 con 0x7ff9000c7220 2022-08-10T17:51:21.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff907c6a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90014aa10 con 0x7ff9000c25c0 2022-08-10T17:51:21.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff905a06700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff9000c25c0 msgr2=0x7ff900156ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:51:21.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff905a06700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff9000c25c0 0x7ff900156ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:21.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff905205700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 0x7ff9000c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff905205700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 0x7ff9000c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43410/0 (socket says 172.21.15.150:43410) 2022-08-10T17:51:21.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff905205700 1 -- 172.21.15.150:0/1184807288 learned_addr learned my addr 172.21.15.150:0/1184807288 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:21.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.196+0000 7ff906207700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c7220 0x7ff9001de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff9000c25c0 msgr2=0x7ff900156ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:51:21.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff9000c25c0 0x7ff900156ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c7220 msgr2=0x7ff9001de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c7220 0x7ff9001de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f8009b30 con 0x7ff9000c4d90 2022-08-10T17:51:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff905205700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 0x7ff9000c8f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00d990 tx=0x7ff8fc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00eb10 con 0x7ff9000c4d90 2022-08-10T17:51:21.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00ec70 con 0x7ff9000c4d90 2022-08-10T17:51:21.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc016440 con 0x7ff9000c4d90 2022-08-10T17:51:21.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9000c85c0 con 0x7ff9000c4d90 2022-08-10T17:51:21.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.197+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9001549a0 con 0x7ff9000c4d90 2022-08-10T17:51:21.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.199+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff8fc01d030 con 0x7ff9000c4d90 2022-08-10T17:51:21.211 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.199+0000 7ff8ee7fc700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8e0065060 0x7ff8e0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff8fc081a70 con 0x7ff9000c4d90 2022-08-10T17:51:21.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff905a06700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8e0065060 0x7ff8e0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff907c6a700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 0x7ff900149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.212 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000672f0 con 0x7ff9000c9450 2022-08-10T17:51:21.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff906207700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 0x7ff900149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff905a06700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8e0065060 0x7ff8e0067510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0007fd0 tx=0x7ff8f0007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:21.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff906207700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff900072890 con 0x7ff9000c9450 2022-08-10T17:51:21.213 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff906207700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 0x7ff900149d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff900157e20 tx=0x7ff8f8004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:21.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.200+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8009550 con 0x7ff9000c9450 2022-08-10T17:51:21.214 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.201+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff8f8004440 con 0x7ff9000c9450 2022-08-10T17:51:21.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.201+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 msgr2=0x7ff900149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.201+0000 7ff8ee7fc700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 0x7ff900149d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff900157e20 tx=0x7ff8f8004950 comp rx=0 tx=0).stop 2022-08-10T17:51:21.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.201+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 msgr2=0x7ff900149d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:21.215 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.201+0000 7ff8ee7fc700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9000c9450 0x7ff900149d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.208+0000 7ff907c6a700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 0x7ff9001ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:21.217 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.208+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff900068e40 con 0x7ff9001ebf30 2022-08-10T17:51:21.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.208+0000 7ff906207700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 0x7ff9001ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:21.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.208+0000 7ff906207700 1 -- 172.21.15.150:0/1184807288 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff900154bf0 con 0x7ff9001ebf30 2022-08-10T17:51:21.218 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.208+0000 7ff906207700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 0x7ff9001ec330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff90006e450 tx=0x7ff8f8011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:21.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f802c070 con 0x7ff9001ebf30 2022-08-10T17:51:21.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5019 (secure 0 0 0) 0x7ff8f80126c0 con 0x7ff9001ebf30 2022-08-10T17:51:21.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 msgr2=0x7ff9001ec330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.219 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 0x7ff9001ec330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff90006e450 tx=0x7ff8f8011000 comp rx=0 tx=0).stop 2022-08-10T17:51:21.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 msgr2=0x7ff9001ec330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:21.220 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff8ee7fc700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff9001ebf30 0x7ff9001ec330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:21.220 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:21.221 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:21.221 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:21.221 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:51:21.221 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 126, 2022-08-10T17:51:21.222 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:21.222 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:21.222 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:51:21.223 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.223 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:51:21.223 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:21.224 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:21.224 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:21.225 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.225 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.226 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.226 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.227 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.227 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.227 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.228 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.228 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.229 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.229 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:21.230 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:21.230 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.231 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.231 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.232 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.232 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.233 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.233 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.234 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.234 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.235 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.235 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.235 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:21.236 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:21.236 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:21.237 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:21.237 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:21.238 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:21.238 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:21.239 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:21.239 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:21.240 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:21.240 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:21.241 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:21.241 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:21.241 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:21.242 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:21.242 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:21.243 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:21.243 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:21.243 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:21.243 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:21.244 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:21.244 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:21.244 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:21.244 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:21.244 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:21.245 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.245 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:21.245 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.245 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:21.246 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.246 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:21.246 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:21.246 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.247 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.247 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.247 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.247 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:21.248 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.248 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.248 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.248 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.249 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:21.249 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.249 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.249 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.250 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.250 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:21.250 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:21.250 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.251 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.251 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.251 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.251 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.252 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:21.252 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:21.252 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.252 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.253 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.253 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.253 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:21.253 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.254 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.254 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.254 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.255 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:21.255 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.255 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.255 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.256 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:21.256 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:21.256 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.256 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.257 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.257 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:21.258 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:21.258 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:21.258 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:21.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.259 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:21.259 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:21.259 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.260 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:21.260 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:21.260 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:21.261 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.261 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.261 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:21.262 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:21.262 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:21.262 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:21.262 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:21.262 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.263 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.263 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.263 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:21.263 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:21.264 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.264 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.264 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.264 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:21.265 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.265 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.265 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:51:21.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.266 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.266 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.266 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:51:21.266 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.267 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.267 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:21.267 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.267 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.267 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.268 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:51:21.268 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.268 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.268 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:21.269 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.269 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:51:21.269 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.269 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:21.270 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.270 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.270 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.270 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.271 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:51:21.271 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.271 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:21.271 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:51:21.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:21.272 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:21.272 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:21.272 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:51:21.273 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:21.273 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:21.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:21.273 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:21.274 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:21.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8e0065060 msgr2=0x7ff8e0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff8e0065060 0x7ff8e0067510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0007fd0 tx=0x7ff8f0007900 comp rx=0 tx=0).stop 2022-08-10T17:51:21.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 msgr2=0x7ff9000c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:21.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 --2- 172.21.15.150:0/1184807288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9000c4d90 0x7ff9000c8f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00d990 tx=0x7ff8fc00dd50 comp rx=0 tx=0).stop 2022-08-10T17:51:21.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff906207700 1 -- 172.21.15.150:0/1184807288 reap_dead start 2022-08-10T17:51:21.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff906207700 1 -- 172.21.15.150:0/1184807288 reap_dead start 2022-08-10T17:51:21.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 shutdown_connections 2022-08-10T17:51:21.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 >> 172.21.15.150:0/1184807288 conn(0x7ff90006d0d0 msgr2=0x7ff90014c320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:21.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 shutdown_connections 2022-08-10T17:51:21.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:21.209+0000 7ff907c6a700 1 -- 172.21.15.150:0/1184807288 wait complete. 2022-08-10T17:51:21.278 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:51:41.280 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:51:41.280 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:51:41.281 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:51:41.281 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:51:41.284 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:51:41.285 INFO:tasks.mon_thrash:Sending STOP to mon a 2022-08-10T17:51:41.285 INFO:tasks.ceph.mon.a:Sent signal 19 2022-08-10T17:51:41.286 INFO:tasks.mon_thrash:Sending STOP to mon b 2022-08-10T17:51:41.287 INFO:tasks.ceph.mon.b:Sent signal 19 2022-08-10T17:51:41.287 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:51:56.288 INFO:tasks.mon_thrash:Sending CONT to mon a 2022-08-10T17:51:56.288 INFO:tasks.ceph.mon.a:Sent signal 18 2022-08-10T17:51:56.289 INFO:tasks.mon_thrash:Sending CONT to mon b 2022-08-10T17:51:56.289 INFO:tasks.ceph.mon.b:Sent signal 18 2022-08-10T17:51:56.289 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:51:56.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:51:56.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.425+0000 7fa531f69700 1 Processor -- start 2022-08-10T17:51:56.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.425+0000 7fa531f69700 1 -- start start 2022-08-10T17:51:56.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa531f69700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa531f69700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa52c0c2020 0x7fa52c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa531f69700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c06d480 con 0x7fa52c1556f0 2022-08-10T17:51:56.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa531f69700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c0b10e0 con 0x7fa52c0c2020 2022-08-10T17:51:56.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa531f69700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c06d720 con 0x7fa52c155320 2022-08-10T17:51:56.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa52c1556f0 0x7fa52c0cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56318/0 (socket says 172.21.15.150:56318) 2022-08-10T17:51:56.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52affd700 1 -- 172.21.15.150:0/2998910092 learned_addr learned my addr 172.21.15.150:0/2998910092 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:51:56.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52bfff700 1 --2- 172.21.15.150:0/2998910092 >> v2:172.21.15.197:3300/0 conn(0x7fa52c0c2020 0x7fa52c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52b7fe700 1 -- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:51:56.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52b7fe700 1 -- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:56.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:56.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:56.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52a7fc700 1 -- 172.21.15.150:0/2998910092 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205522971 0 0) 0x7fa52c06d480 con 0x7fa52c1556f0 2022-08-10T17:51:56.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52a7fc700 1 -- 172.21.15.150:0/2998910092 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa518003430 con 0x7fa52c1556f0 2022-08-10T17:51:56.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52bfff700 1 -- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c0c4390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:56.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52bfff700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52bfff700 1 -- 172.21.15.150:0/2998910092 >> v1:172.21.15.150:6789/0 conn(0x7fa52c1556f0 legacy=0x7fa52c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.426+0000 7fa52bfff700 1 -- 172.21.15.150:0/2998910092 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0c55b0 con 0x7fa52c0c2020 2022-08-10T17:51:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa52bfff700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c0c48d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa524009d90 tx=0x7fa52400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0949f57989cc04 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.443 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa52a7fc700 1 -- 172.21.15.150:0/2998910092 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400e070 con 0x7fa52c0c2020 2022-08-10T17:51:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa52a7fc700 1 -- 172.21.15.150:0/2998910092 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52400bb20 con 0x7fa52c0c2020 2022-08-10T17:51:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa52a7fc700 1 -- 172.21.15.150:0/2998910092 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524012430 con 0x7fa52c0c2020 2022-08-10T17:51:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 -- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 msgr2=0x7fa52c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c0c48d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa524009d90 tx=0x7fa52400b330 comp rx=0 tx=0).stop 2022-08-10T17:51:56.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 -- 172.21.15.150:0/2998910092 shutdown_connections 2022-08-10T17:51:56.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c0c48d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 --2- 172.21.15.150:0/2998910092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c0c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 -- 172.21.15.150:0/2998910092 >> 172.21.15.150:0/2998910092 conn(0x7fa52c06b0c0 msgr2=0x7fa52c06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:56.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 -- 172.21.15.150:0/2998910092 shutdown_connections 2022-08-10T17:51:56.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.427+0000 7fa531f69700 1 -- 172.21.15.150:0/2998910092 wait complete. 2022-08-10T17:51:56.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.428+0000 7fa531f69700 1 Processor -- start 2022-08-10T17:51:56.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.429+0000 7fa531f69700 1 -- start start 2022-08-10T17:51:56.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 0x7fa52c1ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1de7c0 con 0x7fa52c1556f0 2022-08-10T17:51:56.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1de4e0 con 0x7fa52c0c2020 2022-08-10T17:51:56.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1ea360 con 0x7fa52c155320 2022-08-10T17:51:56.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:57866/0 (socket says 172.21.15.150:57866) 2022-08-10T17:51:56.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 -- 172.21.15.150:0/2217879830 learned_addr learned my addr 172.21.15.150:0/2217879830 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:56.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52bfff700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 0x7fa52c1ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-08-10T17:51:56.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:51:56.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:56.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52affd700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:56.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 msgr2=0x7fa52c14f030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:51:56.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 msgr2=0x7fa52c1ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 0x7fa52c1ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 -- 172.21.15.150:0/2217879830 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009a70 con 0x7fa52c0c2020 2022-08-10T17:51:56.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52bfff700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 0x7fa52c1ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:51:56.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa52b7fe700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c14a260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00d5d0 tx=0x7fa51c00d8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0125f0 con 0x7fa52c0c2020 2022-08-10T17:51:56.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c012790 con 0x7fa52c0c2020 2022-08-10T17:51:56.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c012b40 con 0x7fa52c0c2020 2022-08-10T17:51:56.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.430+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c1ea640 con 0x7fa52c0c2020 2022-08-10T17:51:56.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.431+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c0c7e50 con 0x7fa52c0c2020 2022-08-10T17:51:56.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.431+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c1ea1c0 con 0x7fa52c0c2020 2022-08-10T17:51:56.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.432+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa51c012ca0 con 0x7fa52c0c2020 2022-08-10T17:51:56.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.432+0000 7fa513fff700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 0x7fa50c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.432+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa51c082550 con 0x7fa52c0c2020 2022-08-10T17:51:56.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.432+0000 7fa52affd700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 0x7fa50c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.433+0000 7fa52affd700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 0x7fa50c067590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa52c1550a0 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.436+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa52c1ea1c0 con 0x7fa52c0c2020 2022-08-10T17:51:56.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.761+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa52c1ea1c0 con 0x7fa52c0c2020 2022-08-10T17:51:56.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.761+0000 7fa513fff700 1 -- 172.21.15.150:0/2217879830 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7fa52c1ea1c0 con 0x7fa52c0c2020 2022-08-10T17:51:56.765 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:51:56.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 msgr2=0x7fa50c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 0x7fa50c067590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa52c1550a0 tx=0x7fa520009040 comp rx=0 tx=0).stop 2022-08-10T17:51:56.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 msgr2=0x7fa52c14a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c14a260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00d5d0 tx=0x7fa51c00d8e0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 shutdown_connections 2022-08-10T17:51:56.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa52c1556f0 0x7fa52c1ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa52c0c2020 0x7fa52c14a260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa50c0650e0 0x7fa50c067590 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.764+0000 7fa531f69700 1 --2- 172.21.15.150:0/2217879830 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa52c155320 0x7fa52c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.765+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 >> 172.21.15.150:0/2217879830 conn(0x7fa52c06b0c0 msgr2=0x7fa52c0c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:56.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.765+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 shutdown_connections 2022-08-10T17:51:56.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.765+0000 7fa531f69700 1 -- 172.21.15.150:0/2217879830 wait complete. 2022-08-10T17:51:56.781 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:51:56.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:51:56.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.938+0000 7fefd3723700 1 Processor -- start 2022-08-10T17:51:56.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.938+0000 7fefd3723700 1 -- start start 2022-08-10T17:51:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd3723700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd3723700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fefcc1550a0 0x7fefcc155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd3723700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc155a60 con 0x7fefcc06d750 2022-08-10T17:51:56.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd3723700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefcc06b2f0 con 0x7fefcc1550a0 2022-08-10T17:51:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd3723700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0c7690 con 0x7fefcc06db20 2022-08-10T17:51:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd0cbe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd14bf700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fefcc06d750 0x7fefcc0c7fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56334/0 (socket says 172.21.15.150:56334) 2022-08-10T17:51:56.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd14bf700 1 -- 172.21.15.150:0/566364154 learned_addr learned my addr 172.21.15.150:0/566364154 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:51:56.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd1cc0700 1 --2- 172.21.15.150:0/566364154 >> v2:172.21.15.197:3300/0 conn(0x7fefcc1550a0 0x7fefcc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd0cbe700 1 -- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 msgr2=0x7fefcc0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:51:56.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd0cbe700 1 -- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 msgr2=0x7fefcc0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:51:56.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:56.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.939+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:56.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefd1cc0700 1 -- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 msgr2=0x7fefcc0b0870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:51:56.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefd1cc0700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefbbfff700 1 -- 172.21.15.150:0/566364154 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490338985 0 0) 0x7fefc8001110 con 0x7fefcc06d750 2022-08-10T17:51:56.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefd1cc0700 1 -- 172.21.15.150:0/566364154 >> v1:172.21.15.150:6789/0 conn(0x7fefcc06d750 legacy=0x7fefcc0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefd1cc0700 1 -- 172.21.15.150:0/566364154 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0c6b10 con 0x7fefcc1550a0 2022-08-10T17:51:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefd1cc0700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 0x7fefcc155520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009d90 tx=0x7fefc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7315f1417f07710 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefbbfff700 1 -- 172.21.15.150:0/566364154 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400e070 con 0x7fefcc1550a0 2022-08-10T17:51:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefbbfff700 1 -- 172.21.15.150:0/566364154 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc400bbd0 con 0x7fefcc1550a0 2022-08-10T17:51:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.940+0000 7fefbbfff700 1 -- 172.21.15.150:0/566364154 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4012430 con 0x7fefcc1550a0 2022-08-10T17:51:56.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 -- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 msgr2=0x7fefcc155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 0x7fefcc155520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009d90 tx=0x7fefc400b330 comp rx=0 tx=0).stop 2022-08-10T17:51:56.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 -- 172.21.15.150:0/566364154 shutdown_connections 2022-08-10T17:51:56.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 0x7fefcc155520 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 --2- 172.21.15.150:0/566364154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 -- 172.21.15.150:0/566364154 >> 172.21.15.150:0/566364154 conn(0x7fefcc071e40 msgr2=0x7fefcc0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:56.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 -- 172.21.15.150:0/566364154 shutdown_connections 2022-08-10T17:51:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.941+0000 7fefd3723700 1 -- 172.21.15.150:0/566364154 wait complete. 2022-08-10T17:51:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.942+0000 7fefd3723700 1 Processor -- start 2022-08-10T17:51:56.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.942+0000 7fefd3723700 1 -- start start 2022-08-10T17:51:56.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.942+0000 7fefd3723700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 0x7fefcc152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 0x7fefcc0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0afbe0 con 0x7fefcc06d750 2022-08-10T17:51:56.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc069d50 con 0x7fefcc1550a0 2022-08-10T17:51:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0aef30 con 0x7fefcc06db20 2022-08-10T17:51:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 0x7fefcc152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 0x7fefcc152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43660/0 (socket says 172.21.15.150:43660) 2022-08-10T17:51:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 -- 172.21.15.150:0/1040268796 learned_addr learned my addr 172.21.15.150:0/1040268796 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 msgr2=0x7fefcc0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fefcc06db20 0x7fefcc0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 msgr2=0x7fefcc0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fefcc1550a0 0x7fefcc0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4009a70 con 0x7fefcc06d750 2022-08-10T17:51:56.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd14bf700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 0x7fefcc152410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c780 tx=0x7fefc800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80074e0 con 0x7fefcc06d750 2022-08-10T17:51:56.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc80046f0 con 0x7fefcc06d750 2022-08-10T17:51:56.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc069a70 con 0x7fefcc06d750 2022-08-10T17:51:56.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8004aa0 con 0x7fefcc06d750 2022-08-10T17:51:56.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.943+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc0b00a0 con 0x7fefcc06d750 2022-08-10T17:51:56.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.944+0000 7fefd3723700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 0x7fefcc0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.944+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b0800 con 0x7fefcc0695c0 2022-08-10T17:51:56.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.944+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 0x7fefcc0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefd0cbe700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefcc0ca120 con 0x7fefcc0695c0 2022-08-10T17:51:56.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fefc801a020 con 0x7fefcc06d750 2022-08-10T17:51:56.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 0x7fefcc0b02c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006ee0 tx=0x7fefbc00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fefac0650b0 0x7fefac067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fefc8081c10 con 0x7fefcc06d750 2022-08-10T17:51:56.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00fee0 con 0x7fefcc0695c0 2022-08-10T17:51:56.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fefbc014870 con 0x7fefcc0695c0 2022-08-10T17:51:56.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefd1cc0700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fefac0650b0 0x7fefac067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 msgr2=0x7fefcc0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 0x7fefcc0b02c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006ee0 tx=0x7fefbc00f830 comp rx=0 tx=0).stop 2022-08-10T17:51:56.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 msgr2=0x7fefcc0b02c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:56.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.945+0000 7fefb9ffb700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0695c0 0x7fefcc0b02c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.946+0000 7fefd1cc0700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fefac0650b0 0x7fefac067560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b370 tx=0x7fefc4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.952+0000 7fefd3723700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 0x7fefcc0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:56.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.952+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc155a60 con 0x7fefcc0ab8c0 2022-08-10T17:51:56.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.952+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 0x7fefcc0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:56.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefd0cbe700 1 -- 172.21.15.150:0/1040268796 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fefcc0c70d0 con 0x7fefcc0ab8c0 2022-08-10T17:51:56.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefd0cbe700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 0x7fefcc0ac470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0069a0 tx=0x7fefbc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:56.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc022820 con 0x7fefcc0ab8c0 2022-08-10T17:51:56.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4549 (secure 0 0 0) 0x7fefbc026070 con 0x7fefcc0ab8c0 2022-08-10T17:51:56.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 msgr2=0x7fefcc0ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:56.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 0x7fefcc0ac470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0069a0 tx=0x7fefbc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 msgr2=0x7fefcc0ac470 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:56.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.953+0000 7fefb9ffb700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc0ab8c0 0x7fefcc0ac470 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0069a0 tx=0x7fefbc0045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:56.981 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:56.982 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:51:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:51:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:56.983 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:56.984 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:51:56.984 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:51:56.984 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:56.985 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:51:56.985 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:56.985 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:56.986 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:56.986 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:56.986 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:56.986 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:56.987 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:56.987 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:56.987 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:56.988 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:56.988 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:56.988 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:56.988 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:56.989 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:56.989 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:56.989 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:56.989 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:56.990 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:56.990 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:56.990 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:56.991 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:56.991 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:56.991 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:56.991 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:56.991 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:56.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:56.992 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:56.992 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:56.993 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:56.993 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:56.993 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:56.993 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:56.993 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:56.994 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:56.994 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:56.994 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:56.995 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:56.995 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:56.995 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:56.995 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:56.995 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:56.996 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:56.996 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:56.996 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:56.997 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:56.997 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:56.997 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:56.997 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:56.998 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:56.998 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:56.998 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:56.998 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:56.998 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:56.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:56.999 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:56.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.000 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:57.000 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:57.000 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.000 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.001 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.001 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:57.001 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.002 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.002 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.002 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:57.003 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.003 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.003 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.004 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:57.004 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:57.004 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.004 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.005 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.006 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:57.006 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:57.006 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.007 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.007 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.007 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:57.008 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.008 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.009 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:57.009 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.010 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.010 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:57.010 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:57.011 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.011 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.011 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.012 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:57.012 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:57.012 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.013 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.013 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.013 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:57.014 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.014 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.015 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:57.015 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.015 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.015 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.016 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:57.016 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:57.016 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.017 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.017 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.017 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.018 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:57.018 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:57.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.019 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.019 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.019 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:57.019 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.020 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.020 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:57.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.020 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.021 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.021 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:57.021 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.022 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.022 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:57.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.022 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.022 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.023 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:51:57.023 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.023 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.024 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:57.024 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:57.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fefac0650b0 msgr2=0x7fefac067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fefac0650b0 0x7fefac067560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b370 tx=0x7fefc4010000 comp rx=0 tx=0).stop 2022-08-10T17:51:57.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 msgr2=0x7fefcc152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 --2- 172.21.15.150:0/1040268796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefcc06d750 0x7fefcc152410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c780 tx=0x7fefc800cb40 comp rx=0 tx=0).stop 2022-08-10T17:51:57.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd1cc0700 1 -- 172.21.15.150:0/1040268796 reap_dead start 2022-08-10T17:51:57.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd1cc0700 1 -- 172.21.15.150:0/1040268796 reap_dead start 2022-08-10T17:51:57.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 shutdown_connections 2022-08-10T17:51:57.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 >> 172.21.15.150:0/1040268796 conn(0x7fefcc071e40 msgr2=0x7fefcc0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:57.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 shutdown_connections 2022-08-10T17:51:57.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:56.954+0000 7fefd3723700 1 -- 172.21.15.150:0/1040268796 wait complete. 2022-08-10T17:51:57.029 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:51:57.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.178+0000 7fb96ef05700 1 Processor -- start 2022-08-10T17:51:57.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.178+0000 7fb96ef05700 1 -- start start 2022-08-10T17:51:57.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96ef05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb9680c3230 0x7fb9680ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96ef05700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb96806ea90 0x7fb96806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.189 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96ef05700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9680c3600 con 0x7fb96806b1b0 2022-08-10T17:51:57.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96ef05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9680c6080 con 0x7fb9680c3230 2022-08-10T17:51:57.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96ef05700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96806ae80 con 0x7fb96806ea90 2022-08-10T17:51:57.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb9680c3230 0x7fb9680ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb9680c3230 0x7fb9680ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43672/0 (socket says 172.21.15.150:43672) 2022-08-10T17:51:57.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 -- 172.21.15.150:0/1841761357 learned_addr learned my addr 172.21.15.150:0/1841761357 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:57.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96d4a2700 1 --2- 172.21.15.150:0/1841761357 >> v2:172.21.15.197:3300/0 conn(0x7fb96806ea90 0x7fb96806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 -- 172.21.15.150:0/1841761357 >> v2:172.21.15.197:3300/0 conn(0x7fb96806ea90 msgr2=0x7fb96806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:57.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 --2- 172.21.15.150:0/1841761357 >> v2:172.21.15.197:3300/0 conn(0x7fb96806ea90 0x7fb96806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 -- 172.21.15.150:0/1841761357 >> v1:172.21.15.197:6789/0 conn(0x7fb96806b1b0 legacy=0x7fb9680c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:57.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.179+0000 7fb96cca1700 1 -- 172.21.15.150:0/1841761357 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680c5900 con 0x7fb9680c3230 2022-08-10T17:51:57.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96cca1700 1 --2- 172.21.15.150:0/1841761357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9680c3230 0x7fb9680ca420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9680c76b0 tx=0x7fb95c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7866114588595255 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb9677fe700 1 -- 172.21.15.150:0/1841761357 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c011830 con 0x7fb9680c3230 2022-08-10T17:51:57.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb9677fe700 1 -- 172.21.15.150:0/1841761357 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c011990 con 0x7fb9680c3230 2022-08-10T17:51:57.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb9677fe700 1 -- 172.21.15.150:0/1841761357 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c011d20 con 0x7fb9680c3230 2022-08-10T17:51:57.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 -- 172.21.15.150:0/1841761357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9680c3230 msgr2=0x7fb9680ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 --2- 172.21.15.150:0/1841761357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9680c3230 0x7fb9680ca420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9680c76b0 tx=0x7fb95c009a60 comp rx=0 tx=0).stop 2022-08-10T17:51:57.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 -- 172.21.15.150:0/1841761357 shutdown_connections 2022-08-10T17:51:57.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 --2- 172.21.15.150:0/1841761357 >> v2:172.21.15.197:3300/0 conn(0x7fb96806ea90 0x7fb96806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 --2- 172.21.15.150:0/1841761357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9680c3230 0x7fb9680ca420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.180+0000 7fb96ef05700 1 -- 172.21.15.150:0/1841761357 >> 172.21.15.150:0/1841761357 conn(0x7fb968068110 msgr2=0x7fb968068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:57.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.181+0000 7fb96ef05700 1 -- 172.21.15.150:0/1841761357 shutdown_connections 2022-08-10T17:51:57.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.181+0000 7fb96ef05700 1 -- 172.21.15.150:0/1841761357 wait complete. 2022-08-10T17:51:57.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.182+0000 7fb96ef05700 1 Processor -- start 2022-08-10T17:51:57.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.182+0000 7fb96ef05700 1 -- start start 2022-08-10T17:51:57.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 0x7fb968151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96806ea90 0x7fb9681ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9680c3230 0x7fb9681edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681db3c0 con 0x7fb96806ea90 2022-08-10T17:51:57.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681dc1b0 con 0x7fb96806b1b0 2022-08-10T17:51:57.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96ef05700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681db5a0 con 0x7fb9680c3230 2022-08-10T17:51:57.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 0x7fb968151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 0x7fb968151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54270/0 (socket says 172.21.15.150:54270) 2022-08-10T17:51:57.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 -- 172.21.15.150:0/2536118808 learned_addr learned my addr 172.21.15.150:0/2536118808 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:57.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96d4a2700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9680c3230 0x7fb9681edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9680c3230 msgr2=0x7fb9681edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9680c3230 0x7fb9681edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.198 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96806ea90 0x7fb9681ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.183+0000 7fb96cca1700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96806ea90 msgr2=0x7fb9681ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96cca1700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96806ea90 0x7fb9681ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96cca1700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0093e0 con 0x7fb96806b1b0 2022-08-10T17:51:57.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96d4a2700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9680c3230 0x7fb9681edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:51:57.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96806ea90 0x7fb9681ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:51:57.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96cca1700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 0x7fb968151d30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb96806e060 tx=0x7fb95c0045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003520 con 0x7fb96806b1b0 2022-08-10T17:51:57.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c01f070 con 0x7fb96806b1b0 2022-08-10T17:51:57.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9681db880 con 0x7fb96806b1b0 2022-08-10T17:51:57.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003880 con 0x7fb96806b1b0 2022-08-10T17:51:57.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.184+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9681dbe40 con 0x7fb96806b1b0 2022-08-10T17:51:57.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.185+0000 7fb96ef05700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 0x7fb9681ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.185+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681dc2f0 con 0x7fb9680c7d60 2022-08-10T17:51:57.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.185+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 0x7fb9681ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.186+0000 7fb967fff700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb96806aa00 con 0x7fb9680c7d60 2022-08-10T17:51:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.186+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 0x7fb9681ef8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c380 tx=0x7fb95400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.186+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011800 con 0x7fb9680c7d60 2022-08-10T17:51:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.186+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb95c00f050 con 0x7fb96806b1b0 2022-08-10T17:51:57.205 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.186+0000 7fb9657fa700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb950065150 0x7fb950067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb95c021070 con 0x7fb96806b1b0 2022-08-10T17:51:57.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb96d4a2700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb950065150 0x7fb950067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fb95400ce50 con 0x7fb9680c7d60 2022-08-10T17:51:57.206 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 msgr2=0x7fb9681ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 0x7fb9681ef8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c380 tx=0x7fb95400c740 comp rx=0 tx=0).stop 2022-08-10T17:51:57.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 msgr2=0x7fb9681ef8f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:57.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb9657fa700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680c7d60 0x7fb9681ef8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.207 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.187+0000 7fb96d4a2700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb950065150 0x7fb950067600 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb960009ed0 tx=0x7fb96000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.199+0000 7fb96ef05700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 0x7fb9681efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.199+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680aff70 con 0x7fb9680bd870 2022-08-10T17:51:57.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 0x7fb9681efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.208 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb967fff700 1 -- 172.21.15.150:0/2536118808 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb9681dbfd0 con 0x7fb9680bd870 2022-08-10T17:51:57.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb967fff700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 0x7fb9681efe30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c380 tx=0x7fb954004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95401f040 con 0x7fb9680bd870 2022-08-10T17:51:57.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7fb954011960 con 0x7fb9680bd870 2022-08-10T17:51:57.209 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 msgr2=0x7fb9681efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 0x7fb9681efe30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c380 tx=0x7fb954004590 comp rx=0 tx=0).stop 2022-08-10T17:51:57.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 msgr2=0x7fb9681efe30 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:57.210 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.200+0000 7fb9657fa700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9680bd870 0x7fb9681efe30 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c380 tx=0x7fb954004590 comp rx=0 tx=0).stop 2022-08-10T17:51:57.211 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:57.211 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:57.211 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:57.212 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:51:57.212 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:51:57.212 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:57.212 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:57.213 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:51:57.213 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:51:57.213 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.213 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:51:57.214 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:57.214 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:57.214 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:57.215 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:57.215 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:57.215 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:57.215 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:57.216 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:57.217 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.217 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:57.217 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:57.217 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:57.218 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:57.218 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:57.218 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:57.219 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:57.219 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:57.219 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:57.219 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:57.219 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:57.220 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.220 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.220 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:57.220 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:57.221 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:57.221 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:57.221 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:57.221 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:57.222 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:57.222 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:57.222 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:57.223 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:57.223 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:57.223 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:57.223 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:57.223 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:57.224 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:57.224 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:57.224 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:57.225 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:57.225 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:57.225 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:57.225 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:57.225 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:57.226 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:57.226 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:57.226 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:57.227 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.227 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:57.227 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.227 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:57.227 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.228 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:57.228 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:57.228 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.228 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.229 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.229 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.229 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:57.230 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.230 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.230 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.230 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.231 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:57.231 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.231 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.231 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.231 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.232 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:57.232 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:57.232 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.232 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.233 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.233 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.233 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.233 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:57.234 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:57.234 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.234 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.234 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.235 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.235 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:57.235 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.235 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.236 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.236 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.236 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:57.236 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.236 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.237 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.237 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.237 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:57.237 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:57.238 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.238 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.238 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.238 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:57.243 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:57.243 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:57.243 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:57.243 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:57.244 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.244 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.244 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.244 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:57.245 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:57.245 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.245 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.245 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.245 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:57.246 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.246 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.246 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:51:57.246 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.247 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.247 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.247 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:51:57.247 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.248 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.248 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:51:57.248 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.248 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.249 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.249 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:51:57.249 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.250 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.250 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:57.250 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.251 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:51:57.251 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.251 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:57.251 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.252 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.252 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.252 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.252 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:51:57.252 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.253 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:57.253 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:51:57.253 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:57.253 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:57.254 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:57.254 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:51:57.254 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:57.254 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:57.255 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:57.255 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:57.255 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:57.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb950065150 msgr2=0x7fb950067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb950065150 0x7fb950067600 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb960009ed0 tx=0x7fb96000b040 comp rx=0 tx=0).stop 2022-08-10T17:51:57.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 msgr2=0x7fb968151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 --2- 172.21.15.150:0/2536118808 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb96806b1b0 0x7fb968151d30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb96806e060 tx=0x7fb95c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96d4a2700 1 -- 172.21.15.150:0/2536118808 reap_dead start 2022-08-10T17:51:57.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96d4a2700 1 -- 172.21.15.150:0/2536118808 reap_dead start 2022-08-10T17:51:57.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 shutdown_connections 2022-08-10T17:51:57.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 >> 172.21.15.150:0/2536118808 conn(0x7fb968068110 msgr2=0x7fb9680c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:57.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 shutdown_connections 2022-08-10T17:51:57.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.201+0000 7fb96ef05700 1 -- 172.21.15.150:0/2536118808 wait complete. 2022-08-10T17:51:57.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:51:57.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.416+0000 7ff3f553d700 1 Processor -- start 2022-08-10T17:51:57.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.416+0000 7ff3f553d700 1 -- start start 2022-08-10T17:51:57.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.417+0000 7ff3f553d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3f00ca840 0x7ff3f0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.417+0000 7ff3f553d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f0157f30 con 0x7ff3f01553b0 2022-08-10T17:51:57.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.417+0000 7ff3f553d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f01581d0 con 0x7ff3f00c3410 2022-08-10T17:51:57.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.417+0000 7ff3f553d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f01584b0 con 0x7ff3f00ca840 2022-08-10T17:51:57.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.417+0000 7ff3ee7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3f00ca840 0x7ff3f0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3f00ca840 0x7ff3f0153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43694/0 (socket says 172.21.15.150:43694) 2022-08-10T17:51:57.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/4043546760 learned_addr learned my addr 172.21.15.150:0/4043546760 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:57.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/4043546760 >> v1:172.21.15.197:6789/0 conn(0x7ff3f00c3410 legacy=0x7ff3f0154ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-08-10T17:51:57.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/4043546760 >> v1:172.21.15.150:6789/0 conn(0x7ff3f01553b0 legacy=0x7ff3f006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3edffb700 1 -- 172.21.15.150:0/4043546760 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279184923 0 0) 0x7ff3f0157f30 con 0x7ff3f01553b0 2022-08-10T17:51:57.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/4043546760 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0158790 con 0x7ff3f00ca840 2022-08-10T17:51:57.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.418+0000 7ff3ee7fc700 1 --2- 172.21.15.150:0/4043546760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00ca840 0x7ff3f0153d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0006fd0 tx=0x7ff3e0009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baec3674e827e68 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.420+0000 7ff3edffb700 1 -- 172.21.15.150:0/4043546760 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011830 con 0x7ff3f00ca840 2022-08-10T17:51:57.426 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.420+0000 7ff3edffb700 1 -- 172.21.15.150:0/4043546760 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0011990 con 0x7ff3f00ca840 2022-08-10T17:51:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.420+0000 7ff3edffb700 1 -- 172.21.15.150:0/4043546760 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011d40 con 0x7ff3f00ca840 2022-08-10T17:51:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.420+0000 7ff3f553d700 1 -- 172.21.15.150:0/4043546760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00ca840 msgr2=0x7ff3f0153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.420+0000 7ff3f553d700 1 --2- 172.21.15.150:0/4043546760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00ca840 0x7ff3f0153d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0006fd0 tx=0x7ff3e0009a60 comp rx=0 tx=0).stop 2022-08-10T17:51:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.421+0000 7ff3f553d700 1 -- 172.21.15.150:0/4043546760 shutdown_connections 2022-08-10T17:51:57.427 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.421+0000 7ff3f553d700 1 --2- 172.21.15.150:0/4043546760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00ca840 0x7ff3f0153d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.421+0000 7ff3f553d700 1 -- 172.21.15.150:0/4043546760 >> 172.21.15.150:0/4043546760 conn(0x7ff3f0068110 msgr2=0x7ff3f0068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:57.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.421+0000 7ff3f553d700 1 -- 172.21.15.150:0/4043546760 shutdown_connections 2022-08-10T17:51:57.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.421+0000 7ff3f553d700 1 -- 172.21.15.150:0/4043546760 wait complete. 2022-08-10T17:51:57.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.422+0000 7ff3f553d700 1 Processor -- start 2022-08-10T17:51:57.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.423+0000 7ff3f553d700 1 -- start start 2022-08-10T17:51:57.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 0x7ff3f00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3f00ca840 0x7ff3f00c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 0x7ff3f01ec160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01f0250 con 0x7ff3f01553b0 2022-08-10T17:51:57.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00c2fd0 con 0x7ff3f00ca840 2022-08-10T17:51:57.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3f553d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01ef640 con 0x7ff3f00c3410 2022-08-10T17:51:57.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 0x7ff3f01ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3f00ca840 0x7ff3f00c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 0x7ff3f01ec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43700/0 (socket says 172.21.15.150:43700) 2022-08-10T17:51:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ef7fe700 1 -- 172.21.15.150:0/3609101996 learned_addr learned my addr 172.21.15.150:0/3609101996 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 0x7ff3f00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 msgr2=0x7ff3f00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:51:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 msgr2=0x7ff3f00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:51:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 0x7ff3f00c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 0x7ff3f00c8ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 msgr2=0x7ff3f00c8ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:51:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c3410 0x7ff3f00c8ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 msgr2=0x7ff3f01ec160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 0x7ff3f01ec160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00093e0 con 0x7ff3f00ca840 2022-08-10T17:51:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ef7fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f01553b0 0x7ff3f01ec160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:51:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.424+0000 7ff3ee7fc700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3f00ca840 0x7ff3f00c2590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0016000 tx=0x7ff3e00045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.425+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e001b980 con 0x7ff3f00ca840 2022-08-10T17:51:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.425+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e001bb00 con 0x7ff3f00ca840 2022-08-10T17:51:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.425+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0025400 con 0x7ff3f00ca840 2022-08-10T17:51:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.425+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f01ef920 con 0x7ff3f00ca840 2022-08-10T17:51:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.425+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f01efee0 con 0x7ff3f00ca840 2022-08-10T17:51:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3f553d700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f006b620 con 0x7ff3f0156e40 2022-08-10T17:51:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2022-08-10T17:51:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:51:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.426+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:51:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.427+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff3e002b020 con 0x7ff3f00ca840 2022-08-10T17:51:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.428+0000 7ff3d77fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3d00650e0 0x7ff3d0067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.428+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff3e0083560 con 0x7ff3f00ca840 2022-08-10T17:51:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.428+0000 7ff3ef7fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3d00650e0 0x7ff3d0067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.442 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.428+0000 7ff3ef7fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3d00650e0 0x7ff3d0067590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4007fd0 tx=0x7ff3e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:57.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.627+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:57.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.627+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:51:57.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.627+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:51:57.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.627+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:57.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:57.627+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:51:58.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.030+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:58.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.030+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2022-08-10T17:51:58.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.030+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:51:58.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.030+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:51:58.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.030+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:51:58.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.831+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.831+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3f01f0400 con 0x7ff3f0156e40 2022-08-10T17:51:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.831+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800aec0 tx=0x7ff3e80072b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8007cb0 con 0x7ff3f0156e40 2022-08-10T17:51:58.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff3e8007e10 con 0x7ff3f0156e40 2022-08-10T17:51:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800aec0 tx=0x7ff3e80072b0 comp rx=0 tx=0).stop 2022-08-10T17:51:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 msgr2=0x7ff3f01ec6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:58.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.832+0000 7ff3d77fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f0156e40 0x7ff3f01ec6a0 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800aec0 tx=0x7ff3e80072b0 comp rx=0 tx=0).stop 2022-08-10T17:51:58.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.842+0000 7ff3f553d700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 0x7ff3f00c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:58.846 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.842+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01efab0 con 0x7ff3f00c2ad0 2022-08-10T17:51:58.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.842+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 0x7ff3f00c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:58.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.842+0000 7ff3eeffd700 1 -- 172.21.15.150:0/3609101996 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff3f0072890 con 0x7ff3f00c2ad0 2022-08-10T17:51:58.847 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.842+0000 7ff3eeffd700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 0x7ff3f00c1020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800aec0 tx=0x7ff3e8004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:58.848 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8003b20 con 0x7ff3f00c2ad0 2022-08-10T17:51:58.849 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:51:58.849 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:58.849 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:58.850 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:51:58.850 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:51:58.851 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:51:58.851 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:51:58.851 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:51:58.852 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:51:58.852 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:58.852 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:51:58.852 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:58.853 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:51:58.853 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:51:58.853 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:58.854 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:58.854 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:58.855 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:58.855 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:58.855 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:58.856 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:58.856 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:58.856 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:58.857 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:58.857 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:51:58.858 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:51:58.858 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:58.858 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:58.859 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:58.859 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:58.859 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:58.859 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:58.860 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:58.860 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:58.860 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:58.861 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.861 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:51:58.861 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:51:58.862 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:51:58.862 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:51:58.863 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:51:58.863 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:51:58.863 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:58.863 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:51:58.864 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:51:58.864 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:51:58.864 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:51:58.865 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:51:58.865 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:51:58.865 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:51:58.865 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:51:58.866 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:51:58.866 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:51:58.866 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:51:58.866 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:51:58.866 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:51:58.867 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:51:58.867 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:51:58.867 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:51:58.867 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:51:58.868 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:51:58.868 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:58.868 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:51:58.868 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.868 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:51:58.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.869 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:51:58.869 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:51:58.869 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:58.870 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:58.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.870 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:58.870 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:51:58.871 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.871 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:58.872 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:51:58.872 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.873 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.873 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.873 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:51:58.873 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:51:58.874 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:58.874 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:58.874 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:58.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.875 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:51:58.875 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:51:58.875 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:58.876 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:58.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.876 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:58.876 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:51:58.877 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.877 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:58.877 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:51:58.878 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.878 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.878 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.879 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:51:58.879 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:51:58.879 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:58.879 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:58.880 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:58.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.880 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:51:58.881 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:51:58.881 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:51:58.881 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:51:58.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.882 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:51:58.882 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:51:58.882 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.883 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:51:58.883 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:51:58.884 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:51:58.884 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.884 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.885 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:51:58.885 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:51:58.885 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:51:58.886 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:51:58.886 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:51:58.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.886 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.887 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:51:58.887 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:51:58.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.888 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:58.888 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:58.889 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:58.889 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.889 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:58.890 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:51:58.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.890 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:58.890 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:58.891 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:58.891 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.891 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:51:58.892 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:51:58.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:51:58.893 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:51:58.894 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:51:58.894 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:51:58.895 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:51:58.895 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:51:58.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:51:58.895 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:51:58.896 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:51:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4547 (secure 0 0 0) 0x7ff3e8003c80 con 0x7ff3f00c2ad0 2022-08-10T17:51:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 msgr2=0x7ff3f00c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 0x7ff3f00c1020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800aec0 tx=0x7ff3e8004970 comp rx=0 tx=0).stop 2022-08-10T17:51:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 msgr2=0x7ff3f00c1020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:51:58.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3d77fe700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff3f00c2ad0 0x7ff3f00c1020 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3d00650e0 msgr2=0x7ff3d0067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3f553d700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff3d00650e0 0x7ff3d0067590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4007fd0 tx=0x7ff3e4009040 comp rx=0 tx=0).stop 2022-08-10T17:51:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3f00ca840 msgr2=0x7ff3f00c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:58.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3f553d700 1 --2- 172.21.15.150:0/3609101996 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff3f00ca840 0x7ff3f00c2590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0016000 tx=0x7ff3e00045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3ef7fe700 1 -- 172.21.15.150:0/3609101996 reap_dead start 2022-08-10T17:51:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.843+0000 7ff3ef7fe700 1 -- 172.21.15.150:0/3609101996 reap_dead start 2022-08-10T17:51:58.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.844+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 shutdown_connections 2022-08-10T17:51:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.844+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 >> 172.21.15.150:0/3609101996 conn(0x7ff3f0068110 msgr2=0x7ff3f00c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.844+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 shutdown_connections 2022-08-10T17:51:58.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:58.844+0000 7ff3f553d700 1 -- 172.21.15.150:0/3609101996 wait complete. 2022-08-10T17:51:58.902 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:51:58.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:51:59.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.035+0000 7f736e707700 1 Processor -- start 2022-08-10T17:51:59.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.035+0000 7f736e707700 1 -- start start 2022-08-10T17:51:59.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.036+0000 7f736e707700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 0x7f7368159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.036+0000 7f736e707700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 0x7f736815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.036+0000 7f736e707700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73680c4dc0 con 0x7f736806c860 2022-08-10T17:51:59.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.036+0000 7f736e707700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73680c5940 con 0x7f73680647d0 2022-08-10T17:51:59.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.036+0000 7f736e707700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73680c9fc0 con 0x7f7368150af0 2022-08-10T17:51:59.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f73677fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f736806c860 0x7f73680c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56398/0 (socket says 172.21.15.150:56398) 2022-08-10T17:51:59.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 0x7f7368159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f73677fe700 1 -- 172.21.15.150:0/2950471858 learned_addr learned my addr 172.21.15.150:0/2950471858 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:51:59.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f736cca4700 1 --2- 172.21.15.150:0/2950471858 >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 0x7f736815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7366ffd700 1 -- 172.21.15.150:0/2950471858 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848507316 0 0) 0x7f73680c4dc0 con 0x7f736806c860 2022-08-10T17:51:59.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7366ffd700 1 -- 172.21.15.150:0/2950471858 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7354003430 con 0x7f736806c860 2022-08-10T17:51:59.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 -- 172.21.15.150:0/2950471858 >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 msgr2=0x7f736815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:51:59.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 --2- 172.21.15.150:0/2950471858 >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 0x7f736815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 -- 172.21.15.150:0/2950471858 >> v1:172.21.15.150:6789/0 conn(0x7f736806c860 legacy=0x7f73680c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 -- 172.21.15.150:0/2950471858 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736806f9a0 con 0x7f7368150af0 2022-08-10T17:51:59.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f736cca4700 1 --2- 172.21.15.150:0/2950471858 >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 0x7f736815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:51:59.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7367fff700 1 --2- 172.21.15.150:0/2950471858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 0x7f7368159e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73580096b0 tx=0x7f73580099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736753ff3bded8d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:59.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.037+0000 7f7366ffd700 1 -- 172.21.15.150:0/2950471858 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73580107b0 con 0x7f7368150af0 2022-08-10T17:51:59.050 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f7366ffd700 1 -- 172.21.15.150:0/2950471858 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358010910 con 0x7f7368150af0 2022-08-10T17:51:59.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f7366ffd700 1 -- 172.21.15.150:0/2950471858 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358010cc0 con 0x7f7368150af0 2022-08-10T17:51:59.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 -- 172.21.15.150:0/2950471858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 msgr2=0x7f7368159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.051 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 --2- 172.21.15.150:0/2950471858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 0x7f7368159e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73580096b0 tx=0x7f73580099c0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 -- 172.21.15.150:0/2950471858 shutdown_connections 2022-08-10T17:51:59.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 --2- 172.21.15.150:0/2950471858 >> v2:172.21.15.197:3300/0 conn(0x7f73680647d0 0x7f736815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 --2- 172.21.15.150:0/2950471858 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7368150af0 0x7f7368159e60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.052 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.038+0000 7f736e707700 1 -- 172.21.15.150:0/2950471858 >> 172.21.15.150:0/2950471858 conn(0x7f73680c92f0 msgr2=0x7f73680c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:59.055 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.043+0000 7f736e707700 1 -- 172.21.15.150:0/2950471858 shutdown_connections 2022-08-10T17:51:59.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.043+0000 7f736e707700 1 -- 172.21.15.150:0/2950471858 wait complete. 2022-08-10T17:51:59.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.045+0000 7f736e707700 1 Processor -- start 2022-08-10T17:51:59.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.046+0000 7f736e707700 1 -- start start 2022-08-10T17:51:59.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f736806c860 0x7f736814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7368150af0 0x7f73680bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73680be810 con 0x7f73680647d0 2022-08-10T17:51:59.059 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7368159430 con 0x7f7368150af0 2022-08-10T17:51:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.047+0000 7f736e707700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73680bf930 con 0x7f736806c860 2022-08-10T17:51:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43722/0 (socket says 172.21.15.150:43722) 2022-08-10T17:51:59.060 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 -- 172.21.15.150:0/720298448 learned_addr learned my addr 172.21.15.150:0/720298448 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:51:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f73677fe700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f736806c860 0x7f736814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f736cca4700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7368150af0 0x7f73680bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 -- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f736806c860 msgr2=0x7f736814c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f736806c860 0x7f736814c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.061 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 -- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7368150af0 msgr2=0x7f73680bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7368150af0 0x7f73680bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.048+0000 7f7367fff700 1 -- 172.21.15.150:0/720298448 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360009a70 con 0x7f73680647d0 2022-08-10T17:51:59.062 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.051+0000 7f7367fff700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7358009a00 tx=0x7f73580045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.054+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358004230 con 0x7f73680647d0 2022-08-10T17:51:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.054+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73580043b0 con 0x7f73680647d0 2022-08-10T17:51:59.064 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.054+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358003760 con 0x7f73680647d0 2022-08-10T17:51:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.055+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7358009310 con 0x7f73680647d0 2022-08-10T17:51:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.055+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7368159980 con 0x7f73680647d0 2022-08-10T17:51:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.057+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f735802b020 con 0x7f73680647d0 2022-08-10T17:51:59.065 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.057+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7368072890 con 0x7f73680647d0 2022-08-10T17:51:59.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.058+0000 7f7364ff9700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 0x7f73480675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:51:59.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.058+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7358083500 con 0x7f73680647d0 2022-08-10T17:51:59.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.060+0000 7f73677fe700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 0x7f73480675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:51:59.066 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.061+0000 7f73677fe700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 0x7f73480675b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f735c0011e0 tx=0x7f735c007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:51:59.069 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.066+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7358051580 con 0x7f73680647d0 2022-08-10T17:51:59.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.425+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f73680c3ca0 con 0x7f73680647d0 2022-08-10T17:51:59.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.426+0000 7f7364ff9700 1 -- 172.21.15.150:0/720298448 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f7358054ba0 con 0x7f73680647d0 2022-08-10T17:51:59.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 msgr2=0x7f73480675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 0x7f73480675b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f735c0011e0 tx=0x7f735c007c40 comp rx=0 tx=0).stop 2022-08-10T17:51:59.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 msgr2=0x7f736814c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:51:59.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7358009a00 tx=0x7f73580045d0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 shutdown_connections 2022-08-10T17:51:59.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7368150af0 0x7f73680bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73680647d0 0x7f736814c030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7348065100 0x7f73480675b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 --2- 172.21.15.150:0/720298448 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f736806c860 0x7f736814c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:51:59.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 >> 172.21.15.150:0/720298448 conn(0x7f73680c92f0 msgr2=0x7f7368063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:51:59.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 shutdown_connections 2022-08-10T17:51:59.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:51:59.428+0000 7f736e707700 1 -- 172.21.15.150:0/720298448 wait complete. 2022-08-10T17:51:59.447 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:52:09.448 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:52:09.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:09.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.598+0000 7fd8fa476700 1 Processor -- start 2022-08-10T17:52:09.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.598+0000 7fd8fa476700 1 -- start start 2022-08-10T17:52:09.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8fa476700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd8f40c36d0 0x7fd8f40c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:09.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8fa476700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40bf640 con 0x7fd8f414d080 2022-08-10T17:52:09.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8fa476700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40c4060 con 0x7fd8f40705d0 2022-08-10T17:52:09.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8fa476700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f406c2b0 con 0x7fd8f40c36d0 2022-08-10T17:52:09.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8f3fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd8f414d080 0x7fd8f406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56448/0 (socket says 172.21.15.150:56448) 2022-08-10T17:52:09.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.599+0000 7fd8f3fff700 1 -- 172.21.15.150:0/1346552395 learned_addr learned my addr 172.21.15.150:0/1346552395 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:09.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f8a13700 1 --2- 172.21.15.150:0/1346552395 >> v2:172.21.15.197:3300/0 conn(0x7fd8f40c36d0 0x7fd8f40c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:09.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122942625 0 0) 0x7fd8e4001110 con 0x7fd8f414d080 2022-08-10T17:52:09.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e0004540 con 0x7fd8f414d080 2022-08-10T17:52:09.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1504549448 0 0) 0x7fd8e0004540 con 0x7fd8f414d080 2022-08-10T17:52:09.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f8a13700 1 -- 172.21.15.150:0/1346552395 >> v1:172.21.15.197:6789/0 conn(0x7fd8f40705d0 legacy=0x7fd8f40c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f8a13700 1 -- 172.21.15.150:0/1346552395 >> v1:172.21.15.150:6789/0 conn(0x7fd8f414d080 legacy=0x7fd8f406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f8a13700 1 -- 172.21.15.150:0/1346552395 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4156400 con 0x7fd8f40c36d0 2022-08-10T17:52:09.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f8a13700 1 --2- 172.21.15.150:0/1346552395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f40c36d0 0x7fd8f40c3b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e5e56a0cd9b3768 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:09.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00e070 con 0x7fd8f40c36d0 2022-08-10T17:52:09.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00ba20 con 0x7fd8f40c36d0 2022-08-10T17:52:09.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.600+0000 7fd8f2ffd700 1 -- 172.21.15.150:0/1346552395 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4001800 con 0x7fd8f40c36d0 2022-08-10T17:52:09.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.601+0000 7fd8fa476700 1 -- 172.21.15.150:0/1346552395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f40c36d0 msgr2=0x7fd8f40c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.601+0000 7fd8fa476700 1 --2- 172.21.15.150:0/1346552395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f40c36d0 0x7fd8f40c3b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec00b330 comp rx=0 tx=0).stop 2022-08-10T17:52:09.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.601+0000 7fd8fa476700 1 -- 172.21.15.150:0/1346552395 shutdown_connections 2022-08-10T17:52:09.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.601+0000 7fd8fa476700 1 --2- 172.21.15.150:0/1346552395 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f40c36d0 0x7fd8f40c3b20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.601+0000 7fd8fa476700 1 -- 172.21.15.150:0/1346552395 >> 172.21.15.150:0/1346552395 conn(0x7fd8f40c8a10 msgr2=0x7fd8f40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:09.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.602+0000 7fd8fa476700 1 -- 172.21.15.150:0/1346552395 shutdown_connections 2022-08-10T17:52:09.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.602+0000 7fd8fa476700 1 -- 172.21.15.150:0/1346552395 wait complete. 2022-08-10T17:52:09.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.603+0000 7fd8fa476700 1 Processor -- start 2022-08-10T17:52:09.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.603+0000 7fd8fa476700 1 -- start start 2022-08-10T17:52:09.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:09.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd8f40c36d0 0x7fd8f40c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:09.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f414d080 0x7fd8f41ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:09.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41ebec0 con 0x7fd8f40705d0 2022-08-10T17:52:09.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41dcfb0 con 0x7fd8f414d080 2022-08-10T17:52:09.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.604+0000 7fd8fa476700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41540d0 con 0x7fd8f40c36d0 2022-08-10T17:52:09.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:09.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43774/0 (socket says 172.21.15.150:43774) 2022-08-10T17:52:09.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 -- 172.21.15.150:0/4171248235 learned_addr learned my addr 172.21.15.150:0/4171248235 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:09.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f8a13700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f414d080 0x7fd8f41ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:09.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 -- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd8f40c36d0 msgr2=0x7fd8f40c8fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:09.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd8f40c36d0 0x7fd8f40c8fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 -- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f414d080 msgr2=0x7fd8f41ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f414d080 0x7fd8f41ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 -- 172.21.15.150:0/4171248235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009a70 con 0x7fd8f40705d0 2022-08-10T17:52:09.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f3fff700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007fd0 tx=0x7fd8e400c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:09.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40074e0 con 0x7fd8f40705d0 2022-08-10T17:52:09.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e400ce70 con 0x7fd8f40705d0 2022-08-10T17:52:09.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.605+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004910 con 0x7fd8f40705d0 2022-08-10T17:52:09.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.606+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f41f00b0 con 0x7fd8f40705d0 2022-08-10T17:52:09.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.606+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f41ef810 con 0x7fd8f40705d0 2022-08-10T17:52:09.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.607+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f41ebc90 con 0x7fd8f40705d0 2022-08-10T17:52:09.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.608+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd8e401a020 con 0x7fd8f40705d0 2022-08-10T17:52:09.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.608+0000 7fd8f0ff9700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 0x7fd8d40675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.608+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd8e4081fc0 con 0x7fd8f40705d0 2022-08-10T17:52:09.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.610+0000 7fd8f37fe700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 0x7fd8d40675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.613+0000 7fd8f37fe700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 0x7fd8d40675b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40c7300 tx=0x7fd8e8007880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:09.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.613+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd8e4050040 con 0x7fd8f40705d0 2022-08-10T17:52:09.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.987+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd8f40bf640 con 0x7fd8f40705d0 2022-08-10T17:52:09.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.987+0000 7fd8f0ff9700 1 -- 172.21.15.150:0/4171248235 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fd8f40bf640 con 0x7fd8f40705d0 2022-08-10T17:52:09.991 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:09.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 msgr2=0x7fd8d40675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 0x7fd8d40675b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40c7300 tx=0x7fd8e8007880 comp rx=0 tx=0).stop 2022-08-10T17:52:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 msgr2=0x7fd8f41dca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:09.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007fd0 tx=0x7fd8e400c6c0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 shutdown_connections 2022-08-10T17:52:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd8f414d080 0x7fd8f41ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f40705d0 0x7fd8f41dca70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd8d4065100 0x7fd8d40675b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 --2- 172.21.15.150:0/4171248235 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd8f40c36d0 0x7fd8f40c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:09.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 >> 172.21.15.150:0/4171248235 conn(0x7fd8f40c8a10 msgr2=0x7fd8f40c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:09.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 shutdown_connections 2022-08-10T17:52:09.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:09.989+0000 7fd8fa476700 1 -- 172.21.15.150:0/4171248235 wait complete. 2022-08-10T17:52:10.006 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:52:10.006 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:52:10.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:52:10.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.154+0000 7f7ee4c5b700 1 Processor -- start 2022-08-10T17:52:10.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.154+0000 7f7ee4c5b700 1 -- start start 2022-08-10T17:52:10.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ee4c5b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ee0150c60 0x7f7ee00644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ee4c5b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7ee00c3c00 0x7f7ee00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ee4c5b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee006e220 con 0x7f7ee00c4800 2022-08-10T17:52:10.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ee4c5b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee0068930 con 0x7f7ee0150c60 2022-08-10T17:52:10.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ee4c5b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee0068d50 con 0x7f7ee00c3c00 2022-08-10T17:52:10.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ede59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ee0150c60 0x7f7ee00644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7eded9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7ee00c4800 0x7f7ee006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56464/0 (socket says 172.21.15.150:56464) 2022-08-10T17:52:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7ede59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ee0150c60 0x7f7ee00644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43780/0 (socket says 172.21.15.150:43780) 2022-08-10T17:52:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7eded9d700 1 -- 172.21.15.150:0/4163612297 learned_addr learned my addr 172.21.15.150:0/4163612297 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.155+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/4163612297 >> v2:172.21.15.197:3300/0 conn(0x7f7ee00c3c00 0x7f7ee00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ede59c700 1 -- 172.21.15.150:0/4163612297 >> v2:172.21.15.197:3300/0 conn(0x7f7ee00c3c00 msgr2=0x7f7ee00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:10.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ede59c700 1 --2- 172.21.15.150:0/4163612297 >> v2:172.21.15.197:3300/0 conn(0x7f7ee00c3c00 0x7f7ee00c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ede59c700 1 -- 172.21.15.150:0/4163612297 >> v1:172.21.15.150:6789/0 conn(0x7f7ee00c4800 legacy=0x7f7ee006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7edd59a700 1 -- 172.21.15.150:0/4163612297 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348719507 0 0) 0x7f7ee006e220 con 0x7f7ee00c4800 2022-08-10T17:52:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ede59c700 1 -- 172.21.15.150:0/4163612297 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00682b0 con 0x7f7ee0150c60 2022-08-10T17:52:10.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ede59c700 1 --2- 172.21.15.150:0/4163612297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0150c60 0x7f7ee00644b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00c5060 tx=0x7f7ed00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474e01c98777f07c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7edd59a700 1 -- 172.21.15.150:0/4163612297 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011830 con 0x7f7ee0150c60 2022-08-10T17:52:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7edd59a700 1 -- 172.21.15.150:0/4163612297 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0011990 con 0x7f7ee0150c60 2022-08-10T17:52:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7edd59a700 1 -- 172.21.15.150:0/4163612297 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011d40 con 0x7f7ee0150c60 2022-08-10T17:52:10.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/4163612297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0150c60 msgr2=0x7f7ee00644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.156+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/4163612297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0150c60 0x7f7ee00644b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00c5060 tx=0x7f7ed00099c0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/4163612297 shutdown_connections 2022-08-10T17:52:10.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/4163612297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0150c60 0x7f7ee00644b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/4163612297 >> v2:172.21.15.197:3300/0 conn(0x7f7ee00c3c00 0x7f7ee00c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/4163612297 >> 172.21.15.150:0/4163612297 conn(0x7f7ee00c9320 msgr2=0x7f7ee00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/4163612297 shutdown_connections 2022-08-10T17:52:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.157+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/4163612297 wait complete. 2022-08-10T17:52:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.158+0000 7f7ee4c5b700 1 Processor -- start 2022-08-10T17:52:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.158+0000 7f7ee4c5b700 1 -- start start 2022-08-10T17:52:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7ee00c4800 0x7f7ee00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7ee0150c60 0x7f7ee013cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0153840 con 0x7f7ee00c3c00 2022-08-10T17:52:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0152c30 con 0x7f7ee0150c60 2022-08-10T17:52:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0152f10 con 0x7f7ee00c4800 2022-08-10T17:52:10.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43786/0 (socket says 172.21.15.150:43786) 2022-08-10T17:52:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 -- 172.21.15.150:0/172232971 learned_addr learned my addr 172.21.15.150:0/172232971 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7eded9d700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7ee0150c60 0x7f7ee013cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7ee00c4800 0x7f7ee00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7ee00c4800 msgr2=0x7f7ee00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7ee00c4800 0x7f7ee00c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7ee0150c60 msgr2=0x7f7ee013cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7ee0150c60 0x7f7ee013cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009310 con 0x7f7ee00c3c00 2022-08-10T17:52:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ede59c700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009a00 tx=0x7f7ed00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed001a720 con 0x7f7ee00c3c00 2022-08-10T17:52:10.179 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed001a880 con 0x7f7ee00c3c00 2022-08-10T17:52:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee01531f0 con 0x7f7ee00c3c00 2022-08-10T17:52:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.159+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed001ac30 con 0x7f7ee00c3c00 2022-08-10T17:52:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.160+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0154210 con 0x7f7ee00c3c00 2022-08-10T17:52:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.160+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 0x7f7ee013d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.160+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0071e00 con 0x7f7ee00babe0 2022-08-10T17:52:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.160+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 0x7f7ee013d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eddd9b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ee013d800 con 0x7f7ee00babe0 2022-08-10T17:52:10.181 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 0x7f7ee013d2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ee01555b0 tx=0x7f7ed400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7ed002b030 con 0x7f7ee00c3c00 2022-08-10T17:52:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7ebc0650b0 0x7f7ebc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4014680 con 0x7f7ee00babe0 2022-08-10T17:52:10.182 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7ed00833a0 con 0x7f7ee00c3c00 2022-08-10T17:52:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eded9d700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7ebc0650b0 0x7f7ebc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f7ed40147e0 con 0x7f7ee00babe0 2022-08-10T17:52:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 msgr2=0x7f7ee013d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 0x7f7ee013d2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ee01555b0 tx=0x7f7ed400b9d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.183 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 msgr2=0x7f7ee013d2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.161+0000 7f7eceffd700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00babe0 0x7f7ee013d2c0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ee01555b0 tx=0x7f7ed400b9d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.184 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.162+0000 7f7eded9d700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7ebc0650b0 0x7f7ebc067560 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007e40 tx=0x7f7ed8007d90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.169+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 0x7f7ee01ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.169+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0153980 con 0x7f7ee0151260 2022-08-10T17:52:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.169+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 0x7f7ee01ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eddd9b700 1 -- 172.21.15.150:0/172232971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7ee0153b20 con 0x7f7ee0151260 2022-08-10T17:52:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eddd9b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 0x7f7ee01ef2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4019000 tx=0x7f7ed40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed401ed80 con 0x7f7ee0151260 2022-08-10T17:52:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4550 (secure 0 0 0) 0x7f7ed4027070 con 0x7f7ee0151260 2022-08-10T17:52:10.187 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 msgr2=0x7f7ee01ef2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 0x7f7ee01ef2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4019000 tx=0x7f7ed40045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 msgr2=0x7f7ee01ef2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.188 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7eceffd700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee0151260 0x7f7ee01ef2e0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4019000 tx=0x7f7ed40045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.189 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:10.189 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:10.189 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:10.189 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:52:10.190 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:52:10.190 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:10.190 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:10.190 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:10.191 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:10.191 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.191 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 13, 2022-08-10T17:52:10.191 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.192 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:10.192 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:10.192 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.192 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.192 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.193 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.194 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.195 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.196 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.196 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.196 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.196 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.197 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.197 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.197 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.197 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:10.198 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:10.198 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:10.198 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:10.198 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:10.199 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:10.199 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.199 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.199 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:10.199 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:10.200 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:10.200 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:10.200 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:10.200 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:10.201 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.201 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:10.201 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.201 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.202 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.202 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.202 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.202 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.203 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.203 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.203 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.203 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.204 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:10.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.204 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:10.204 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.205 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:10.205 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:10.205 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.206 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.206 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.206 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.206 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:10.207 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.207 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.207 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.207 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.208 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:10.208 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.208 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.209 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.209 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.209 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.210 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.210 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.210 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.211 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.211 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.211 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:10.211 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:10.212 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.212 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.213 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.213 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:10.214 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.214 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.215 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.215 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.215 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:10.216 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.216 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.216 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.216 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.217 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.217 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.217 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.217 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.218 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.218 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.218 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.219 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:10.219 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:10.219 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.220 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.220 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.220 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.221 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:10.221 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.222 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.222 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:10.222 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.222 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.223 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.223 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.223 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.224 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.224 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.224 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.225 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.225 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.225 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.226 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:10.226 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:10.226 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.227 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.227 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.227 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.227 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.228 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.228 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:52:10.228 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.228 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.229 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.229 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.229 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.229 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.230 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:10.230 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.230 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.230 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.231 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:10.231 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.231 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.232 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.232 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:10.232 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:10.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7ebc0650b0 msgr2=0x7f7ebc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.170+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7ebc0650b0 0x7f7ebc067560 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007e40 tx=0x7f7ed8007d90 comp rx=0 tx=0).stop 2022-08-10T17:52:10.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 msgr2=0x7f7ee0153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7eded9d700 1 -- 172.21.15.150:0/172232971 reap_dead start 2022-08-10T17:52:10.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009a00 tx=0x7f7ed00045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 shutdown_connections 2022-08-10T17:52:10.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 --2- 172.21.15.150:0/172232971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee00c3c00 0x7f7ee0153cd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.236 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 >> 172.21.15.150:0/172232971 conn(0x7f7ee00c9320 msgr2=0x7f7ee00bb610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 shutdown_connections 2022-08-10T17:52:10.237 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.171+0000 7f7ee4c5b700 1 -- 172.21.15.150:0/172232971 wait complete. 2022-08-10T17:52:10.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:52:10.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.369+0000 7fd619ab7700 1 Processor -- start 2022-08-10T17:52:10.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.369+0000 7fd619ab7700 1 -- start start 2022-08-10T17:52:10.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd619ab7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd61414e970 0x7fd6140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd619ab7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 0x7fd614157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd619ab7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6140c48e0 con 0x7fd61414ed40 2022-08-10T17:52:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd619ab7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6140c13a0 con 0x7fd61414e970 2022-08-10T17:52:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd619ab7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140bcd00 con 0x7fd61406c8a0 2022-08-10T17:52:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd61414e970 0x7fd6140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd612ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 0x7fd614157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd613fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fd61414ed40 0x7fd614158250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:42834/0 (socket says 172.21.15.150:42834) 2022-08-10T17:52:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd613fff700 1 -- 172.21.15.150:0/323345859 learned_addr learned my addr 172.21.15.150:0/323345859 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:10.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd61414e970 0x7fd6140689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54390/0 (socket says 172.21.15.150:54390) 2022-08-10T17:52:10.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 -- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 msgr2=0x7fd614157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 0x7fd614157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 -- 172.21.15.150:0/323345859 >> v1:172.21.15.197:6789/0 conn(0x7fd61414ed40 legacy=0x7fd614158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 -- 172.21.15.150:0/323345859 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614064550 con 0x7fd61414e970 2022-08-10T17:52:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd612ffd700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 0x7fd614157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:10.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.370+0000 7fd6137fe700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd6140689b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6040096e0 tx=0x7fd6040099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=196dae9f7a107457 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd6127fc700 1 -- 172.21.15.150:0/323345859 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040107b0 con 0x7fd61414e970 2022-08-10T17:52:10.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd6127fc700 1 -- 172.21.15.150:0/323345859 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604010910 con 0x7fd61414e970 2022-08-10T17:52:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd6127fc700 1 -- 172.21.15.150:0/323345859 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604010cc0 con 0x7fd61414e970 2022-08-10T17:52:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 -- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 msgr2=0x7fd6140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd6140689b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6040096e0 tx=0x7fd6040099f0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 -- 172.21.15.150:0/323345859 shutdown_connections 2022-08-10T17:52:10.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd6140689b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 --2- 172.21.15.150:0/323345859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61406c8a0 0x7fd614157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 -- 172.21.15.150:0/323345859 >> 172.21.15.150:0/323345859 conn(0x7fd6140c92f0 msgr2=0x7fd6140c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 -- 172.21.15.150:0/323345859 shutdown_connections 2022-08-10T17:52:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.371+0000 7fd619ab7700 1 -- 172.21.15.150:0/323345859 wait complete. 2022-08-10T17:52:10.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.372+0000 7fd619ab7700 1 Processor -- start 2022-08-10T17:52:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.372+0000 7fd619ab7700 1 -- start start 2022-08-10T17:52:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 0x7fd6141ec650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd614140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61414ed40 0x7fd61414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd614143ac0 con 0x7fd61406c8a0 2022-08-10T17:52:10.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141ecb90 con 0x7fd61414e970 2022-08-10T17:52:10.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd619ab7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140bafd0 con 0x7fd61414ed40 2022-08-10T17:52:10.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 0x7fd6141ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 0x7fd6141ec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43806/0 (socket says 172.21.15.150:43806) 2022-08-10T17:52:10.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 -- 172.21.15.150:0/3036695570 learned_addr learned my addr 172.21.15.150:0/3036695570 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:10.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd614140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd613fff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61414ed40 0x7fd61414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61414ed40 msgr2=0x7fd61414c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd61414ed40 0x7fd61414c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 msgr2=0x7fd614140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd614140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd6137fe700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608009310 con 0x7fd61406c8a0 2022-08-10T17:52:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.373+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd61414e970 0x7fd614140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:10.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd6137fe700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 0x7fd6141ec650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6040090b0 tx=0x7fd6040045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604004230 con 0x7fd61406c8a0 2022-08-10T17:52:10.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040043b0 con 0x7fd61406c8a0 2022-08-10T17:52:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd604009310 con 0x7fd61406c8a0 2022-08-10T17:52:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604003760 con 0x7fd61406c8a0 2022-08-10T17:52:10.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.374+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd614143400 con 0x7fd61406c8a0 2022-08-10T17:52:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd619ab7700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 0x7fd61414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd614071e00 con 0x7fd6140bbd30 2022-08-10T17:52:10.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 0x7fd61414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd612ffd700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd614072890 con 0x7fd6140bbd30 2022-08-10T17:52:10.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd60402b020 con 0x7fd61406c8a0 2022-08-10T17:52:10.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 0x7fd61414c850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6141e9890 tx=0x7fd60800f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.375+0000 7fd5fbfff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5f40650e0 0x7fd5f4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd6040835a0 con 0x7fd61406c8a0 2022-08-10T17:52:10.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd613fff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5f40650e0 0x7fd5f4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608004240 con 0x7fd6140bbd30 2022-08-10T17:52:10.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd6080043a0 con 0x7fd6140bbd30 2022-08-10T17:52:10.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 msgr2=0x7fd61414c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 0x7fd61414c850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6141e9890 tx=0x7fd60800f520 comp rx=0 tx=0).stop 2022-08-10T17:52:10.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 msgr2=0x7fd61414c850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd5fbfff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bbd30 0x7fd61414c850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.376+0000 7fd613fff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5f40650e0 0x7fd5f4067590 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd60c005b10 tx=0x7fd60c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd619ab7700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 0x7fd614143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140c8ff0 con 0x7fd6140bab20 2022-08-10T17:52:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 0x7fd614143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd612ffd700 1 -- 172.21.15.150:0/3036695570 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6140c8d10 con 0x7fd6140bab20 2022-08-10T17:52:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd612ffd700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 0x7fd614143de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd608018000 tx=0x7fd6080045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.383+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60801e880 con 0x7fd6140bab20 2022-08-10T17:52:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7fd608024040 con 0x7fd6140bab20 2022-08-10T17:52:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 msgr2=0x7fd614143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd5fbfff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 0x7fd614143de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd608018000 tx=0x7fd6080045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd5fbfff700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 msgr2=0x7fd614143de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd5fbfff700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6140bab20 0x7fd614143de0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.410 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:10.411 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:10.411 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:10.412 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:52:10.412 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:52:10.412 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:10.412 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:10.413 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:10.413 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:10.413 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.413 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:52:10.414 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.414 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:10.414 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:10.414 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.415 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.415 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.415 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.415 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.416 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.416 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.416 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.416 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.416 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.417 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:10.417 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:10.417 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.417 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.418 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.418 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.418 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.418 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.419 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.419 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.419 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.420 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.420 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:10.420 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:10.421 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:10.421 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:10.421 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:10.421 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:10.422 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.422 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.422 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:10.423 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:10.423 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:10.423 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:10.423 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:10.424 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:10.424 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.424 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:10.424 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.425 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.425 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.425 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.425 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.425 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.426 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.426 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.426 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.426 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.427 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:10.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.427 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:10.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.428 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:10.428 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:10.428 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.428 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:10.430 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.430 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.431 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:10.431 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.431 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.431 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.432 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.433 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.433 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.433 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.434 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.434 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:10.435 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:10.435 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.435 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.436 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.436 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:10.436 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.437 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.437 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:10.437 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.438 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.438 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.438 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.439 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.439 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.439 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.440 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:10.440 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:10.440 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.440 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.441 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.441 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:10.442 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.443 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.443 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:10.443 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.443 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.444 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.444 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.444 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.445 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.445 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.445 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.446 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.446 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.446 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:10.447 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:10.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.447 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.448 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.448 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.448 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.448 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.449 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:10.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.449 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.449 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.449 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:52:10.450 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.450 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.451 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:52:10.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.451 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.452 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.452 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 7 2022-08-10T17:52:10.452 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.452 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.453 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:10.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.453 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:52:10.453 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.454 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.454 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.455 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.455 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:52:10.455 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.456 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.456 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:52:10.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.456 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.457 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.457 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:10.457 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.457 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.458 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:10.458 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:10.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5f40650e0 msgr2=0x7fd5f4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5f40650e0 0x7fd5f4067590 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd60c005b10 tx=0x7fd60c009040 comp rx=0 tx=0).stop 2022-08-10T17:52:10.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 msgr2=0x7fd6141ec650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 --2- 172.21.15.150:0/3036695570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd61406c8a0 0x7fd6141ec650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6040090b0 tx=0x7fd6040045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd613fff700 1 -- 172.21.15.150:0/3036695570 reap_dead start 2022-08-10T17:52:10.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd613fff700 1 -- 172.21.15.150:0/3036695570 reap_dead start 2022-08-10T17:52:10.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 shutdown_connections 2022-08-10T17:52:10.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 >> 172.21.15.150:0/3036695570 conn(0x7fd6140c92f0 msgr2=0x7fd6140c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 shutdown_connections 2022-08-10T17:52:10.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.384+0000 7fd619ab7700 1 -- 172.21.15.150:0/3036695570 wait complete. 2022-08-10T17:52:10.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:52:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.619+0000 7fd55efe8700 1 Processor -- start 2022-08-10T17:52:10.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.619+0000 7fd55efe8700 1 -- start start 2022-08-10T17:52:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55efe8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 0x7fd5580c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55efe8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5580c3340 0x7fd5580c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55efe8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55806e070 con 0x7fd5580c8af0 2022-08-10T17:52:10.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55efe8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55806ec10 con 0x7fd5580c3340 2022-08-10T17:52:10.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55efe8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580c37c0 con 0x7fd5580c96b0 2022-08-10T17:52:10.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55cd84700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fd5580c8af0 0x7fd55806e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:42850/0 (socket says 172.21.15.150:42850) 2022-08-10T17:52:10.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55cd84700 1 -- 172.21.15.150:0/1552718052 learned_addr learned my addr 172.21.15.150:0/1552718052 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:10.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd557fff700 1 --2- 172.21.15.150:0/1552718052 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 0x7fd5580c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd55d585700 1 --2- 172.21.15.150:0/1552718052 >> v2:172.21.15.150:3300/0 conn(0x7fd5580c3340 0x7fd5580c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.620+0000 7fd5577fe700 1 -- 172.21.15.150:0/1552718052 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090761002 0 0) 0x7fd55806e070 con 0x7fd5580c8af0 2022-08-10T17:52:10.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd5577fe700 1 -- 172.21.15.150:0/1552718052 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd540003430 con 0x7fd5580c8af0 2022-08-10T17:52:10.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd557fff700 1 -- 172.21.15.150:0/1552718052 >> v2:172.21.15.150:3300/0 conn(0x7fd5580c3340 msgr2=0x7fd5580c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:10.632 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd557fff700 1 --2- 172.21.15.150:0/1552718052 >> v2:172.21.15.150:3300/0 conn(0x7fd5580c3340 0x7fd5580c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd557fff700 1 -- 172.21.15.150:0/1552718052 >> v1:172.21.15.197:6789/0 conn(0x7fd5580c8af0 legacy=0x7fd55806e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.633 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd557fff700 1 -- 172.21.15.150:0/1552718052 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580701c0 con 0x7fd5580c96b0 2022-08-10T17:52:10.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd557fff700 1 --2- 172.21.15.150:0/1552718052 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 0x7fd5580c8ec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006fd0 tx=0x7fd54c009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a7ecae1aa78b892 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd5577fe700 1 -- 172.21.15.150:0/1552718052 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00f830 con 0x7fd5580c96b0 2022-08-10T17:52:10.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd5577fe700 1 -- 172.21.15.150:0/1552718052 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00f990 con 0x7fd5580c96b0 2022-08-10T17:52:10.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.621+0000 7fd5577fe700 1 -- 172.21.15.150:0/1552718052 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00fd00 con 0x7fd5580c96b0 2022-08-10T17:52:10.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 -- 172.21.15.150:0/1552718052 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 msgr2=0x7fd5580c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1552718052 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 0x7fd5580c8ec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd54c006fd0 tx=0x7fd54c009b00 comp rx=0 tx=0).stop 2022-08-10T17:52:10.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 -- 172.21.15.150:0/1552718052 shutdown_connections 2022-08-10T17:52:10.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1552718052 >> v2:172.21.15.150:3300/0 conn(0x7fd5580c3340 0x7fd5580c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1552718052 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c96b0 0x7fd5580c8ec0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.622+0000 7fd55efe8700 1 -- 172.21.15.150:0/1552718052 >> 172.21.15.150:0/1552718052 conn(0x7fd55806b500 msgr2=0x7fd55806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.623+0000 7fd55efe8700 1 -- 172.21.15.150:0/1552718052 shutdown_connections 2022-08-10T17:52:10.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.623+0000 7fd55efe8700 1 -- 172.21.15.150:0/1552718052 wait complete. 2022-08-10T17:52:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.624+0000 7fd55efe8700 1 Processor -- start 2022-08-10T17:52:10.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.625+0000 7fd55efe8700 1 -- start start 2022-08-10T17:52:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5580c3340 0x7fd5581ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 0x7fd5582048c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5580c96b0 0x7fd5581ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580b7010 con 0x7fd5580c96b0 2022-08-10T17:52:10.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581ec330 con 0x7fd5580c3340 2022-08-10T17:52:10.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55efe8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd558204e00 con 0x7fd5580c8af0 2022-08-10T17:52:10.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd557fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 0x7fd5582048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55cd84700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5580c3340 0x7fd5581ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd557fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 0x7fd5582048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58046/0 (socket says 172.21.15.150:58046) 2022-08-10T17:52:10.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd557fff700 1 -- 172.21.15.150:0/1487537004 learned_addr learned my addr 172.21.15.150:0/1487537004 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:10.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.626+0000 7fd55cd84700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5580c3340 0x7fd5581ec7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54416/0 (socket says 172.21.15.150:54416) 2022-08-10T17:52:10.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5580c3340 msgr2=0x7fd5581ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd5580c3340 0x7fd5581ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5580c96b0 msgr2=0x7fd5581ee4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:10.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5580c96b0 0x7fd5581ee4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c006b40 con 0x7fd5580c8af0 2022-08-10T17:52:10.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd557fff700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 0x7fd5582048c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd54c013000 tx=0x7fd54c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c01b050 con 0x7fd5580c8af0 2022-08-10T17:52:10.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c01c040 con 0x7fd5580c8af0 2022-08-10T17:52:10.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.627+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c017b00 con 0x7fd5580c8af0 2022-08-10T17:52:10.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.628+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5580b6770 con 0x7fd5580c8af0 2022-08-10T17:52:10.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.628+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5580b6d30 con 0x7fd5580c8af0 2022-08-10T17:52:10.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.632+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd54c017c60 con 0x7fd5580c8af0 2022-08-10T17:52:10.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 0x7fd534004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd534007d90 con 0x7fd534002a40 2022-08-10T17:52:10.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd5557fa700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5400654e0 0x7fd540067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd55cd84700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 0x7fd534004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd54c083fb0 con 0x7fd5580c8af0 2022-08-10T17:52:10.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.633+0000 7fd55cd84700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd534007f50 con 0x7fd534002a40 2022-08-10T17:52:10.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd55d585700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5400654e0 0x7fd540067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd55cd84700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 0x7fd534004ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd548000f60 tx=0x7fd54800f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480072e0 con 0x7fd534002a40 2022-08-10T17:52:10.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd55d585700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5400654e0 0x7fd540067990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd550003e30 tx=0x7fd55000c060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fd548007440 con 0x7fd534002a40 2022-08-10T17:52:10.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 msgr2=0x7fd534004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 0x7fd534004ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd548000f60 tx=0x7fd54800f8d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 msgr2=0x7fd534004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.634+0000 7fd5557fa700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534002a40 0x7fd534004ef0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd548000f60 tx=0x7fd54800f8d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.653+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 0x7fd534007260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.653+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340078c0 con 0x7fd534006de0 2022-08-10T17:52:10.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.653+0000 7fd55cd84700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 0x7fd534007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.653+0000 7fd55cd84700 1 -- 172.21.15.150:0/1487537004 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd534007a80 con 0x7fd534006de0 2022-08-10T17:52:10.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.653+0000 7fd55cd84700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 0x7fd534007260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd548001eb0 tx=0x7fd5480010a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.662 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54801cc70 con 0x7fd534006de0 2022-08-10T17:52:10.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7fd54801cdd0 con 0x7fd534006de0 2022-08-10T17:52:10.663 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 msgr2=0x7fd534007260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 0x7fd534007260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd548001eb0 tx=0x7fd5480010a0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 msgr2=0x7fd534007260 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:10.664 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd5557fa700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd534006de0 0x7fd534007260 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd548001eb0 tx=0x7fd5480010a0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.665 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:10.665 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:10.666 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:10.666 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:52:10.666 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 128, 2022-08-10T17:52:10.666 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:10.667 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:10.667 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:10.667 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:10.667 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.667 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 14, 2022-08-10T17:52:10.668 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.668 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:10.668 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:10.668 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.669 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.669 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.669 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.669 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.670 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.670 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.670 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.670 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.671 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.671 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:10.671 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:10.671 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.672 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.672 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.672 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.672 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.672 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.673 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.673 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.673 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.673 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.674 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:10.674 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:10.674 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:10.675 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:10.675 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:10.675 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:10.675 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.676 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:10.676 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:10.676 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:10.676 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:10.677 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:10.677 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:10.677 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:10.677 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:10.678 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:10.678 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:10.678 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:10.678 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:10.679 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:10.679 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:10.679 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:10.679 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:10.680 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:10.680 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:10.680 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.680 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:10.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.681 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:10.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.681 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:10.681 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:10.682 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.682 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.682 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.683 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:10.683 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.684 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.684 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:10.684 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.684 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.685 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.685 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:10.685 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.686 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.686 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.687 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:10.687 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:10.687 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.687 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.689 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.689 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:10.689 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.690 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.690 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.690 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.691 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:10.691 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.691 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.691 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:10.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:10.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.693 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:10.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:10.694 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.694 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:10.695 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:10.695 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:10.695 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.695 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.696 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.696 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:10.696 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:10.696 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:10.697 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:10.697 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.697 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.698 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:10.698 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:10.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.698 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.698 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.699 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.699 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.699 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.699 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:10.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.700 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.700 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.700 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:10.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.701 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:10.701 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:10.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:10.702 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:10.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:10.703 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:10.703 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5400654e0 msgr2=0x7fd540067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd5400654e0 0x7fd540067990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd550003e30 tx=0x7fd55000c060 comp rx=0 tx=0).stop 2022-08-10T17:52:10.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.654+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 msgr2=0x7fd5582048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55efe8700 1 --2- 172.21.15.150:0/1487537004 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd5580c8af0 0x7fd5582048c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd54c013000 tx=0x7fd54c0045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55d585700 1 -- 172.21.15.150:0/1487537004 reap_dead start 2022-08-10T17:52:10.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55d585700 1 -- 172.21.15.150:0/1487537004 reap_dead start 2022-08-10T17:52:10.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 shutdown_connections 2022-08-10T17:52:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 >> 172.21.15.150:0/1487537004 conn(0x7fd55806b500 msgr2=0x7fd55806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 shutdown_connections 2022-08-10T17:52:10.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.655+0000 7fd55efe8700 1 -- 172.21.15.150:0/1487537004 wait complete. 2022-08-10T17:52:10.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2022-08-10T17:52:10.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:52:10.708 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2022-08-10T17:52:10.708 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:52:10.709 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:52:10.709 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:52:10.720 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:52:10.720 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:52:10.720 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:10.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.903+0000 7fd243022700 1 Processor -- start 2022-08-10T17:52:10.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.903+0000 7fd243022700 1 -- start start 2022-08-10T17:52:10.919 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.903+0000 7fd243022700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.903+0000 7fd243022700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd243022700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c1521f0 con 0x7fd23c155400 2022-08-10T17:52:10.920 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd243022700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c154710 con 0x7fd23c0c69b0 2022-08-10T17:52:10.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd243022700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c66c0 con 0x7fd23c0c21d0 2022-08-10T17:52:10.921 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd23bfff700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7fd23c155400 legacy=0x7fd23c0c59c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:10.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd2415bf700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.922 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd2415bf700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54434/0 (socket says 172.21.15.150:54434) 2022-08-10T17:52:10.923 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd2415bf700 1 -- 172.21.15.150:0/1954923859 learned_addr learned my addr 172.21.15.150:0/1954923859 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:10.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58060/0 (socket says 172.21.15.150:58060) 2022-08-10T17:52:10.924 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 -- 172.21.15.150:0/1954923859 >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 msgr2=0x7fd23c06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:10.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 --2- 172.21.15.150:0/1954923859 >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.925 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 -- 172.21.15.150:0/1954923859 >> v1:172.21.15.150:6789/0 conn(0x7fd23c155400 legacy=0x7fd23c0c59c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:10.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 -- 172.21.15.150:0/1954923859 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0c6e80 con 0x7fd23c0c21d0 2022-08-10T17:52:10.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd2415bf700 1 --2- 172.21.15.150:0/1954923859 >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:10.926 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd240dbe700 1 --2- 172.21.15.150:0/1954923859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2300096b0 tx=0x7fd2300099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fb119dca99b881 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.904+0000 7fd23b7fe700 1 -- 172.21.15.150:0/1954923859 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230004230 con 0x7fd23c0c21d0 2022-08-10T17:52:10.927 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd23b7fe700 1 -- 172.21.15.150:0/1954923859 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230004390 con 0x7fd23c0c21d0 2022-08-10T17:52:10.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd23b7fe700 1 -- 172.21.15.150:0/1954923859 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300107d0 con 0x7fd23c0c21d0 2022-08-10T17:52:10.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 -- 172.21.15.150:0/1954923859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 msgr2=0x7fd23c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 --2- 172.21.15.150:0/1954923859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2300096b0 tx=0x7fd2300099c0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 -- 172.21.15.150:0/1954923859 shutdown_connections 2022-08-10T17:52:10.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 --2- 172.21.15.150:0/1954923859 >> v2:172.21.15.197:3300/0 conn(0x7fd23c0c69b0 0x7fd23c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 --2- 172.21.15.150:0/1954923859 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c0caa90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 -- 172.21.15.150:0/1954923859 >> 172.21.15.150:0/1954923859 conn(0x7fd23c06fae0 msgr2=0x7fd23c06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:10.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 -- 172.21.15.150:0/1954923859 shutdown_connections 2022-08-10T17:52:10.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.905+0000 7fd243022700 1 -- 172.21.15.150:0/1954923859 wait complete. 2022-08-10T17:52:10.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.906+0000 7fd243022700 1 Processor -- start 2022-08-10T17:52:10.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 -- start start 2022-08-10T17:52:10.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 0x7fd23c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 0x7fd23c1de220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c157fe0 con 0x7fd23c155400 2022-08-10T17:52:10.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1579b0 con 0x7fd23c0c69b0 2022-08-10T17:52:10.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd243022700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c14b400 con 0x7fd23c0c21d0 2022-08-10T17:52:10.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd2415bf700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 msgr2=0x7fd23c1de220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:10.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd2415bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 0x7fd23c1de220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:10.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd240dbe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 0x7fd23c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd240dbe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58066/0 (socket says 172.21.15.150:58066) 2022-08-10T17:52:10.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.907+0000 7fd240dbe700 1 -- 172.21.15.150:0/171018604 learned_addr learned my addr 172.21.15.150:0/171018604 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:10.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 -- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 msgr2=0x7fd23c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:10.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 0x7fd23c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 -- 172.21.15.150:0/171018604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 msgr2=0x7fd23c1de220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:10.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 0x7fd23c1de220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:10.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 -- 172.21.15.150:0/171018604 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009b30 con 0x7fd23c0c21d0 2022-08-10T17:52:10.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd23bfff700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 0x7fd23c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:10.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd240dbe700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd2300090b0 tx=0x7fd2300045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003520 con 0x7fd23c0c21d0 2022-08-10T17:52:10.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2300036a0 con 0x7fd23c0c21d0 2022-08-10T17:52:10.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230009310 con 0x7fd23c0c21d0 2022-08-10T17:52:10.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003a50 con 0x7fd23c0c21d0 2022-08-10T17:52:10.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.908+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c14b670 con 0x7fd23c0c21d0 2022-08-10T17:52:10.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.909+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c158120 con 0x7fd23c0c21d0 2022-08-10T17:52:10.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.909+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd23002c070 con 0x7fd23c0c21d0 2022-08-10T17:52:10.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.910+0000 7fd2397fa700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 0x7fd224067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:10.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.910+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd230083480 con 0x7fd23c0c21d0 2022-08-10T17:52:10.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.910+0000 7fd23bfff700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 0x7fd224067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:10.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.910+0000 7fd23bfff700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 0x7fd224067540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd23c154ad0 tx=0x7fd228009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:10.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:10.918+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd23c158120 con 0x7fd23c0c21d0 2022-08-10T17:52:11.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.248+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd23c14b860 con 0x7fd23c0c21d0 2022-08-10T17:52:11.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.248+0000 7fd2397fa700 1 -- 172.21.15.150:0/171018604 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fd230016600 con 0x7fd23c0c21d0 2022-08-10T17:52:11.253 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:11.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.251+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 msgr2=0x7fd224067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:11.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.251+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 0x7fd224067540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd23c154ad0 tx=0x7fd228009060 comp rx=0 tx=0).stop 2022-08-10T17:52:11.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.251+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 msgr2=0x7fd23c1eb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:11.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.251+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd2300090b0 tx=0x7fd2300045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:11.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 shutdown_connections 2022-08-10T17:52:11.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23c155400 0x7fd23c1de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:11.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd224065090 0x7fd224067540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:11.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd23c0c21d0 0x7fd23c1eb4b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:11.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 --2- 172.21.15.150:0/171018604 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd23c0c69b0 0x7fd23c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:11.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 >> 172.21.15.150:0/171018604 conn(0x7fd23c06fae0 msgr2=0x7fd23c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:11.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 shutdown_connections 2022-08-10T17:52:11.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:11.252+0000 7fd243022700 1 -- 172.21.15.150:0/171018604 wait complete. 2022-08-10T17:52:14.273 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:14.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.399+0000 7ff2deb97700 1 Processor -- start 2022-08-10T17:52:14.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.399+0000 7ff2deb97700 1 -- start start 2022-08-10T17:52:14.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2deb97700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 0x7ff2d81621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:14.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2deb97700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d8070620 con 0x7ff2d8150b80 2022-08-10T17:52:14.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2deb97700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80ca810 con 0x7ff2d8150f50 2022-08-10T17:52:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2deb97700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80c5ac0 con 0x7ff2d81573d0 2022-08-10T17:52:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2dc933700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7ff2d8150b80 legacy=0x7ff2d80c42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2dd134700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 0x7ff2d81621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2d7fff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7ff2d8150f50 0x7ff2d8156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:42898/0 (socket says 172.21.15.150:42898) 2022-08-10T17:52:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.400+0000 7ff2d7fff700 1 -- 172.21.15.150:0/673895745 learned_addr learned my addr 172.21.15.150:0/673895745 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2d77fe700 1 -- 172.21.15.150:0/673895745 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246594651 0 0) 0x7ff2d80ca810 con 0x7ff2d8150f50 2022-08-10T17:52:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2d77fe700 1 -- 172.21.15.150:0/673895745 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc003430 con 0x7ff2d8150f50 2022-08-10T17:52:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2dd134700 1 -- 172.21.15.150:0/673895745 >> v1:172.21.15.197:6789/0 conn(0x7ff2d8150f50 legacy=0x7ff2d8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2dd134700 1 -- 172.21.15.150:0/673895745 >> v1:172.21.15.150:6789/0 conn(0x7ff2d8150b80 legacy=0x7ff2d80c42a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2dd134700 1 -- 172.21.15.150:0/673895745 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8070010 con 0x7ff2d81573d0 2022-08-10T17:52:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2dd134700 1 --2- 172.21.15.150:0/673895745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 0x7ff2d81621f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009dc0 tx=0x7ff2d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87a3bb97fe57a78 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2d77fe700 1 -- 172.21.15.150:0/673895745 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000e070 con 0x7ff2d81573d0 2022-08-10T17:52:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2d77fe700 1 -- 172.21.15.150:0/673895745 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000bae0 con 0x7ff2d81573d0 2022-08-10T17:52:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2d77fe700 1 -- 172.21.15.150:0/673895745 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000be50 con 0x7ff2d81573d0 2022-08-10T17:52:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2deb97700 1 -- 172.21.15.150:0/673895745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 msgr2=0x7ff2d81621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.401+0000 7ff2deb97700 1 --2- 172.21.15.150:0/673895745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 0x7ff2d81621f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009dc0 tx=0x7ff2d000b330 comp rx=0 tx=0).stop 2022-08-10T17:52:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.402+0000 7ff2deb97700 1 -- 172.21.15.150:0/673895745 shutdown_connections 2022-08-10T17:52:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.402+0000 7ff2deb97700 1 --2- 172.21.15.150:0/673895745 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d81573d0 0x7ff2d81621f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.402+0000 7ff2deb97700 1 -- 172.21.15.150:0/673895745 >> 172.21.15.150:0/673895745 conn(0x7ff2d8071e40 msgr2=0x7ff2d806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.402+0000 7ff2deb97700 1 -- 172.21.15.150:0/673895745 shutdown_connections 2022-08-10T17:52:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.402+0000 7ff2deb97700 1 -- 172.21.15.150:0/673895745 wait complete. 2022-08-10T17:52:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.403+0000 7ff2deb97700 1 Processor -- start 2022-08-10T17:52:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.403+0000 7ff2deb97700 1 -- start start 2022-08-10T17:52:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d8150b80 0x7ff2d81ec760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 0x7ff2d8146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8151c90 con 0x7ff2d81573d0 2022-08-10T17:52:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8151340 con 0x7ff2d8150f50 2022-08-10T17:52:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2deb97700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81ebd40 con 0x7ff2d8150b80 2022-08-10T17:52:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2dd134700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 msgr2=0x7ff2d8146140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2dd134700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 0x7ff2d8146140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54462/0 (socket says 172.21.15.150:54462) 2022-08-10T17:52:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 -- 172.21.15.150:0/648392269 learned_addr learned my addr 172.21.15.150:0/648392269 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2dc933700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d8150b80 0x7ff2d81ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 -- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d8150b80 msgr2=0x7ff2d81ec760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d8150b80 0x7ff2d81ec760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 -- 172.21.15.150:0/648392269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 msgr2=0x7ff2d8146140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 0x7ff2d8146140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.404+0000 7ff2d7fff700 1 -- 172.21.15.150:0/648392269 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0009a70 con 0x7ff2d8150f50 2022-08-10T17:52:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2d7fff700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400c3e0 tx=0x7ff2c400c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40074e0 con 0x7ff2d8150f50 2022-08-10T17:52:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4007640 con 0x7ff2d8150f50 2022-08-10T17:52:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80cb060 con 0x7ff2d8150f50 2022-08-10T17:52:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d8151870 con 0x7ff2d8150f50 2022-08-10T17:52:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.405+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40059c0 con 0x7ff2d8150f50 2022-08-10T17:52:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.407+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff2c4019030 con 0x7ff2d8150f50 2022-08-10T17:52:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.407+0000 7ff2d57fa700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 0x7ff2c0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.408+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff2c4081320 con 0x7ff2d8150f50 2022-08-10T17:52:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.408+0000 7ff2dc933700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 0x7ff2c0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.408+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b4005170 con 0x7ff2d8150f50 2022-08-10T17:52:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.408+0000 7ff2dc933700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 0x7ff2c0067510 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0092d0 tx=0x7ff2cc009260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.415+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff2c404a6b0 con 0x7ff2d8150f50 2022-08-10T17:52:14.789 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.785+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff2b40059a0 con 0x7ff2d8150f50 2022-08-10T17:52:14.790 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.786+0000 7ff2d57fa700 1 -- 172.21.15.150:0/648392269 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7ff2c4017020 con 0x7ff2d8150f50 2022-08-10T17:52:14.790 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:14.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 msgr2=0x7ff2c0067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:14.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 0x7ff2c0067510 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0092d0 tx=0x7ff2cc009260 comp rx=0 tx=0).stop 2022-08-10T17:52:14.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 msgr2=0x7ff2d80cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:14.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400c3e0 tx=0x7ff2c400c6f0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 shutdown_connections 2022-08-10T17:52:14.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d81573d0 0x7ff2d8146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2c0065060 0x7ff2c0067510 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2d8150b80 0x7ff2d81ec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 --2- 172.21.15.150:0/648392269 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff2d8150f50 0x7ff2d80cc050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:14.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 >> 172.21.15.150:0/648392269 conn(0x7ff2d8071e40 msgr2=0x7ff2d80c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:14.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 shutdown_connections 2022-08-10T17:52:14.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:14.788+0000 7ff2deb97700 1 -- 172.21.15.150:0/648392269 wait complete. 2022-08-10T17:52:17.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.943+0000 7efeb5935700 1 Processor -- start 2022-08-10T17:52:17.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.943+0000 7efeb5935700 1 -- start start 2022-08-10T17:52:17.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeb5935700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efeb00c3060 0x7efeb006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeb5935700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 0x7efeb00c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeb5935700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb006a3d0 con 0x7efeb00c7170 2022-08-10T17:52:17.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeb5935700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0070810 con 0x7efeb006af70 2022-08-10T17:52:17.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeb5935700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00c5fb0 con 0x7efeb00c3060 2022-08-10T17:52:17.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeaf7fe700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 msgr2=0x7efeb00c4cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:17.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeaf7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 0x7efeb00c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:17.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeae7fc700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7efeb00c7170 legacy=0x7efeb006a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:17.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.944+0000 7efeaeffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efeb00c3060 0x7efeb006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:17.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efeb00c3060 0x7efeb006ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54496/0 (socket says 172.21.15.150:54496) 2022-08-10T17:52:17.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 -- 172.21.15.150:0/674830090 learned_addr learned my addr 172.21.15.150:0/674830090 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:17.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 -- 172.21.15.150:0/674830090 >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 msgr2=0x7efeb00c4cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:17.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 --2- 172.21.15.150:0/674830090 >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 0x7efeb00c4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:17.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 -- 172.21.15.150:0/674830090 >> v1:172.21.15.150:6789/0 conn(0x7efeb00c7170 legacy=0x7efeb006a860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:17.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 -- 172.21.15.150:0/674830090 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb006fc90 con 0x7efeb00c3060 2022-08-10T17:52:17.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeaeffd700 1 --2- 172.21.15.150:0/674830090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb00c3060 0x7efeb006ea50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeb00cab90 tx=0x7efea0009a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ec0c19086e0f88 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:17.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeadffb700 1 -- 172.21.15.150:0/674830090 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0011830 con 0x7efeb00c3060 2022-08-10T17:52:17.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeadffb700 1 -- 172.21.15.150:0/674830090 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0011990 con 0x7efeb00c3060 2022-08-10T17:52:17.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.945+0000 7efeadffb700 1 -- 172.21.15.150:0/674830090 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0011d40 con 0x7efeb00c3060 2022-08-10T17:52:17.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 -- 172.21.15.150:0/674830090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb00c3060 msgr2=0x7efeb006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:17.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 --2- 172.21.15.150:0/674830090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb00c3060 0x7efeb006ea50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeb00cab90 tx=0x7efea0009a60 comp rx=0 tx=0).stop 2022-08-10T17:52:17.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 -- 172.21.15.150:0/674830090 shutdown_connections 2022-08-10T17:52:17.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 --2- 172.21.15.150:0/674830090 >> v2:172.21.15.150:3300/0 conn(0x7efeb006af70 0x7efeb00c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:17.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 --2- 172.21.15.150:0/674830090 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb00c3060 0x7efeb006ea50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:17.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 -- 172.21.15.150:0/674830090 >> 172.21.15.150:0/674830090 conn(0x7efeb0068be0 msgr2=0x7efeb00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:17.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 -- 172.21.15.150:0/674830090 shutdown_connections 2022-08-10T17:52:17.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.946+0000 7efeb5935700 1 -- 172.21.15.150:0/674830090 wait complete. 2022-08-10T17:52:17.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.948+0000 7efeb5935700 1 Processor -- start 2022-08-10T17:52:17.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.948+0000 7efeb5935700 1 -- start start 2022-08-10T17:52:17.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 0x7efeb01eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efeb00c7170 0x7efeb00abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ac640 con 0x7efeb00c3060 2022-08-10T17:52:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01ef470 con 0x7efeb006af70 2022-08-10T17:52:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeb5935700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ac870 con 0x7efeb00c7170 2022-08-10T17:52:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeae7fc700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 msgr2=0x7efeb01eb8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:17.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeae7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 0x7efeb01eb8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeaeffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeaeffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54502/0 (socket says 172.21.15.150:54502) 2022-08-10T17:52:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeaeffd700 1 -- 172.21.15.150:0/1235451861 learned_addr learned my addr 172.21.15.150:0/1235451861 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:17.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.949+0000 7efeaf7fe700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efeb00c7170 0x7efeb00abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 -- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efeb00c7170 msgr2=0x7efeb00abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efeb00c7170 0x7efeb00abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 -- 172.21.15.150:0/1235451861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 msgr2=0x7efeb01eb8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 0x7efeb01eb8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:17.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 -- 172.21.15.150:0/1235451861 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00093e0 con 0x7efeb006af70 2022-08-10T17:52:17.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeaeffd700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efea0011db0 tx=0x7efea00045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:17.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001b7f0 con 0x7efeb006af70 2022-08-10T17:52:17.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea001b990 con 0x7efeb006af70 2022-08-10T17:52:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00acb30 con 0x7efeb006af70 2022-08-10T17:52:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001bd40 con 0x7efeb006af70 2022-08-10T17:52:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.950+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb00ad0f0 con 0x7efeb006af70 2022-08-10T17:52:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.951+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb01ef750 con 0x7efeb006af70 2022-08-10T17:52:17.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.952+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efea002c030 con 0x7efeb006af70 2022-08-10T17:52:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.952+0000 7efe97fff700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 0x7efe90067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.953+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efea0083440 con 0x7efeb006af70 2022-08-10T17:52:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.953+0000 7efeae7fc700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 0x7efe90067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:17.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.953+0000 7efeae7fc700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 0x7efe90067540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efeb01e9540 tx=0x7efea4006c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:17.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:17.960+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7efea00514d0 con 0x7efeb006af70 2022-08-10T17:52:18.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.273+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efeb006ff70 con 0x7efeb006af70 2022-08-10T17:52:18.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.276+0000 7efe97fff700 1 -- 172.21.15.150:0/1235451861 <== mon.1 v2:172.21.15.197:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7efea002a080 con 0x7efeb006af70 2022-08-10T17:52:18.283 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":128,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:18.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.279+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 msgr2=0x7efe90067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:18.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.279+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 0x7efe90067540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efeb01e9540 tx=0x7efea4006c80 comp rx=0 tx=0).stop 2022-08-10T17:52:18.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.279+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 msgr2=0x7efeb01ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:18.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.279+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efea0011db0 tx=0x7efea00045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:18.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 shutdown_connections 2022-08-10T17:52:18.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efe90065090 0x7efe90067540 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efeb01e9540 tx=0x7efea4006c80 comp rx=0 tx=0).stop 2022-08-10T17:52:18.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efeb00c7170 0x7efeb00abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:18.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efeb006af70 0x7efeb01ef900 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efea0011db0 tx=0x7efea00045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:18.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 --2- 172.21.15.150:0/1235451861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efeb00c3060 0x7efeb01eb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:18.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 >> 172.21.15.150:0/1235451861 conn(0x7efeb0068be0 msgr2=0x7efeb006f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:18.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 shutdown_connections 2022-08-10T17:52:18.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:18.280+0000 7efeb5935700 1 -- 172.21.15.150:0/1235451861 wait complete. 2022-08-10T17:52:21.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:21.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.449+0000 7f7502211700 1 Processor -- start 2022-08-10T17:52:21.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.449+0000 7f7502211700 1 -- start start 2022-08-10T17:52:21.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f7502211700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:21.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f7502211700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:21.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f7502211700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc154240 con 0x7f74fc150d60 2022-08-10T17:52:21.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f7502211700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc068450 con 0x7f74fc0bd5e0 2022-08-10T17:52:21.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f7502211700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc153630 con 0x7f74fc069510 2022-08-10T17:52:21.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74faffd700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 msgr2=0x7f74fc0c5320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fb7fe700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f74fc150d60 legacy=0x7f74fc0c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74faffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58176/0 (socket says 172.21.15.150:58176) 2022-08-10T17:52:21.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 learned_addr learned my addr 172.21.15.150:0/4270566397 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:52:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:21.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.450+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:21.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fb7fe700 1 -- 172.21.15.150:0/4270566397 >> v1:172.21.15.150:6789/0 conn(0x7f74fc150d60 legacy=0x7f74fc0c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:21.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 msgr2=0x7f74fc0c5320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:21.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:52:21.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:21.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:52:21.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:21.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:21.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:21.651+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:52:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fb7fe700 1 -- 172.21.15.150:0/4270566397 >> v1:172.21.15.150:6789/0 conn(0x7f74fc150d60 legacy=0x7f74fc0c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 msgr2=0x7f74fc0c5320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:22.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:52:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:52:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:22.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:22.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.052+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:52:22.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 msgr2=0x7f74fc0c5320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:22.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fb7fe700 1 -- 172.21.15.150:0/4270566397 >> v1:172.21.15.150:6789/0 conn(0x7f74fc150d60 legacy=0x7f74fc0c4410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:22.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:52:22.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:22.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:52:22.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:22.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:22.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:22.853+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:52:24.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 msgr2=0x7f74fc0c5860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:24.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74fc069510 0x7f74fc0c5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:24.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 msgr2=0x7f74fc0c5320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:24.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.150:3300/0 conn(0x7f74fc0bd5e0 0x7f74fc0c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:24.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 -- 172.21.15.150:0/4270566397 >> v1:172.21.15.150:6789/0 conn(0x7f74fc150d60 legacy=0x7f74fc0c4410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:24.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:24.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 -- 172.21.15.150:0/4270566397 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc153910 con 0x7f74dc0057c0 2022-08-10T17:52:24.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74f97fa700 1 -- 172.21.15.150:0/4270566397 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc068450 con 0x7f74dc009460 2022-08-10T17:52:24.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:24.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:24.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:24.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:24.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.450+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:24.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.651+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:24.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.651+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:24.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.651+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:24.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.651+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:24.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:24.651+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:52:25.056 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.052+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.052+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:25.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.052+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:25.057 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.052+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:25.058 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.052+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:52:25.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.701+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058739708 0 0) 0x7f74fc153910 con 0x7f74dc0057c0 2022-08-10T17:52:25.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.701+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e8003430 con 0x7f74dc0057c0 2022-08-10T17:52:25.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333554334 0 0) 0x7f74e8003430 con 0x7f74dc0057c0 2022-08-10T17:52:25.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 msgr2=0x7f74dc00b910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:25.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 --2- 172.21.15.150:0/4270566397 >> v2:172.21.15.197:3300/0 conn(0x7f74dc009460 0x7f74dc00b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc154240 con 0x7f74dc0057c0 2022-08-10T17:52:25.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f74ec004000 con 0x7f74dc0057c0 2022-08-10T17:52:25.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 >> v1:172.21.15.197:6789/0 conn(0x7f74dc0057c0 legacy=0x7f74dc007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:25.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 reap_dead start 2022-08-10T17:52:25.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74e8003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 0x7f74e8004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 0x7f74e800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc068450 con 0x7f74e80050d0 2022-08-10T17:52:25.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e800bfe0 con 0x7f74e80046d0 2022-08-10T17:52:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e800c1a0 con 0x7f74e8003880 2022-08-10T17:52:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fbfff700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 msgr2=0x7f74e800b890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:25.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fbfff700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 0x7f74e800b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74fb7fe700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74e8003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.703+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 0x7f74e8004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 msgr2=0x7f74e8003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:25.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74e8003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 msgr2=0x7f74e800b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 0x7f74e800b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 -- 172.21.15.150:0/4270566397 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8003430 con 0x7f74e80046d0 2022-08-10T17:52:25.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74faffd700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 0x7f74e8004b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f00055b0 tx=0x7f74e8005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729a597e1c6ad4a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:25.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f00059e0 con 0x7f74e80046d0 2022-08-10T17:52:25.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0011070 con 0x7f74e80046d0 2022-08-10T17:52:25.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.704+0000 7f74fa7fc700 1 -- 172.21.15.150:0/4270566397 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0009e20 con 0x7f74e80046d0 2022-08-10T17:52:25.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.705+0000 7f7502211700 1 -- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 msgr2=0x7f74e8004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:25.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.705+0000 7f7502211700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 0x7f74e8004b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f00055b0 tx=0x7f74e8005700 comp rx=0 tx=0).stop 2022-08-10T17:52:25.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 -- 172.21.15.150:0/4270566397 shutdown_connections 2022-08-10T17:52:25.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80050d0 0x7f74e800b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80046d0 0x7f74e8004b40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 --2- 172.21.15.150:0/4270566397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74e8003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 -- 172.21.15.150:0/4270566397 >> 172.21.15.150:0/4270566397 conn(0x7f74fc0c65e0 msgr2=0x7f74fc0c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:25.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 -- 172.21.15.150:0/4270566397 shutdown_connections 2022-08-10T17:52:25.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.707+0000 7f7502211700 1 -- 172.21.15.150:0/4270566397 wait complete. 2022-08-10T17:52:25.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.708+0000 7f7502211700 1 Processor -- start 2022-08-10T17:52:25.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 -- start start 2022-08-10T17:52:25.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 0x7f74fc1ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80050d0 0x7f74fc1ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0ba4a0 con 0x7f74e80046d0 2022-08-10T17:52:25.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0ba780 con 0x7f74e80050d0 2022-08-10T17:52:25.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f7502211700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0baa60 con 0x7f74e8003880 2022-08-10T17:52:25.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f74faffd700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 msgr2=0x7f74fc1ebe40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:25.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.709+0000 7f74faffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 0x7f74fc1ebe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:25.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58218/0 (socket says 172.21.15.150:58218) 2022-08-10T17:52:25.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 -- 172.21.15.150:0/2300448753 learned_addr learned my addr 172.21.15.150:0/2300448753 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:25.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fbfff700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80050d0 0x7f74fc1ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 -- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80050d0 msgr2=0x7f74fc1ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:25.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80050d0 0x7f74fc1ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 -- 172.21.15.150:0/2300448753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 msgr2=0x7f74fc1ebe40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:25.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 0x7f74fc1ebe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:25.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 -- 172.21.15.150:0/2300448753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0bad40 con 0x7f74e8003880 2022-08-10T17:52:25.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.710+0000 7f74fb7fe700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007530 tx=0x7f74ec00a700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:25.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.714+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec011070 con 0x7f74e8003880 2022-08-10T17:52:25.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.714+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00ace0 con 0x7f74e8003880 2022-08-10T17:52:25.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.714+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc0bb020 con 0x7f74e8003880 2022-08-10T17:52:25.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.714+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec016690 con 0x7f74e8003880 2022-08-10T17:52:25.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.714+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc1dd420 con 0x7f74e8003880 2022-08-10T17:52:25.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.715+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc072890 con 0x7f74e8003880 2022-08-10T17:52:25.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.715+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f74ec009420 con 0x7f74e8003880 2022-08-10T17:52:25.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.716+0000 7f74e3fff700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 0x7f74dc067b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:25.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.716+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f74ec082930 con 0x7f74e8003880 2022-08-10T17:52:25.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.716+0000 7f74faffd700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 0x7f74dc067b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:25.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.716+0000 7f74faffd700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 0x7f74dc067b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f74fc1548d0 tx=0x7f74f0011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:25.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:25.721+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f74ec0508b0 con 0x7f74e8003880 2022-08-10T17:52:26.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.089+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f74fc0baba0 con 0x7f74e8003880 2022-08-10T17:52:26.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.092+0000 7f74e3fff700 1 -- 172.21.15.150:0/2300448753 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f74fc0baba0 con 0x7f74e8003880 2022-08-10T17:52:26.099 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":130,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:26.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.095+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 msgr2=0x7f74dc067b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.095+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 0x7f74dc067b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f74fc1548d0 tx=0x7f74f0011000 comp rx=0 tx=0).stop 2022-08-10T17:52:26.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.095+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 msgr2=0x7f74fc1dcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.095+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007530 tx=0x7f74ec00a700 comp rx=0 tx=0).stop 2022-08-10T17:52:26.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 shutdown_connections 2022-08-10T17:52:26.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f74e80050d0 0x7f74fc1ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f74dc065660 0x7f74dc067b10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f74e8003880 0x7f74fc1dcee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 --2- 172.21.15.150:0/2300448753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80046d0 0x7f74fc1ebe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 >> 172.21.15.150:0/2300448753 conn(0x7f74fc0c65e0 msgr2=0x7f74fc0c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:26.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 shutdown_connections 2022-08-10T17:52:26.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.096+0000 7f7502211700 1 -- 172.21.15.150:0/2300448753 wait complete. 2022-08-10T17:52:26.118 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:52:26.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:52:26.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.273+0000 7f105fff9700 1 Processor -- start 2022-08-10T17:52:26.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.273+0000 7f105fff9700 1 -- start start 2022-08-10T17:52:26.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105fff9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105806c8a0 0x7f1058157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105fff9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f105814ed40 0x7f1058158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105fff9700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10580c48e0 con 0x7f105814e970 2022-08-10T17:52:26.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105fff9700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580c13a0 con 0x7f105814ed40 2022-08-10T17:52:26.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105fff9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580bcd00 con 0x7f105806c8a0 2022-08-10T17:52:26.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105d594700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105806c8a0 0x7f1058157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105e596700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f105814ed40 0x7f1058158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.274+0000 7f105dd95700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f105814e970 0x7f10580689b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43036/0 (socket says 172.21.15.150:43036) 2022-08-10T17:52:26.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105dd95700 1 -- 172.21.15.150:0/99776653 learned_addr learned my addr 172.21.15.150:0/99776653 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:26.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105e596700 1 -- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105806c8a0 msgr2=0x7f1058157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:26.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105e596700 1 --2- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105806c8a0 0x7f1058157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105e596700 1 -- 172.21.15.150:0/99776653 >> v1:172.21.15.197:6789/0 conn(0x7f105814e970 legacy=0x7f10580689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105e596700 1 -- 172.21.15.150:0/99776653 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058064550 con 0x7f105814ed40 2022-08-10T17:52:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105cd93700 1 -- 172.21.15.150:0/99776653 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353089155 0 0) 0x7f10580c48e0 con 0x7f105814e970 2022-08-10T17:52:26.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105e596700 1 --2- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814ed40 0x7f1058158250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1050009dc0 tx=0x7f105000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae33ac7acc4ca0d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105cd93700 1 -- 172.21.15.150:0/99776653 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000e070 con 0x7f105814ed40 2022-08-10T17:52:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105cd93700 1 -- 172.21.15.150:0/99776653 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000bae0 con 0x7f105814ed40 2022-08-10T17:52:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.275+0000 7f105cd93700 1 -- 172.21.15.150:0/99776653 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000be90 con 0x7f105814ed40 2022-08-10T17:52:26.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 -- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814ed40 msgr2=0x7f1058158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 --2- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814ed40 0x7f1058158250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1050009dc0 tx=0x7f105000b330 comp rx=0 tx=0).stop 2022-08-10T17:52:26.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 -- 172.21.15.150:0/99776653 shutdown_connections 2022-08-10T17:52:26.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 --2- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814ed40 0x7f1058158250 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 --2- 172.21.15.150:0/99776653 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105806c8a0 0x7f1058157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 -- 172.21.15.150:0/99776653 >> 172.21.15.150:0/99776653 conn(0x7f10580c92f0 msgr2=0x7f10580c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:26.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 -- 172.21.15.150:0/99776653 shutdown_connections 2022-08-10T17:52:26.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.276+0000 7f105fff9700 1 -- 172.21.15.150:0/99776653 wait complete. 2022-08-10T17:52:26.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.277+0000 7f105fff9700 1 Processor -- start 2022-08-10T17:52:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.277+0000 7f105fff9700 1 -- start start 2022-08-10T17:52:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 0x7f10581509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f105814e970 0x7f10581ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105814ed40 0x7f10580c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581478b0 con 0x7f105814e970 2022-08-10T17:52:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581f0250 con 0x7f105806c8a0 2022-08-10T17:52:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10581efcf0 con 0x7f105814ed40 2022-08-10T17:52:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105d594700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f105814e970 msgr2=0x7f10581ec770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:26.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105d594700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f105814e970 0x7f10581ec770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 0x7f10581509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 0x7f10581509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54602/0 (socket says 172.21.15.150:54602) 2022-08-10T17:52:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105e596700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105814ed40 0x7f10580c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 -- 172.21.15.150:0/1034128934 learned_addr learned my addr 172.21.15.150:0/1034128934 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105814ed40 msgr2=0x7f10580c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f105814ed40 0x7f10580c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f105814e970 msgr2=0x7f10581ec770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:26.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f105814e970 0x7f10581ec770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009a70 con 0x7f105806c8a0 2022-08-10T17:52:26.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105dd95700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 0x7f10581509b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10540011e0 tx=0x7f105400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105400cea0 con 0x7f105806c8a0 2022-08-10T17:52:26.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540074e0 con 0x7f105806c8a0 2022-08-10T17:52:26.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540048f0 con 0x7f105806c8a0 2022-08-10T17:52:26.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10581510a0 con 0x7f105806c8a0 2022-08-10T17:52:26.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.278+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10581ebf70 con 0x7f105806c8a0 2022-08-10T17:52:26.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.279+0000 7f105fff9700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 0x7f10581ec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.279+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058071e00 con 0x7f1058147a10 2022-08-10T17:52:26.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.279+0000 7f105d594700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 0x7f10581ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f105d594700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10581ebdd0 con 0x7f1058147a10 2022-08-10T17:52:26.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f105401a020 con 0x7f105806c8a0 2022-08-10T17:52:26.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f105d594700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 0x7f10581ec190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1058158b40 tx=0x7f104800eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1038065060 0x7f1038067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1054081d20 con 0x7f105806c8a0 2022-08-10T17:52:26.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f105e596700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1038065060 0x7f1038067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048004020 con 0x7f1058147a10 2022-08-10T17:52:26.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f1048004180 con 0x7f1058147a10 2022-08-10T17:52:26.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 msgr2=0x7f10581ec190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 0x7f10581ec190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1058158b40 tx=0x7f104800eb00 comp rx=0 tx=0).stop 2022-08-10T17:52:26.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 msgr2=0x7f10581ec190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:26.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.280+0000 7f10467fc700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1058147a10 0x7f10581ec190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.281+0000 7f105e596700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1038065060 0x7f1038067510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f10580c0800 tx=0x7f1050011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f105fff9700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 0x7f105814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105805fda0 con 0x7f105814aff0 2022-08-10T17:52:26.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f105d594700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 0x7f105814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f105d594700 1 -- 172.21.15.150:0/1034128934 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f105806d0e0 con 0x7f105814aff0 2022-08-10T17:52:26.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f105d594700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 0x7f105814b3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1048018000 tx=0x7f1048004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.288+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048005cb0 con 0x7f105814aff0 2022-08-10T17:52:26.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5021 (secure 0 0 0) 0x7f1048005e10 con 0x7f105814aff0 2022-08-10T17:52:26.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 msgr2=0x7f105814b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f10467fc700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 0x7f105814b3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1048018000 tx=0x7f1048004640 comp rx=0 tx=0).stop 2022-08-10T17:52:26.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f10467fc700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 msgr2=0x7f105814b3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:26.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f10467fc700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105814aff0 0x7f105814b3f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.308 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:26.308 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:26.309 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:26.309 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:52:26.309 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 130, 2022-08-10T17:52:26.309 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:26.310 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:26.310 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:26.310 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.310 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:52:26.311 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:26.311 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:26.311 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:26.311 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.311 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.312 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.312 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.312 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.313 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.313 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.313 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.313 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.314 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:26.314 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:26.314 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.314 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.315 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.315 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.315 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.315 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.315 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.316 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.316 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.316 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.316 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:26.317 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:26.317 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:26.317 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:26.317 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:26.318 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:26.318 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:26.318 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:26.318 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:26.319 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:26.319 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:26.319 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:26.319 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:26.319 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:26.320 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:26.320 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:26.320 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.320 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.320 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.321 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.321 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.321 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.321 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.322 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.322 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.322 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.322 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:26.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.323 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:26.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.323 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:26.324 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:26.324 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.324 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.325 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.325 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:26.325 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.326 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.326 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:26.326 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.326 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.327 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.327 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:26.327 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:26.328 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.328 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.328 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.329 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:26.329 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:26.329 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.329 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.330 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.330 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:26.330 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.331 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.331 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:26.331 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.332 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.332 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.332 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:26.333 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:26.333 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.333 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.333 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.334 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:26.334 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:26.334 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.335 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.335 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.335 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:26.335 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.336 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.336 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:26.337 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.337 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.337 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.338 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:26.338 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:26.338 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.338 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.338 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.339 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.339 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.339 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:26.340 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:26.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.340 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.340 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.340 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:26.341 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.341 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.341 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:26.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.342 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.342 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.342 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:52:26.342 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.342 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:52:26.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.343 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.343 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:52:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.345 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:52:26.345 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.345 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:26.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.346 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.346 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.346 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:52:26.346 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.347 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.347 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:52:26.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.348 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.348 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.348 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:26.348 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.348 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.349 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:26.349 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:26.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1038065060 msgr2=0x7f1038067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.351 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1038065060 0x7f1038067510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f10580c0800 tx=0x7f1050011000 comp rx=0 tx=0).stop 2022-08-10T17:52:26.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 msgr2=0x7f10581509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 --2- 172.21.15.150:0/1034128934 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f105806c8a0 0x7f10581509b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10540011e0 tx=0x7f105400c730 comp rx=0 tx=0).stop 2022-08-10T17:52:26.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105e596700 1 -- 172.21.15.150:0/1034128934 reap_dead start 2022-08-10T17:52:26.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105e596700 1 -- 172.21.15.150:0/1034128934 reap_dead start 2022-08-10T17:52:26.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 shutdown_connections 2022-08-10T17:52:26.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 >> 172.21.15.150:0/1034128934 conn(0x7f10580c92f0 msgr2=0x7f10580c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:26.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 shutdown_connections 2022-08-10T17:52:26.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.289+0000 7f105fff9700 1 -- 172.21.15.150:0/1034128934 wait complete. 2022-08-10T17:52:26.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:52:26.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.506+0000 7f596a663700 1 Processor -- start 2022-08-10T17:52:26.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 -- start start 2022-08-10T17:52:26.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 0x7f59640644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596406e220 con 0x7f59640c4800 2022-08-10T17:52:26.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5964068930 con 0x7f5964150c60 2022-08-10T17:52:26.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f596a663700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5964068d50 con 0x7f59640c3c00 2022-08-10T17:52:26.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f5963fff700 1 -- >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 msgr2=0x7f59640644b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:26.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f5963fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 0x7f59640644b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:26.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.507+0000 7f5968c00700 1 -- >> v1:172.21.15.150:6789/0 conn(0x7f59640c4800 legacy=0x7f596406fcd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.150:6789/0 2022-08-10T17:52:26.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58246/0 (socket says 172.21.15.150:58246) 2022-08-10T17:52:26.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 -- 172.21.15.150:0/3911704038 learned_addr learned my addr 172.21.15.150:0/3911704038 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:26.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 -- 172.21.15.150:0/3911704038 >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 msgr2=0x7f59640644b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:26.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 --2- 172.21.15.150:0/3911704038 >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 0x7f59640644b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 -- 172.21.15.150:0/3911704038 >> v1:172.21.15.150:6789/0 conn(0x7f59640c4800 legacy=0x7f596406fcd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:26.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 -- 172.21.15.150:0/3911704038 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640682b0 con 0x7f59640c3c00 2022-08-10T17:52:26.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f59637fe700 1 --2- 172.21.15.150:0/3911704038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f8c104bab07355 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f5962ffd700 1 -- 172.21.15.150:0/3911704038 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011830 con 0x7f59640c3c00 2022-08-10T17:52:26.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f5962ffd700 1 -- 172.21.15.150:0/3911704038 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958011990 con 0x7f59640c3c00 2022-08-10T17:52:26.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.508+0000 7f5962ffd700 1 -- 172.21.15.150:0/3911704038 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011d40 con 0x7f59640c3c00 2022-08-10T17:52:26.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 -- 172.21.15.150:0/3911704038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 msgr2=0x7f59640c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 --2- 172.21.15.150:0/3911704038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958009a60 comp rx=0 tx=0).stop 2022-08-10T17:52:26.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 -- 172.21.15.150:0/3911704038 shutdown_connections 2022-08-10T17:52:26.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 --2- 172.21.15.150:0/3911704038 >> v2:172.21.15.150:3300/0 conn(0x7f5964150c60 0x7f59640644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 --2- 172.21.15.150:0/3911704038 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c3c00 0x7f59640c42c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 -- 172.21.15.150:0/3911704038 >> 172.21.15.150:0/3911704038 conn(0x7f59640c9320 msgr2=0x7f59640c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:26.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 -- 172.21.15.150:0/3911704038 shutdown_connections 2022-08-10T17:52:26.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.509+0000 7f596a663700 1 -- 172.21.15.150:0/3911704038 wait complete. 2022-08-10T17:52:26.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.510+0000 7f596a663700 1 Processor -- start 2022-08-10T17:52:26.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.510+0000 7f596a663700 1 -- start start 2022-08-10T17:52:26.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59640c3c00 0x7f59640c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640c4800 0x7f5964151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 0x7f5964153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964151fe0 con 0x7f59640c4800 2022-08-10T17:52:26.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964153160 con 0x7f59640c3c00 2022-08-10T17:52:26.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f596a663700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c0f00 con 0x7f5964150c60 2022-08-10T17:52:26.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f59637fe700 1 -- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640c4800 msgr2=0x7f5964151560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:3300/0 2022-08-10T17:52:26.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f59637fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640c4800 0x7f5964151560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:26.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5963fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59640c3c00 0x7f59640c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 0x7f5964153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 0x7f5964153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58256/0 (socket says 172.21.15.150:58256) 2022-08-10T17:52:26.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 learned_addr learned my addr 172.21.15.150:0/1450335829 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:26.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5963fff700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59640c3c00 0x7f59640c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54622/0 (socket says 172.21.15.150:54622) 2022-08-10T17:52:26.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59640c3c00 msgr2=0x7f59640c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f59640c3c00 0x7f59640c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.537 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640c4800 msgr2=0x7f5964151560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:26.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59640c4800 0x7f5964151560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.538 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580093e0 con 0x7f5964150c60 2022-08-10T17:52:26.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5968c00700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 0x7f5964153580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f595c00be50 tx=0x7f595c009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.539 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00cd10 con 0x7f5964150c60 2022-08-10T17:52:26.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.511+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00ce70 con 0x7f5964150c60 2022-08-10T17:52:26.540 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.512+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59641435f0 con 0x7f5964150c60 2022-08-10T17:52:26.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.512+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0062f0 con 0x7f5964150c60 2022-08-10T17:52:26.541 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.512+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59641527c0 con 0x7f5964150c60 2022-08-10T17:52:26.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.512+0000 7f596a663700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 0x7f5964153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.512+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5964071e00 con 0x7f596414faa0 2022-08-10T17:52:26.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.513+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f595c01d070 con 0x7f5964150c60 2022-08-10T17:52:26.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5960ff9700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5944065060 0x7f5944067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5963fff700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 0x7f5964153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f595c082610 con 0x7f5964150c60 2022-08-10T17:52:26.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f59637fe700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5944065060 0x7f5944067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5963fff700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59641532a0 con 0x7f596414faa0 2022-08-10T17:52:26.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5963fff700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 0x7f5964153ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5954009570 tx=0x7f5954009930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f59637fe700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5944065060 0x7f5944067510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f59641542d0 tx=0x7f5958008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.514+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954003a00 con 0x7f596414faa0 2022-08-10T17:52:26.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.515+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f5954012600 con 0x7f596414faa0 2022-08-10T17:52:26.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.515+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 msgr2=0x7f5964153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.515+0000 7f5960ff9700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 0x7f5964153ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5954009570 tx=0x7f5954009930 comp rx=0 tx=0).stop 2022-08-10T17:52:26.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.515+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 msgr2=0x7f5964153ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:26.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.515+0000 7f5960ff9700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f596414faa0 0x7f5964153ac0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5954009570 tx=0x7f5954009930 comp rx=0 tx=0).stop 2022-08-10T17:52:26.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.528+0000 7f596a663700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 0x7f59641529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:26.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.528+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5964152f20 con 0x7f59640c0690 2022-08-10T17:52:26.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.528+0000 7f5963fff700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 0x7f59641529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:26.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.528+0000 7f5963fff700 1 -- 172.21.15.150:0/1450335829 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5964072890 con 0x7f59640c0690 2022-08-10T17:52:26.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5963fff700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 0x7f59641529e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5954017000 tx=0x7f59540058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:26.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954005950 con 0x7f59640c0690 2022-08-10T17:52:26.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4536 (secure 0 0 0) 0x7f5954026070 con 0x7f59640c0690 2022-08-10T17:52:26.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 msgr2=0x7f59641529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 0x7f59641529e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5954017000 tx=0x7f59540058e0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 msgr2=0x7f59641529e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:26.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5960ff9700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f59640c0690 0x7f59641529e0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5954017000 tx=0x7f59540058e0 comp rx=0 tx=0).stop 2022-08-10T17:52:26.557 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:26.557 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:26.558 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:26.558 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:52:26.558 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 130, 2022-08-10T17:52:26.559 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:26.559 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:26.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:26.559 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.560 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:52:26.560 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:26.560 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:26.560 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:26.561 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.561 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.561 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.561 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.562 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.562 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.562 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.563 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.563 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.563 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.563 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:26.564 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:26.564 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.564 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.564 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.565 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.565 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.565 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.565 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.566 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.566 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.566 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.567 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:26.567 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:26.567 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:26.567 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:26.568 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:26.568 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:26.568 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:26.568 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:26.569 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:26.569 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:26.569 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:26.569 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:26.570 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:26.570 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:26.570 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:26.570 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:26.571 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:26.571 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:26.571 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:26.571 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:26.572 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:26.572 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:26.572 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:26.572 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:26.573 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:26.573 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.573 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:26.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.574 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:26.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.574 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:26.574 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:26.575 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.575 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.576 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.576 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:26.576 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.577 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.577 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:26.577 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.577 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.578 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.578 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:26.578 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:26.579 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.579 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.579 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.580 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:26.580 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:26.580 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.580 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.581 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.581 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:26.581 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.582 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.582 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:26.582 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.583 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.583 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:26.584 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:26.584 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.584 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.584 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.585 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:26.585 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:26.585 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:26.586 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:26.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.586 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:26.586 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:26.587 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.587 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:26.587 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:26.588 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:26.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.588 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.589 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:26.589 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:26.589 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:26.589 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:26.589 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:26.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.590 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:26.591 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:26.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.591 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.591 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.592 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:26.592 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.592 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.592 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:26.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.593 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.593 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.593 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:26.593 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.594 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:26.594 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:26.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:26.595 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:26.595 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:26.595 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:26.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:26.595 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:26.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:26.596 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:26.596 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:26.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5944065060 msgr2=0x7f5944067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f596a663700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5944065060 0x7f5944067510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f59641542d0 tx=0x7f5958008030 comp rx=0 tx=0).stop 2022-08-10T17:52:26.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 msgr2=0x7f5964153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:26.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f596a663700 1 --2- 172.21.15.150:0/1450335829 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5964150c60 0x7f5964153580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f595c00be50 tx=0x7f595c009f40 comp rx=0 tx=0).stop 2022-08-10T17:52:26.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 reap_dead start 2022-08-10T17:52:26.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.529+0000 7f5968c00700 1 -- 172.21.15.150:0/1450335829 reap_dead start 2022-08-10T17:52:26.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.531+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 shutdown_connections 2022-08-10T17:52:26.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.531+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 >> 172.21.15.150:0/1450335829 conn(0x7f59640c9320 msgr2=0x7f59640bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:26.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.531+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 shutdown_connections 2022-08-10T17:52:26.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:26.531+0000 7f596a663700 1 -- 172.21.15.150:0/1450335829 wait complete. 2022-08-10T17:52:26.601 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:52:46.602 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2022-08-10T17:52:46.602 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2022-08-10T17:52:46.603 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-10T17:52:46.603 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-10T17:52:46.606 INFO:tasks.ceph.mon.a:Started 2022-08-10T17:52:46.607 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:52:46.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:46.929 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.925+0000 7eff1ff9e700 1 Processor -- start 2022-08-10T17:52:46.930 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.925+0000 7eff1ff9e700 1 -- start start 2022-08-10T17:52:46.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1ff9e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1ff9e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 0x7eff180c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1ff9e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff18157190 con 0x7eff180c4f10 2022-08-10T17:52:46.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1ff9e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1806ba20 con 0x7eff18150bd0 2022-08-10T17:52:46.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1ff9e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff181568c0 con 0x7eff180c32f0 2022-08-10T17:52:46.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:46.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44136/0 (socket says 172.21.15.150:44136) 2022-08-10T17:52:46.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 -- 172.21.15.150:0/2004223876 learned_addr learned my addr 172.21.15.150:0/2004223876 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1e53b700 1 --2- 172.21.15.150:0/2004223876 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 0x7eff180c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 -- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 msgr2=0x7eff18159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 -- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 msgr2=0x7eff18159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 --2- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1dd3a700 1 --2- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1e53b700 1 -- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 msgr2=0x7eff18159e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1e53b700 1 --2- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1e53b700 1 -- 172.21.15.150:0/2004223876 >> v1:172.21.15.197:6789/0 conn(0x7eff180c4f10 legacy=0x7eff1806b310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:46.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.926+0000 7eff1e53b700 1 -- 172.21.15.150:0/2004223876 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1806bc30 con 0x7eff180c32f0 2022-08-10T17:52:46.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.927+0000 7eff1e53b700 1 --2- 172.21.15.150:0/2004223876 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 0x7eff180c3770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f303cd2331160086 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:46.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.932+0000 7eff1cd38700 1 -- 172.21.15.150:0/2004223876 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000e070 con 0x7eff180c32f0 2022-08-10T17:52:46.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.932+0000 7eff1cd38700 1 -- 172.21.15.150:0/2004223876 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000bb90 con 0x7eff180c32f0 2022-08-10T17:52:46.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.932+0000 7eff1cd38700 1 -- 172.21.15.150:0/2004223876 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100038a0 con 0x7eff180c32f0 2022-08-10T17:52:46.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 -- 172.21.15.150:0/2004223876 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 msgr2=0x7eff180c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:46.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/2004223876 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 0x7eff180c3770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1000b330 comp rx=0 tx=0).stop 2022-08-10T17:52:46.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 -- 172.21.15.150:0/2004223876 shutdown_connections 2022-08-10T17:52:46.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/2004223876 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff180c32f0 0x7eff180c3770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:46.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/2004223876 >> v2:172.21.15.150:3300/0 conn(0x7eff18150bd0 0x7eff18159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:46.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 -- 172.21.15.150:0/2004223876 >> 172.21.15.150:0/2004223876 conn(0x7eff180c8a10 msgr2=0x7eff180c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:46.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 -- 172.21.15.150:0/2004223876 shutdown_connections 2022-08-10T17:52:46.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.933+0000 7eff1ff9e700 1 -- 172.21.15.150:0/2004223876 wait complete. 2022-08-10T17:52:46.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.934+0000 7eff1ff9e700 1 Processor -- start 2022-08-10T17:52:46.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 -- start start 2022-08-10T17:52:46.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff180c32f0 0x7eff181ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff180c4f10 0x7eff181e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181dfc30 con 0x7eff180c4f10 2022-08-10T17:52:46.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181ded60 con 0x7eff180c32f0 2022-08-10T17:52:46.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.935+0000 7eff1ff9e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff181df620 con 0x7eff18150bd0 2022-08-10T17:52:46.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:46.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58360/0 (socket says 172.21.15.150:58360) 2022-08-10T17:52:46.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 -- 172.21.15.150:0/3394143962 learned_addr learned my addr 172.21.15.150:0/3394143962 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 -- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff180c32f0 msgr2=0x7eff181ec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff180c32f0 0x7eff181ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:46.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 -- 172.21.15.150:0/3394143962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff180c4f10 msgr2=0x7eff181e00c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff180c4f10 0x7eff181e00c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 -- 172.21.15.150:0/3394143962 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009a70 con 0x7eff18150bd0 2022-08-10T17:52:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.936+0000 7eff1e53b700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff1806bb60 tx=0x7eff10004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:46.949 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.937+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012630 con 0x7eff18150bd0 2022-08-10T17:52:46.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.937+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff181ecbf0 con 0x7eff18150bd0 2022-08-10T17:52:46.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.937+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff181df2e0 con 0x7eff18150bd0 2022-08-10T17:52:46.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.938+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100047a0 con 0x7eff18150bd0 2022-08-10T17:52:46.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.938+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100129b0 con 0x7eff18150bd0 2022-08-10T17:52:46.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.938+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc005170 con 0x7eff18150bd0 2022-08-10T17:52:46.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.939+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7eff10012b10 con 0x7eff18150bd0 2022-08-10T17:52:46.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.940+0000 7eff067fc700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 0x7efef8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:46.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.940+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7eff10084200 con 0x7eff18150bd0 2022-08-10T17:52:46.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.940+0000 7eff1dd3a700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 0x7efef8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:46.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.941+0000 7eff1dd3a700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 0x7efef8067560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff08006fa0 tx=0x7eff08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:46.953 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:46.945+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7eff10052160 con 0x7eff18150bd0 2022-08-10T17:52:47.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.237+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efefc0059a0 con 0x7eff18150bd0 2022-08-10T17:52:47.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.238+0000 7eff067fc700 1 -- 172.21.15.150:0/3394143962 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7eff1002a080 con 0x7eff18150bd0 2022-08-10T17:52:47.242 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":130,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 msgr2=0x7efef8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 0x7efef8067560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff08006fa0 tx=0x7eff08008040 comp rx=0 tx=0).stop 2022-08-10T17:52:47.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 msgr2=0x7eff181476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff1806bb60 tx=0x7eff10004950 comp rx=0 tx=0).stop 2022-08-10T17:52:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 shutdown_connections 2022-08-10T17:52:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efef80650b0 0x7efef8067560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:47.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff18150bd0 0x7eff181476a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff180c32f0 0x7eff181ec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 --2- 172.21.15.150:0/3394143962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff180c4f10 0x7eff181e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:47.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 >> 172.21.15.150:0/3394143962 conn(0x7eff180c8a10 msgr2=0x7eff180c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 shutdown_connections 2022-08-10T17:52:47.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:47.240+0000 7eff1ff9e700 1 -- 172.21.15.150:0/3394143962 wait complete. 2022-08-10T17:52:50.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:52:50.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.377+0000 7f5bbcba7700 1 Processor -- start 2022-08-10T17:52:50.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.377+0000 7f5bbcba7700 1 -- start start 2022-08-10T17:52:50.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.378+0000 7f5bbcba7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:50.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.378+0000 7f5bbcba7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb806e510 con 0x7f5bb806f570 2022-08-10T17:52:50.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.378+0000 7f5bbcba7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb806e7b0 con 0x7f5bb814d700 2022-08-10T17:52:50.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.378+0000 7f5bbcba7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8070220 con 0x7f5bb814dad0 2022-08-10T17:52:50.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb6d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5bb806f570 0x7f5bb8156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56842/0 (socket says 172.21.15.150:56842) 2022-08-10T17:52:50.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb6d9d700 1 -- 172.21.15.150:0/3553657486 learned_addr learned my addr 172.21.15.150:0/3553657486 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:50.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:50.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:50.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:50.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:50.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.379+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:52:50.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.580+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:50.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.580+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:50.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.580+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:50.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.580+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:50.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.580+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:52:50.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.981+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:50.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.981+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:50.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.981+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:50.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.981+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:50.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:50.981+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:52:51.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:51.782+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:51.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:51.782+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:52:51.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:51.782+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:52:51.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:51.782+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:52:51.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:51.782+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:52:53.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967978567 0 0) 0x7f5bb806e7b0 con 0x7f5bb814d700 2022-08-10T17:52:53.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003430 con 0x7f5bb814d700 2022-08-10T17:52:53.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317607234 0 0) 0x7f5b9c003430 con 0x7f5bb814d700 2022-08-10T17:52:53.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb806bce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:52:53.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 >> v1:172.21.15.150:6789/0 conn(0x7f5bb806f570 legacy=0x7f5bb8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb806ea90 con 0x7f5bb814d700 2022-08-10T17:52:53.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5ba8001670 con 0x7f5bb814d700 2022-08-10T17:52:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 >> v1:172.21.15.197:6789/0 conn(0x7f5bb814d700 legacy=0x7f5bb80c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9c003880 0x7f5b9c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9c0046d0 0x7f5b9c004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5b9c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8070220 con 0x7f5b9c0046d0 2022-08-10T17:52:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00dc30 con 0x7f5b9c003880 2022-08-10T17:52:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00ddf0 con 0x7f5bb814dad0 2022-08-10T17:52:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.087+0000 7f5bb6d9d700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5b9c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9c003880 msgr2=0x7f5b9c003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5b9c003880 0x7f5b9c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9c0046d0 msgr2=0x7f5b9c004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9c0046d0 0x7f5b9c004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 -- 172.21.15.150:0/3553657486 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb806ea90 con 0x7f5bb814dad0 2022-08-10T17:52:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb6d9d700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5b9c005130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0001e10 tx=0x7f5b9c005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9173a1f43776498 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.088+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0001900 con 0x7f5bb814dad0 2022-08-10T17:52:53.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.089+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0004d30 con 0x7f5bb814dad0 2022-08-10T17:52:53.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.089+0000 7f5bb559a700 1 -- 172.21.15.150:0/3553657486 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0004ea0 con 0x7f5bb814dad0 2022-08-10T17:52:53.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 -- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5b9c005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/3553657486 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5b9c005130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0001e10 tx=0x7f5b9c005700 comp rx=0 tx=0).stop 2022-08-10T17:52:53.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bb6d9d700 1 -- 172.21.15.150:0/3553657486 reap_dead start 2022-08-10T17:52:53.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 -- 172.21.15.150:0/3553657486 shutdown_connections 2022-08-10T17:52:53.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 -- 172.21.15.150:0/3553657486 >> 172.21.15.150:0/3553657486 conn(0x7f5bb80c8a10 msgr2=0x7f5bb80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 -- 172.21.15.150:0/3553657486 shutdown_connections 2022-08-10T17:52:53.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.090+0000 7f5bbcba7700 1 -- 172.21.15.150:0/3553657486 wait complete. 2022-08-10T17:52:53.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.092+0000 7f5bbcba7700 1 Processor -- start 2022-08-10T17:52:53.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.092+0000 7f5bbcba7700 1 -- start start 2022-08-10T17:52:53.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5bb80b6950 0x7f5bb80b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80b61c0 con 0x7f5bb80c2910 2022-08-10T17:52:53.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80b81a0 con 0x7f5bb80b6950 2022-08-10T17:52:53.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bbcba7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80b7300 con 0x7f5bb814dad0 2022-08-10T17:52:53.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44198/0 (socket says 172.21.15.150:44198) 2022-08-10T17:52:53.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/4039280078 learned_addr learned my addr 172.21.15.150:0/4039280078 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:53.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb6d9d700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5bb80b6950 0x7f5bb80b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 msgr2=0x7f5bb814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5bb80b6950 msgr2=0x7f5bb80b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5bb80b6950 0x7f5bb80b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 -- 172.21.15.150:0/4039280078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80c8160 con 0x7f5bb80c2910 2022-08-10T17:52:53.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.093+0000 7f5bb5d9b700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5bac006c50 tx=0x7f5bac013930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.094+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004020 con 0x7f5bb80c2910 2022-08-10T17:52:53.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.094+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80b8420 con 0x7f5bb80c2910 2022-08-10T17:52:53.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.094+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac0041a0 con 0x7f5bb80c2910 2022-08-10T17:52:53.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.095+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac015690 con 0x7f5bb80c2910 2022-08-10T17:52:53.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.095+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80c7e00 con 0x7f5bb80c2910 2022-08-10T17:52:53.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.096+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb806b720 con 0x7f5bb80c2910 2022-08-10T17:52:53.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.096+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5bac027070 con 0x7f5bb80c2910 2022-08-10T17:52:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.097+0000 7f5ba6ffd700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 0x7f5b94067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.097+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5bac082160 con 0x7f5bb80c2910 2022-08-10T17:52:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.097+0000 7f5bb659c700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 0x7f5b94067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.097+0000 7f5bb659c700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 0x7f5b94067560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001050 tx=0x7f5ba8001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.102+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5bac0500c0 con 0x7f5bb80c2910 2022-08-10T17:52:53.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.451+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5bb806b440 con 0x7f5bb80c2910 2022-08-10T17:52:53.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.451+0000 7f5ba6ffd700 1 -- 172.21.15.150:0/4039280078 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f5bac025070 con 0x7f5bb80c2910 2022-08-10T17:52:53.456 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:52:53.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.453+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 msgr2=0x7f5b94067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.453+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 0x7f5b94067560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001050 tx=0x7f5ba8001640 comp rx=0 tx=0).stop 2022-08-10T17:52:53.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.453+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 msgr2=0x7f5bb814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.453+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5bac006c50 tx=0x7f5bac013930 comp rx=0 tx=0).stop 2022-08-10T17:52:53.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.453+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 shutdown_connections 2022-08-10T17:52:53.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5bb80b6950 0x7f5bb80b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5b940650b0 0x7f5b94067560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5bb814dad0 0x7f5bb814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 --2- 172.21.15.150:0/4039280078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb80c2910 0x7f5bb814c9c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 >> 172.21.15.150:0/4039280078 conn(0x7f5bb80c8a10 msgr2=0x7f5bb80c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 shutdown_connections 2022-08-10T17:52:53.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.454+0000 7f5bbcba7700 1 -- 172.21.15.150:0/4039280078 wait complete. 2022-08-10T17:52:53.470 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:52:53.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:52:53.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.612+0000 7fb5a7d6d700 1 Processor -- start 2022-08-10T17:52:53.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.612+0000 7fb5a7d6d700 1 -- start start 2022-08-10T17:52:53.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a7d6d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5a006c860 0x7fb5a0068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a7d6d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a01563c0 con 0x7fb5a0070040 2022-08-10T17:52:53.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a7d6d700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a0150940 con 0x7fb5a00bc830 2022-08-10T17:52:53.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a7d6d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a0153590 con 0x7fb5a006c860 2022-08-10T17:52:53.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a5b09700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fb5a00bc830 0x7fb5a0152e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43236/0 (socket says 172.21.15.150:43236) 2022-08-10T17:52:53.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.613+0000 7fb5a5b09700 1 -- 172.21.15.150:0/2174371323 learned_addr learned my addr 172.21.15.150:0/2174371323 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:53.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274186571 0 0) 0x7fb5a0150940 con 0x7fb5a00bc830 2022-08-10T17:52:53.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588003430 con 0x7fb5a00bc830 2022-08-10T17:52:53.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3996522143 0 0) 0x7fb588003430 con 0x7fb5a00bc830 2022-08-10T17:52:53.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 >> v2:172.21.15.150:3300/0 conn(0x7fb5a006c860 msgr2=0x7fb5a0068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:53.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 --2- 172.21.15.150:0/2174371323 >> v2:172.21.15.150:3300/0 conn(0x7fb5a006c860 0x7fb5a0068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 >> v1:172.21.15.150:6789/0 conn(0x7fb5a0070040 legacy=0x7fb5a00644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0068870 con 0x7fb5a00bc830 2022-08-10T17:52:53.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7fb594001670 con 0x7fb5a00bc830 2022-08-10T17:52:53.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 >> v1:172.21.15.197:6789/0 conn(0x7fb5a00bc830 legacy=0x7fb5a0152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 0x7fb588003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5880046d0 0x7fb588004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5880051a0 0x7fb58800b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c0a0 con 0x7fb5880051a0 2022-08-10T17:52:53.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c210 con 0x7fb5880046d0 2022-08-10T17:52:53.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c3d0 con 0x7fb588003880 2022-08-10T17:52:53.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.614+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 0x7fb588003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a630a700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5880051a0 0x7fb58800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 -- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5880046d0 msgr2=0x7fb588004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:53.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5880046d0 0x7fb588004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 -- 172.21.15.150:0/2174371323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5880051a0 msgr2=0x7fb58800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:53.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5880051a0 0x7fb58800b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 -- 172.21.15.150:0/2174371323 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0068870 con 0x7fb588003880 2022-08-10T17:52:53.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a630a700 1 -- 172.21.15.150:0/2174371323 reap_dead start 2022-08-10T17:52:53.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 0x7fb588003c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb594007fd0 tx=0x7fb588005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a55e3e910768634 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400cd20 con 0x7fb588003880 2022-08-10T17:52:53.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5940070d0 con 0x7fb588003880 2022-08-10T17:52:53.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.615+0000 7fb5a4b07700 1 -- 172.21.15.150:0/2174371323 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400cea0 con 0x7fb588003880 2022-08-10T17:52:53.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.616+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 msgr2=0x7fb588003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.616+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 0x7fb588003c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb594007fd0 tx=0x7fb588005700 comp rx=0 tx=0).stop 2022-08-10T17:52:53.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.619+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/2174371323 shutdown_connections 2022-08-10T17:52:53.634 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.619+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/2174371323 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb588003880 0x7fb588003c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.619+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/2174371323 >> 172.21.15.150:0/2174371323 conn(0x7fb5a00c92f0 msgr2=0x7fb5a00c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.635 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.619+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/2174371323 shutdown_connections 2022-08-10T17:52:53.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.620+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/2174371323 wait complete. 2022-08-10T17:52:53.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.621+0000 7fb5a7d6d700 1 Processor -- start 2022-08-10T17:52:53.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.622+0000 7fb5a7d6d700 1 -- start start 2022-08-10T17:52:53.636 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00c1b00 0x7fb5a0152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5a00c1ed0 0x7fb5a00bda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5a00c5b20 0x7fb5a00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0152a30 con 0x7fb5a00c1b00 2022-08-10T17:52:53.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0152160 con 0x7fb5a00c1ed0 2022-08-10T17:52:53.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a7d6d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0150d20 con 0x7fb5a00c5b20 2022-08-10T17:52:53.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a5308700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5a00c1ed0 0x7fb5a00bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a5308700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5a00c1ed0 0x7fb5a00bda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54808/0 (socket says 172.21.15.150:54808) 2022-08-10T17:52:53.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a5308700 1 -- 172.21.15.150:0/3239653356 learned_addr learned my addr 172.21.15.150:0/3239653356 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:53.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.623+0000 7fb5a630a700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5a00c5b20 0x7fb5a00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5a00c1ed0 msgr2=0x7fb5a00bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb5a00c1ed0 0x7fb5a00bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00c1b00 msgr2=0x7fb5a0152e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:52:53.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00c1b00 0x7fb5a0152e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00c4900 con 0x7fb5a00c5b20 2022-08-10T17:52:53.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a630a700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5a00c5b20 0x7fb5a00c5f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5a006dc30 tx=0x7fb59800fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598003ab0 con 0x7fb5a00c5b20 2022-08-10T17:52:53.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb598003c30 con 0x7fb5a00c5b20 2022-08-10T17:52:53.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980050d0 con 0x7fb5a00c5b20 2022-08-10T17:52:53.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a0152370 con 0x7fb5a00c5b20 2022-08-10T17:52:53.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.624+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a01553b0 con 0x7fb5a00c5b20 2022-08-10T17:52:53.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.626+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb598005250 con 0x7fb5a00c5b20 2022-08-10T17:52:53.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.627+0000 7fb5927fc700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5800650b0 0x7fb580067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.627+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb598081f30 con 0x7fb5a00c5b20 2022-08-10T17:52:53.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.628+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5800650b0 0x7fb580067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.628+0000 7fb5a5b09700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5800650b0 0x7fb580067560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00c38c0 tx=0x7fb594007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.628+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 0x7fb584004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.628+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584007d90 con 0x7fb584002a40 2022-08-10T17:52:53.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.629+0000 7fb5a5308700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 0x7fb584004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.629+0000 7fb5a5308700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb584007f50 con 0x7fb584002a40 2022-08-10T17:52:53.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.629+0000 7fb5a5308700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 0x7fb584004ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00e560 tx=0x7fb59c00e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.630+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c013680 con 0x7fb584002a40 2022-08-10T17:52:53.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.638+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fb59c0137e0 con 0x7fb584002a40 2022-08-10T17:52:53.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.638+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 msgr2=0x7fb584004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.638+0000 7fb5927fc700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 0x7fb584004ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00e560 tx=0x7fb59c00e920 comp rx=0 tx=0).stop 2022-08-10T17:52:53.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.638+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 msgr2=0x7fb584004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:53.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.638+0000 7fb5927fc700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584002a40 0x7fb584004ef0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00e560 tx=0x7fb59c00e920 comp rx=0 tx=0).stop 2022-08-10T17:52:53.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.647+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 0x7fb584007260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.647+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840078c0 con 0x7fb584006de0 2022-08-10T17:52:53.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.647+0000 7fb5a5308700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 0x7fb584007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5a5308700 1 -- 172.21.15.150:0/3239653356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb584007a80 con 0x7fb584006de0 2022-08-10T17:52:53.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5a5308700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 0x7fb584007260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0094f0 tx=0x7fb59c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c023070 con 0x7fb584006de0 2022-08-10T17:52:53.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4379 (secure 0 0 0) 0x7fb59c006480 con 0x7fb584006de0 2022-08-10T17:52:53.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 msgr2=0x7fb584007260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 0x7fb584007260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0094f0 tx=0x7fb59c004750 comp rx=0 tx=0).stop 2022-08-10T17:52:53.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 msgr2=0x7fb584007260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:53.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.648+0000 7fb5927fc700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb584006de0 0x7fb584007260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.658 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:53.659 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:53.659 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:53.660 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:52:53.660 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:52:53.661 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:53.661 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:53.662 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:53.662 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:53.663 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.663 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:52:53.663 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:53.664 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:53.664 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:53.665 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.665 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.666 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.666 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.667 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.667 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.668 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.668 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.669 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.669 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.669 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:53.670 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:53.670 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.671 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.671 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.672 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.672 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.673 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.673 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.673 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.674 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.674 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.675 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:53.676 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:53.676 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:53.676 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:53.676 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:53.677 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:53.677 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:53.677 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:53.677 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:53.678 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:53.678 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:53.678 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:53.678 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:53.679 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:53.679 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:53.679 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:53.680 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.680 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.680 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.680 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.681 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.681 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.681 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.681 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.682 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.682 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.682 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.683 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.686 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.687 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.688 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:53.688 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:53.689 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.689 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.689 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.690 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:53.691 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:53.691 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.691 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.692 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:53.692 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.696 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:53.696 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:53.697 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.697 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.698 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.699 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:53.699 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:53.700 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.700 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.700 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.701 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:53.701 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.702 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.702 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:53.702 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.702 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.703 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.703 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:53.703 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:53.704 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.704 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.704 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.704 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.704 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.705 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:53.705 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:53.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.706 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.706 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.706 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:53.706 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.706 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.707 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:53.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.707 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.708 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.708 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:53.708 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.708 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.709 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:53.709 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5800650b0 msgr2=0x7fb580067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb5800650b0 0x7fb580067560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00c38c0 tx=0x7fb594007000 comp rx=0 tx=0).stop 2022-08-10T17:52:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5a00c5b20 msgr2=0x7fb5a00c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 --2- 172.21.15.150:0/3239653356 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb5a00c5b20 0x7fb5a00c5f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5a006dc30 tx=0x7fb59800fa50 comp rx=0 tx=0).stop 2022-08-10T17:52:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a630a700 1 -- 172.21.15.150:0/3239653356 reap_dead start 2022-08-10T17:52:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a630a700 1 -- 172.21.15.150:0/3239653356 reap_dead start 2022-08-10T17:52:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 shutdown_connections 2022-08-10T17:52:53.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.649+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 >> 172.21.15.150:0/3239653356 conn(0x7fb5a00c92f0 msgr2=0x7fb5a00c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.652+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 shutdown_connections 2022-08-10T17:52:53.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.653+0000 7fb5a7d6d700 1 -- 172.21.15.150:0/3239653356 wait complete. 2022-08-10T17:52:53.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:52:53.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.855+0000 7f7b0f06a700 1 Processor -- start 2022-08-10T17:52:53.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.855+0000 7f7b0f06a700 1 -- start start 2022-08-10T17:52:53.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0f06a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b08158170 0x7f7b080c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0f06a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080c1f40 con 0x7f7b08068bf0 2022-08-10T17:52:53.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0f06a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080c2220 con 0x7f7b08151290 2022-08-10T17:52:53.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0f06a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080c7d90 con 0x7f7b08158170 2022-08-10T17:52:53.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b07fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b08158170 0x7f7b080c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0d607700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7b08068bf0 0x7f7b080c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56910/0 (socket says 172.21.15.150:56910) 2022-08-10T17:52:53.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.856+0000 7f7b0d607700 1 -- 172.21.15.150:0/2862481701 learned_addr learned my addr 172.21.15.150:0/2862481701 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:53.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b07fff700 1 -- 172.21.15.150:0/2862481701 >> v1:172.21.15.197:6789/0 conn(0x7f7b08151290 legacy=0x7f7b08157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b07fff700 1 -- 172.21.15.150:0/2862481701 >> v1:172.21.15.150:6789/0 conn(0x7f7b08068bf0 legacy=0x7f7b080c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b07fff700 1 -- 172.21.15.150:0/2862481701 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080c2500 con 0x7f7b08158170 2022-08-10T17:52:53.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b07fff700 1 --2- 172.21.15.150:0/2862481701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08158170 0x7f7b080c7850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7af40096b0 tx=0x7f7af40099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a3de50c425a98 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b077fe700 1 -- 172.21.15.150:0/2862481701 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4011830 con 0x7f7b08158170 2022-08-10T17:52:53.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b077fe700 1 -- 172.21.15.150:0/2862481701 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af4011990 con 0x7f7b08158170 2022-08-10T17:52:53.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.857+0000 7f7b077fe700 1 -- 172.21.15.150:0/2862481701 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4011d40 con 0x7f7b08158170 2022-08-10T17:52:53.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 -- 172.21.15.150:0/2862481701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08158170 msgr2=0x7f7b080c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/2862481701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08158170 0x7f7b080c7850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7af40096b0 tx=0x7f7af40099c0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 -- 172.21.15.150:0/2862481701 shutdown_connections 2022-08-10T17:52:53.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/2862481701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08158170 0x7f7b080c7850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 -- 172.21.15.150:0/2862481701 >> 172.21.15.150:0/2862481701 conn(0x7f7b0806f880 msgr2=0x7f7b0806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 -- 172.21.15.150:0/2862481701 shutdown_connections 2022-08-10T17:52:53.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.858+0000 7f7b0f06a700 1 -- 172.21.15.150:0/2862481701 wait complete. 2022-08-10T17:52:53.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.859+0000 7f7b0f06a700 1 Processor -- start 2022-08-10T17:52:53.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.859+0000 7f7b0f06a700 1 -- start start 2022-08-10T17:52:53.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 0x7f7b081ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b08151290 0x7f7b0813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b08158170 0x7f7b08140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081ecf90 con 0x7f7b08068bf0 2022-08-10T17:52:53.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08143e00 con 0x7f7b08151290 2022-08-10T17:52:53.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0f06a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08155d50 con 0x7f7b08158170 2022-08-10T17:52:53.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 0x7f7b081ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b08151290 0x7f7b0813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 0x7f7b081ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44232/0 (socket says 172.21.15.150:44232) 2022-08-10T17:52:53.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 -- 172.21.15.150:0/829691643 learned_addr learned my addr 172.21.15.150:0/829691643 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:53.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0d607700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b08158170 0x7f7b08140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b08158170 msgr2=0x7f7b08140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7b08158170 0x7f7b08140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b08151290 msgr2=0x7f7b0813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b08151290 0x7f7b0813f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4009310 con 0x7f7b08068bf0 2022-08-10T17:52:53.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.860+0000 7f7b0ce06700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 0x7f7b081ed3b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00c3f0 tx=0x7f7afc00c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.861+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0052d0 con 0x7f7b08068bf0 2022-08-10T17:52:53.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.861+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00ce10 con 0x7f7b08068bf0 2022-08-10T17:52:53.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.861+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b08155630 con 0x7f7b08068bf0 2022-08-10T17:52:53.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.861+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc005450 con 0x7f7b08068bf0 2022-08-10T17:52:53.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.861+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b081ecbb0 con 0x7f7b08068bf0 2022-08-10T17:52:53.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 0x7f7b080c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080644b0 con 0x7f7b081549c0 2022-08-10T17:52:53.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b07fff700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 0x7f7b080c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7afc019030 con 0x7f7b08068bf0 2022-08-10T17:52:53.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b07fff700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b08071e10 con 0x7f7b081549c0 2022-08-10T17:52:53.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b07fff700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 0x7f7b080c97e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7af40096b0 tx=0x7f7af4004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.862+0000 7f7b057fa700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7af00650b0 0x7f7af0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7afc081490 con 0x7f7b08068bf0 2022-08-10T17:52:53.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b0d607700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7af00650b0 0x7f7af0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af401f040 con 0x7f7b081549c0 2022-08-10T17:52:53.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f7af4003930 con 0x7f7b081549c0 2022-08-10T17:52:53.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 msgr2=0x7f7b080c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 0x7f7b080c97e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7af40096b0 tx=0x7f7af4004640 comp rx=0 tx=0).stop 2022-08-10T17:52:53.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 msgr2=0x7f7b080c97e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:53.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b057fa700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b081549c0 0x7f7b080c97e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.863+0000 7f7b0d607700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7af00650b0 0x7f7af0067560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b00007fd0 tx=0x7f7b00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.876+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 0x7f7b080c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:53.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.876+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081ecda0 con 0x7f7b080c6d20 2022-08-10T17:52:53.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.876+0000 7f7b07fff700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 0x7f7b080c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:53.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.876+0000 7f7b07fff700 1 -- 172.21.15.150:0/829691643 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7b081ed200 con 0x7f7b080c6d20 2022-08-10T17:52:53.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.876+0000 7f7b07fff700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 0x7f7b080c9d20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b08147430 tx=0x7f7af40045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:53.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40335f0 con 0x7f7b080c6d20 2022-08-10T17:52:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5030 (secure 0 0 0) 0x7f7af4003eb0 con 0x7f7b080c6d20 2022-08-10T17:52:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 msgr2=0x7f7b080c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 0x7f7b080c9d20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b08147430 tx=0x7f7af40045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 msgr2=0x7f7b080c9d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:53.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b057fa700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7b080c6d20 0x7f7b080c9d20 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b08147430 tx=0x7f7af40045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:53.890 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:53.890 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:53.890 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:53.891 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:52:53.891 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:52:53.891 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:53.892 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:53.892 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:53.892 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:53.893 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.893 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:52:53.893 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:53.893 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:53.893 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:53.894 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.894 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.894 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.894 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.895 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.895 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.895 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.895 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.896 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.896 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.896 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:53.896 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:53.897 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.898 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.898 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.898 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.898 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.899 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.899 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.899 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.899 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.899 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.900 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:53.900 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:53.900 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:53.901 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:53.901 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:53.901 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:53.901 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:53.901 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:53.902 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:53.902 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:53.902 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:53.902 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:53.903 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:53.903 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:53.903 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:53.903 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:53.904 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:53.904 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:53.904 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:53.904 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:53.904 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:53.905 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:53.905 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:53.905 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:53.905 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:53.906 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.906 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:53.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.906 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:53.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.907 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:53.907 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:53.907 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.908 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.908 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.908 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:53.908 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.909 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.909 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:53.910 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.910 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.910 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.911 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:53.911 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:53.911 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.911 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.912 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.912 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:53.913 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:53.913 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.913 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.913 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.914 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:53.914 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.915 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.915 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:53.915 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.915 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.916 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:53.916 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:53.916 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.917 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.917 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.917 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:53.918 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:53.918 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:53.918 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:53.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:53.919 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:53.919 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.920 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:53.920 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:53.920 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:53.920 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.921 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.921 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:53.921 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:53.922 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:53.922 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:53.922 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:53.922 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.923 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.923 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:53.923 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:53.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.924 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.924 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.924 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:53.924 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.925 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.925 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:53.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.925 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.925 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.926 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:52:53.926 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.926 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:52:53.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.927 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.927 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.927 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:52:53.927 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.928 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.928 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:53.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.928 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:52:53.929 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.929 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:53.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.930 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.930 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.930 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:52:53.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.931 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:53.931 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:52:53.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:53.931 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:53.932 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:53.932 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:52:53.932 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:53.932 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:53.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:53.933 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:53.933 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:53.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7af00650b0 msgr2=0x7f7af0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7af00650b0 0x7f7af0067560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b00007fd0 tx=0x7f7b00009040 comp rx=0 tx=0).stop 2022-08-10T17:52:53.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 msgr2=0x7f7b081ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:53.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 --2- 172.21.15.150:0/829691643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08068bf0 0x7f7b081ed3b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00c3f0 tx=0x7f7afc00c700 comp rx=0 tx=0).stop 2022-08-10T17:52:53.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0d607700 1 -- 172.21.15.150:0/829691643 reap_dead start 2022-08-10T17:52:53.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0d607700 1 -- 172.21.15.150:0/829691643 reap_dead start 2022-08-10T17:52:53.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 shutdown_connections 2022-08-10T17:52:53.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 >> 172.21.15.150:0/829691643 conn(0x7f7b0806f880 msgr2=0x7f7b08159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:53.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 shutdown_connections 2022-08-10T17:52:53.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:53.877+0000 7f7b0f06a700 1 -- 172.21.15.150:0/829691643 wait complete. 2022-08-10T17:52:53.937 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:52:54.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.090+0000 7fe5c1c37700 1 Processor -- start 2022-08-10T17:52:54.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.090+0000 7fe5c1c37700 1 -- start start 2022-08-10T17:52:54.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5c1c37700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5c1c37700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe5bc0c7220 0x7fe5bc0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5c1c37700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0699c0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5c1c37700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c5e10 con 0x7fe5bc0c7220 2022-08-10T17:52:54.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5c1c37700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c1c30 con 0x7fe5bc0c4d90 2022-08-10T17:52:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe5bc0c7220 0x7fe5bc0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58466/0 (socket says 172.21.15.150:58466) 2022-08-10T17:52:54.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5bb7fe700 1 -- 172.21.15.150:0/4096055137 learned_addr learned my addr 172.21.15.150:0/4096055137 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:54.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 -- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 msgr2=0x7fe5bc0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:54.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 -- 172.21.15.150:0/4096055137 >> v1:172.21.15.197:6789/0 conn(0x7fe5bc0c2080 legacy=0x7fe5bc06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 -- 172.21.15.150:0/4096055137 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc068e40 con 0x7fe5bc0c7220 2022-08-10T17:52:54.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5bb7fe700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:54.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.091+0000 7fe5baffd700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c7220 0x7fe5bc0c56a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009710 tx=0x7fe5b0009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfd4a91be631340 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5ba7fc700 1 -- 172.21.15.150:0/4096055137 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00107b0 con 0x7fe5bc0c7220 2022-08-10T17:52:54.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5ba7fc700 1 -- 172.21.15.150:0/4096055137 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b0010910 con 0x7fe5bc0c7220 2022-08-10T17:52:54.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5ba7fc700 1 -- 172.21.15.150:0/4096055137 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0010ca0 con 0x7fe5bc0c7220 2022-08-10T17:52:54.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 -- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c7220 msgr2=0x7fe5bc0c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c7220 0x7fe5bc0c56a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009710 tx=0x7fe5b0009a20 comp rx=0 tx=0).stop 2022-08-10T17:52:54.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 -- 172.21.15.150:0/4096055137 shutdown_connections 2022-08-10T17:52:54.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c4d90 0x7fe5bc0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/4096055137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c7220 0x7fe5bc0c56a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 -- 172.21.15.150:0/4096055137 >> 172.21.15.150:0/4096055137 conn(0x7fe5bc06d0d0 msgr2=0x7fe5bc0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:54.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 -- 172.21.15.150:0/4096055137 shutdown_connections 2022-08-10T17:52:54.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.092+0000 7fe5c1c37700 1 -- 172.21.15.150:0/4096055137 wait complete. 2022-08-10T17:52:54.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 Processor -- start 2022-08-10T17:52:54.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 -- start start 2022-08-10T17:52:54.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 0x7fe5bc0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5bc0c4d90 0x7fe5bc1ec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c7220 0x7fe5bc1def80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0abd20 con 0x7fe5bc0c4d90 2022-08-10T17:52:54.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c79c0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5c1c37700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c89d0 con 0x7fe5bc0c7220 2022-08-10T17:52:54.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 0x7fe5bc0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5baffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5bc0c4d90 0x7fe5bc1ec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 0x7fe5bc0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54842/0 (socket says 172.21.15.150:54842) 2022-08-10T17:52:54.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.094+0000 7fe5bb7fe700 1 -- 172.21.15.150:0/3219259833 learned_addr learned my addr 172.21.15.150:0/3219259833 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:54.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bbfff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c7220 0x7fe5bc1def80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c7220 msgr2=0x7fe5bc1def80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc0c7220 0x7fe5bc1def80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5bc0c4d90 msgr2=0x7fe5bc1ec6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5bc0c4d90 0x7fe5bc1ec6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0093e0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5baffd700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5bc0c4d90 0x7fe5bc1ec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:52:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5bb7fe700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 0x7fe5bc0c90b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00e900 tx=0x7fe5ac00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac013680 con 0x7fe5bc0c2080 2022-08-10T17:52:54.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac0137e0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac013b90 con 0x7fe5bc0c2080 2022-08-10T17:52:54.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b0009310 con 0x7fe5bc0c2080 2022-08-10T17:52:54.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.095+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0c95f0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.096+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 0x7fe5bc155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.096+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0672f0 con 0x7fe5bc154d50 2022-08-10T17:52:54.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.097+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe5ac019030 con 0x7fe5bc0c2080 2022-08-10T17:52:54.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.097+0000 7fe5a3fff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe59c0650e0 0x7fe59c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.097+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe5ac081fb0 con 0x7fe5bc0c2080 2022-08-10T17:52:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.097+0000 7fe5bbfff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe59c0650e0 0x7fe59c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.098+0000 7fe5bbfff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe59c0650e0 0x7fe59c067590 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40012e0 tx=0x7fe5b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.099+0000 7fe5baffd700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 0x7fe5bc155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.100+0000 7fe5baffd700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5bc05fda0 con 0x7fe5bc154d50 2022-08-10T17:52:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.100+0000 7fe5baffd700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 0x7fe5bc155120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009710 tx=0x7fe5b00045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.100+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0020070 con 0x7fe5bc154d50 2022-08-10T17:52:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.101+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe5b0010c60 con 0x7fe5bc154d50 2022-08-10T17:52:54.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.101+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 msgr2=0x7fe5bc155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.101+0000 7fe5a3fff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 0x7fe5bc155120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009710 tx=0x7fe5b00045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.101+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 msgr2=0x7fe5bc155120 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:54.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.101+0000 7fe5a3fff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc154d50 0x7fe5bc155120 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009710 tx=0x7fe5b00045d0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.109+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 0x7fe5bc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.109+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc152760 con 0x7fe5bc151e20 2022-08-10T17:52:54.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.110+0000 7fe5baffd700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 0x7fe5bc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.110+0000 7fe5baffd700 1 -- 172.21.15.150:0/3219259833 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe5bc157ac0 con 0x7fe5bc151e20 2022-08-10T17:52:54.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.110+0000 7fe5baffd700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 0x7fe5bc152220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009630 tx=0x7fe5b0010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.110+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b002c040 con 0x7fe5bc151e20 2022-08-10T17:52:54.127 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:52:54.127 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:54.128 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:54.128 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:52:54.128 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:52:54.128 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:52:54.129 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:52:54.129 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:52:54.129 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:52:54.129 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:54.129 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:52:54.130 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:54.130 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:52:54.130 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:52:54.130 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:54.131 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:54.131 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:54.131 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:54.131 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:54.132 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:54.132 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:54.132 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:54.132 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:54.133 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:54.133 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:52:54.133 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:52:54.133 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:54.133 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:54.134 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:54.134 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:54.134 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:54.134 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:54.135 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:54.135 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:54.135 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:54.135 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.136 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:52:54.136 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:52:54.136 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:52:54.136 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:52:54.137 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:52:54.137 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:52:54.137 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:54.137 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:52:54.138 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:52:54.138 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:52:54.138 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:52:54.138 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:52:54.139 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:52:54.139 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:52:54.139 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:52:54.139 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:52:54.139 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:52:54.140 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:52:54.140 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:52:54.140 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:52:54.140 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:52:54.141 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:52:54.141 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:52:54.141 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:52:54.141 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:52:54.142 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:54.142 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:52:54.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.142 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:52:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:52:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:52:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:54.143 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:54.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.144 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:54.144 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:52:54.144 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.145 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:54.145 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:52:54.145 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.146 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.146 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.146 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:52:54.147 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:52:54.147 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:54.147 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:54.147 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:54.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.148 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:52:54.148 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:52:54.149 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:54.149 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:54.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.149 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:54.150 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:52:54.150 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.151 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:54.151 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:52:54.151 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.151 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.152 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.152 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:52:54.152 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:52:54.152 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:54.153 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:54.153 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:54.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.154 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:52:54.154 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:52:54.154 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:52:54.154 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:52:54.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.155 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:52:54.155 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:52:54.155 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.156 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:52:54.156 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:52:54.157 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:52:54.157 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.157 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.158 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:52:54.158 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:52:54.158 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:52:54.159 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:52:54.159 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:52:54.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.160 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.161 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:52:54.161 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:52:54.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.161 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:54.162 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:54.162 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:54.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.162 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:54.163 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:52:54.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.163 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:54.163 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:54.163 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:54.164 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.164 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:52:54.164 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:52:54.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:52:54.165 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:52:54.165 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:52:54.165 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:52:54.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:52:54.166 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:52:54.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:52:54.166 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:52:54.166 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:52:54.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4547 (secure 0 0 0) 0x7fe5b0011e20 con 0x7fe5bc151e20 2022-08-10T17:52:54.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 msgr2=0x7fe5bc152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5a3fff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 0x7fe5bc152220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009630 tx=0x7fe5b0010000 comp rx=0 tx=0).stop 2022-08-10T17:52:54.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5a3fff700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 msgr2=0x7fe5bc152220 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:52:54.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5a3fff700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe5bc151e20 0x7fe5bc152220 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009630 tx=0x7fe5b0010000 comp rx=0 tx=0).stop 2022-08-10T17:52:54.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe59c0650e0 msgr2=0x7fe59c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe59c0650e0 0x7fe59c067590 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40012e0 tx=0x7fe5b4009040 comp rx=0 tx=0).stop 2022-08-10T17:52:54.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 msgr2=0x7fe5bc0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5c1c37700 1 --2- 172.21.15.150:0/3219259833 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe5bc0c2080 0x7fe5bc0c90b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00e900 tx=0x7fe5ac00ec10 comp rx=0 tx=0).stop 2022-08-10T17:52:54.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5bbfff700 1 -- 172.21.15.150:0/3219259833 reap_dead start 2022-08-10T17:52:54.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.111+0000 7fe5bbfff700 1 -- 172.21.15.150:0/3219259833 reap_dead start 2022-08-10T17:52:54.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.112+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 shutdown_connections 2022-08-10T17:52:54.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.112+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 >> 172.21.15.150:0/3219259833 conn(0x7fe5bc06d0d0 msgr2=0x7fe5bc154050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:54.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.112+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 shutdown_connections 2022-08-10T17:52:54.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.112+0000 7fe5c1c37700 1 -- 172.21.15.150:0/3219259833 wait complete. 2022-08-10T17:52:54.172 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:52:54.173 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:52:54.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.301+0000 7f83b7f09700 1 Processor -- start 2022-08-10T17:52:54.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.301+0000 7f83b7f09700 1 -- start start 2022-08-10T17:52:54.315 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b7f09700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b01544d0 0x7f83b0071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b7f09700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f83b015a970 0x7f83b00718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.316 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b7f09700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b006a050 con 0x7f83b006ea90 2022-08-10T17:52:54.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b7f09700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00c6220 con 0x7f83b015a970 2022-08-10T17:52:54.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b7f09700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00c4420 con 0x7f83b01544d0 2022-08-10T17:52:54.317 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b54a4700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f83b006ea90 0x7f83b015a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56942/0 (socket says 172.21.15.150:56942) 2022-08-10T17:52:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b54a4700 1 -- 172.21.15.150:0/2029691937 learned_addr learned my addr 172.21.15.150:0/2029691937 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:52:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b64a6700 1 --2- 172.21.15.150:0/2029691937 >> v2:172.21.15.197:3300/0 conn(0x7f83b015a970 0x7f83b00718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.318 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.302+0000 7f83b5ca5700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b01544d0 0x7f83b0071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b4ca3700 1 -- 172.21.15.150:0/2029691937 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836403876 0 0) 0x7f83b006a050 con 0x7f83b006ea90 2022-08-10T17:52:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b4ca3700 1 -- 172.21.15.150:0/2029691937 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8398003430 con 0x7f83b006ea90 2022-08-10T17:52:54.319 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b64a6700 1 -- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b01544d0 msgr2=0x7f83b0071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:52:54.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b64a6700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b01544d0 0x7f83b0071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b64a6700 1 -- 172.21.15.150:0/2029691937 >> v1:172.21.15.150:6789/0 conn(0x7f83b006ea90 legacy=0x7f83b015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.320 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b64a6700 1 -- 172.21.15.150:0/2029691937 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b00c4700 con 0x7f83b015a970 2022-08-10T17:52:54.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b64a6700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b015a970 0x7f83b00718b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009d90 tx=0x7f83a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf97d03011a8077 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b4ca3700 1 -- 172.21.15.150:0/2029691937 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800e070 con 0x7f83b015a970 2022-08-10T17:52:54.321 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b4ca3700 1 -- 172.21.15.150:0/2029691937 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800bb20 con 0x7f83b015a970 2022-08-10T17:52:54.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.303+0000 7f83b4ca3700 1 -- 172.21.15.150:0/2029691937 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8012430 con 0x7f83b015a970 2022-08-10T17:52:54.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 -- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b015a970 msgr2=0x7f83b00718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.322 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b015a970 0x7f83b00718b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009d90 tx=0x7f83a800b330 comp rx=0 tx=0).stop 2022-08-10T17:52:54.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 -- 172.21.15.150:0/2029691937 shutdown_connections 2022-08-10T17:52:54.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b015a970 0x7f83b00718b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 --2- 172.21.15.150:0/2029691937 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b01544d0 0x7f83b0071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 -- 172.21.15.150:0/2029691937 >> 172.21.15.150:0/2029691937 conn(0x7f83b0068110 msgr2=0x7f83b0068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:54.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 -- 172.21.15.150:0/2029691937 shutdown_connections 2022-08-10T17:52:54.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.304+0000 7f83b7f09700 1 -- 172.21.15.150:0/2029691937 wait complete. 2022-08-10T17:52:54.324 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.306+0000 7f83b7f09700 1 Processor -- start 2022-08-10T17:52:54.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.306+0000 7f83b7f09700 1 -- start start 2022-08-10T17:52:54.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.325 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b01544d0 0x7f83b0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b015a970 0x7f83b01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00c3af0 con 0x7f83b006ea90 2022-08-10T17:52:54.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01ed300 con 0x7f83b01544d0 2022-08-10T17:52:54.326 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b7f09700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0156120 con 0x7f83b015a970 2022-08-10T17:52:54.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44268/0 (socket says 172.21.15.150:44268) 2022-08-10T17:52:54.327 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 -- 172.21.15.150:0/3751074376 learned_addr learned my addr 172.21.15.150:0/3751074376 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:52:54.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b54a4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b01544d0 0x7f83b0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b64a6700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b015a970 0x7f83b01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.328 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 -- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b015a970 msgr2=0x7f83b01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b015a970 0x7f83b01570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.329 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 -- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b01544d0 msgr2=0x7f83b0156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b01544d0 0x7f83b0156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.307+0000 7f83b5ca5700 1 -- 172.21.15.150:0/3751074376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009a70 con 0x7f83b006ea90 2022-08-10T17:52:54.330 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f83b5ca5700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e870 tx=0x7f83ac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac009400 con 0x7f83b006ea90 2022-08-10T17:52:54.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac013680 con 0x7f83b006ea90 2022-08-10T17:52:54.331 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0154950 con 0x7f83b006ea90 2022-08-10T17:52:54.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0139f0 con 0x7f83b006ea90 2022-08-10T17:52:54.332 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.308+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b0154f10 con 0x7f83b006ea90 2022-08-10T17:52:54.333 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.309+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b0155130 con 0x7f83b006ea90 2022-08-10T17:52:54.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.309+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f83ac023070 con 0x7f83b006ea90 2022-08-10T17:52:54.334 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.309+0000 7f839e7fc700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 0x7f8390067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:52:54.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.310+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f83ac082190 con 0x7f83b006ea90 2022-08-10T17:52:54.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.310+0000 7f83b54a4700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 0x7f8390067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:52:54.335 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.310+0000 7f83b54a4700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 0x7f8390067560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f83b0148300 tx=0x7f83a0007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:52:54.337 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.313+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f83ac050110 con 0x7f83b006ea90 2022-08-10T17:52:54.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.703+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f83b0072890 con 0x7f83b006ea90 2022-08-10T17:52:54.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.704+0000 7f839e7fc700 1 -- 172.21.15.150:0/3751074376 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f83ac053730 con 0x7f83b006ea90 2022-08-10T17:52:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.706+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 msgr2=0x7f8390067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.706+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 0x7f8390067560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f83b0148300 tx=0x7f83a0007c40 comp rx=0 tx=0).stop 2022-08-10T17:52:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.706+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 msgr2=0x7f83b0158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:52:54.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.706+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e870 tx=0x7f83ac00eb80 comp rx=0 tx=0).stop 2022-08-10T17:52:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 shutdown_connections 2022-08-10T17:52:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83900650b0 0x7f8390067560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f83b015a970 0x7f83b01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83b006ea90 0x7f83b0158fe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 --2- 172.21.15.150:0/3751074376 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f83b01544d0 0x7f83b0156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:52:54.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 >> 172.21.15.150:0/3751074376 conn(0x7f83b0068110 msgr2=0x7f83b00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:52:54.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 shutdown_connections 2022-08-10T17:52:54.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:52:54.707+0000 7f83b7f09700 1 -- 172.21.15.150:0/3751074376 wait complete. 2022-08-10T17:52:54.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:53:04.729 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:53:04.730 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:53:04.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 Processor -- start 2022-08-10T17:53:04.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 -- start start 2022-08-10T17:53:04.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b0070620 con 0x7f53b00c7d80 2022-08-10T17:53:04.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b00c5ac0 con 0x7f53b0150f50 2022-08-10T17:53:04.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.856+0000 7f53b6c3e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b015a860 con 0x7f53b0150b80 2022-08-10T17:53:04.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53affff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53affff700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54908/0 (socket says 172.21.15.150:54908) 2022-08-10T17:53:04.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53affff700 1 -- 172.21.15.150:0/671432975 learned_addr learned my addr 172.21.15.150:0/671432975 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:04.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b51db700 1 --1- 172.21.15.150:0/671432975 >> v1:172.21.15.197:6789/0 conn(0x7f53b00c7d80 0x7f53b0156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43352/0 (socket says 172.21.15.150:43352) 2022-08-10T17:53:04.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 -- 172.21.15.150:0/671432975 >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 msgr2=0x7f53b00c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:04.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 --2- 172.21.15.150:0/671432975 >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 -- 172.21.15.150:0/671432975 >> v1:172.21.15.197:6789/0 conn(0x7f53b00c7d80 legacy=0x7f53b0156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:04.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 -- 172.21.15.150:0/671432975 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00ca810 con 0x7f53b0150b80 2022-08-10T17:53:04.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53affff700 1 --2- 172.21.15.150:0/671432975 >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:53:04.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53b49da700 1 --2- 172.21.15.150:0/671432975 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c42a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53a40096b0 tx=0x7f53a40099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7065f7f0ab8503a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:04.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53af7fe700 1 -- 172.21.15.150:0/671432975 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40107b0 con 0x7f53b0150b80 2022-08-10T17:53:04.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53af7fe700 1 -- 172.21.15.150:0/671432975 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a4010910 con 0x7f53b0150b80 2022-08-10T17:53:04.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.857+0000 7f53af7fe700 1 -- 172.21.15.150:0/671432975 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4010cc0 con 0x7f53b0150b80 2022-08-10T17:53:04.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 -- 172.21.15.150:0/671432975 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 msgr2=0x7f53b00c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:04.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/671432975 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c42a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53a40096b0 tx=0x7f53a40099c0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 -- 172.21.15.150:0/671432975 shutdown_connections 2022-08-10T17:53:04.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/671432975 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c42a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/671432975 >> v2:172.21.15.197:3300/0 conn(0x7f53b0150f50 0x7f53b00c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 -- 172.21.15.150:0/671432975 >> 172.21.15.150:0/671432975 conn(0x7f53b0071e40 msgr2=0x7f53b006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:04.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 -- 172.21.15.150:0/671432975 shutdown_connections 2022-08-10T17:53:04.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.858+0000 7f53b6c3e700 1 -- 172.21.15.150:0/671432975 wait complete. 2022-08-10T17:53:04.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.859+0000 7f53b6c3e700 1 Processor -- start 2022-08-10T17:53:04.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.859+0000 7f53b6c3e700 1 -- start start 2022-08-10T17:53:04.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53b0150f50 0x7f53b014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01ef3b0 con 0x7f53b00c7d80 2022-08-10T17:53:04.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b014ea60 con 0x7f53b0150f50 2022-08-10T17:53:04.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b6c3e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b014fc60 con 0x7f53b0150b80 2022-08-10T17:53:04.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44322/0 (socket says 172.21.15.150:44322) 2022-08-10T17:53:04.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 -- 172.21.15.150:0/3402420494 learned_addr learned my addr 172.21.15.150:0/3402420494 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53affff700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b51db700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53b0150f50 0x7f53b014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 -- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 msgr2=0x7f53b00c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:04.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 -- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53b0150f50 msgr2=0x7f53b014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:04.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53b0150f50 0x7f53b014eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:04.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 -- 172.21.15.150:0/3402420494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0093e0 con 0x7f53b00c7d80 2022-08-10T17:53:04.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53affff700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:53:04.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53b49da700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53a4013040 tx=0x7f53a40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:04.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.860+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4010a80 con 0x7f53b00c7d80 2022-08-10T17:53:04.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.861+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a4010be0 con 0x7f53b00c7d80 2022-08-10T17:53:04.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.861+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4009310 con 0x7f53b00c7d80 2022-08-10T17:53:04.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.861+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4004270 con 0x7f53b00c7d80 2022-08-10T17:53:04.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.861+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b0156470 con 0x7f53b00c7d80 2022-08-10T17:53:04.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.862+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b0072890 con 0x7f53b00c7d80 2022-08-10T17:53:04.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.862+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f53a402d070 con 0x7f53b00c7d80 2022-08-10T17:53:04.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.862+0000 7f53ad7fa700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 0x7f5398067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:04.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.862+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f53a4021030 con 0x7f53b00c7d80 2022-08-10T17:53:04.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.862+0000 7f53affff700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 0x7f5398067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:04.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.863+0000 7f53affff700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 0x7f5398067560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b014d390 tx=0x7f539c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:04.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:04.867+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f53a4051a60 con 0x7f53b00c7d80 2022-08-10T17:53:05.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.166+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f53b00692f0 con 0x7f53b00c7d80 2022-08-10T17:53:05.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.166+0000 7f53ad7fa700 1 -- 172.21.15.150:0/3402420494 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f53a402b020 con 0x7f53b00c7d80 2022-08-10T17:53:05.171 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:53:05.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.168+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 msgr2=0x7f5398067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.168+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 0x7f5398067560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b014d390 tx=0x7f539c009190 comp rx=0 tx=0).stop 2022-08-10T17:53:05.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.168+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 msgr2=0x7f53b014dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.168+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53a4013040 tx=0x7f53a40045d0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 shutdown_connections 2022-08-10T17:53:05.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53b0150f50 0x7f53b014eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.176 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00c7d80 0x7f53b014dbe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53980650b0 0x7f5398067560 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 --2- 172.21.15.150:0/3402420494 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53b0150b80 0x7f53b00c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 >> 172.21.15.150:0/3402420494 conn(0x7f53b0071e40 msgr2=0x7f53b00c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.177 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 shutdown_connections 2022-08-10T17:53:05.178 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.172+0000 7f53b6c3e700 1 -- 172.21.15.150:0/3402420494 wait complete. 2022-08-10T17:53:05.192 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:53:05.192 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:53:05.193 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:53:05.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.349+0000 7f72ebde8700 1 Processor -- start 2022-08-10T17:53:05.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.349+0000 7f72ebde8700 1 -- start start 2022-08-10T17:53:05.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72ebde8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72ebde8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72e406bbe0 0x7f72e406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72ebde8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e406ffd0 con 0x7f72e40c3380 2022-08-10T17:53:05.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72ebde8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e41569e0 con 0x7f72e406bbe0 2022-08-10T17:53:05.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72ebde8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4068110 con 0x7f72e41509c0 2022-08-10T17:53:05.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72e9b84700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.350+0000 7f72e9b84700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58572/0 (socket says 172.21.15.150:58572) 2022-08-10T17:53:05.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 -- 172.21.15.150:0/322690092 learned_addr learned my addr 172.21.15.150:0/322690092 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:05.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 -- 172.21.15.150:0/322690092 >> v2:172.21.15.150:3300/0 conn(0x7f72e406bbe0 msgr2=0x7f72e406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:05.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 --2- 172.21.15.150:0/322690092 >> v2:172.21.15.150:3300/0 conn(0x7f72e406bbe0 0x7f72e406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 -- 172.21.15.150:0/322690092 >> v1:172.21.15.150:6789/0 conn(0x7f72e40c3380 legacy=0x7f72e4156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:05.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 -- 172.21.15.150:0/322690092 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4156690 con 0x7f72e41509c0 2022-08-10T17:53:05.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e9b84700 1 --2- 172.21.15.150:0/322690092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f72d4006fd0 tx=0x7f72d4009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80fa1350c02e169c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e8b82700 1 -- 172.21.15.150:0/322690092 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4011830 con 0x7f72e41509c0 2022-08-10T17:53:05.359 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e8b82700 1 -- 172.21.15.150:0/322690092 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40119b0 con 0x7f72e41509c0 2022-08-10T17:53:05.360 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.351+0000 7f72e8b82700 1 -- 172.21.15.150:0/322690092 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4011d60 con 0x7f72e41509c0 2022-08-10T17:53:05.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.352+0000 7f72ebde8700 1 -- 172.21.15.150:0/322690092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 msgr2=0x7f72e40c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.352+0000 7f72ebde8700 1 --2- 172.21.15.150:0/322690092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f72d4006fd0 tx=0x7f72d4009a60 comp rx=0 tx=0).stop 2022-08-10T17:53:05.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.353+0000 7f72ebde8700 1 -- 172.21.15.150:0/322690092 shutdown_connections 2022-08-10T17:53:05.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.353+0000 7f72ebde8700 1 --2- 172.21.15.150:0/322690092 >> v2:172.21.15.150:3300/0 conn(0x7f72e406bbe0 0x7f72e406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.353+0000 7f72ebde8700 1 --2- 172.21.15.150:0/322690092 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e40c9a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.353+0000 7f72ebde8700 1 -- 172.21.15.150:0/322690092 >> 172.21.15.150:0/322690092 conn(0x7f72e406aac0 msgr2=0x7f72e40c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.359+0000 7f72ebde8700 1 -- 172.21.15.150:0/322690092 shutdown_connections 2022-08-10T17:53:05.363 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.359+0000 7f72ebde8700 1 -- 172.21.15.150:0/322690092 wait complete. 2022-08-10T17:53:05.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.360+0000 7f72ebde8700 1 Processor -- start 2022-08-10T17:53:05.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.360+0000 7f72ebde8700 1 -- start start 2022-08-10T17:53:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 0x7f72e414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e4146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72e41e2740 0x7f72e414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41ec9e0 con 0x7f72e40c3380 2022-08-10T17:53:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41dfd70 con 0x7f72e41e2740 2022-08-10T17:53:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72ebde8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e414dbe0 con 0x7f72e41509c0 2022-08-10T17:53:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72e9b84700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 0x7f72e414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72e9b84700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 0x7f72e414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44352/0 (socket says 172.21.15.150:44352) 2022-08-10T17:53:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72e9b84700 1 -- 172.21.15.150:0/240380142 learned_addr learned my addr 172.21.15.150:0/240380142 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.361+0000 7f72e9383700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e4146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72ea385700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72e41e2740 0x7f72e414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 msgr2=0x7f72e4146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f72e41509c0 0x7f72e4146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72e41e2740 msgr2=0x7f72e414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f72e41e2740 0x7f72e414e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40093e0 con 0x7f72e40c3380 2022-08-10T17:53:05.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72e9b84700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 0x7f72e414d6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72d4013000 tx=0x7f72d40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4004450 con 0x7f72e40c3380 2022-08-10T17:53:05.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4003520 con 0x7f72e40c3380 2022-08-10T17:53:05.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40038b0 con 0x7f72e40c3380 2022-08-10T17:53:05.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e414cd10 con 0x7f72e40c3380 2022-08-10T17:53:05.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.362+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e41dff80 con 0x7f72e40c3380 2022-08-10T17:53:05.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.363+0000 7f72ebde8700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 0x7f72e41ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.363+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4071e00 con 0x7f72e406aac0 2022-08-10T17:53:05.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.363+0000 7f72e9383700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 0x7f72e41ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.364+0000 7f72e9383700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72e41ecb20 con 0x7f72e406aac0 2022-08-10T17:53:05.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.364+0000 7f72e9383700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 0x7f72e41ec240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c0680 tx=0x7f72e000f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.364+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000fe50 con 0x7f72e406aac0 2022-08-10T17:53:05.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.364+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f72d400f050 con 0x7f72e40c3380 2022-08-10T17:53:05.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72c4065150 0x7f72c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f72d4083580 con 0x7f72e40c3380 2022-08-10T17:53:05.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72ea385700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72c4065150 0x7f72c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f72e0014460 con 0x7f72e406aac0 2022-08-10T17:53:05.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 msgr2=0x7f72e41ec240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 0x7f72e41ec240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c0680 tx=0x7f72e000f590 comp rx=0 tx=0).stop 2022-08-10T17:53:05.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 msgr2=0x7f72e41ec240 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.365+0000 7f72d27fc700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e406aac0 0x7f72e41ec240 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f72e40c0680 tx=0x7f72e000f590 comp rx=0 tx=0).stop 2022-08-10T17:53:05.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.366+0000 7f72ea385700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72c4065150 0x7f72c4067600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f72e41e2b10 tx=0x7f72dc00d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.378+0000 7f72ebde8700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 0x7f72e41e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.378+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c5c00 con 0x7f72e40c8e50 2022-08-10T17:53:05.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.378+0000 7f72e9383700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 0x7f72e41e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72e9383700 1 -- 172.21.15.150:0/240380142 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72e4072890 con 0x7f72e40c8e50 2022-08-10T17:53:05.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72e9383700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 0x7f72e41e0be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72e000b480 tx=0x7f72e00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0004220 con 0x7f72e40c8e50 2022-08-10T17:53:05.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4380 (secure 0 0 0) 0x7f72e0006790 con 0x7f72e40c8e50 2022-08-10T17:53:05.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 msgr2=0x7f72e41e0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 0x7f72e41e0be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72e000b480 tx=0x7f72e00045c0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 msgr2=0x7f72e41e0be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.379+0000 7f72d27fc700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c8e50 0x7f72e41e0be0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72e000b480 tx=0x7f72e00045c0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.391 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:53:05.391 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:05.392 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:05.392 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:53:05.392 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:53:05.392 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:53:05.393 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:53:05.393 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:53:05.393 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:53:05.393 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.394 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:53:05.394 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.394 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:53:05.394 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:53:05.395 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.395 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.395 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.395 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.396 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.396 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.396 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.396 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.396 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.397 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.397 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:53:05.397 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:53:05.397 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.398 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.398 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.398 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.398 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.399 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.399 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.399 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.399 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.400 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.400 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:53:05.400 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:53:05.401 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:53:05.401 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:53:05.401 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:53:05.401 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:53:05.401 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.402 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.402 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:53:05.402 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:53:05.402 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:53:05.403 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:53:05.403 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:53:05.403 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:53:05.404 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.404 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:53:05.404 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.404 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.404 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.405 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.405 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.405 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.405 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.406 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.406 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.406 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.406 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:53:05.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.407 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:53:05.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.407 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:05.408 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:05.408 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.408 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.408 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.409 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:53:05.409 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.410 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.410 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:53:05.410 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.410 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.411 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.411 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.411 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.412 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.412 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.412 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.413 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:05.413 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:05.414 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.414 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.414 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.415 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:53:05.415 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.416 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.416 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:53:05.416 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.417 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.417 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.417 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.418 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.418 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.418 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.419 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:05.419 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:05.419 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.420 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.420 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.420 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:53:05.421 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.421 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.422 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:53:05.422 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.422 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.422 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.423 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.423 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.423 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.423 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.424 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.424 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:53:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:53:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.425 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.426 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:53:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.427 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:53:05.428 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.428 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.428 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:53:05.428 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:53:05.430 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72c4065150 msgr2=0x7f72c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f72c4065150 0x7f72c4067600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f72e41e2b10 tx=0x7f72dc00d040 comp rx=0 tx=0).stop 2022-08-10T17:53:05.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 msgr2=0x7f72e414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 --2- 172.21.15.150:0/240380142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72e40c3380 0x7f72e414d6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72d4013000 tx=0x7f72d40045d0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.431 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ea385700 1 -- 172.21.15.150:0/240380142 reap_dead start 2022-08-10T17:53:05.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ea385700 1 -- 172.21.15.150:0/240380142 reap_dead start 2022-08-10T17:53:05.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 shutdown_connections 2022-08-10T17:53:05.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 >> 172.21.15.150:0/240380142 conn(0x7f72e406bbe0 msgr2=0x7f72e41e2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.432 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 shutdown_connections 2022-08-10T17:53:05.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.380+0000 7f72ebde8700 1 -- 172.21.15.150:0/240380142 wait complete. 2022-08-10T17:53:05.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:53:05.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.564+0000 7f2b16556700 1 Processor -- start 2022-08-10T17:53:05.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.564+0000 7f2b16556700 1 -- start start 2022-08-10T17:53:05.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.565+0000 7f2b16556700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 0x7f2b100cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.565+0000 7f2b16556700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f2b100cda80 0x7f2b100691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.565+0000 7f2b16556700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b100c3020 con 0x7f2b10070240 2022-08-10T17:53:05.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.565+0000 7f2b16556700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100c1b60 con 0x7f2b100cda80 2022-08-10T17:53:05.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.565+0000 7f2b16556700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10156930 con 0x7f2b100c1730 2022-08-10T17:53:05.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0ffff700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f2b10070240 0x7f2b10157060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43396/0 (socket says 172.21.15.150:43396) 2022-08-10T17:53:05.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0f7fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 0x7f2b100cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0ffff700 1 -- 172.21.15.150:0/224531628 learned_addr learned my addr 172.21.15.150:0/224531628 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:53:05.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 --2- 172.21.15.150:0/224531628 >> v2:172.21.15.197:3300/0 conn(0x7f2b100cda80 0x7f2b100691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 -- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 msgr2=0x7f2b100cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:05.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 0x7f2b100cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 -- 172.21.15.150:0/224531628 >> v1:172.21.15.197:6789/0 conn(0x7f2b10070240 legacy=0x7f2b10157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 -- 172.21.15.150:0/224531628 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10156bd0 con 0x7f2b100cda80 2022-08-10T17:53:05.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0effd700 1 -- 172.21.15.150:0/224531628 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526441222 0 0) 0x7f2b100c3020 con 0x7f2b10070240 2022-08-10T17:53:05.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0f7fe700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 0x7f2b100cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:53:05.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b14af3700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b100cda80 0x7f2b100691a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d90 tx=0x7f2b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6532ff5d596c17ee server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0effd700 1 -- 172.21.15.150:0/224531628 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800e070 con 0x7f2b100cda80 2022-08-10T17:53:05.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0effd700 1 -- 172.21.15.150:0/224531628 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0800bb20 con 0x7f2b100cda80 2022-08-10T17:53:05.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.566+0000 7f2b0effd700 1 -- 172.21.15.150:0/224531628 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08012430 con 0x7f2b100cda80 2022-08-10T17:53:05.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 -- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b100cda80 msgr2=0x7f2b100691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b100cda80 0x7f2b100691a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d90 tx=0x7f2b0800b330 comp rx=0 tx=0).stop 2022-08-10T17:53:05.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 -- 172.21.15.150:0/224531628 shutdown_connections 2022-08-10T17:53:05.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b100cda80 0x7f2b100691a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 --2- 172.21.15.150:0/224531628 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100c1730 0x7f2b100cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 -- 172.21.15.150:0/224531628 >> 172.21.15.150:0/224531628 conn(0x7f2b10071e40 msgr2=0x7f2b100cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 -- 172.21.15.150:0/224531628 shutdown_connections 2022-08-10T17:53:05.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.567+0000 7f2b16556700 1 -- 172.21.15.150:0/224531628 wait complete. 2022-08-10T17:53:05.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.568+0000 7f2b16556700 1 Processor -- start 2022-08-10T17:53:05.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.568+0000 7f2b16556700 1 -- start start 2022-08-10T17:53:05.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 0x7f2b1014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b100c1730 0x7f2b1014c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100cda80 0x7f2b10153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10152130 con 0x7f2b100c1730 2022-08-10T17:53:05.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c41c0 con 0x7f2b10070240 2022-08-10T17:53:05.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.569+0000 7f2b16556700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10152c70 con 0x7f2b100cda80 2022-08-10T17:53:05.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 0x7f2b1014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 0x7f2b1014bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54962/0 (socket says 172.21.15.150:54962) 2022-08-10T17:53:05.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 -- 172.21.15.150:0/2216311974 learned_addr learned my addr 172.21.15.150:0/2216311974 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:05.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b14af3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100cda80 0x7f2b10153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100cda80 msgr2=0x7f2b10153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b100cda80 0x7f2b10153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b100c1730 msgr2=0x7f2b1014c120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:53:05.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b100c1730 0x7f2b1014c120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009310 con 0x7f2b10070240 2022-08-10T17:53:05.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0ffff700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 0x7f2b1014bbe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c480 tx=0x7f2b0000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000074e0 con 0x7f2b10070240 2022-08-10T17:53:05.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0000ce60 con 0x7f2b10070240 2022-08-10T17:53:05.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b08009a70 con 0x7f2b10070240 2022-08-10T17:53:05.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000048f0 con 0x7f2b10070240 2022-08-10T17:53:05.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.570+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b100c46f0 con 0x7f2b10070240 2022-08-10T17:53:05.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.571+0000 7f2b16556700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 0x7f2b10153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.571+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100673d0 con 0x7f2b10155fc0 2022-08-10T17:53:05.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.572+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2b0001a020 con 0x7f2b10070240 2022-08-10T17:53:05.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.572+0000 7f2b0cff9700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2af00650e0 0x7f2af0067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.572+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2b00081cf0 con 0x7f2b10070240 2022-08-10T17:53:05.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.572+0000 7f2b14af3700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2af00650e0 0x7f2af0067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.572+0000 7f2b0f7fe700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 0x7f2b10153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0f7fe700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b10152f50 con 0x7f2b10155fc0 2022-08-10T17:53:05.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b14af3700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2af00650e0 0x7f2af0067590 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2b100cdea0 tx=0x7f2b08011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0f7fe700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 0x7f2b10153640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b100c8340 tx=0x7f2b0400eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04004030 con 0x7f2b10155fc0 2022-08-10T17:53:05.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f2b04004190 con 0x7f2b10155fc0 2022-08-10T17:53:05.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 msgr2=0x7f2b10153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 0x7f2b10153640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b100c8340 tx=0x7f2b0400eb00 comp rx=0 tx=0).stop 2022-08-10T17:53:05.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 msgr2=0x7f2b10153640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.573+0000 7f2b0cff9700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10155fc0 0x7f2b10153640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.580+0000 7f2b16556700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 0x7f2b101ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.580+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10152db0 con 0x7f2b10152740 2022-08-10T17:53:05.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.580+0000 7f2b0f7fe700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 0x7f2b101ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.581+0000 7f2b0f7fe700 1 -- 172.21.15.150:0/2216311974 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2b100c4910 con 0x7f2b10152740 2022-08-10T17:53:05.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.581+0000 7f2b0f7fe700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 0x7f2b101ef620 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b040092e0 tx=0x7f2b04004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.583+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04003e40 con 0x7f2b10152740 2022-08-10T17:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7f2b040058a0 con 0x7f2b10152740 2022-08-10T17:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 msgr2=0x7f2b101ef620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b0cff9700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 0x7f2b101ef620 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b040092e0 tx=0x7f2b04004640 comp rx=0 tx=0).stop 2022-08-10T17:53:05.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b0cff9700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 msgr2=0x7f2b101ef620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b0cff9700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10152740 0x7f2b101ef620 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.611 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:53:05.612 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:05.612 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:05.612 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:53:05.612 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:53:05.613 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:53:05.613 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:53:05.613 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:53:05.613 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:53:05.614 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.614 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:53:05.614 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.614 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:53:05.615 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:53:05.615 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.615 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.615 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.615 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.616 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.616 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.616 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.616 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.617 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.617 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.617 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:53:05.617 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:53:05.617 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.618 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.618 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.618 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.618 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.619 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.619 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.619 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.619 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.620 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.620 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:53:05.620 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:53:05.621 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:53:05.621 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:53:05.621 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:53:05.621 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:53:05.622 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.622 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.622 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:53:05.622 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:53:05.623 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:53:05.623 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:53:05.623 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:53:05.623 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:53:05.624 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.624 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:53:05.624 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.624 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.625 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.625 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.625 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.625 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.625 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.626 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.626 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.626 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.626 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:53:05.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.627 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:53:05.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.627 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:05.628 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:05.628 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.628 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.629 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.629 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:53:05.629 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.630 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:53:05.630 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.631 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.631 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.631 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.632 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.632 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.632 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.633 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:05.633 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:05.633 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.634 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.634 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.634 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:53:05.635 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.636 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.636 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:53:05.636 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.636 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.637 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.637 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.637 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.638 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.638 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.638 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.639 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:05.639 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:05.639 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.640 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.640 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.640 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:53:05.641 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.641 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.642 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:53:05.642 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.642 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.642 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.643 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.643 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.644 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.644 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.644 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.645 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.645 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:53:05.646 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:53:05.646 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.646 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.647 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.647 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.647 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.647 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.648 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:53:05.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.648 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.648 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.649 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:53:05.649 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.649 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.649 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:53:05.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.650 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.650 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.650 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 8 2022-08-10T17:53:05.650 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.651 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.651 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:53:05.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.651 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:53:05.652 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.652 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.653 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.653 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.653 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:53:05.653 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.654 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.654 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:53:05.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.654 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.654 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.655 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:53:05.655 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.655 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.656 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:53:05.657 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:53:05.658 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2af00650e0 msgr2=0x7f2af0067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2af00650e0 0x7f2af0067590 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2b100cdea0 tx=0x7f2b08011000 comp rx=0 tx=0).stop 2022-08-10T17:53:05.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 msgr2=0x7f2b1014bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 --2- 172.21.15.150:0/2216311974 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b10070240 0x7f2b1014bbe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c480 tx=0x7f2b0000c790 comp rx=0 tx=0).stop 2022-08-10T17:53:05.659 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b14af3700 1 -- 172.21.15.150:0/2216311974 reap_dead start 2022-08-10T17:53:05.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b14af3700 1 -- 172.21.15.150:0/2216311974 reap_dead start 2022-08-10T17:53:05.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 shutdown_connections 2022-08-10T17:53:05.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 >> 172.21.15.150:0/2216311974 conn(0x7f2b10071e40 msgr2=0x7f2b100ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.660 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.586+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 shutdown_connections 2022-08-10T17:53:05.661 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.587+0000 7f2b16556700 1 -- 172.21.15.150:0/2216311974 wait complete. 2022-08-10T17:53:05.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:53:05.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.797+0000 7f1e40297700 1 Processor -- start 2022-08-10T17:53:05.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.797+0000 7f1e40297700 1 -- start start 2022-08-10T17:53:05.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.798+0000 7f1e40297700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.798+0000 7f1e40297700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 0x7f1e380c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.805 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.798+0000 7f1e40297700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e380c1f40 con 0x7f1e38151290 2022-08-10T17:53:05.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.798+0000 7f1e40297700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e380c7d90 con 0x7f1e38068bf0 2022-08-10T17:53:05.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.798+0000 7f1e40297700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380c2220 con 0x7f1e38158170 2022-08-10T17:53:05.806 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58608/0 (socket says 172.21.15.150:58608) 2022-08-10T17:53:05.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 -- 172.21.15.150:0/2773064791 learned_addr learned my addr 172.21.15.150:0/2773064791 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:05.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3e834700 1 --2- 172.21.15.150:0/2773064791 >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 0x7f1e380c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.807 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 -- 172.21.15.150:0/2773064791 >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 msgr2=0x7f1e380c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:05.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 --2- 172.21.15.150:0/2773064791 >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 0x7f1e380c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 -- 172.21.15.150:0/2773064791 >> v1:172.21.15.197:6789/0 conn(0x7f1e38151290 legacy=0x7f1e38157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 -- 172.21.15.150:0/2773064791 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380c2500 con 0x7f1e38158170 2022-08-10T17:53:05.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3e834700 1 --2- 172.21.15.150:0/2773064791 >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 0x7f1e380c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:53:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d832700 1 --2- 172.21.15.150:0/2773064791 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e28006fd0 tx=0x7f1e28009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b62b4232ccf9b4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d031700 1 -- 172.21.15.150:0/2773064791 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28004230 con 0x7f1e38158170 2022-08-10T17:53:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d031700 1 -- 172.21.15.150:0/2773064791 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28004390 con 0x7f1e38158170 2022-08-10T17:53:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.799+0000 7f1e3d031700 1 -- 172.21.15.150:0/2773064791 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011830 con 0x7f1e38158170 2022-08-10T17:53:05.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 -- 172.21.15.150:0/2773064791 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 msgr2=0x7f1e380c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 --2- 172.21.15.150:0/2773064791 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e28006fd0 tx=0x7f1e28009a60 comp rx=0 tx=0).stop 2022-08-10T17:53:05.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 -- 172.21.15.150:0/2773064791 shutdown_connections 2022-08-10T17:53:05.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 --2- 172.21.15.150:0/2773064791 >> v2:172.21.15.197:3300/0 conn(0x7f1e38068bf0 0x7f1e380c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 --2- 172.21.15.150:0/2773064791 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e380c7850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 -- 172.21.15.150:0/2773064791 >> 172.21.15.150:0/2773064791 conn(0x7f1e3806f880 msgr2=0x7f1e3806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 -- 172.21.15.150:0/2773064791 shutdown_connections 2022-08-10T17:53:05.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.800+0000 7f1e40297700 1 -- 172.21.15.150:0/2773064791 wait complete. 2022-08-10T17:53:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.801+0000 7f1e40297700 1 Processor -- start 2022-08-10T17:53:05.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.801+0000 7f1e40297700 1 -- start start 2022-08-10T17:53:05.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e38068bf0 0x7f1e38149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 0x7f1e380c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e381ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e381f05b0 con 0x7f1e38068bf0 2022-08-10T17:53:05.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e381f0b00 con 0x7f1e38151290 2022-08-10T17:53:05.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e40297700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e381f0820 con 0x7f1e38158170 2022-08-10T17:53:05.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 0x7f1e380c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3e033700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e38068bf0 0x7f1e38149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 0x7f1e380c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:54984/0 (socket says 172.21.15.150:54984) 2022-08-10T17:53:05.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 -- 172.21.15.150:0/2776230295 learned_addr learned my addr 172.21.15.150:0/2776230295 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:05.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3e834700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e381ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 msgr2=0x7f1e381ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38158170 0x7f1e381ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e38068bf0 msgr2=0x7f1e38149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e38068bf0 0x7f1e38149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.802+0000 7f1e3d832700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30009a70 con 0x7f1e38151290 2022-08-10T17:53:05.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e3d832700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 0x7f1e380c5800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000c00 tx=0x7f1e280045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011e70 con 0x7f1e38151290 2022-08-10T17:53:05.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28003520 con 0x7f1e38151290 2022-08-10T17:53:05.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280093e0 con 0x7f1e38151290 2022-08-10T17:53:05.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280038b0 con 0x7f1e38151290 2022-08-10T17:53:05.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.803+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e380cdb10 con 0x7f1e38151290 2022-08-10T17:53:05.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e40297700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 0x7f1e381ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380cdca0 con 0x7f1e380ccd90 2022-08-10T17:53:05.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e3e033700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 0x7f1e381ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e3e033700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e38071e10 con 0x7f1e380ccd90 2022-08-10T17:53:05.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1e28017020 con 0x7f1e38151290 2022-08-10T17:53:05.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e3e033700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 0x7f1e381ec6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400f430 tx=0x7f1e3400df90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.804+0000 7f1e26ffd700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1e180650e0 0x7f1e18067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1e28083c40 con 0x7f1e38151290 2022-08-10T17:53:05.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e3e834700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1e180650e0 0x7f1e18067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34017070 con 0x7f1e380ccd90 2022-08-10T17:53:05.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f1e340050d0 con 0x7f1e380ccd90 2022-08-10T17:53:05.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 msgr2=0x7f1e381ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 0x7f1e381ec6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400f430 tx=0x7f1e3400df90 comp rx=0 tx=0).stop 2022-08-10T17:53:05.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 msgr2=0x7f1e381ec6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.830 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e26ffd700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e380ccd90 0x7f1e381ec6a0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400f430 tx=0x7f1e3400df90 comp rx=0 tx=0).stop 2022-08-10T17:53:05.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.805+0000 7f1e3e834700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1e180650e0 0x7f1e18067590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1e300114e0 tx=0x7f1e3000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e40297700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 0x7f1e38146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:05.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380644b0 con 0x7f1e38146870 2022-08-10T17:53:05.831 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e3e033700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 0x7f1e38146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:05.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e3e033700 1 -- 172.21.15.150:0/2776230295 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1e381ecbe0 con 0x7f1e38146870 2022-08-10T17:53:05.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e3e033700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 0x7f1e38146c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e34016000 tx=0x7f1e34000f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:05.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.812+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34006cd0 con 0x7f1e38146870 2022-08-10T17:53:05.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4548 (secure 0 0 0) 0x7f1e34006e30 con 0x7f1e38146870 2022-08-10T17:53:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 msgr2=0x7f1e38146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e26ffd700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 0x7f1e38146c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e34016000 tx=0x7f1e34000f20 comp rx=0 tx=0).stop 2022-08-10T17:53:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e26ffd700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 msgr2=0x7f1e38146c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:05.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e26ffd700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f1e38146870 0x7f1e38146c70 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e34016000 tx=0x7f1e34000f20 comp rx=0 tx=0).stop 2022-08-10T17:53:05.834 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:53:05.834 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:05.834 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:05.835 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:53:05.835 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 134, 2022-08-10T17:53:05.835 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:53:05.835 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:53:05.836 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:53:05.836 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:53:05.836 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.836 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:53:05.836 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.837 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:53:05.837 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:53:05.837 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.837 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.838 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.838 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.838 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.838 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.839 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.839 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.839 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.839 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.839 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:53:05.840 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:53:05.840 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.840 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.840 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.841 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.841 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.841 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.841 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.842 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.842 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.842 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:53:05.843 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:53:05.843 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:53:05.843 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:53:05.843 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:53:05.844 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:53:05.844 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.844 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:05.844 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:53:05.844 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:53:05.845 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:53:05.845 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:53:05.845 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:53:05.845 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:53:05.846 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:05.846 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:53:05.846 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:05.846 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:05.847 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:05.847 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:05.847 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:05.847 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:05.847 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:05.848 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:05.848 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:05.848 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.848 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:53:05.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.849 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:53:05.849 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.849 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:05.850 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:05.850 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.850 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.850 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.851 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.851 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:53:05.851 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.851 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.852 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.852 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:53:05.852 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.852 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.853 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.853 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.853 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:53:05.854 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.854 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.854 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.854 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.855 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.855 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:05.855 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:05.855 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.856 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.856 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.856 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.856 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:53:05.856 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.857 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.857 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:53:05.858 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.858 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.858 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.858 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.859 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.859 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:53:05.859 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.859 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.859 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.860 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.860 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:05.860 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:05.861 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:05.861 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:05.861 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.861 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:05.861 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:53:05.862 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.862 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.863 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:05.863 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:53:05.863 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:05.864 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.864 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.864 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.865 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:53:05.865 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:05.865 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:05.866 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:05.866 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.866 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.867 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:53:05.867 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:53:05.867 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.867 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.868 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.868 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.868 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.868 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.869 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:53:05.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.869 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.869 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.870 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.870 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.870 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:05.870 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:53:05.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:05.871 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:05.871 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:05.871 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:05.871 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:05.872 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:05.872 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:05.872 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:53:05.872 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:53:05.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1e180650e0 msgr2=0x7f1e18067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f1e180650e0 0x7f1e18067590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1e300114e0 tx=0x7f1e3000b040 comp rx=0 tx=0).stop 2022-08-10T17:53:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 msgr2=0x7f1e380c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 --2- 172.21.15.150:0/2776230295 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f1e38151290 0x7f1e380c5800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000c00 tx=0x7f1e280045d0 comp rx=0 tx=0).stop 2022-08-10T17:53:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e3e834700 1 -- 172.21.15.150:0/2776230295 reap_dead start 2022-08-10T17:53:05.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e3e834700 1 -- 172.21.15.150:0/2776230295 reap_dead start 2022-08-10T17:53:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 shutdown_connections 2022-08-10T17:53:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 >> 172.21.15.150:0/2776230295 conn(0x7f1e3806f880 msgr2=0x7f1e380c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:05.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 shutdown_connections 2022-08-10T17:53:05.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:05.813+0000 7f1e40297700 1 -- 172.21.15.150:0/2776230295 wait complete. 2022-08-10T17:53:05.877 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2022-08-10T17:53:05.878 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2022-08-10T17:53:05.878 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2022-08-10T17:53:05.878 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:53:05.879 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-10T17:53:05.879 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:53:05.900 INFO:tasks.ceph.mon.b:Stopped 2022-08-10T17:53:05.900 INFO:tasks.mon_thrash:Sending STOP to mon a 2022-08-10T17:53:05.901 INFO:tasks.ceph.mon.a:Sent signal 19 2022-08-10T17:53:05.901 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:53:20.902 INFO:tasks.mon_thrash:Sending CONT to mon a 2022-08-10T17:53:20.904 INFO:tasks.ceph.mon.a:Sent signal 18 2022-08-10T17:53:20.904 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:53:20.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:53:21.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.022+0000 7f31db43c700 1 Processor -- start 2022-08-10T17:53:21.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.022+0000 7f31db43c700 1 -- start start 2022-08-10T17:53:21.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31db43c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:21.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31db43c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40c4930 con 0x7f31d41577a0 2022-08-10T17:53:21.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31db43c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415adc0 con 0x7f31d41573d0 2022-08-10T17:53:21.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31db43c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40c5610 con 0x7f31d415a950 2022-08-10T17:53:21.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31d89d7700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 msgr2=0x7f31d40c5ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:21.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31d91d8700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f31d41573d0 legacy=0x7f31d40c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:21.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31d89d7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:21.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31d99d9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f31d41577a0 0x7f31d40c6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57176/0 (socket says 172.21.15.150:57176) 2022-08-10T17:53:21.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.023+0000 7f31d99d9700 1 -- 172.21.15.150:0/2067207572 learned_addr learned my addr 172.21.15.150:0/2067207572 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:53:21.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.224+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 msgr2=0x7f31d40c5ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:21.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.224+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.197:6789/0 conn(0x7f31d41573d0 legacy=0x7f31d40c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:21.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.224+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:53:21.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.625+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.197:6789/0 conn(0x7f31d41573d0 legacy=0x7f31d40c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:21.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.625+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 msgr2=0x7f31d40c5ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:21.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:21.625+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:53:22.428 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:22.426+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 msgr2=0x7f31d40c5ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:22.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:22.426+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.197:6789/0 conn(0x7f31d41573d0 legacy=0x7f31d40c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:22.429 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:22.426+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:53:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 msgr2=0x7f31d40c5ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.197:3300/0 conn(0x7f31d415a950 0x7f31d40c5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:24.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.197:6789/0 conn(0x7f31d41573d0 legacy=0x7f31d40c2180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:24.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.150:6789/0 conn(0x7f31d41577a0 legacy=0x7f31d40c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:24.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:24.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:24.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40c5610 con 0x7f31b40035d0 2022-08-10T17:53:24.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4008c10 con 0x7f31b4006030 2022-08-10T17:53:24.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:53:24.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:53:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:24.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.023+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:24.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:53:24.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:53:24.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:53:24.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.224+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:53:24.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:24.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:53:24.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:53:24.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:53:24.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:24.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:24.625+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:53:25.433 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:25.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:25.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-08-10T17:53:25.434 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:25.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:25.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:53:25.435 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:53:25.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d89d7700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:53:25.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:53:25.436 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:25.426+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:53:27.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 msgr2=0x7f31b40084e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:27.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4006030 0x7f31b40084e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 msgr2=0x7f31b4005a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:27.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b40035d0 0x7f31b4005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31d99d9700 1 -- 172.21.15.150:0/2067207572 reap_dead start 2022-08-10T17:53:27.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 0x7f31b40064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b4008600 0x7f31b400d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40c58f0 con 0x7f31b40069f0 2022-08-10T17:53:27.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40c5610 con 0x7f31b4008600 2022-08-10T17:53:27.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.022+0000 7f31c2ffd700 1 -- 172.21.15.150:0/2067207572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4008c10 con 0x7f31b4003a30 2022-08-10T17:53:27.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 0x7f31b40064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d99d9700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b4008600 0x7f31b400d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b4008600 msgr2=0x7f31b400d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:27.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b4008600 0x7f31b400d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 >> v1:172.21.15.150:6789/0 conn(0x7f31b40069f0 legacy=0x7f31b4006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 -- 172.21.15.150:0/2067207572 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d415adc0 con 0x7f31b4003a30 2022-08-10T17:53:27.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 0x7f31b40064b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31c4003fd0 tx=0x7f31c40057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae7be123d42813a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31c3fff700 1 -- 172.21.15.150:0/2067207572 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4009d60 con 0x7f31b4003a30 2022-08-10T17:53:27.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31c3fff700 1 -- 172.21.15.150:0/2067207572 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400c420 con 0x7f31b4003a30 2022-08-10T17:53:27.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.023+0000 7f31c3fff700 1 -- 172.21.15.150:0/2067207572 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400c7d0 con 0x7f31b4003a30 2022-08-10T17:53:27.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 -- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 msgr2=0x7f31b40064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 0x7f31b40064b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31c4003fd0 tx=0x7f31c40057d0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 -- 172.21.15.150:0/2067207572 shutdown_connections 2022-08-10T17:53:27.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 --2- 172.21.15.150:0/2067207572 >> v2:172.21.15.150:3300/0 conn(0x7f31b4008600 0x7f31b400d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 --2- 172.21.15.150:0/2067207572 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4003a30 0x7f31b40064b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 -- 172.21.15.150:0/2067207572 >> 172.21.15.150:0/2067207572 conn(0x7f31d4070590 msgr2=0x7f31d4071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 -- 172.21.15.150:0/2067207572 shutdown_connections 2022-08-10T17:53:27.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.024+0000 7f31db43c700 1 -- 172.21.15.150:0/2067207572 wait complete. 2022-08-10T17:53:27.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.026+0000 7f31db43c700 1 Processor -- start 2022-08-10T17:53:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.026+0000 7f31db43c700 1 -- start start 2022-08-10T17:53:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 0x7f31d40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4008600 0x7f31d41eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4153160 con 0x7f31b40069f0 2022-08-10T17:53:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c6990 con 0x7f31b4003a30 2022-08-10T17:53:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31db43c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c8520 con 0x7f31b4008600 2022-08-10T17:53:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31d91d8700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 msgr2=0x7f31d40c7b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:27.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.027+0000 7f31d91d8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 0x7f31d40c7b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:27.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44558/0 (socket says 172.21.15.150:44558) 2022-08-10T17:53:27.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 -- 172.21.15.150:0/2479807717 learned_addr learned my addr 172.21.15.150:0/2479807717 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:27.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d99d9700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4008600 0x7f31d41eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 -- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4008600 msgr2=0x7f31d41eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4008600 0x7f31d41eb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 -- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 msgr2=0x7f31d40c7b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:53:27.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 0x7f31d40c7b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 -- 172.21.15.150:0/2479807717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4005150 con 0x7f31b40069f0 2022-08-10T17:53:27.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31d89d7700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31d000bc30 tx=0x7f31d000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00058c0 con 0x7f31b40069f0 2022-08-10T17:53:27.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0011070 con 0x7f31b40069f0 2022-08-10T17:53:27.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0005a60 con 0x7f31b40069f0 2022-08-10T17:53:27.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.028+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40c8240 con 0x7f31b40069f0 2022-08-10T17:53:27.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.029+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40c62d0 con 0x7f31b40069f0 2022-08-10T17:53:27.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.030+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d40c4030 con 0x7f31b40069f0 2022-08-10T17:53:27.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.030+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f31d0020410 con 0x7f31b40069f0 2022-08-10T17:53:27.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.031+0000 7f31c1ffb700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 0x7f31b4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.031+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f31d0082db0 con 0x7f31b40069f0 2022-08-10T17:53:27.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.031+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 0x7f31b4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.031+0000 7f31d91d8700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 0x7f31b4071910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f31c4019040 tx=0x7f31c4011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.035+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f31d0050d30 con 0x7f31b40069f0 2022-08-10T17:53:27.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.348+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f31d40c6ad0 con 0x7f31b40069f0 2022-08-10T17:53:27.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.349+0000 7f31c1ffb700 1 -- 172.21.15.150:0/2479807717 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f31d001b600 con 0x7f31b40069f0 2022-08-10T17:53:27.353 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":138,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:53:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.351+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 msgr2=0x7f31b4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.351+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 0x7f31b4071910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f31c4019040 tx=0x7f31c4011000 comp rx=0 tx=0).stop 2022-08-10T17:53:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.351+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 msgr2=0x7f31d4155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.351+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31d000bc30 tx=0x7f31d000bf40 comp rx=0 tx=0).stop 2022-08-10T17:53:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 shutdown_connections 2022-08-10T17:53:27.356 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f31b406f460 0x7f31b4071910 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f31b4008600 0x7f31d41eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f31b4003a30 0x7f31d40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 --2- 172.21.15.150:0/2479807717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31b40069f0 0x7f31d4155410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.357 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 >> 172.21.15.150:0/2479807717 conn(0x7f31d4070590 msgr2=0x7f31d40c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 shutdown_connections 2022-08-10T17:53:27.358 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.352+0000 7f31db43c700 1 -- 172.21.15.150:0/2479807717 wait complete. 2022-08-10T17:53:27.372 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:53:27.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:53:27.528 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.522+0000 7fcc99b76700 1 Processor -- start 2022-08-10T17:53:27.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.522+0000 7fcc99b76700 1 -- start start 2022-08-10T17:53:27.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc99b76700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc9406db20 0x7fcc940b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc99b76700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc94155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc99b76700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc94155a60 con 0x7fcc9406d750 2022-08-10T17:53:27.529 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc99b76700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9406b2f0 con 0x7fcc9406db20 2022-08-10T17:53:27.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc99b76700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940c7690 con 0x7fcc941550a0 2022-08-10T17:53:27.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc937fe700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7fcc9406d750 legacy=0x7fcc940c7fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:27.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc9406db20 0x7fcc940b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc9406db20 0x7fcc940b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44570/0 (socket says 172.21.15.150:44570) 2022-08-10T17:53:27.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2988674066 learned_addr learned my addr 172.21.15.150:0/2988674066 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:27.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc93fff700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc94155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2988674066 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 msgr2=0x7fcc94155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:53:27.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc94155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2988674066 >> v1:172.21.15.197:6789/0 conn(0x7fcc9406d750 legacy=0x7fcc940c7fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:27.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.523+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2988674066 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940c6b10 con 0x7fcc9406db20 2022-08-10T17:53:27.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406db20 0x7fcc940b0870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc84009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b447f7ef70afffd8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc927fc700 1 -- 172.21.15.150:0/2988674066 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840107b0 con 0x7fcc9406db20 2022-08-10T17:53:27.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc927fc700 1 -- 172.21.15.150:0/2988674066 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84010910 con 0x7fcc9406db20 2022-08-10T17:53:27.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc927fc700 1 -- 172.21.15.150:0/2988674066 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84010ca0 con 0x7fcc9406db20 2022-08-10T17:53:27.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 -- 172.21.15.150:0/2988674066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406db20 msgr2=0x7fcc940b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406db20 0x7fcc940b0870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc84009a60 comp rx=0 tx=0).stop 2022-08-10T17:53:27.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 -- 172.21.15.150:0/2988674066 shutdown_connections 2022-08-10T17:53:27.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc94155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2988674066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406db20 0x7fcc940b0870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 -- 172.21.15.150:0/2988674066 >> 172.21.15.150:0/2988674066 conn(0x7fcc94071e40 msgr2=0x7fcc940c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 -- 172.21.15.150:0/2988674066 shutdown_connections 2022-08-10T17:53:27.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.524+0000 7fcc99b76700 1 -- 172.21.15.150:0/2988674066 wait complete. 2022-08-10T17:53:27.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.526+0000 7fcc99b76700 1 Processor -- start 2022-08-10T17:53:27.542 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.526+0000 7fcc99b76700 1 -- start start 2022-08-10T17:53:27.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 0x7fcc9414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.543 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc9406db20 0x7fcc9414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc940bec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.544 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940c5260 con 0x7fcc9406d750 2022-08-10T17:53:27.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9414d8c0 con 0x7fcc9406db20 2022-08-10T17:53:27.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc99b76700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94151690 con 0x7fcc941550a0 2022-08-10T17:53:27.545 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc92ffd700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc9406db20 msgr2=0x7fcc9414e290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:27.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc92ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc9406db20 0x7fcc9414e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:27.546 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 0x7fcc9414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc940bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 0x7fcc9414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44576/0 (socket says 172.21.15.150:44576) 2022-08-10T17:53:27.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 -- 172.21.15.150:0/2811172137 learned_addr learned my addr 172.21.15.150:0/2811172137 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:27.547 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 msgr2=0x7fcc940bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc941550a0 0x7fcc940bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc9406db20 msgr2=0x7fcc9414e290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:53:27.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc9406db20 0x7fcc9414e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.548 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc840093e0 con 0x7fcc9406d750 2022-08-10T17:53:27.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.527+0000 7fcc937fe700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 0x7fcc9414dd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800b430 tx=0x7fcc8800b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88003cd0 con 0x7fcc9406d750 2022-08-10T17:53:27.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc88003e50 con 0x7fcc9406d750 2022-08-10T17:53:27.549 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940c4ca0 con 0x7fcc9406d750 2022-08-10T17:53:27.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc880052b0 con 0x7fcc9406d750 2022-08-10T17:53:27.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9414d270 con 0x7fcc9406d750 2022-08-10T17:53:27.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 0x7fcc940bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.550 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.528+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9414d0f0 con 0x7fcc9414d490 2022-08-10T17:53:27.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 0x7fcc940bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc9414dba0 con 0x7fcc9414d490 2022-08-10T17:53:27.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcc8800f070 con 0x7fcc9406d750 2022-08-10T17:53:27.551 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 0x7fcc940bf160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc840045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc7bfff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc74065060 0x7fcc74067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.529+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcc88081a00 con 0x7fcc9406d750 2022-08-10T17:53:27.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc93fff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc74065060 0x7fcc74067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84010e90 con 0x7fcc9414d490 2022-08-10T17:53:27.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fcc84020070 con 0x7fcc9414d490 2022-08-10T17:53:27.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 msgr2=0x7fcc940bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 0x7fcc940bf160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc840045d0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 msgr2=0x7fcc940bf160 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:27.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc7bfff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9414d490 0x7fcc940bf160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.530+0000 7fcc93fff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc74065060 0x7fcc74067510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcc94151a10 tx=0x7fcc8c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.537+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 0x7fcc94147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.537+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940bfaa0 con 0x7fcc940bf6a0 2022-08-10T17:53:27.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.537+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 0x7fcc94147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc92ffd700 1 -- 172.21.15.150:0/2811172137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcc94072890 con 0x7fcc940bf6a0 2022-08-10T17:53:27.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc92ffd700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 0x7fcc94147e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009aa0 tx=0x7fcc84009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011850 con 0x7fcc940bf6a0 2022-08-10T17:53:27.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4878 (secure 0 0 0) 0x7fcc840119b0 con 0x7fcc940bf6a0 2022-08-10T17:53:27.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 msgr2=0x7fcc94147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 0x7fcc94147e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009aa0 tx=0x7fcc84009190 comp rx=0 tx=0).stop 2022-08-10T17:53:27.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 msgr2=0x7fcc94147e70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:27.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.538+0000 7fcc7bfff700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc940bf6a0 0x7fcc94147e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.558 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:53:27.558 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:27.558 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:27.559 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:53:27.559 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 138, 2022-08-10T17:53:27.559 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:53:27.559 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:53:27.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:53:27.560 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.560 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:53:27.560 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:27.560 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:53:27.561 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:53:27.561 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.561 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.561 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.562 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.562 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.562 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.563 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.563 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.563 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.563 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.564 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:53:27.564 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:53:27.564 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.564 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.565 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.565 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.565 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.565 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.565 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.566 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.566 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.566 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.567 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:53:27.567 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:53:27.568 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:53:27.568 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:53:27.568 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:53:27.569 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:53:27.569 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:27.569 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:27.569 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:53:27.570 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:53:27.570 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:53:27.570 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:53:27.570 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:53:27.571 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:53:27.571 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:27.571 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:53:27.571 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.571 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.572 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.572 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.572 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.572 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.573 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.573 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.573 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.573 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.574 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:53:27.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.574 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:53:27.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.575 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:27.575 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:27.575 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.575 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.576 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.576 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:53:27.576 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.577 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.577 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:53:27.577 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.578 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.578 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.579 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:53:27.579 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:53:27.579 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.580 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.580 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.581 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:27.581 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:27.581 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.581 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.582 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.582 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:53:27.582 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.583 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:53:27.583 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.584 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.584 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.584 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:53:27.585 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:53:27.585 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.585 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.585 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.586 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:27.586 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:27.586 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.587 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.587 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.587 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:53:27.588 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.589 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:53:27.590 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.591 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:53:27.591 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:53:27.591 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.591 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.592 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.592 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.592 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.593 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:53:27.593 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:53:27.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.593 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.594 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.594 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:27.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.594 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.595 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:53:27.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.595 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.595 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.596 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:53:27.596 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.596 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.596 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:53:27.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.597 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.597 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.597 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:53:27.597 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.598 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.598 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:53:27.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.598 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.599 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.599 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:53:27.599 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.600 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.600 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:53:27.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.600 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.601 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.601 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:53:27.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.601 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.602 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:53:27.602 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:53:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc74065060 msgr2=0x7fcc74067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc74065060 0x7fcc74067510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcc94151a10 tx=0x7fcc8c00b040 comp rx=0 tx=0).stop 2022-08-10T17:53:27.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 msgr2=0x7fcc9414dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 --2- 172.21.15.150:0/2811172137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc9406d750 0x7fcc9414dd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800b430 tx=0x7fcc8800b740 comp rx=0 tx=0).stop 2022-08-10T17:53:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc93fff700 1 -- 172.21.15.150:0/2811172137 reap_dead start 2022-08-10T17:53:27.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc93fff700 1 -- 172.21.15.150:0/2811172137 reap_dead start 2022-08-10T17:53:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 shutdown_connections 2022-08-10T17:53:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 >> 172.21.15.150:0/2811172137 conn(0x7fcc94071e40 msgr2=0x7fcc940ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 shutdown_connections 2022-08-10T17:53:27.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.539+0000 7fcc99b76700 1 -- 172.21.15.150:0/2811172137 wait complete. 2022-08-10T17:53:27.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:53:27.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.739+0000 7f0ffd365700 1 Processor -- start 2022-08-10T17:53:27.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.739+0000 7f0ffd365700 1 -- start start 2022-08-10T17:53:27.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ffd365700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 0x7f0ff8071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ffd365700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ffd365700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff806a050 con 0x7f0ff806eff0 2022-08-10T17:53:27.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ffd365700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80c6220 con 0x7f0ff81544d0 2022-08-10T17:53:27.747 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ffd365700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80c4420 con 0x7f0ff806ea90 2022-08-10T17:53:27.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff6ffd700 1 -- >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 msgr2=0x7f0ff8071370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:27.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff77fe700 1 -- >> v1:172.21.15.197:6789/0 conn(0x7f0ff806eff0 legacy=0x7f0ff815a260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.197:6789/0 2022-08-10T17:53:27.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff6ffd700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 0x7f0ff8071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:27.748 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58812/0 (socket says 172.21.15.150:58812) 2022-08-10T17:53:27.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 -- 172.21.15.150:0/74210492 learned_addr learned my addr 172.21.15.150:0/74210492 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:27.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 -- 172.21.15.150:0/74210492 >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 msgr2=0x7f0ff8071370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:27.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 --2- 172.21.15.150:0/74210492 >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 0x7f0ff8071370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 -- 172.21.15.150:0/74210492 >> v1:172.21.15.197:6789/0 conn(0x7f0ff806eff0 legacy=0x7f0ff815a260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 -- 172.21.15.150:0/74210492 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80c4700 con 0x7f0ff806ea90 2022-08-10T17:53:27.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.740+0000 7f0ff67fc700 1 --2- 172.21.15.150:0/74210492 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935dda591fdf0b6e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ff5ffb700 1 -- 172.21.15.150:0/74210492 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec011830 con 0x7f0ff806ea90 2022-08-10T17:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ff5ffb700 1 -- 172.21.15.150:0/74210492 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec011990 con 0x7f0ff806ea90 2022-08-10T17:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ff5ffb700 1 -- 172.21.15.150:0/74210492 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec011d40 con 0x7f0ff806ea90 2022-08-10T17:53:27.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 -- 172.21.15.150:0/74210492 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 msgr2=0x7f0ff80718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 --2- 172.21.15.150:0/74210492 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec009a60 comp rx=0 tx=0).stop 2022-08-10T17:53:27.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 -- 172.21.15.150:0/74210492 shutdown_connections 2022-08-10T17:53:27.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 --2- 172.21.15.150:0/74210492 >> v2:172.21.15.197:3300/0 conn(0x7f0ff81544d0 0x7f0ff8071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 --2- 172.21.15.150:0/74210492 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806ea90 0x7f0ff80718b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 -- 172.21.15.150:0/74210492 >> 172.21.15.150:0/74210492 conn(0x7f0ff8068110 msgr2=0x7f0ff8068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 -- 172.21.15.150:0/74210492 shutdown_connections 2022-08-10T17:53:27.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.741+0000 7f0ffd365700 1 -- 172.21.15.150:0/74210492 wait complete. 2022-08-10T17:53:27.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 Processor -- start 2022-08-10T17:53:27.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 -- start start 2022-08-10T17:53:27.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ff806ea90 0x7f0ff8147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 0x7f0ff8147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 0x7f0ff81edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8156a80 con 0x7f0ff81544d0 2022-08-10T17:53:27.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81ed8d0 con 0x7f0ff806ea90 2022-08-10T17:53:27.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.743+0000 7f0ffd365700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80ca8b0 con 0x7f0ff806eff0 2022-08-10T17:53:27.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff6ffd700 1 -- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ff806ea90 msgr2=0x7f0ff8147880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3300/0 2022-08-10T17:53:27.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ff806ea90 0x7f0ff8147880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:53:27.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 0x7f0ff81edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 0x7f0ff8147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 0x7f0ff81edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44598/0 (socket says 172.21.15.150:44598) 2022-08-10T17:53:27.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 0x7f0ff8147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:58818/0 (socket says 172.21.15.150:58818) 2022-08-10T17:53:27.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff77fe700 1 -- 172.21.15.150:0/395738306 learned_addr learned my addr 172.21.15.150:0/395738306 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:53:27.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ff806ea90 msgr2=0x7f0ff8147880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:53:27.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f0ff806ea90 0x7f0ff8147880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 msgr2=0x7f0ff81edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 0x7f0ff81edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0093e0 con 0x7f0ff806eff0 2022-08-10T17:53:27.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff77fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff81544d0 0x7f0ff81edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:53:27.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ff67fc700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 0x7f0ff8147dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fec016000 tx=0x7f0fec0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0042f0 con 0x7f0ff806eff0 2022-08-10T17:53:27.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec003520 con 0x7f0ff806eff0 2022-08-10T17:53:27.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8156630 con 0x7f0ff806eff0 2022-08-10T17:53:27.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0038d0 con 0x7f0ff806eff0 2022-08-10T17:53:27.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.744+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81ed560 con 0x7f0ff806eff0 2022-08-10T17:53:27.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.745+0000 7f0ffd365700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 0x7f0ff81ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.745+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81eda40 con 0x7f0ff81575e0 2022-08-10T17:53:27.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0ff6ffd700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 0x7f0ff81ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f0fec00f050 con 0x7f0ff806eff0 2022-08-10T17:53:27.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0ff6ffd700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ff8156f10 con 0x7f0ff81575e0 2022-08-10T17:53:27.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0fdf7fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0fd8065090 0x7f0fd8067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f0fec083410 con 0x7f0ff806eff0 2022-08-10T17:53:27.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0ff6ffd700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 0x7f0ff81ee2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800b310 tx=0x7f0fe800b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0ff77fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0fd8065090 0x7f0fd8067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.746+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8003b20 con 0x7f0ff81575e0 2022-08-10T17:53:27.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f0fe8003c80 con 0x7f0ff81575e0 2022-08-10T17:53:27.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 msgr2=0x7f0ff81ee2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0fdf7fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 0x7f0ff81ee2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800b310 tx=0x7f0fe800b6d0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 msgr2=0x7f0ff81ee2a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:27.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0fdf7fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81575e0 0x7f0ff81ee2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.747+0000 7f0ff77fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0fd8065090 0x7f0fd8067540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0003ad0 tx=0x7f0ff00096c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.754+0000 7f0ffd365700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 0x7f0ff81ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:53:27.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.754+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81ed3c0 con 0x7f0ff81ef4c0 2022-08-10T17:53:27.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.754+0000 7f0ff6ffd700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 0x7f0ff81ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:53:27.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.754+0000 7f0ff6ffd700 1 -- 172.21.15.150:0/395738306 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0ff81ed6f0 con 0x7f0ff81ef4c0 2022-08-10T17:53:27.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.754+0000 7f0ff6ffd700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 0x7f0ff81ef8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8013000 tx=0x7f0fe8005930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:53:27.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011c70 con 0x7f0ff81ef4c0 2022-08-10T17:53:27.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4849 (secure 0 0 0) 0x7f0fe801f420 con 0x7f0ff81ef4c0 2022-08-10T17:53:27.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 msgr2=0x7f0ff81ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 0x7f0ff81ef8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8013000 tx=0x7f0fe8005930 comp rx=0 tx=0).stop 2022-08-10T17:53:27.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 msgr2=0x7f0ff81ef8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:53:27.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0fdf7fe700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff81ef4c0 0x7f0ff81ef8c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.773 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:53:27.774 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:27.774 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:27.774 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:53:27.775 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 138, 2022-08-10T17:53:27.775 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:53:27.775 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:53:27.775 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:53:27.776 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.776 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:53:27.776 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:27.776 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:53:27.776 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:53:27.777 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.777 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.777 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.777 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.778 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.778 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.778 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.778 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.779 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.779 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.779 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:53:27.780 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:53:27.780 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.780 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.781 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.781 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.781 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.781 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.782 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.782 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.782 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.782 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.783 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.783 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:53:27.783 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:53:27.783 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:53:27.784 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:53:27.784 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:53:27.784 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:53:27.784 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:27.785 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:53:27.785 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:53:27.785 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:53:27.785 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:53:27.786 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:53:27.786 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:53:27.786 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:53:27.787 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:53:27.787 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:53:27.788 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:53:27.788 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:53:27.789 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:53:27.790 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:53:27.790 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:53:27.790 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:53:27.791 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:53:27.792 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:53:27.792 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:53:27.792 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.793 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:53:27.793 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.794 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:53:27.794 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.794 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:53:27.795 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:53:27.795 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.795 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.795 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.796 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.796 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:53:27.796 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.797 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.797 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.797 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.797 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:53:27.798 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.798 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.798 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.798 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.799 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:53:27.799 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:53:27.799 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.800 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.800 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.801 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.801 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.801 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:53:27.802 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:53:27.802 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.803 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.803 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.804 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.804 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:53:27.805 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.805 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.805 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.806 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.806 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:53:27.807 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.807 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.808 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.808 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.809 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:53:27.809 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:53:27.809 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.810 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.810 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.810 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.810 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:53:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:53:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:53:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:53:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:53:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:53:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.813 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.813 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:53:27.813 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:53:27.813 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:53:27.813 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.814 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.814 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:53:27.814 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:53:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:53:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:53:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:53:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.816 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:53:27.816 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:53:27.816 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.817 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.817 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.817 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:27.817 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.817 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.818 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:53:27.818 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.818 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.818 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.819 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:53:27.819 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.819 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.819 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:53:27.820 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.820 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.820 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.820 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:53:27.821 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.821 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:53:27.821 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:53:27.822 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.822 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:53:27.822 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.822 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:53:27.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.823 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:53:27.823 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:53:27.823 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:53:27.823 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5 2022-08-10T17:53:27.824 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:53:27.824 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:53:27.824 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:53:27.824 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:53:27.825 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:53:27.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0fd8065090 msgr2=0x7f0fd8067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0ffd365700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f0fd8065090 0x7f0fd8067540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0003ad0 tx=0x7f0ff00096c0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 msgr2=0x7f0ff8147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:53:27.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0ffd365700 1 --2- 172.21.15.150:0/395738306 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f0ff806eff0 0x7f0ff8147dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fec016000 tx=0x7f0fec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:53:27.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.755+0000 7f0ff77fe700 1 -- 172.21.15.150:0/395738306 reap_dead start 2022-08-10T17:53:27.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.756+0000 7f0ff77fe700 1 -- 172.21.15.150:0/395738306 reap_dead start 2022-08-10T17:53:27.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.756+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 shutdown_connections 2022-08-10T17:53:27.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.756+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 >> 172.21.15.150:0/395738306 conn(0x7f0ff8068110 msgr2=0x7f0ff80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:53:27.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.756+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 shutdown_connections 2022-08-10T17:53:27.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:53:27.756+0000 7f0ffd365700 1 -- 172.21.15.150:0/395738306 wait complete. 2022-08-10T17:53:27.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:53:46.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:53:46.141 DEBUG:teuthology.orchestra.run.smithi197:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-08-10T17:53:46.315 INFO:tasks.ceph.osd.4.smithi197.stderr:2022-08-10T17:53:46.311+0000 7f684d85b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103455) UID: 0 2022-08-10T17:53:46.317 INFO:tasks.ceph.osd.5.smithi197.stderr:2022-08-10T17:53:46.311+0000 7fea9347d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103455) UID: 0 2022-08-10T17:53:46.318 INFO:tasks.ceph.osd.6.smithi197.stderr:2022-08-10T17:53:46.311+0000 7fc11ed04700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103455) UID: 0 2022-08-10T17:53:46.318 INFO:tasks.ceph.osd.7.smithi197.stderr:2022-08-10T17:53:46.311+0000 7f43e3cf3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103455) UID: 0 2022-08-10T17:53:46.503 INFO:tasks.ceph.osd.2.smithi150.stderr:2022-08-10T17:53:46.499+0000 7f3f08bb6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123026) UID: 0 2022-08-10T17:53:46.504 INFO:tasks.ceph.osd.1.smithi150.stderr:2022-08-10T17:53:46.499+0000 7f8e6e7bc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123026) UID: 0 2022-08-10T17:53:46.505 INFO:tasks.ceph.osd.3.smithi150.stderr:2022-08-10T17:53:46.499+0000 7f9620e5c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123026) UID: 0 2022-08-10T17:53:46.506 INFO:tasks.ceph.osd.0.smithi150.stderr:2022-08-10T17:53:46.499+0000 7f2f8be56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123026) UID: 0 2022-08-10T17:53:47.830 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2022-08-10T17:53:47.831 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2022-08-10T17:53:47.831 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-10T17:53:47.832 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-10T17:53:47.835 INFO:tasks.ceph.mon.b:Started 2022-08-10T17:53:47.835 INFO:tasks.mon_thrash:Sending STOP to mon a 2022-08-10T17:53:47.836 INFO:tasks.ceph.mon.a:Sent signal 19 2022-08-10T17:53:47.836 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2022-08-10T17:54:02.838 INFO:tasks.mon_thrash:Sending CONT to mon a 2022-08-10T17:54:02.839 INFO:tasks.ceph.mon.a:Sent signal 18 2022-08-10T17:54:02.839 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:54:02.840 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.958+0000 7efc1861c700 1 Processor -- start 2022-08-10T17:54:02.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.958+0000 7efc1861c700 1 -- start start 2022-08-10T17:54:02.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc1861c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc100644b0 0x7efc1006f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc1861c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc1861c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc100c6780 con 0x7efc10150e70 2022-08-10T17:54:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc1861c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc100c6a60 con 0x7efc100644b0 2022-08-10T17:54:02.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc1861c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1006b4e0 con 0x7efc1006fef0 2022-08-10T17:54:02.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc15bb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc100644b0 0x7efc1006f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc15bb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc100644b0 0x7efc1006f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44650/0 (socket says 172.21.15.150:44650) 2022-08-10T17:54:02.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.959+0000 7efc15bb7700 1 -- 172.21.15.150:0/2916517907 learned_addr learned my addr 172.21.15.150:0/2916517907 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:02.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc16bb9700 1 --2- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc16bb9700 1 -- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 msgr2=0x7efc1006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc16bb9700 1 -- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 msgr2=0x7efc1006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc16bb9700 1 --2- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc15bb7700 1 -- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 msgr2=0x7efc1006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:02.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc16bb9700 1 --2- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc15bb7700 1 --2- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc15bb7700 1 -- 172.21.15.150:0/2916517907 >> v1:172.21.15.197:6789/0 conn(0x7efc10150e70 legacy=0x7efc10157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc15bb7700 1 -- 172.21.15.150:0/2916517907 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1006b7c0 con 0x7efc100644b0 2022-08-10T17:54:02.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc15bb7700 1 --2- 172.21.15.150:0/2916517907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc100644b0 0x7efc1006f9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc1006e110 tx=0x7efc0c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bc19d5eb9bc4fb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc153b6700 1 -- 172.21.15.150:0/2916517907 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c004230 con 0x7efc100644b0 2022-08-10T17:54:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc153b6700 1 -- 172.21.15.150:0/2916517907 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c004390 con 0x7efc100644b0 2022-08-10T17:54:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.960+0000 7efc153b6700 1 -- 172.21.15.150:0/2916517907 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011830 con 0x7efc100644b0 2022-08-10T17:54:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 -- 172.21.15.150:0/2916517907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc100644b0 msgr2=0x7efc1006f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:02.970 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 --2- 172.21.15.150:0/2916517907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc100644b0 0x7efc1006f9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc1006e110 tx=0x7efc0c009a60 comp rx=0 tx=0).stop 2022-08-10T17:54:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 -- 172.21.15.150:0/2916517907 shutdown_connections 2022-08-10T17:54:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 --2- 172.21.15.150:0/2916517907 >> v2:172.21.15.197:3300/0 conn(0x7efc1006fef0 0x7efc1006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 --2- 172.21.15.150:0/2916517907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc100644b0 0x7efc1006f9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:02.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 -- 172.21.15.150:0/2916517907 >> 172.21.15.150:0/2916517907 conn(0x7efc100c9d60 msgr2=0x7efc100c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:02.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 -- 172.21.15.150:0/2916517907 shutdown_connections 2022-08-10T17:54:02.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.961+0000 7efc1861c700 1 -- 172.21.15.150:0/2916517907 wait complete. 2022-08-10T17:54:02.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.962+0000 7efc1861c700 1 Processor -- start 2022-08-10T17:54:02.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.962+0000 7efc1861c700 1 -- start start 2022-08-10T17:54:02.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc1006fef0 0x7efc1014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c49d0 con 0x7efc10150e70 2022-08-10T17:54:02.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c4c00 con 0x7efc100644b0 2022-08-10T17:54:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c4ee0 con 0x7efc1006fef0 2022-08-10T17:54:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44658/0 (socket says 172.21.15.150:44658) 2022-08-10T17:54:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 -- 172.21.15.150:0/3257908154 learned_addr learned my addr 172.21.15.150:0/3257908154 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:02.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc163b8700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc15bb7700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc1006fef0 0x7efc1014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc163b8700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 msgr2=0x7efc1014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:54:02.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc1006fef0 msgr2=0x7efc1014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:02.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc163b8700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 msgr2=0x7efc1014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:54:02.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc1006fef0 0x7efc1014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:02.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc163b8700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:02.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 msgr2=0x7efc1014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:02.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc163b8700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:02.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:02.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 -- 172.21.15.150:0/3257908154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0093e0 con 0x7efc10150e70 2022-08-10T17:54:02.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc16bb9700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc08007e30 tx=0x7efc0800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:02.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ede0 con 0x7efc10150e70 2022-08-10T17:54:02.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08014420 con 0x7efc10150e70 2022-08-10T17:54:02.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc100c51c0 con 0x7efc10150e70 2022-08-10T17:54:02.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080147d0 con 0x7efc10150e70 2022-08-10T17:54:02.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.963+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc101e12e0 con 0x7efc10150e70 2022-08-10T17:54:02.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.964+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc100c56e0 con 0x7efc10150e70 2022-08-10T17:54:02.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.965+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7efc08012050 con 0x7efc10150e70 2022-08-10T17:54:02.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.965+0000 7efc02ffd700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 0x7efbf0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:02.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.965+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7efc08082610 con 0x7efc10150e70 2022-08-10T17:54:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.965+0000 7efc163b8700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 0x7efbf0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:02.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.966+0000 7efc163b8700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 0x7efbf0067560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc04000f60 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:02.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:02.969+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7efc080505f0 con 0x7efc10150e70 2022-08-10T17:54:03.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.221+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efc10072890 con 0x7efc10150e70 2022-08-10T17:54:03.225 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.221+0000 7efc02ffd700 1 -- 172.21.15.150:0/3257908154 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7efc08053c10 con 0x7efc10150e70 2022-08-10T17:54:03.225 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:03.227 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 msgr2=0x7efbf0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 0x7efbf0067560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc04000f60 tx=0x7efc04009040 comp rx=0 tx=0).stop 2022-08-10T17:54:03.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 msgr2=0x7efc101e1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc08007e30 tx=0x7efc0800e3c0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.228 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 shutdown_connections 2022-08-10T17:54:03.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10150e70 0x7efc101e1800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7efc100644b0 0x7efc1014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7efbf00650b0 0x7efbf0067560 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 --2- 172.21.15.150:0/3257908154 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7efc1006fef0 0x7efc1014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.223+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 >> 172.21.15.150:0/3257908154 conn(0x7efc100c9d60 msgr2=0x7efc1014b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.224+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 shutdown_connections 2022-08-10T17:54:03.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.224+0000 7efc1861c700 1 -- 172.21.15.150:0/3257908154 wait complete. 2022-08-10T17:54:03.240 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:54:03.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:54:03.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.359+0000 7f0a02b65700 1 Processor -- start 2022-08-10T17:54:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.359+0000 7f0a02b65700 1 -- start start 2022-08-10T17:54:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f0a02b65700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09fc0c1730 0x7f09fc0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f0a02b65700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0c3020 con 0x7f09fc0cda80 2022-08-10T17:54:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f0a02b65700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc156bd0 con 0x7f09fc070240 2022-08-10T17:54:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f0a02b65700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0c1b60 con 0x7f09fc0c1730 2022-08-10T17:54:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09fc0c1730 0x7f09fc0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09fc0c1730 0x7f09fc0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44664/0 (socket says 172.21.15.150:44664) 2022-08-10T17:54:03.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f0a01102700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f09fc0cda80 0x7f09fc0691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57346/0 (socket says 172.21.15.150:57346) 2022-08-10T17:54:03.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 -- 172.21.15.150:0/3800001921 learned_addr learned my addr 172.21.15.150:0/3800001921 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:03.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 -- 172.21.15.150:0/3800001921 >> v1:172.21.15.197:6789/0 conn(0x7f09fc070240 legacy=0x7f09fc157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 -- 172.21.15.150:0/3800001921 >> v1:172.21.15.150:6789/0 conn(0x7f09fc0cda80 legacy=0x7f09fc0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 -- 172.21.15.150:0/3800001921 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc06f770 con 0x7f09fc0c1730 2022-08-10T17:54:03.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.360+0000 7f09fbfff700 1 --2- 172.21.15.150:0/3800001921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c1730 0x7f09fc0cd540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09e8006fd0 tx=0x7f09e8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce03bef5780b741 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.361+0000 7f09fb7fe700 1 -- 172.21.15.150:0/3800001921 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004290 con 0x7f09fc0c1730 2022-08-10T17:54:03.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.361+0000 7f09fb7fe700 1 -- 172.21.15.150:0/3800001921 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80043f0 con 0x7f09fc0c1730 2022-08-10T17:54:03.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.361+0000 7f09fb7fe700 1 -- 172.21.15.150:0/3800001921 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011850 con 0x7f09fc0c1730 2022-08-10T17:54:03.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 -- 172.21.15.150:0/3800001921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c1730 msgr2=0x7f09fc0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3800001921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c1730 0x7f09fc0cd540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09e8006fd0 tx=0x7f09e8009a60 comp rx=0 tx=0).stop 2022-08-10T17:54:03.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 -- 172.21.15.150:0/3800001921 shutdown_connections 2022-08-10T17:54:03.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3800001921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c1730 0x7f09fc0cd540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 -- 172.21.15.150:0/3800001921 >> 172.21.15.150:0/3800001921 conn(0x7f09fc071e40 msgr2=0x7f09fc0cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 -- 172.21.15.150:0/3800001921 shutdown_connections 2022-08-10T17:54:03.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.362+0000 7f0a02b65700 1 -- 172.21.15.150:0/3800001921 wait complete. 2022-08-10T17:54:03.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.363+0000 7f0a02b65700 1 Processor -- start 2022-08-10T17:54:03.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.364+0000 7f0a02b65700 1 -- start start 2022-08-10T17:54:03.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09fc070240 0x7f09fc1e2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09fc0c1730 0x7f09fc14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 0x7f09fc14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc146d20 con 0x7f09fc0cda80 2022-08-10T17:54:03.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0c9ce0 con 0x7f09fc070240 2022-08-10T17:54:03.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0c8960 con 0x7f09fc0c1730 2022-08-10T17:54:03.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 0x7f09fc14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 0x7f09fc14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44672/0 (socket says 172.21.15.150:44672) 2022-08-10T17:54:03.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a00901700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09fc070240 0x7f09fc1e2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 learned_addr learned my addr 172.21.15.150:0/3419082236 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:03.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09fc0c1730 0x7f09fc14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09fc0c1730 msgr2=0x7f09fc14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f09fc0c1730 0x7f09fc14a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09fc070240 msgr2=0x7f09fc1e2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f09fc070240 0x7f09fc1e2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80093e0 con 0x7f09fc0cda80 2022-08-10T17:54:03.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a01102700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 0x7f09fc14b4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c700 tx=0x7f09f400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40070d0 con 0x7f09fc0cda80 2022-08-10T17:54:03.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4007230 con 0x7f09fc0cda80 2022-08-10T17:54:03.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40075a0 con 0x7f09fc0cda80 2022-08-10T17:54:03.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.365+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0c8c40 con 0x7f09fc0cda80 2022-08-10T17:54:03.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.366+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0c9200 con 0x7f09fc0cda80 2022-08-10T17:54:03.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.366+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 0x7f09fc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.366+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0673d0 con 0x7f09fc14c430 2022-08-10T17:54:03.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f0a00901700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 0x7f09fc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f0a00901700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09fc072890 con 0x7f09fc14c430 2022-08-10T17:54:03.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f09f4019030 con 0x7f09fc0cda80 2022-08-10T17:54:03.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f0a00901700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 0x7f09fc14ba30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000f60 tx=0x7f09f000f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f09f97fa700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09e40650b0 0x7f09e4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f09f4081460 con 0x7f09fc0cda80 2022-08-10T17:54:03.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f09fbfff700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09e40650b0 0x7f09e4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.367+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0001270 con 0x7f09fc14c430 2022-08-10T17:54:03.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f09f00052e0 con 0x7f09fc14c430 2022-08-10T17:54:03.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 msgr2=0x7f09fc14ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09f97fa700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 0x7f09fc14ba30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000f60 tx=0x7f09f000f8d0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 msgr2=0x7f09fc14ba30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09f97fa700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14c430 0x7f09fc14ba30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.368+0000 7f09fbfff700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09e40650b0 0x7f09e4067560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f09e8014040 tx=0x7f09e8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 0x7f09fc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0cd5f0 con 0x7f09fc14ae00 2022-08-10T17:54:03.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f0a00901700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 0x7f09fc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.398 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f0a00901700 1 -- 172.21.15.150:0/3419082236 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09fc0c78e0 con 0x7f09fc14ae00 2022-08-10T17:54:03.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f0a00901700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 0x7f09fc0c93f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000f60 tx=0x7f09f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.381+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f001cbb0 con 0x7f09fc14ae00 2022-08-10T17:54:03.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4889 (secure 0 0 0) 0x7f09f001cd10 con 0x7f09fc14ae00 2022-08-10T17:54:03.399 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 msgr2=0x7f09fc0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f09f97fa700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 0x7f09fc0c93f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000f60 tx=0x7f09f0001120 comp rx=0 tx=0).stop 2022-08-10T17:54:03.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f09f97fa700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 msgr2=0x7f09fc0c93f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.400 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f09f97fa700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc14ae00 0x7f09fc0c93f0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000f60 tx=0x7f09f0001120 comp rx=0 tx=0).stop 2022-08-10T17:54:03.401 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:03.401 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:03.401 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:03.401 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:54:03.402 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:03.402 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:03.402 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:03.402 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:03.403 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:03.403 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.403 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:54:03.403 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.404 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:03.404 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:03.404 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.404 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.404 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.405 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.405 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.405 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.405 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.406 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.406 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.406 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.406 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:03.407 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:03.407 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.407 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.407 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.408 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.408 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.408 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.408 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.409 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.409 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.409 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.410 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:03.410 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:03.410 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:03.410 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:03.411 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:03.411 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:03.411 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.411 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.412 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:03.412 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:03.412 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:03.412 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:03.413 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:03.413 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:03.413 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.413 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:03.414 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.414 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.414 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.414 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.415 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.415 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.415 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.415 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.416 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.416 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.416 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:03.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.417 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:03.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.417 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:03.417 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:03.417 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.418 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.418 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.418 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:03.419 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.419 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:54:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:54:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:03.442 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09e40650b0 msgr2=0x7f09e4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f09e40650b0 0x7f09e4067560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f09e8014040 tx=0x7f09e8010000 comp rx=0 tx=0).stop 2022-08-10T17:54:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 msgr2=0x7f09fc14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 --2- 172.21.15.150:0/3419082236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0cda80 0x7f09fc14b4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c700 tx=0x7f09f400ca10 comp rx=0 tx=0).stop 2022-08-10T17:54:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 reap_dead start 2022-08-10T17:54:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a01102700 1 -- 172.21.15.150:0/3419082236 reap_dead start 2022-08-10T17:54:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 shutdown_connections 2022-08-10T17:54:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 >> 172.21.15.150:0/3419082236 conn(0x7f09fc071e40 msgr2=0x7f09fc14ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 shutdown_connections 2022-08-10T17:54:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.382+0000 7f0a02b65700 1 -- 172.21.15.150:0/3419082236 wait complete. 2022-08-10T17:54:03.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:54:03.568 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 Processor -- start 2022-08-10T17:54:03.569 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 -- start start 2022-08-10T17:54:03.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 0x7f53e00c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00c39a0 con 0x7f53e00c4410 2022-08-10T17:54:03.578 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00b0ff0 con 0x7f53e006d850 2022-08-10T17:54:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53e61a8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e006e120 con 0x7f53e006d480 2022-08-10T17:54:03.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.565+0000 7f53dffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f53e00c4410 0x7f53e0154f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57364/0 (socket says 172.21.15.150:57364) 2022-08-10T17:54:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53dffff700 1 -- 172.21.15.150:0/2804463971 learned_addr learned my addr 172.21.15.150:0/2804463971 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53df7fe700 1 --2- 172.21.15.150:0/2804463971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 0x7f53e00c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.580 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618185363 0 0) 0x7f53e00c39a0 con 0x7f53e00c4410 2022-08-10T17:54:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53cc003430 con 0x7f53e00c4410 2022-08-10T17:54:03.581 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970913389 0 0) 0x7f53e00b0ff0 con 0x7f53e006d850 2022-08-10T17:54:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e00c39a0 con 0x7f53e006d850 2022-08-10T17:54:03.582 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53df7fe700 1 -- 172.21.15.150:0/2804463971 >> v1:172.21.15.197:6789/0 conn(0x7f53e006d850 legacy=0x7f53e00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53df7fe700 1 -- 172.21.15.150:0/2804463971 >> v1:172.21.15.150:6789/0 conn(0x7f53e00c4410 legacy=0x7f53e0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.583 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53df7fe700 1 -- 172.21.15.150:0/2804463971 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00c5620 con 0x7f53e006d480 2022-08-10T17:54:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53df7fe700 1 --2- 172.21.15.150:0/2804463971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 0x7f53e00c1f60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53d00096e0 tx=0x7f53d00099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556ed8e5eb09c2b7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00107b0 con 0x7f53e006d480 2022-08-10T17:54:03.584 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0010910 con 0x7f53e006d480 2022-08-10T17:54:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.566+0000 7f53de7fc700 1 -- 172.21.15.150:0/2804463971 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0010c80 con 0x7f53e006d480 2022-08-10T17:54:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 -- 172.21.15.150:0/2804463971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 msgr2=0x7f53e00c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 --2- 172.21.15.150:0/2804463971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 0x7f53e00c1f60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53d00096e0 tx=0x7f53d00099f0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.585 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 -- 172.21.15.150:0/2804463971 shutdown_connections 2022-08-10T17:54:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 --2- 172.21.15.150:0/2804463971 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d480 0x7f53e00c1f60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 -- 172.21.15.150:0/2804463971 >> 172.21.15.150:0/2804463971 conn(0x7f53e006b3b0 msgr2=0x7f53e006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 -- 172.21.15.150:0/2804463971 shutdown_connections 2022-08-10T17:54:03.586 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.567+0000 7f53e61a8700 1 -- 172.21.15.150:0/2804463971 wait complete. 2022-08-10T17:54:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.568+0000 7f53e61a8700 1 Processor -- start 2022-08-10T17:54:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.568+0000 7f53e61a8700 1 -- start start 2022-08-10T17:54:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e006d480 0x7f53e0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d850 0x7f53e01ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 0x7f53e0147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01ed9f0 con 0x7f53e00c4410 2022-08-10T17:54:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e014af70 con 0x7f53e006d480 2022-08-10T17:54:03.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53e61a8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e0154a80 con 0x7f53e006d850 2022-08-10T17:54:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 0x7f53e0147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 0x7f53e0147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44690/0 (socket says 172.21.15.150:44690) 2022-08-10T17:54:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 learned_addr learned my addr 172.21.15.150:0/172139671 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:03.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53df7fe700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e006d480 0x7f53e0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53deffd700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d850 0x7f53e01ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d850 msgr2=0x7f53e01ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f53e006d850 0x7f53e01ea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e006d480 msgr2=0x7f53e0157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e006d480 0x7f53e0157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.569+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0009310 con 0x7f53e00c4410 2022-08-10T17:54:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53dffff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 0x7f53e0147470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c760 tx=0x7f53d800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80070d0 con 0x7f53e00c4410 2022-08-10T17:54:03.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8007230 con 0x7f53e00c4410 2022-08-10T17:54:03.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e0157660 con 0x7f53e00c4410 2022-08-10T17:54:03.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80075e0 con 0x7f53e00c4410 2022-08-10T17:54:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.570+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e01eabb0 con 0x7f53e00c4410 2022-08-10T17:54:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53e61a8700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 0x7f53e01edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00673d0 con 0x7f53e01ed550 2022-08-10T17:54:03.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53df7fe700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 0x7f53e01edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53df7fe700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53e01ed1d0 con 0x7f53e01ed550 2022-08-10T17:54:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53df7fe700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 0x7f53e01edd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53d00096e0 tx=0x7f53d0004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0025670 con 0x7f53e01ed550 2022-08-10T17:54:03.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.571+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f53d8019030 con 0x7f53e00c4410 2022-08-10T17:54:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53c0065150 0x7f53c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f53d8081630 con 0x7f53e00c4410 2022-08-10T17:54:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53deffd700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53c0065150 0x7f53c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f53d0011440 con 0x7f53e01ed550 2022-08-10T17:54:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 msgr2=0x7f53e01edd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 0x7f53e01edd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53d00096e0 tx=0x7f53d0004640 comp rx=0 tx=0).stop 2022-08-10T17:54:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 msgr2=0x7f53e01edd10 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53c7fff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e01ed550 0x7f53e01edd10 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53d00096e0 tx=0x7f53d0004640 comp rx=0 tx=0).stop 2022-08-10T17:54:03.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.572+0000 7f53deffd700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53c0065150 0x7f53c0067600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53e01dfaf0 tx=0x7f53d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53e61a8700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 0x7f53e01ded70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01edb30 con 0x7f53e014aa10 2022-08-10T17:54:03.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53df7fe700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 0x7f53e01ded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53df7fe700 1 -- 172.21.15.150:0/172139671 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f53e0072890 con 0x7f53e014aa10 2022-08-10T17:54:03.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53df7fe700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 0x7f53e01ded70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009630 tx=0x7f53d00045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.579+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011bd0 con 0x7f53e014aa10 2022-08-10T17:54:03.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f53d0011d30 con 0x7f53e014aa10 2022-08-10T17:54:03.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 msgr2=0x7f53e01ded70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53c7fff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 0x7f53e01ded70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009630 tx=0x7f53d00045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53c7fff700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 msgr2=0x7f53e01ded70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53c7fff700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f53e014aa10 0x7f53e01ded70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.601 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:54:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:03.603 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:03.604 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:54:03.605 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:03.606 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.607 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.608 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.609 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.610 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:03.611 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.612 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.613 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.614 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:03.616 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.617 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:03.618 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.619 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.620 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.621 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:03.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:03.623 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.627 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.630 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:03.632 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.633 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.640 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.640 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.641 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.641 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.641 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.642 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:03.642 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:03.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.642 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.643 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.643 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:03.643 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.643 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.644 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:03.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.644 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.644 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.644 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:03.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.645 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.645 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:03.646 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53c0065150 msgr2=0x7f53c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f53c0065150 0x7f53c0067600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53e01dfaf0 tx=0x7f53d4009040 comp rx=0 tx=0).stop 2022-08-10T17:54:03.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 msgr2=0x7f53e0147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 --2- 172.21.15.150:0/172139671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e00c4410 0x7f53e0147470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c760 tx=0x7f53d800ca70 comp rx=0 tx=0).stop 2022-08-10T17:54:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 reap_dead start 2022-08-10T17:54:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53dffff700 1 -- 172.21.15.150:0/172139671 reap_dead start 2022-08-10T17:54:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 shutdown_connections 2022-08-10T17:54:03.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 >> 172.21.15.150:0/172139671 conn(0x7f53e006b3b0 msgr2=0x7f53e00c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 shutdown_connections 2022-08-10T17:54:03.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.580+0000 7f53e61a8700 1 -- 172.21.15.150:0/172139671 wait complete. 2022-08-10T17:54:03.651 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:54:03.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.771+0000 7fe375c2b700 1 Processor -- start 2022-08-10T17:54:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.771+0000 7fe375c2b700 1 -- start start 2022-08-10T17:54:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe375c2b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37006c860 0x7fe3700c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe375c2b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe37015a570 0x7fe3700c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe375c2b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3700c4dc0 con 0x7fe370150af0 2022-08-10T17:54:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe375c2b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3700c5940 con 0x7fe37015a570 2022-08-10T17:54:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe375c2b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700c9fc0 con 0x7fe37006c860 2022-08-10T17:54:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe36f7fe700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7fe370150af0 0x7fe370159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43732/0 (socket says 172.21.15.150:43732) 2022-08-10T17:54:03.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe36f7fe700 1 -- 172.21.15.150:0/3228566759 learned_addr learned my addr 172.21.15.150:0/3228566759 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe36ffff700 1 --2- 172.21.15.150:0/3228566759 >> v2:172.21.15.197:3300/0 conn(0x7fe37015a570 0x7fe3700c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.772+0000 7fe36effd700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37006c860 0x7fe3700c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36ffff700 1 -- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37006c860 msgr2=0x7fe3700c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:03.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36ffff700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37006c860 0x7fe3700c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36ffff700 1 -- 172.21.15.150:0/3228566759 >> v1:172.21.15.197:6789/0 conn(0x7fe370150af0 legacy=0x7fe370159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36ffff700 1 -- 172.21.15.150:0/3228566759 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37006f9a0 con 0x7fe37015a570 2022-08-10T17:54:03.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36e7fc700 1 -- 172.21.15.150:0/3228566759 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415988381 0 0) 0x7fe3700c4dc0 con 0x7fe370150af0 2022-08-10T17:54:03.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36ffff700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe37015a570 0x7fe3700c4400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe36800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4160ab55dd9f90df server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36e7fc700 1 -- 172.21.15.150:0/3228566759 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800e070 con 0x7fe37015a570 2022-08-10T17:54:03.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36e7fc700 1 -- 172.21.15.150:0/3228566759 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800bb20 con 0x7fe37015a570 2022-08-10T17:54:03.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe36e7fc700 1 -- 172.21.15.150:0/3228566759 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368012430 con 0x7fe37015a570 2022-08-10T17:54:03.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe375c2b700 1 -- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe37015a570 msgr2=0x7fe3700c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.773+0000 7fe375c2b700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe37015a570 0x7fe3700c4400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe36800b330 comp rx=0 tx=0).stop 2022-08-10T17:54:03.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 -- 172.21.15.150:0/3228566759 shutdown_connections 2022-08-10T17:54:03.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe37015a570 0x7fe3700c4400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 --2- 172.21.15.150:0/3228566759 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37006c860 0x7fe3700c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 -- 172.21.15.150:0/3228566759 >> 172.21.15.150:0/3228566759 conn(0x7fe3700c92f0 msgr2=0x7fe3700c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 -- 172.21.15.150:0/3228566759 shutdown_connections 2022-08-10T17:54:03.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.774+0000 7fe375c2b700 1 -- 172.21.15.150:0/3228566759 wait complete. 2022-08-10T17:54:03.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.775+0000 7fe375c2b700 1 Processor -- start 2022-08-10T17:54:03.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.775+0000 7fe375c2b700 1 -- start start 2022-08-10T17:54:03.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 0x7fe3700bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe370150af0 0x7fe370146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37015a570 0x7fe3701471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370152e50 con 0x7fe37006c860 2022-08-10T17:54:03.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700bedc0 con 0x7fe370150af0 2022-08-10T17:54:03.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370151550 con 0x7fe37015a570 2022-08-10T17:54:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 0x7fe3700bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 0x7fe3700bba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44706/0 (socket says 172.21.15.150:44706) 2022-08-10T17:54:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36f7fe700 1 -- 172.21.15.150:0/1350202997 learned_addr learned my addr 172.21.15.150:0/1350202997 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:03.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe370150af0 0x7fe370146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36ffff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37015a570 0x7fe3701471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37015a570 msgr2=0x7fe3701471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe37015a570 0x7fe3701471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 msgr2=0x7fe3700bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 0x7fe3700bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368009a70 con 0x7fe370150af0 2022-08-10T17:54:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36f7fe700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe37006c860 0x7fe3700bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:54:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe36effd700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe370150af0 0x7fe370146c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e870 tx=0x7fe36400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364013680 con 0x7fe370150af0 2022-08-10T17:54:03.798 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640137e0 con 0x7fe370150af0 2022-08-10T17:54:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370151810 con 0x7fe370150af0 2022-08-10T17:54:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364013b50 con 0x7fe370150af0 2022-08-10T17:54:03.799 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.776+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3700bf2f0 con 0x7fe370150af0 2022-08-10T17:54:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.777+0000 7fe375c2b700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 0x7fe370151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.777+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370071e00 con 0x7fe3701539c0 2022-08-10T17:54:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.777+0000 7fe36f7fe700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 0x7fe370151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe36f7fe700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe37006e290 con 0x7fe3701539c0 2022-08-10T17:54:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe36f7fe700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 0x7fe370151c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe360007fd0 tx=0x7fe360004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe364019030 con 0x7fe370150af0 2022-08-10T17:54:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe357fff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3500650b0 0x7fe350067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.801 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe364081f10 con 0x7fe370150af0 2022-08-10T17:54:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.778+0000 7fe36ffff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3500650b0 0x7fe350067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.802 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360007190 con 0x7fe3701539c0 2022-08-10T17:54:03.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fe36000f7c0 con 0x7fe3701539c0 2022-08-10T17:54:03.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 msgr2=0x7fe370151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 0x7fe370151c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe360007fd0 tx=0x7fe360004cb0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 msgr2=0x7fe370151c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe357fff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3701539c0 0x7fe370151c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.779+0000 7fe36ffff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3500650b0 0x7fe350067560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe368011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.785+0000 7fe375c2b700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 0x7fe370152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:03.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.785+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370072890 con 0x7fe3700bbfa0 2022-08-10T17:54:03.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe36f7fe700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 0x7fe370152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:03.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe36f7fe700 1 -- 172.21.15.150:0/1350202997 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe37006f3a0 con 0x7fe3700bbfa0 2022-08-10T17:54:03.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe36f7fe700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 0x7fe370152180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe360007fd0 tx=0x7fe360001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:03.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360023810 con 0x7fe3700bbfa0 2022-08-10T17:54:03.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4860 (secure 0 0 0) 0x7fe36001cd20 con 0x7fe3700bbfa0 2022-08-10T17:54:03.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 msgr2=0x7fe370152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 0x7fe370152180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe360007fd0 tx=0x7fe360001080 comp rx=0 tx=0).stop 2022-08-10T17:54:03.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 msgr2=0x7fe370152180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:03.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.786+0000 7fe357fff700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe3700bbfa0 0x7fe370152180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:03.818 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:03.818 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:03.818 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:03.819 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:54:03.819 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:03.819 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:03.820 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:03.820 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:03.820 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:03.820 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.821 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 0, 2022-08-10T17:54:03.821 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.821 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:03.822 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:03.822 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.822 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.822 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.823 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.823 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.823 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.824 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.824 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.824 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.824 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.825 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:03.825 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:03.825 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.825 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.826 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.826 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.826 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.826 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.827 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.827 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.827 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.827 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.828 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:03.828 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:03.828 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:03.829 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:03.829 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:03.829 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:03.829 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.830 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:03.830 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:03.830 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:03.830 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:03.831 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:03.831 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:03.831 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:03.831 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:03.832 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:03.832 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:03.832 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:03.832 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:03.833 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:03.833 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:03.834 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:03.834 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:03.834 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:03.835 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:03.835 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.835 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:03.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.836 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:03.836 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.837 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:03.837 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:03.837 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.837 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.838 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.838 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.838 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:03.838 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.839 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.839 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.839 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.839 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:03.840 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.840 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.840 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.841 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.841 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:03.841 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.841 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.842 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.842 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.843 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:03.843 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:03.843 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.843 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.844 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.844 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.844 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:03.845 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.845 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.845 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.846 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.846 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:03.847 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.848 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.848 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.849 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.849 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:03.850 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.850 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.851 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.852 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.852 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:03.853 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:03.853 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:03.854 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:03.854 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.855 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:03.855 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:03.856 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.856 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.856 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.857 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:03.857 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:03.858 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:03.858 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.859 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.860 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.860 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:03.860 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:03.861 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:03.861 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:03.861 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.862 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.862 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.863 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.864 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.865 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.866 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.867 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:03.868 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:54:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:03.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:03.870 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:03.871 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:03.872 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:03.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3500650b0 msgr2=0x7fe350067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe3500650b0 0x7fe350067560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe368011000 comp rx=0 tx=0).stop 2022-08-10T17:54:03.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe370150af0 msgr2=0x7fe370146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:03.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 --2- 172.21.15.150:0/1350202997 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe370150af0 0x7fe370146c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e870 tx=0x7fe36400eb80 comp rx=0 tx=0).stop 2022-08-10T17:54:03.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe36ffff700 1 -- 172.21.15.150:0/1350202997 reap_dead start 2022-08-10T17:54:03.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe36ffff700 1 -- 172.21.15.150:0/1350202997 reap_dead start 2022-08-10T17:54:03.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 shutdown_connections 2022-08-10T17:54:03.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 >> 172.21.15.150:0/1350202997 conn(0x7fe3700c92f0 msgr2=0x7fe37014e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:03.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 shutdown_connections 2022-08-10T17:54:03.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.787+0000 7fe375c2b700 1 -- 172.21.15.150:0/1350202997 wait complete. 2022-08-10T17:54:03.876 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:54:03.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:54:03.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.994+0000 7fdfe4671700 1 Processor -- start 2022-08-10T17:54:03.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.994+0000 7fdfe4671700 1 -- start start 2022-08-10T17:54:04.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe4671700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0c9a30 0x7fdfdc161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:04.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe4671700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc06ffd0 con 0x7fdfdc0c3380 2022-08-10T17:54:04.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe4671700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc1569e0 con 0x7fdfdc1509c0 2022-08-10T17:54:04.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe4671700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc068110 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe1c0c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdfdc0c3380 0x7fdfdc06bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57398/0 (socket says 172.21.15.150:57398) 2022-08-10T17:54:04.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe1c0c700 1 -- 172.21.15.150:0/652370788 learned_addr learned my addr 172.21.15.150:0/652370788 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:04.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe2c0e700 1 --2- 172.21.15.150:0/652370788 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0c9a30 0x7fdfdc161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:04.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/652370788 >> v1:172.21.15.197:6789/0 conn(0x7fdfdc1509c0 legacy=0x7fdfdc156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe140b700 1 -- 172.21.15.150:0/652370788 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232087925 0 0) 0x7fdfdc1569e0 con 0x7fdfdc1509c0 2022-08-10T17:54:04.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/652370788 >> v1:172.21.15.150:6789/0 conn(0x7fdfdc0c3380 legacy=0x7fdfdc06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/652370788 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0c9e90 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe2c0e700 1 --2- 172.21.15.150:0/652370788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc161ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009d90 tx=0x7fdfd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759387437ade64dc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:04.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.995+0000 7fdfe140b700 1 -- 172.21.15.150:0/652370788 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400e070 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe140b700 1 -- 172.21.15.150:0/652370788 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd400bbd0 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe140b700 1 -- 172.21.15.150:0/652370788 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4012430 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 -- 172.21.15.150:0/652370788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc0c9a30 msgr2=0x7fdfdc161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 --2- 172.21.15.150:0/652370788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc161ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009d90 tx=0x7fdfd400b330 comp rx=0 tx=0).stop 2022-08-10T17:54:04.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 -- 172.21.15.150:0/652370788 shutdown_connections 2022-08-10T17:54:04.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 --2- 172.21.15.150:0/652370788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc161ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 -- 172.21.15.150:0/652370788 >> 172.21.15.150:0/652370788 conn(0x7fdfdc06aac0 msgr2=0x7fdfdc0c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:04.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 -- 172.21.15.150:0/652370788 shutdown_connections 2022-08-10T17:54:04.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.996+0000 7fdfe4671700 1 -- 172.21.15.150:0/652370788 wait complete. 2022-08-10T17:54:04.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.997+0000 7fdfe4671700 1 Processor -- start 2022-08-10T17:54:04.007 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.997+0000 7fdfe4671700 1 -- start start 2022-08-10T17:54:04.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc1dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:04.010 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdfdc1509c0 0x7fdfdc1ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:04.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:04.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc153f60 con 0x7fdfdc1ef540 2022-08-10T17:54:04.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0c8630 con 0x7fdfdc0c9a30 2022-08-10T17:54:04.011 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe4671700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1e0470 con 0x7fdfdc1509c0 2022-08-10T17:54:04.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:04.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44728/0 (socket says 172.21.15.150:44728) 2022-08-10T17:54:04.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/4131191151 learned_addr learned my addr 172.21.15.150:0/4131191151 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:04.012 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe240d700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc1dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:04.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe1c0c700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdfdc1509c0 0x7fdfdc1ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:04.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdfdc1509c0 msgr2=0x7fdfdc1ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdfdc1509c0 0x7fdfdc1ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.013 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdfdc0c9a30 msgr2=0x7fdfdc1dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc1dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.998+0000 7fdfe2c0e700 1 -- 172.21.15.150:0/4131191151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009a70 con 0x7fdfdc1ef540 2022-08-10T17:54:04.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfe2c0e700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0698e0 tx=0x7fdfd4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:04.014 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd401b810 con 0x7fdfdc1ef540 2022-08-10T17:54:04.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4020070 con 0x7fdfdc1ef540 2022-08-10T17:54:04.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc1efd60 con 0x7fdfdc1ef540 2022-08-10T17:54:04.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd401bbd0 con 0x7fdfdc1ef540 2022-08-10T17:54:04.015 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:03.999+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc1efa80 con 0x7fdfdc1ef540 2022-08-10T17:54:04.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.000+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc072890 con 0x7fdfdc1ef540 2022-08-10T17:54:04.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.000+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdfd401bd30 con 0x7fdfdc1ef540 2022-08-10T17:54:04.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.001+0000 7fdfcaffd700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 0x7fdfbc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:04.016 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.001+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdfd4022070 con 0x7fdfdc1ef540 2022-08-10T17:54:04.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.001+0000 7fdfe240d700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 0x7fdfbc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:04.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.001+0000 7fdfe240d700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 0x7fdfbc067560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007fd0 tx=0x7fdfd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:04.017 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.005+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fdfd4052db0 con 0x7fdfdc1ef540 2022-08-10T17:54:04.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.260+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fdfdc156690 con 0x7fdfdc1ef540 2022-08-10T17:54:04.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.261+0000 7fdfcaffd700 1 -- 172.21.15.150:0/4131191151 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fdfd40563d0 con 0x7fdfdc1ef540 2022-08-10T17:54:04.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 msgr2=0x7fdfbc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 0x7fdfbc067560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007fd0 tx=0x7fdfd8009040 comp rx=0 tx=0).stop 2022-08-10T17:54:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 msgr2=0x7fdfdc158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0698e0 tx=0x7fdfd4004950 comp rx=0 tx=0).stop 2022-08-10T17:54:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 shutdown_connections 2022-08-10T17:54:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc1ef540 0x7fdfdc158420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdfdc0c9a30 0x7fdfdc1dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfbc0650b0 0x7fdfbc067560 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 --2- 172.21.15.150:0/4131191151 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdfdc1509c0 0x7fdfdc1ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 >> 172.21.15.150:0/4131191151 conn(0x7fdfdc0c3380 msgr2=0x7fdfdc0c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 shutdown_connections 2022-08-10T17:54:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:04.263+0000 7fdfe4671700 1 -- 172.21.15.150:0/4131191151 wait complete. 2022-08-10T17:54:04.279 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:54:14.280 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:54:14.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:14.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.401+0000 7f784b5ab700 1 Processor -- start 2022-08-10T17:54:14.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f784b5ab700 1 -- start start 2022-08-10T17:54:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f784b5ab700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 0x7f7844156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f784b5ab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78440c6220 con 0x7f78440c4700 2022-08-10T17:54:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f784b5ab700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78440c64e0 con 0x7f78440696c0 2022-08-10T17:54:14.411 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f784b5ab700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c5330 con 0x7f7844070330 2022-08-10T17:54:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f7848b46700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f78440c4700 0x7f784406cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57424/0 (socket says 172.21.15.150:57424) 2022-08-10T17:54:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f7848b46700 1 -- 172.21.15.150:0/1525780360 learned_addr learned my addr 172.21.15.150:0/1525780360 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.402+0000 7f7849347700 1 --2- 172.21.15.150:0/1525780360 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 0x7f7844156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.412 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186651424 0 0) 0x7f78440c6220 con 0x7f78440c4700 2022-08-10T17:54:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f782c003430 con 0x7f78440c4700 2022-08-10T17:54:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565667092 0 0) 0x7f78440c64e0 con 0x7f78440696c0 2022-08-10T17:54:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78440c6220 con 0x7f78440696c0 2022-08-10T17:54:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7849347700 1 -- 172.21.15.150:0/1525780360 >> v1:172.21.15.197:6789/0 conn(0x7f78440696c0 legacy=0x7f78441615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.413 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7849347700 1 -- 172.21.15.150:0/1525780360 >> v1:172.21.15.150:6789/0 conn(0x7f78440c4700 legacy=0x7f784406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7849347700 1 -- 172.21.15.150:0/1525780360 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784415a5a0 con 0x7f7844070330 2022-08-10T17:54:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7849347700 1 --2- 172.21.15.150:0/1525780360 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 0x7f7844156d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78340096e0 tx=0x7f78340099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61794816bcf4063b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78340107b0 con 0x7f7844070330 2022-08-10T17:54:14.414 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7834010910 con 0x7f7844070330 2022-08-10T17:54:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.403+0000 7f7833fff700 1 -- 172.21.15.150:0/1525780360 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834010cc0 con 0x7f7844070330 2022-08-10T17:54:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 -- 172.21.15.150:0/1525780360 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 msgr2=0x7f7844156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 --2- 172.21.15.150:0/1525780360 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 0x7f7844156d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78340096e0 tx=0x7f78340099f0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.415 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 -- 172.21.15.150:0/1525780360 shutdown_connections 2022-08-10T17:54:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 --2- 172.21.15.150:0/1525780360 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7844070330 0x7f7844156d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 -- 172.21.15.150:0/1525780360 >> 172.21.15.150:0/1525780360 conn(0x7f78440c7330 msgr2=0x7f784406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 -- 172.21.15.150:0/1525780360 shutdown_connections 2022-08-10T17:54:14.416 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.404+0000 7f784b5ab700 1 -- 172.21.15.150:0/1525780360 wait complete. 2022-08-10T17:54:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.405+0000 7f784b5ab700 1 Processor -- start 2022-08-10T17:54:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.405+0000 7f784b5ab700 1 -- start start 2022-08-10T17:54:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 0x7f784414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.417 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f784414af20 0x7f784414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784406d650 con 0x7f78440c4700 2022-08-10T17:54:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c32c0 con 0x7f78440696c0 2022-08-10T17:54:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784414b3e0 con 0x7f784414af20 2022-08-10T17:54:14.418 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7849347700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 0x7f784414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44752/0 (socket says 172.21.15.150:44752) 2022-08-10T17:54:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7849b48700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f784414af20 0x7f784414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7849347700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 0x7f784414bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:55342/0 (socket says 172.21.15.150:55342) 2022-08-10T17:54:14.419 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 -- 172.21.15.150:0/2587707587 learned_addr learned my addr 172.21.15.150:0/2587707587 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 -- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f784414af20 msgr2=0x7f784414a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f784414af20 0x7f784414a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 -- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 msgr2=0x7f784414bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.420 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 0x7f784414bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 -- 172.21.15.150:0/2587707587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009310 con 0x7f78440c4700 2022-08-10T17:54:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7848b46700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f784000c390 tx=0x7f7840001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400072d0 con 0x7f78440c4700 2022-08-10T17:54:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840007430 con 0x7f78440c4700 2022-08-10T17:54:14.421 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78440c3020 con 0x7f78440c4700 2022-08-10T17:54:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.406+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400057c0 con 0x7f78440c4700 2022-08-10T17:54:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.407+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78441ecff0 con 0x7f78440c4700 2022-08-10T17:54:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.407+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784415a880 con 0x7f78440c4700 2022-08-10T17:54:14.422 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.408+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7840019030 con 0x7f78440c4700 2022-08-10T17:54:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.408+0000 7f7831ffb700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 0x7f7824067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.408+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7840081340 con 0x7f78440c4700 2022-08-10T17:54:14.423 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.408+0000 7f7849347700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 0x7f7824067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.409+0000 7f7849347700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 0x7f7824067560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78440670c0 tx=0x7f7834008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.424 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.412+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f784004f320 con 0x7f78440c4700 2022-08-10T17:54:14.670 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.667+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7844065b90 con 0x7f78440c4700 2022-08-10T17:54:14.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.668+0000 7f7831ffb700 1 -- 172.21.15.150:0/2587707587 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f7840052940 con 0x7f78440c4700 2022-08-10T17:54:14.671 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:14.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 msgr2=0x7f7824067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 0x7f7824067560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78440670c0 tx=0x7f7834008030 comp rx=0 tx=0).stop 2022-08-10T17:54:14.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 msgr2=0x7f784414a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f784000c390 tx=0x7f7840001e70 comp rx=0 tx=0).stop 2022-08-10T17:54:14.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 shutdown_connections 2022-08-10T17:54:14.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f78240650b0 0x7f7824067560 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f784414af20 0x7f784414a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f78440696c0 0x7f784414bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 --2- 172.21.15.150:0/2587707587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78440c4700 0x7f784414a270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 >> 172.21.15.150:0/2587707587 conn(0x7f78440c7330 msgr2=0x7f784406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:14.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 shutdown_connections 2022-08-10T17:54:14.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.670+0000 7f784b5ab700 1 -- 172.21.15.150:0/2587707587 wait complete. 2022-08-10T17:54:14.685 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:54:14.685 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2022-08-10T17:54:14.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:54:14.808 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.805+0000 7fe0009ac700 1 Processor -- start 2022-08-10T17:54:14.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.805+0000 7fe0009ac700 1 -- start start 2022-08-10T17:54:14.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.806+0000 7fe0009ac700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 0x7fdffc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.806+0000 7fe0009ac700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 0x7fdffc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.806+0000 7fe0009ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0c1f40 con 0x7fdffc157780 2022-08-10T17:54:14.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.806+0000 7fe0009ac700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0c7d90 con 0x7fdffc158170 2022-08-10T17:54:14.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.806+0000 7fe0009ac700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc069130 con 0x7fdffc151290 2022-08-10T17:54:14.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdffc157780 0x7fdffc0c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57442/0 (socket says 172.21.15.150:57442) 2022-08-10T17:54:14.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffad9d700 1 -- 172.21.15.150:0/3567309350 learned_addr learned my addr 172.21.15.150:0/3567309350 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:14.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 --2- 172.21.15.150:0/3567309350 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 0x7fdffc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/3567309350 >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 0x7fdffc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff959a700 1 -- 172.21.15.150:0/3567309350 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059315913 0 0) 0x7fdffc0c1f40 con 0x7fdffc157780 2022-08-10T17:54:14.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff959a700 1 -- 172.21.15.150:0/3567309350 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe0003430 con 0x7fdffc157780 2022-08-10T17:54:14.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 -- 172.21.15.150:0/3567309350 >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 msgr2=0x7fdffc068bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:14.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 --2- 172.21.15.150:0/3567309350 >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 0x7fdffc068bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 -- 172.21.15.150:0/3567309350 >> v1:172.21.15.150:6789/0 conn(0x7fdffc157780 legacy=0x7fdffc0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 -- 172.21.15.150:0/3567309350 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0c2220 con 0x7fdffc151290 2022-08-10T17:54:14.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/3567309350 >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 0x7fdffc068bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:54:14.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdffa59c700 1 --2- 172.21.15.150:0/3567309350 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 0x7fdffc0c7850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0096a0 tx=0x7fdfec0099b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42c1077e92a33123 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff959a700 1 -- 172.21.15.150:0/3567309350 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec005cb0 con 0x7fdffc151290 2022-08-10T17:54:14.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff959a700 1 -- 172.21.15.150:0/3567309350 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec005e10 con 0x7fdffc151290 2022-08-10T17:54:14.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.807+0000 7fdff959a700 1 -- 172.21.15.150:0/3567309350 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec006250 con 0x7fdffc151290 2022-08-10T17:54:14.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 -- 172.21.15.150:0/3567309350 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 msgr2=0x7fdffc0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 --2- 172.21.15.150:0/3567309350 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 0x7fdffc0c7850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0096a0 tx=0x7fdfec0099b0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 -- 172.21.15.150:0/3567309350 shutdown_connections 2022-08-10T17:54:14.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 --2- 172.21.15.150:0/3567309350 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc151290 0x7fdffc0c7850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 --2- 172.21.15.150:0/3567309350 >> v2:172.21.15.197:3300/0 conn(0x7fdffc158170 0x7fdffc068bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 -- 172.21.15.150:0/3567309350 >> 172.21.15.150:0/3567309350 conn(0x7fdffc06f880 msgr2=0x7fdffc06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:14.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 -- 172.21.15.150:0/3567309350 shutdown_connections 2022-08-10T17:54:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.808+0000 7fe0009ac700 1 -- 172.21.15.150:0/3567309350 wait complete. 2022-08-10T17:54:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.809+0000 7fe0009ac700 1 Processor -- start 2022-08-10T17:54:14.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.809+0000 7fe0009ac700 1 -- start start 2022-08-10T17:54:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc157780 0x7fdffc144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdffc158170 0x7fdffc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c6160 con 0x7fdffc151290 2022-08-10T17:54:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc154f00 con 0x7fdffc158170 2022-08-10T17:54:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fe0009ac700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c8520 con 0x7fdffc157780 2022-08-10T17:54:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44764/0 (socket says 172.21.15.150:44764) 2022-08-10T17:54:14.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 -- 172.21.15.150:0/949240877 learned_addr learned my addr 172.21.15.150:0/949240877 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:14.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc157780 0x7fdffc144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffad9d700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdffc158170 0x7fdffc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc157780 msgr2=0x7fdffc144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fdffc157780 0x7fdffc144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdffc158170 msgr2=0x7fdffc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fdffc158170 0x7fdffc1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.810+0000 7fdffa59c700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009310 con 0x7fdffc151290 2022-08-10T17:54:14.826 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fdffa59c700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009d00 tx=0x7fdfec0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec004430 con 0x7fdffc151290 2022-08-10T17:54:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec003520 con 0x7fdffc151290 2022-08-10T17:54:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec0092b0 con 0x7fdffc151290 2022-08-10T17:54:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0038b0 con 0x7fdffc151290 2022-08-10T17:54:14.827 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.811+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc155430 con 0x7fdffc151290 2022-08-10T17:54:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fe0009ac700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 0x7fdffc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0644b0 con 0x7fdffc0c6cd0 2022-08-10T17:54:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 0x7fdffc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.828 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fdff9d9b700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdffc0c86f0 con 0x7fdffc0c6cd0 2022-08-10T17:54:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 0x7fdffc0c7fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdffc159bb0 tx=0x7fdff0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff000f890 con 0x7fdffc0c6cd0 2022-08-10T17:54:14.829 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.812+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fdfec02c070 con 0x7fdffc151290 2022-08-10T17:54:14.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfd8065150 0x7fdfd8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fdfec083560 con 0x7fdffc151290 2022-08-10T17:54:14.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdffad9d700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfd8065150 0x7fdfd8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fdff000f9f0 con 0x7fdffc0c6cd0 2022-08-10T17:54:14.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 msgr2=0x7fdffc0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 0x7fdffc0c7fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdffc159bb0 tx=0x7fdff0011c40 comp rx=0 tx=0).stop 2022-08-10T17:54:14.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 msgr2=0x7fdffc0c7fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:14.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdfeaffd700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c6cd0 0x7fdffc0c7fc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.813+0000 7fdffad9d700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfd8065150 0x7fdfd8067600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdff4001560 tx=0x7fdff4007f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.820+0000 7fe0009ac700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 0x7fdffc0c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:14.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.820+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc071e10 con 0x7fdffc0c5650 2022-08-10T17:54:14.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.820+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 0x7fdffc0c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:14.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.820+0000 7fdff9d9b700 1 -- 172.21.15.150:0/949240877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdffc072890 con 0x7fdffc0c5650 2022-08-10T17:54:14.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdff9d9b700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 0x7fdffc0c89d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdffc159bb0 tx=0x7fdff00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:14.835 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0021040 con 0x7fdffc0c5650 2022-08-10T17:54:14.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4890 (secure 0 0 0) 0x7fdff001d810 con 0x7fdffc0c5650 2022-08-10T17:54:14.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 msgr2=0x7fdffc0c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 0x7fdffc0c89d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdffc159bb0 tx=0x7fdff00045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.836 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 msgr2=0x7fdffc0c89d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:14.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdfeaffd700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc0c5650 0x7fdffc0c89d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.837 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:54:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 11, 2022-08-10T17:54:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:14.856 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.857 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.857 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.857 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:14.858 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:14.858 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:14.858 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:14.858 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:14.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.859 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.859 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:14.859 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:14.860 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:14.860 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:14.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:14.860 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:14.861 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.861 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.861 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:14.862 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:14.862 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.862 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.862 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.863 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.863 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:14.863 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:14.863 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:14.864 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:14.864 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:14.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.865 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:14.865 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:14.865 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:14.865 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:14.866 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.866 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:14.866 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:14.866 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.867 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.867 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.867 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:14.867 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:14.868 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:14.868 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.868 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.868 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.869 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:14.869 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:14.869 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:14.869 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:14.869 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:14.870 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.870 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.870 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.870 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:14.871 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:14.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.871 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:14.871 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:14.872 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:14.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.872 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.872 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:14.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.873 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:14.873 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:14.873 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:14.873 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.874 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.874 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:14.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.874 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:14.875 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:14.875 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:14.875 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.875 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.876 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:14.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.876 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:14.876 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:14.876 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:54:14.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.877 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:14.877 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:54:14.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:14.878 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:14.878 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:14.878 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:14.878 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:14.879 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:14.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:14.879 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:14.879 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:14.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfd8065150 msgr2=0x7fdfd8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fdfd8065150 0x7fdfd8067600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdff4001560 tx=0x7fdff4007f40 comp rx=0 tx=0).stop 2022-08-10T17:54:14.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 msgr2=0x7fdffc1549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:14.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009d00 tx=0x7fdfec0045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fdffad9d700 1 -- 172.21.15.150:0/949240877 reap_dead start 2022-08-10T17:54:14.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 shutdown_connections 2022-08-10T17:54:14.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 --2- 172.21.15.150:0/949240877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdffc151290 0x7fdffc1549c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:14.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 >> 172.21.15.150:0/949240877 conn(0x7fdffc06f880 msgr2=0x7fdffc14ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:14.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 shutdown_connections 2022-08-10T17:54:14.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:14.821+0000 7fe0009ac700 1 -- 172.21.15.150:0/949240877 wait complete. 2022-08-10T17:54:14.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:54:15.005 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.002+0000 7fc1ab530700 1 Processor -- start 2022-08-10T17:54:15.006 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.003+0000 7fc1ab530700 1 -- start start 2022-08-10T17:54:15.020 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.003+0000 7fc1ab530700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1a40c4d90 0x7fc1a40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.003+0000 7fc1ab530700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40699c0 con 0x7fc1a40c2790 2022-08-10T17:54:15.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.003+0000 7fc1ab530700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a4068e40 con 0x7fc1a40c7220 2022-08-10T17:54:15.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.003+0000 7fc1ab530700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40c5e10 con 0x7fc1a40c4d90 2022-08-10T17:54:15.021 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1a40c4d90 0x7fc1a40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1a40c4d90 0x7fc1a40c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44776/0 (socket says 172.21.15.150:44776) 2022-08-10T17:54:15.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 -- 172.21.15.150:0/614528146 learned_addr learned my addr 172.21.15.150:0/614528146 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:15.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a8acb700 1 --1- 172.21.15.150:0/614528146 >> v1:172.21.15.197:6789/0 conn(0x7fc1a40c7220 0x7fc1a40c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:43808/0 (socket says 172.21.15.150:43808) 2022-08-10T17:54:15.022 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a9acd700 1 --1- 172.21.15.150:0/614528146 >> v1:172.21.15.150:6789/0 conn(0x7fc1a40c2790 0x7fc1a406fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57456/0 (socket says 172.21.15.150:57456) 2022-08-10T17:54:15.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc193fff700 1 -- 172.21.15.150:0/614528146 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21260174 0 0) 0x7fc1a4068e40 con 0x7fc1a40c7220 2022-08-10T17:54:15.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 -- 172.21.15.150:0/614528146 >> v1:172.21.15.197:6789/0 conn(0x7fc1a40c7220 legacy=0x7fc1a40c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 -- 172.21.15.150:0/614528146 >> v1:172.21.15.150:6789/0 conn(0x7fc1a40c2790 legacy=0x7fc1a406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.023 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 -- 172.21.15.150:0/614528146 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4069120 con 0x7fc1a40c4d90 2022-08-10T17:54:15.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc1a92cc700 1 --2- 172.21.15.150:0/614528146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c4d90 0x7fc1a40c5160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc19400bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea4581874997572 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc193fff700 1 -- 172.21.15.150:0/614528146 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194004230 con 0x7fc1a40c4d90 2022-08-10T17:54:15.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc193fff700 1 -- 172.21.15.150:0/614528146 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194004390 con 0x7fc1a40c4d90 2022-08-10T17:54:15.024 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.004+0000 7fc193fff700 1 -- 172.21.15.150:0/614528146 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19400dc90 con 0x7fc1a40c4d90 2022-08-10T17:54:15.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 -- 172.21.15.150:0/614528146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c4d90 msgr2=0x7fc1a40c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 --2- 172.21.15.150:0/614528146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c4d90 0x7fc1a40c5160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc19400bd00 comp rx=0 tx=0).stop 2022-08-10T17:54:15.025 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 -- 172.21.15.150:0/614528146 shutdown_connections 2022-08-10T17:54:15.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 --2- 172.21.15.150:0/614528146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c4d90 0x7fc1a40c5160 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 -- 172.21.15.150:0/614528146 >> 172.21.15.150:0/614528146 conn(0x7fc1a406d0d0 msgr2=0x7fc1a40c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.026 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 -- 172.21.15.150:0/614528146 shutdown_connections 2022-08-10T17:54:15.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.005+0000 7fc1ab530700 1 -- 172.21.15.150:0/614528146 wait complete. 2022-08-10T17:54:15.027 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.006+0000 7fc1ab530700 1 Processor -- start 2022-08-10T17:54:15.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.006+0000 7fc1ab530700 1 -- start start 2022-08-10T17:54:15.028 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc1a40c2790 0x7fc1a41490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a40c4d90 0x7fc1a4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 0x7fc1a4155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.029 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4153c40 con 0x7fc1a40c7220 2022-08-10T17:54:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a414ded0 con 0x7fc1a40c4d90 2022-08-10T17:54:15.030 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1ab530700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4153060 con 0x7fc1a40c2790 2022-08-10T17:54:15.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 0x7fc1a4155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.031 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a8acb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a40c4d90 0x7fc1a4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.032 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 0x7fc1a4155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44786/0 (socket says 172.21.15.150:44786) 2022-08-10T17:54:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a92cc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc1a40c2790 0x7fc1a41490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.033 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a8acb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a40c4d90 0x7fc1a4149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:55376/0 (socket says 172.21.15.150:55376) 2022-08-10T17:54:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 learned_addr learned my addr 172.21.15.150:0/2577395271 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:15.034 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc1a40c2790 msgr2=0x7fc1a41490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc1a40c2790 0x7fc1a41490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.035 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a40c4d90 msgr2=0x7fc1a4149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a40c4d90 0x7fc1a4149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19400b680 con 0x7fc1a40c7220 2022-08-10T17:54:15.036 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.007+0000 7fc1a9acd700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 0x7fc1a4155a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c700 tx=0x7fc19c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.008+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0070d0 con 0x7fc1a40c7220 2022-08-10T17:54:15.037 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.008+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c007230 con 0x7fc1a40c7220 2022-08-10T17:54:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.008+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0075a0 con 0x7fc1a40c7220 2022-08-10T17:54:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.008+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a414e170 con 0x7fc1a40c7220 2022-08-10T17:54:15.038 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.008+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a41535f0 con 0x7fc1a40c7220 2022-08-10T17:54:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc1ab530700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 0x7fc1a41ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.039 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40672f0 con 0x7fc1a4155fc0 2022-08-10T17:54:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc1a92cc700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 0x7fc1a41ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc1a92cc700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1a4153fd0 con 0x7fc1a4155fc0 2022-08-10T17:54:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc19c019030 con 0x7fc1a40c7220 2022-08-10T17:54:15.040 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.009+0000 7fc1a92cc700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 0x7fc1a41ef3e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc194004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc1840650b0 0x7fc184067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc19c081580 con 0x7fc1a40c7220 2022-08-10T17:54:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc1a8acb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc1840650b0 0x7fc184067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194027070 con 0x7fc1a4155fc0 2022-08-10T17:54:15.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7fc19401f040 con 0x7fc1a4155fc0 2022-08-10T17:54:15.042 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 msgr2=0x7fc1a41ef3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 0x7fc1a41ef3e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc194004640 comp rx=0 tx=0).stop 2022-08-10T17:54:15.043 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 msgr2=0x7fc1a41ef3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:15.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc191ffb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a4155fc0 0x7fc1a41ef3e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.044 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.010+0000 7fc1a8acb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc1840650b0 0x7fc184067560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0007ae0 tx=0x7fc1a0007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc1ab530700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 0x7fc1a414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.045 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4072890 con 0x7fc1a41ef920 2022-08-10T17:54:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc1a92cc700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 0x7fc1a414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc1a92cc700 1 -- 172.21.15.150:0/2577395271 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc1a4070140 con 0x7fc1a41ef920 2022-08-10T17:54:15.046 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc1a92cc700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 0x7fc1a414bf60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1940045a0 tx=0x7fc1940045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.017+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19401e050 con 0x7fc1a41ef920 2022-08-10T17:54:15.047 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4378 (secure 0 0 0) 0x7fc19400dc80 con 0x7fc1a41ef920 2022-08-10T17:54:15.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 msgr2=0x7fc1a414bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.048 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc191ffb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 0x7fc1a414bf60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1940045a0 tx=0x7fc1940045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc191ffb700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 msgr2=0x7fc1a414bf60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:15.049 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc191ffb700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc1a41ef920 0x7fc1a414bf60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.050 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:15.051 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:15.051 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:15.052 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:54:15.052 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:15.053 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:15.053 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:15.053 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:15.054 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:15.054 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.055 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:54:15.055 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:15.055 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:15.055 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:15.056 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.056 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.056 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.056 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.057 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.057 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.057 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.058 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.058 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.058 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.059 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:15.059 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:15.059 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.059 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.059 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.060 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.060 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.060 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.061 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.061 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.061 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.062 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.062 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:15.063 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:15.063 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:15.063 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:15.063 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:15.064 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:15.064 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:15.064 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:15.064 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:15.065 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:15.065 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:15.065 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:15.066 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:15.066 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:15.066 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:15.066 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:15.067 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.067 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.067 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.067 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.068 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.068 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.068 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.068 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.069 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.069 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.070 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:15.071 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.071 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:15.071 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.072 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:15.072 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:15.073 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.073 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.074 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.075 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:15.075 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.076 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.076 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.076 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.077 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:15.077 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.078 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.078 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.079 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:15.079 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:15.080 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.080 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.081 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.082 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:15.082 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:15.082 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.083 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.083 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.083 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:15.083 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.084 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.084 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.084 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:15.085 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.085 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.085 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.086 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.086 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:15.086 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:15.086 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.087 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.087 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.087 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:15.088 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:15.088 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.088 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.088 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.089 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.089 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:15.089 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.089 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.090 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.090 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.090 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:15.090 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.091 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.091 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.091 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.091 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:15.092 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:15.092 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.092 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.092 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.093 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.093 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.093 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:15.094 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:15.094 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.094 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.095 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.095 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:15.095 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.095 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.096 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:15.096 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.096 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.096 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.096 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:15.097 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.097 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.097 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:15.098 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:15.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc1840650b0 msgr2=0x7fc184067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc1840650b0 0x7fc184067560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0007ae0 tx=0x7fc1a0007a30 comp rx=0 tx=0).stop 2022-08-10T17:54:15.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 msgr2=0x7fc1a4155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 --2- 172.21.15.150:0/2577395271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1a40c7220 0x7fc1a4155a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c700 tx=0x7fc19c00ca10 comp rx=0 tx=0).stop 2022-08-10T17:54:15.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 reap_dead start 2022-08-10T17:54:15.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1a9acd700 1 -- 172.21.15.150:0/2577395271 reap_dead start 2022-08-10T17:54:15.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 shutdown_connections 2022-08-10T17:54:15.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 >> 172.21.15.150:0/2577395271 conn(0x7fc1a406d0d0 msgr2=0x7fc1a40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 shutdown_connections 2022-08-10T17:54:15.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.018+0000 7fc1ab530700 1 -- 172.21.15.150:0/2577395271 wait complete. 2022-08-10T17:54:15.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:54:15.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.223+0000 7f4afc7c9700 1 Processor -- start 2022-08-10T17:54:15.226 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.223+0000 7f4afc7c9700 1 -- start start 2022-08-10T17:54:15.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afc7c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4af4158170 0x7f4af40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.229 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afc7c9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4068bf0 0x7f4af40c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afc7c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40c1f40 con 0x7f4af4151290 2022-08-10T17:54:15.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afc7c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40c7d90 con 0x7f4af4158170 2022-08-10T17:54:15.230 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afc7c9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c2220 con 0x7f4af4068bf0 2022-08-10T17:54:15.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4af9d64700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4af4158170 0x7f4af40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4af9d64700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4af4158170 0x7f4af40c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44796/0 (socket says 172.21.15.150:44796) 2022-08-10T17:54:15.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4af9d64700 1 -- 172.21.15.150:0/914847305 learned_addr learned my addr 172.21.15.150:0/914847305 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:15.231 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.224+0000 7f4afad66700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4068bf0 0x7f4af40c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9d64700 1 -- 172.21.15.150:0/914847305 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4068bf0 msgr2=0x7f4af40c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:15.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9d64700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4068bf0 0x7f4af40c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9d64700 1 -- 172.21.15.150:0/914847305 >> v1:172.21.15.150:6789/0 conn(0x7f4af4151290 legacy=0x7f4af4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9d64700 1 -- 172.21.15.150:0/914847305 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40c2500 con 0x7f4af4158170 2022-08-10T17:54:15.232 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9d64700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af40c7850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4006fd0 tx=0x7f4ae4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0bb2d6abe92b67 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9563700 1 -- 172.21.15.150:0/914847305 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004230 con 0x7f4af4158170 2022-08-10T17:54:15.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9563700 1 -- 172.21.15.150:0/914847305 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4004390 con 0x7f4af4158170 2022-08-10T17:54:15.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4af9563700 1 -- 172.21.15.150:0/914847305 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4011830 con 0x7f4af4158170 2022-08-10T17:54:15.233 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4afc7c9700 1 -- 172.21.15.150:0/914847305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 msgr2=0x7f4af40c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.225+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af40c7850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4006fd0 tx=0x7f4ae4009a60 comp rx=0 tx=0).stop 2022-08-10T17:54:15.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 -- 172.21.15.150:0/914847305 shutdown_connections 2022-08-10T17:54:15.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4068bf0 0x7f4af40c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.234 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/914847305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af40c7850 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 -- 172.21.15.150:0/914847305 >> 172.21.15.150:0/914847305 conn(0x7f4af406f880 msgr2=0x7f4af406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 -- 172.21.15.150:0/914847305 shutdown_connections 2022-08-10T17:54:15.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.226+0000 7f4afc7c9700 1 -- 172.21.15.150:0/914847305 wait complete. 2022-08-10T17:54:15.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 Processor -- start 2022-08-10T17:54:15.235 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 -- start start 2022-08-10T17:54:15.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4af4068bf0 0x7f4af413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4151290 0x7f4af413a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af41e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af413f010 con 0x7f4af4158170 2022-08-10T17:54:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af413ed30 con 0x7f4af4068bf0 2022-08-10T17:54:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.227+0000 7f4afc7c9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41488e0 con 0x7f4af4151290 2022-08-10T17:54:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af41e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af41e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44804/0 (socket says 172.21.15.150:44804) 2022-08-10T17:54:15.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 learned_addr learned my addr 172.21.15.150:0/3931857125 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:15.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4af9d64700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4151290 0x7f4af413a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afa565700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4af4068bf0 0x7f4af413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4151290 msgr2=0x7f4af413a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af4151290 0x7f4af413a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4af4068bf0 msgr2=0x7f4af413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4af4068bf0 0x7f4af413e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40093e0 con 0x7f4af4158170 2022-08-10T17:54:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afad66700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af41e3a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d30 tx=0x7f4aec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00cc90 con 0x7f4af4158170 2022-08-10T17:54:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec00f040 con 0x7f4af4158170 2022-08-10T17:54:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af41effe0 con 0x7f4af4158170 2022-08-10T17:54:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec009e80 con 0x7f4af4158170 2022-08-10T17:54:15.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.228+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af41f05a0 con 0x7f4af4158170 2022-08-10T17:54:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.229+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 0x7f4af41e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.229+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40644b0 con 0x7f4af41f0790 2022-08-10T17:54:15.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.229+0000 7f4afa565700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 0x7f4af41e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.229+0000 7f4afa565700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4af413ee70 con 0x7f4af41f0790 2022-08-10T17:54:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4afa565700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 0x7f4af41e3f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4af000f400 tx=0x7f4af000f7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000fe70 con 0x7f4af41f0790 2022-08-10T17:54:15.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4aec014480 con 0x7f4af4158170 2022-08-10T17:54:15.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4ad4065120 0x7f4ad40675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4aec082e20 con 0x7f4af4158170 2022-08-10T17:54:15.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f4af00052e0 con 0x7f4af41f0790 2022-08-10T17:54:15.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4af9d64700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4ad4065120 0x7f4ad40675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 msgr2=0x7f4af41e3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 0x7f4af41e3f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4af000f400 tx=0x7f4af000f7c0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 msgr2=0x7f4af41e3f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.230+0000 7f4ae2ffd700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41f0790 0x7f4af41e3f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.231+0000 7f4af9d64700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4ad4065120 0x7f4ad40675d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009aa0 tx=0x7f4ae4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.237+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 0x7f4af4140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.237+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af413f1c0 con 0x7f4af41efaa0 2022-08-10T17:54:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.237+0000 7f4afa565700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 0x7f4af4140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4afa565700 1 -- 172.21.15.150:0/3931857125 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4af4071e10 con 0x7f4af41efaa0 2022-08-10T17:54:15.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4afa565700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 0x7f4af4140250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4af0017000 tx=0x7f4af00010f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001cc30 con 0x7f4af41efaa0 2022-08-10T17:54:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4861 (secure 0 0 0) 0x7f4af001cd90 con 0x7f4af41efaa0 2022-08-10T17:54:15.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 msgr2=0x7f4af4140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 0x7f4af4140250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4af0017000 tx=0x7f4af00010f0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 msgr2=0x7f4af4140250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:15.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.238+0000 7f4ae2ffd700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4af41efaa0 0x7f4af4140250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.256 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:15.256 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:15.257 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:15.257 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:54:15.257 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 140, 2022-08-10T17:54:15.258 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:15.258 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:15.258 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:54:15.258 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:54:15.259 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.259 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 12, 2022-08-10T17:54:15.259 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:15.260 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:15.260 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:15.260 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.260 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.260 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.261 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.261 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.261 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.262 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.262 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.262 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.262 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.263 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:15.263 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:15.263 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.264 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.264 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.264 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.264 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.265 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.265 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.265 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.266 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.266 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.267 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:15.267 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:15.267 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:15.268 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:15.268 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:15.268 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:15.269 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:15.269 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:15.269 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:15.269 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:15.270 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:15.270 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:15.270 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:15.271 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:15.271 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:15.271 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:15.271 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:15.272 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:15.272 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:15.272 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:15.273 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:15.273 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:15.273 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:15.273 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:15.274 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:15.274 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.275 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:15.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.275 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:15.275 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.275 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:15.276 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:15.276 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.276 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.277 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.277 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:15.277 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.278 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.279 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:15.279 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.279 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.279 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.280 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.280 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:15.280 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:15.280 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.281 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.281 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.282 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:15.282 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:15.282 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.283 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.283 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.283 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:15.284 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.285 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.285 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:15.285 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.285 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.286 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.286 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:15.287 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:15.287 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.287 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.287 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.288 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:15.288 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:15.289 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:15.289 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:15.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.290 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:15.290 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:15.290 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.291 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:15.291 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:15.291 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:15.292 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.292 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.292 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:15.293 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:15.293 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:15.293 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:15.293 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:15.294 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.294 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.295 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:15.295 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:15.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.296 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.296 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.296 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:15.296 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.297 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.297 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:15.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.297 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.298 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.298 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:15.298 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.298 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.298 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:15.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.299 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.299 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.300 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:15.300 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.300 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:15.300 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:15.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.301 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:54:15.301 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.302 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:15.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:15.302 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:15.303 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:15.303 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:15.303 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:15.304 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:15.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:15.304 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:15.304 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4ad4065120 msgr2=0x7f4ad40675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4ad4065120 0x7f4ad40675d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009aa0 tx=0x7f4ae4008030 comp rx=0 tx=0).stop 2022-08-10T17:54:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 msgr2=0x7f4af41e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 --2- 172.21.15.150:0/3931857125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4158170 0x7f4af41e3a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d30 tx=0x7f4aec00c3a0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 reap_dead start 2022-08-10T17:54:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afad66700 1 -- 172.21.15.150:0/3931857125 reap_dead start 2022-08-10T17:54:15.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 shutdown_connections 2022-08-10T17:54:15.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 >> 172.21.15.150:0/3931857125 conn(0x7f4af406f880 msgr2=0x7f4af414e940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 shutdown_connections 2022-08-10T17:54:15.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.239+0000 7f4afc7c9700 1 -- 172.21.15.150:0/3931857125 wait complete. 2022-08-10T17:54:15.310 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2022-08-10T17:54:15.310 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2022-08-10T17:54:15.311 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2022-08-10T17:54:15.311 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:54:15.311 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:54:15.312 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:54:15.324 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:54:15.324 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2022-08-10T17:54:15.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:15.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.453+0000 7fe0accf8700 1 Processor -- start 2022-08-10T17:54:15.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.453+0000 7fe0accf8700 1 -- start start 2022-08-10T17:54:15.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0accf8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 0x7fe0a806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0accf8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0a80705d0 0x7fe0a80c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.468 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0accf8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80bf640 con 0x7fe0a806c0e0 2022-08-10T17:54:15.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0accf8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8156400 con 0x7fe0a80705d0 2022-08-10T17:54:15.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0accf8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81566e0 con 0x7fe0a814d080 2022-08-10T17:54:15.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0a659c700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 msgr2=0x7fe0a806bba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:15.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0a659c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 0x7fe0a806bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:15.470 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0a5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0a80705d0 0x7fe0a80c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0a6d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe0a806c0e0 0x7fe0a80c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57522/0 (socket says 172.21.15.150:57522) 2022-08-10T17:54:15.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.454+0000 7fe0a6d9d700 1 -- 172.21.15.150:0/627360752 learned_addr learned my addr 172.21.15.150:0/627360752 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:15.471 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/627360752 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 msgr2=0x7fe0a806bba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:15.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a5d9b700 1 --2- 172.21.15.150:0/627360752 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 0x7fe0a806bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/627360752 >> v1:172.21.15.150:6789/0 conn(0x7fe0a806c0e0 legacy=0x7fe0a80c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.472 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/627360752 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a81569c0 con 0x7fe0a80705d0 2022-08-10T17:54:15.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a559a700 1 -- 172.21.15.150:0/627360752 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794835849 0 0) 0x7fe0a0001490 con 0x7fe0a806c0e0 2022-08-10T17:54:15.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a5d9b700 1 --2- 172.21.15.150:0/627360752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a80c47f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a850 tx=0x7fe09800ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6639f42d34b54d1c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a559a700 1 -- 172.21.15.150:0/627360752 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800c940 con 0x7fe0a80705d0 2022-08-10T17:54:15.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a559a700 1 -- 172.21.15.150:0/627360752 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800caa0 con 0x7fe0a80705d0 2022-08-10T17:54:15.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0a559a700 1 -- 172.21.15.150:0/627360752 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800ce30 con 0x7fe0a80705d0 2022-08-10T17:54:15.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0accf8700 1 -- 172.21.15.150:0/627360752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 msgr2=0x7fe0a80c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.455+0000 7fe0accf8700 1 --2- 172.21.15.150:0/627360752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a80c47f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a850 tx=0x7fe09800ab60 comp rx=0 tx=0).stop 2022-08-10T17:54:15.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 -- 172.21.15.150:0/627360752 shutdown_connections 2022-08-10T17:54:15.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 --2- 172.21.15.150:0/627360752 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a814d080 0x7fe0a806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 --2- 172.21.15.150:0/627360752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a80c47f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 -- 172.21.15.150:0/627360752 >> 172.21.15.150:0/627360752 conn(0x7fe0a80c8a10 msgr2=0x7fe0a80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 -- 172.21.15.150:0/627360752 shutdown_connections 2022-08-10T17:54:15.477 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.456+0000 7fe0accf8700 1 -- 172.21.15.150:0/627360752 wait complete. 2022-08-10T17:54:15.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.457+0000 7fe0accf8700 1 Processor -- start 2022-08-10T17:54:15.478 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.457+0000 7fe0accf8700 1 -- start start 2022-08-10T17:54:15.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 0x7fe0a80c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.479 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0a814d080 0x7fe0a80c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80c3ad0 con 0x7fe0a80705d0 2022-08-10T17:54:15.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81ea760 con 0x7fe0a814d080 2022-08-10T17:54:15.480 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81ea9d0 con 0x7fe0a806c0e0 2022-08-10T17:54:15.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a659c700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 msgr2=0x7fe0a80c5150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:15.481 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a659c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 0x7fe0a80c5150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:15.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44846/0 (socket says 172.21.15.150:44846) 2022-08-10T17:54:15.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/3417559423 learned_addr learned my addr 172.21.15.150:0/3417559423 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:15.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a6d9d700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0a814d080 0x7fe0a80c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.483 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 msgr2=0x7fe0a80c5150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:15.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 0x7fe0a80c5150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.484 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0a814d080 msgr2=0x7fe0a80c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0a814d080 0x7fe0a80c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 -- 172.21.15.150:0/3417559423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09800a4b0 con 0x7fe0a80705d0 2022-08-10T17:54:15.485 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0a5d9b700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe09800afd0 tx=0x7fe098004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098019dd0 con 0x7fe0a80705d0 2022-08-10T17:54:15.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980233f0 con 0x7fe0a80705d0 2022-08-10T17:54:15.486 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098023760 con 0x7fe0a80705d0 2022-08-10T17:54:15.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a80c3d20 con 0x7fe0a80705d0 2022-08-10T17:54:15.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.458+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a80c42e0 con 0x7fe0a80705d0 2022-08-10T17:54:15.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.459+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a806b790 con 0x7fe0a80705d0 2022-08-10T17:54:15.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.460+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe09800e040 con 0x7fe0a80705d0 2022-08-10T17:54:15.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.460+0000 7fe09effd700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 0x7fe08c067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:15.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.460+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe0980836c0 con 0x7fe0a80705d0 2022-08-10T17:54:15.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.460+0000 7fe0a659c700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 0x7fe08c067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:15.489 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.461+0000 7fe0a659c700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 0x7fe08c067510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe090003840 tx=0x7fe090006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:15.490 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.464+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe0980516a0 con 0x7fe0a80705d0 2022-08-10T17:54:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.717+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe0a806b4b0 con 0x7fe0a80705d0 2022-08-10T17:54:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.718+0000 7fe09effd700 1 -- 172.21.15.150:0/3417559423 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fe098054cc0 con 0x7fe0a80705d0 2022-08-10T17:54:15.721 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.719+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 msgr2=0x7fe08c067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.719+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 0x7fe08c067510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe090003840 tx=0x7fe090006c90 comp rx=0 tx=0).stop 2022-08-10T17:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.719+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 msgr2=0x7fe0a8149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.719+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe09800afd0 tx=0x7fe098004640 comp rx=0 tx=0).stop 2022-08-10T17:54:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.719+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 shutdown_connections 2022-08-10T17:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe0a814d080 0x7fe0a80c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe08c065060 0x7fe08c067510 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe0a806c0e0 0x7fe0a80c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 --2- 172.21.15.150:0/3417559423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a80705d0 0x7fe0a8149980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 >> 172.21.15.150:0/3417559423 conn(0x7fe0a80c8a10 msgr2=0x7fe0a80c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 shutdown_connections 2022-08-10T17:54:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:15.720+0000 7fe0accf8700 1 -- 172.21.15.150:0/3417559423 wait complete. 2022-08-10T17:54:18.128 INFO:tasks.workunit.client.0.smithi150.stdout:Syncing()...44 sec 2022-08-10T17:54:18.128 INFO:tasks.workunit.client.0.smithi150.stdout:FFSB benchmark finished at: Wed Aug 10 17:54:18 2022 2022-08-10T17:54:18.129 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.129 INFO:tasks.workunit.client.0.smithi150.stdout:Results: 2022-08-10T17:54:18.129 INFO:tasks.workunit.client.0.smithi150.stdout:Benchmark took 870.33 sec 2022-08-10T17:54:18.129 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.130 INFO:tasks.workunit.client.0.smithi150.stdout:Total Results 2022-08-10T17:54:18.130 INFO:tasks.workunit.client.0.smithi150.stdout:=============== 2022-08-10T17:54:18.130 INFO:tasks.workunit.client.0.smithi150.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2022-08-10T17:54:18.130 INFO:tasks.workunit.client.0.smithi150.stdout: ======= ============ ========= ======= =========== ========== 2022-08-10T17:54:18.131 INFO:tasks.workunit.client.0.smithi150.stdout: write : 1730560 1988.39 100.000% 100.000% 7.77MB/sec 2022-08-10T17:54:18.131 INFO:tasks.workunit.client.0.smithi150.stdout:- 2022-08-10T17:54:18.131 INFO:tasks.workunit.client.0.smithi150.stdout:1988.39 Transactions per Second 2022-08-10T17:54:18.131 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.132 INFO:tasks.workunit.client.0.smithi150.stdout:Throughput Results 2022-08-10T17:54:18.132 INFO:tasks.workunit.client.0.smithi150.stdout:=================== 2022-08-10T17:54:18.132 INFO:tasks.workunit.client.0.smithi150.stdout:Write Throughput: 7.77MB/sec 2022-08-10T17:54:18.136 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.137 INFO:tasks.workunit.client.0.smithi150.stdout:System Call Latency statistics in millisecs 2022-08-10T17:54:18.137 INFO:tasks.workunit.client.0.smithi150.stdout:===== 2022-08-10T17:54:18.137 INFO:tasks.workunit.client.0.smithi150.stdout: Min Avg Max Total Calls 2022-08-10T17:54:18.137 INFO:tasks.workunit.client.0.smithi150.stdout: ======== ======== ======== ============ 2022-08-10T17:54:18.138 INFO:tasks.workunit.client.0.smithi150.stdout:[ open] 0.003000 780.526729 48799.734375 1352 2022-08-10T17:54:18.138 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[0] 5000.000000 - 10000.000000 : 11 2022-08-10T17:54:18.138 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[1] 2000.000000 - 5000.000000 : 7 2022-08-10T17:54:18.138 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[2] 1000.000000 - 2000.000000 : 3 2022-08-10T17:54:18.139 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[3] 500.000000 - 1000.000000 : 3 2022-08-10T17:54:18.139 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[4] 200.000000 - 500.000000 : 4 2022-08-10T17:54:18.139 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2022-08-10T17:54:18.139 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2022-08-10T17:54:18.140 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[7] 20.000000 - 50.000000 : 9 2022-08-10T17:54:18.140 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[8] 10.000000 - 20.000000 : 18 2022-08-10T17:54:18.140 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[9] 5.000000 - 10.000000 : 59 2022-08-10T17:54:18.140 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[10] 2.000000 - 5.000000 : 124 2022-08-10T17:54:18.140 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[11] 1.000000 - 2.000000 : 58 2022-08-10T17:54:18.141 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[12] 0.500000 - 1.000000 : 20 2022-08-10T17:54:18.141 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2022-08-10T17:54:18.141 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[14] 0.100000 - 0.200000 : 1 2022-08-10T17:54:18.141 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[15] 0.050000 - 0.100000 : 2 2022-08-10T17:54:18.142 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[16] 0.020000 - 0.050000 : 97 2022-08-10T17:54:18.142 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[17] 0.010000 - 0.020000 : 449 2022-08-10T17:54:18.142 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[18] 0.000000 - 0.010000 : 461 2022-08-10T17:54:18.142 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.143 INFO:tasks.workunit.client.0.smithi150.stdout:[ write] 0.001000 7.979791 35965.406250 1730560 2022-08-10T17:54:18.143 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[0] 5000.000000 - 10000.000000 : 189 2022-08-10T17:54:18.143 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[1] 2000.000000 - 5000.000000 : 262 2022-08-10T17:54:18.143 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[2] 1000.000000 - 2000.000000 : 440 2022-08-10T17:54:18.143 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[3] 500.000000 - 1000.000000 : 5076 2022-08-10T17:54:18.144 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[4] 200.000000 - 500.000000 : 13528 2022-08-10T17:54:18.144 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[5] 100.000000 - 200.000000 : 8976 2022-08-10T17:54:18.144 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[6] 50.000000 - 100.000000 : 7645 2022-08-10T17:54:18.144 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[7] 20.000000 - 50.000000 : 5892 2022-08-10T17:54:18.145 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[8] 10.000000 - 20.000000 : 860 2022-08-10T17:54:18.145 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[9] 5.000000 - 10.000000 : 68 2022-08-10T17:54:18.145 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[10] 2.000000 - 5.000000 : 64 2022-08-10T17:54:18.145 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[11] 1.000000 - 2.000000 : 32 2022-08-10T17:54:18.146 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[12] 0.500000 - 1.000000 : 30 2022-08-10T17:54:18.146 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[13] 0.200000 - 0.500000 : 61 2022-08-10T17:54:18.146 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[14] 0.100000 - 0.200000 : 80 2022-08-10T17:54:18.146 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[15] 0.050000 - 0.100000 : 346 2022-08-10T17:54:18.147 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[16] 0.020000 - 0.050000 : 1523 2022-08-10T17:54:18.147 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[17] 0.010000 - 0.020000 : 5914 2022-08-10T17:54:18.147 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[18] 0.000000 - 0.010000 : 1679506 2022-08-10T17:54:18.147 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.147 INFO:tasks.workunit.client.0.smithi150.stdout:[ lseek] 0.000000 4.391669 17310.539062 1730560 2022-08-10T17:54:18.148 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[0] 5000.000000 - 10000.000000 : 58 2022-08-10T17:54:18.148 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[1] 2000.000000 - 5000.000000 : 93 2022-08-10T17:54:18.148 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[2] 1000.000000 - 2000.000000 : 214 2022-08-10T17:54:18.148 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[3] 500.000000 - 1000.000000 : 3379 2022-08-10T17:54:18.149 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[4] 200.000000 - 500.000000 : 10651 2022-08-10T17:54:18.149 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[5] 100.000000 - 200.000000 : 3672 2022-08-10T17:54:18.149 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[6] 50.000000 - 100.000000 : 1488 2022-08-10T17:54:18.149 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[7] 20.000000 - 50.000000 : 704 2022-08-10T17:54:18.150 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[8] 10.000000 - 20.000000 : 119 2022-08-10T17:54:18.150 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[9] 5.000000 - 10.000000 : 232 2022-08-10T17:54:18.150 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[10] 2.000000 - 5.000000 : 600 2022-08-10T17:54:18.150 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[11] 1.000000 - 2.000000 : 363 2022-08-10T17:54:18.151 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[12] 0.500000 - 1.000000 : 243 2022-08-10T17:54:18.151 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[13] 0.200000 - 0.500000 : 207 2022-08-10T17:54:18.151 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[14] 0.100000 - 0.200000 : 117 2022-08-10T17:54:18.151 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[15] 0.050000 - 0.100000 : 165 2022-08-10T17:54:18.151 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[16] 0.020000 - 0.050000 : 533 2022-08-10T17:54:18.152 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[17] 0.010000 - 0.020000 : 778 2022-08-10T17:54:18.152 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[18] 0.000000 - 0.010000 : 1706927 2022-08-10T17:54:18.152 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.152 INFO:tasks.workunit.client.0.smithi150.stdout:[ close] 0.001000 0.003738 0.042000 1352 2022-08-10T17:54:18.153 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2022-08-10T17:54:18.153 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2022-08-10T17:54:18.153 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2022-08-10T17:54:18.153 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2022-08-10T17:54:18.154 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2022-08-10T17:54:18.154 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2022-08-10T17:54:18.154 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2022-08-10T17:54:18.154 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2022-08-10T17:54:18.155 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2022-08-10T17:54:18.155 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2022-08-10T17:54:18.155 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2022-08-10T17:54:18.155 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2022-08-10T17:54:18.156 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2022-08-10T17:54:18.156 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2022-08-10T17:54:18.156 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2022-08-10T17:54:18.156 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2022-08-10T17:54:18.156 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[16] 0.020000 - 0.050000 : 2 2022-08-10T17:54:18.157 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[17] 0.010000 - 0.020000 : 12 2022-08-10T17:54:18.157 INFO:tasks.workunit.client.0.smithi150.stdout: msec_range[18] 0.000000 - 0.010000 : 1338 2022-08-10T17:54:18.157 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.157 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.158 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.158 INFO:tasks.workunit.client.0.smithi150.stdout: 2022-08-10T17:54:18.158 INFO:tasks.workunit.client.0.smithi150.stdout:0.1% User Time 2022-08-10T17:54:18.158 INFO:tasks.workunit.client.0.smithi150.stdout:2.2% System Time 2022-08-10T17:54:18.158 INFO:tasks.workunit.client.0.smithi150.stdout:2.3% CPU Utilization 2022-08-10T17:54:18.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:18.857 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.853+0000 7f4faa983700 1 Processor -- start 2022-08-10T17:54:18.858 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.853+0000 7f4faa983700 1 -- start start 2022-08-10T17:54:18.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4faa983700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa4155400 0x7f4fa40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4faa983700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4faa983700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa41521f0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.867 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4faa983700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa4154710 con 0x7f4fa4155400 2022-08-10T17:54:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4faa983700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40c66c0 con 0x7f4fa40c69b0 2022-08-10T17:54:18.868 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa8f20700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 msgr2=0x7f4fa406d610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa8f20700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa406d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa3fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4fa40c21d0 0x7f4fa40caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57542/0 (socket says 172.21.15.150:57542) 2022-08-10T17:54:18.869 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa3fff700 1 -- 172.21.15.150:0/1603577420 learned_addr learned my addr 172.21.15.150:0/1603577420 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa37fe700 1 --2- 172.21.15.150:0/1603577420 >> v2:172.21.15.150:3300/0 conn(0x7f4fa4155400 0x7f4fa40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:18.870 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa2ffd700 1 -- 172.21.15.150:0/1603577420 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273507984 0 0) 0x7f4fa41521f0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa2ffd700 1 -- 172.21.15.150:0/1603577420 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f84003430 con 0x7f4fa40c21d0 2022-08-10T17:54:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa37fe700 1 -- 172.21.15.150:0/1603577420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 msgr2=0x7f4fa406d610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:18.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.854+0000 7f4fa37fe700 1 --2- 172.21.15.150:0/1603577420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa406d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa37fe700 1 -- 172.21.15.150:0/1603577420 >> v1:172.21.15.150:6789/0 conn(0x7f4fa40c21d0 legacy=0x7f4fa40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:18.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa37fe700 1 -- 172.21.15.150:0/1603577420 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40c6e80 con 0x7f4fa4155400 2022-08-10T17:54:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa37fe700 1 --2- 172.21.15.150:0/1603577420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4155400 0x7f4fa40c59c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f940096b0 tx=0x7f4f940099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80740ec285537f2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa2ffd700 1 -- 172.21.15.150:0/1603577420 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940107b0 con 0x7f4fa4155400 2022-08-10T17:54:18.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa2ffd700 1 -- 172.21.15.150:0/1603577420 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94010910 con 0x7f4fa4155400 2022-08-10T17:54:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4fa2ffd700 1 -- 172.21.15.150:0/1603577420 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94010c80 con 0x7f4fa4155400 2022-08-10T17:54:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 -- 172.21.15.150:0/1603577420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4155400 msgr2=0x7f4fa40c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:18.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 --2- 172.21.15.150:0/1603577420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4155400 0x7f4fa40c59c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f940096b0 tx=0x7f4f940099c0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 -- 172.21.15.150:0/1603577420 shutdown_connections 2022-08-10T17:54:18.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 --2- 172.21.15.150:0/1603577420 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 --2- 172.21.15.150:0/1603577420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4155400 0x7f4fa40c59c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 -- 172.21.15.150:0/1603577420 >> 172.21.15.150:0/1603577420 conn(0x7f4fa406fae0 msgr2=0x7f4fa406fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:18.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 -- 172.21.15.150:0/1603577420 shutdown_connections 2022-08-10T17:54:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.855+0000 7f4faa983700 1 -- 172.21.15.150:0/1603577420 wait complete. 2022-08-10T17:54:18.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.857+0000 7f4faa983700 1 Processor -- start 2022-08-10T17:54:18.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.857+0000 7f4faa983700 1 -- start start 2022-08-10T17:54:18.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.857+0000 7f4faa983700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.857+0000 7f4faa983700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa4149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.857+0000 7f4faa983700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 0x7f4fa40ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4faa983700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa414f8c0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4faa983700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa41dda30 con 0x7f4fa4155400 2022-08-10T17:54:18.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4faa983700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa414ecb0 con 0x7f4fa40c69b0 2022-08-10T17:54:18.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa37fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 msgr2=0x7f4fa4149970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:18.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa37fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa4149970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:18.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:18.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44868/0 (socket says 172.21.15.150:44868) 2022-08-10T17:54:18.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 -- 172.21.15.150:0/1508094929 learned_addr learned my addr 172.21.15.150:0/1508094929 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:18.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa8f20700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 0x7f4fa40ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:18.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 -- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 msgr2=0x7f4fa4149970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:18.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa4149970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 -- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 msgr2=0x7f4fa40ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:18.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 0x7f4fa40ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:18.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 -- 172.21.15.150:0/1508094929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94009310 con 0x7f4fa40c21d0 2022-08-10T17:54:18.886 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa8f20700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 0x7f4fa40ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:54:18.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.858+0000 7f4fa3fff700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c3c0 tx=0x7f4f8c00c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:18.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.859+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0072d0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.887 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.859+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c007430 con 0x7f4fa40c21d0 2022-08-10T17:54:18.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.859+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa414ef90 con 0x7f4fa40c21d0 2022-08-10T17:54:18.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.859+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0057c0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.859+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa414f550 con 0x7f4fa40c21d0 2022-08-10T17:54:18.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.860+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa414f6e0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.861+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4f8c019030 con 0x7f4fa40c21d0 2022-08-10T17:54:18.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.861+0000 7f4fa0ff9700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 0x7f4f88067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:18.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.861+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4f8c0813a0 con 0x7f4fa40c21d0 2022-08-10T17:54:18.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.861+0000 7f4fa37fe700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 0x7f4f88067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:18.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.862+0000 7f4fa37fe700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 0x7f4f88067540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fa41557f0 tx=0x7f4f94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:18.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:18.865+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4f8c04f380 con 0x7f4fa40c21d0 2022-08-10T17:54:19.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.114+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4fa40c7fd0 con 0x7f4fa40c21d0 2022-08-10T17:54:19.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.115+0000 7f4fa0ff9700 1 -- 172.21.15.150:0/1508094929 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7f4f8c017020 con 0x7f4fa40c21d0 2022-08-10T17:54:19.119 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:19.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 msgr2=0x7f4f88067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:19.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 0x7f4f88067540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fa41557f0 tx=0x7f4f94008030 comp rx=0 tx=0).stop 2022-08-10T17:54:19.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 msgr2=0x7f4fa41decd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:19.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c3c0 tx=0x7f4f8c00c6d0 comp rx=0 tx=0).stop 2022-08-10T17:54:19.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 shutdown_connections 2022-08-10T17:54:19.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4fa4155400 0x7f4fa40ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:19.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40c21d0 0x7f4fa41decd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:19.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4f88065090 0x7f4f88067540 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:19.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 --2- 172.21.15.150:0/1508094929 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4fa40c69b0 0x7f4fa4149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:19.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 >> 172.21.15.150:0/1508094929 conn(0x7f4fa406fae0 msgr2=0x7f4fa41525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:19.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 shutdown_connections 2022-08-10T17:54:19.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:19.117+0000 7f4faa983700 1 -- 172.21.15.150:0/1508094929 wait complete. 2022-08-10T17:54:22.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.256+0000 7fb93c858700 1 Processor -- start 2022-08-10T17:54:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.256+0000 7fb93c858700 1 -- start start 2022-08-10T17:54:22.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93c858700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb938150800 0x7fb9380699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93c858700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 0x7fb9380c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93c858700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93815ab00 con 0x7fb938150bd0 2022-08-10T17:54:22.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93c858700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93806a050 con 0x7fb938150800 2022-08-10T17:54:22.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93c858700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938159ef0 con 0x7fb9380c6540 2022-08-10T17:54:22.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb936d9d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 msgr2=0x7fb9380c69e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:22.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb935d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb938150bd0 0x7fb9381572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57562/0 (socket says 172.21.15.150:57562) 2022-08-10T17:54:22.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb935d9b700 1 -- 172.21.15.150:0/585075622 learned_addr learned my addr 172.21.15.150:0/585075622 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:22.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb936d9d700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 0x7fb9380c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:22.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.257+0000 7fb93659c700 1 --2- 172.21.15.150:0/585075622 >> v2:172.21.15.197:3300/0 conn(0x7fb938150800 0x7fb9380699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:22.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93659c700 1 -- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 msgr2=0x7fb9380c69e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:22.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93659c700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 0x7fb9380c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93659c700 1 -- 172.21.15.150:0/585075622 >> v1:172.21.15.150:6789/0 conn(0x7fb938150bd0 legacy=0x7fb9381572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:22.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93659c700 1 -- 172.21.15.150:0/585075622 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93815a1d0 con 0x7fb938150800 2022-08-10T17:54:22.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93659c700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb938150800 0x7fb9380699e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9280096b0 tx=0x7fb9280099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d3267c85bae4b1e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:22.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93559a700 1 -- 172.21.15.150:0/585075622 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928011830 con 0x7fb938150800 2022-08-10T17:54:22.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93559a700 1 -- 172.21.15.150:0/585075622 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928011990 con 0x7fb938150800 2022-08-10T17:54:22.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.258+0000 7fb93559a700 1 -- 172.21.15.150:0/585075622 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928011d20 con 0x7fb938150800 2022-08-10T17:54:22.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 -- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb938150800 msgr2=0x7fb9380699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:22.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb938150800 0x7fb9380699e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9280096b0 tx=0x7fb9280099c0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 -- 172.21.15.150:0/585075622 shutdown_connections 2022-08-10T17:54:22.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb9380c6540 0x7fb9380c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 --2- 172.21.15.150:0/585075622 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb938150800 0x7fb9380699e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 -- 172.21.15.150:0/585075622 >> 172.21.15.150:0/585075622 conn(0x7fb938071e40 msgr2=0x7fb9380692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:22.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 -- 172.21.15.150:0/585075622 shutdown_connections 2022-08-10T17:54:22.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.259+0000 7fb93c858700 1 -- 172.21.15.150:0/585075622 wait complete. 2022-08-10T17:54:22.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.260+0000 7fb93c858700 1 Processor -- start 2022-08-10T17:54:22.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.260+0000 7fb93c858700 1 -- start start 2022-08-10T17:54:22.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 0x7fb93806f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 0x7fb9380c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381e1740 con 0x7fb9380c6540 2022-08-10T17:54:22.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb938155b60 con 0x7fb9380ca150 2022-08-10T17:54:22.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938155e40 con 0x7fb938150800 2022-08-10T17:54:22.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:22.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb935d9b700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 msgr2=0x7fb93806f850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:22.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb935d9b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 0x7fb93806f850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:22.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44888/0 (socket says 172.21.15.150:44888) 2022-08-10T17:54:22.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 -- 172.21.15.150:0/625551170 learned_addr learned my addr 172.21.15.150:0/625551170 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:22.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb936d9d700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 0x7fb9380c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:22.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 -- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 msgr2=0x7fb93806f850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:22.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 0x7fb93806f850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 -- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 msgr2=0x7fb9380c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:22.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 0x7fb9380c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 -- 172.21.15.150:0/625551170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb928009310 con 0x7fb9380c6540 2022-08-10T17:54:22.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb936d9d700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 0x7fb9380c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:54:22.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93659c700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9280090b0 tx=0x7fb9280045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:22.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928003930 con 0x7fb9380c6540 2022-08-10T17:54:22.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92801f070 con 0x7fb9380c6540 2022-08-10T17:54:22.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9381e19e0 con 0x7fb9380c6540 2022-08-10T17:54:22.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.261+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928003cf0 con 0x7fb9380c6540 2022-08-10T17:54:22.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.262+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9381e39a0 con 0x7fb9380c6540 2022-08-10T17:54:22.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.262+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93815a4b0 con 0x7fb9380c6540 2022-08-10T17:54:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.263+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb92800f050 con 0x7fb9380c6540 2022-08-10T17:54:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.264+0000 7fb926ffd700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 0x7fb914067540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:22.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.264+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb928021070 con 0x7fb9380c6540 2022-08-10T17:54:22.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.264+0000 7fb935d9b700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 0x7fb914067540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:22.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.264+0000 7fb935d9b700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 0x7fb914067540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb9380c3e10 tx=0x7fb92c0079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:22.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.270+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb928051c20 con 0x7fb9380c6540 2022-08-10T17:54:22.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.527+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb938068110 con 0x7fb9380c6540 2022-08-10T17:54:22.532 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.528+0000 7fb926ffd700 1 -- 172.21.15.150:0/625551170 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fb92802b600 con 0x7fb9380c6540 2022-08-10T17:54:22.532 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:22.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 msgr2=0x7fb914067540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:22.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 0x7fb914067540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb9380c3e10 tx=0x7fb92c0079f0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 msgr2=0x7fb9381e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:22.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9280090b0 tx=0x7fb9280045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 shutdown_connections 2022-08-10T17:54:22.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb9380ca150 0x7fb9380c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9380c6540 0x7fb9381e3460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb914065090 0x7fb914067540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 --2- 172.21.15.150:0/625551170 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb938150800 0x7fb93806f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 >> 172.21.15.150:0/625551170 conn(0x7fb938071e40 msgr2=0x7fb93814dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 shutdown_connections 2022-08-10T17:54:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:22.530+0000 7fb93c858700 1 -- 172.21.15.150:0/625551170 wait complete. 2022-08-10T17:54:25.546 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:25.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.894+0000 7f5e858c3700 1 Processor -- start 2022-08-10T17:54:25.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.894+0000 7f5e858c3700 1 -- start start 2022-08-10T17:54:25.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.895+0000 7f5e858c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:25.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.895+0000 7f5e858c3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:25.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.895+0000 7f5e858c3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800c5270 con 0x7f5e8014ce90 2022-08-10T17:54:25.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.895+0000 7f5e858c3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800c47c0 con 0x7f5e800c4060 2022-08-10T17:54:25.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.895+0000 7f5e858c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800705f0 con 0x7f5e8006c050 2022-08-10T17:54:25.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.898+0000 7f5e7effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5e8014ce90 0x7f5e8006b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57594/0 (socket says 172.21.15.150:57594) 2022-08-10T17:54:25.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.898+0000 7f5e7effd700 1 -- 172.21.15.150:0/3638001020 learned_addr learned my addr 172.21.15.150:0/3638001020 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:25.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.900+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e80152ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.900+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.901+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.901+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.901+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:25.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.901+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:25.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:25.901+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:26.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.101+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e80152ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:26.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.101+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:54:26.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.102+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:26.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.102+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:26.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.102+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:26.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.102+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:26.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.102+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:54:26.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.503+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e80152ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:26.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.503+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:54:26.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.507+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:26.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.507+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:26.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.507+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:26.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.507+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:26.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:26.507+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:54:27.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.308+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:27.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.308+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:27.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.308+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:27.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.308+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:27.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.308+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:54:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.316+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e80152ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:27.323 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:27.316+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:54:27.356 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-08-10T17:54:27.357 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-08-10T17:54:27.747 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2022-08-10T17:54:27.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-08-10T17:54:28.238 DEBUG:teuthology.parallel:result is None 2022-08-10T17:54:28.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2022-08-10T17:54:28.619 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2022-08-10T17:54:28.620 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2022-08-10T17:54:28.632 INFO:tasks.mon_thrash:joining mon_thrasher 2022-08-10T17:54:28.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e80152ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:28.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e80152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:28.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 msgr2=0x7f5e80153410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:28.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.150:3300/0 conn(0x7f5e800c4060 0x7f5e80153410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:28.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 -- 172.21.15.150:0/3638001020 >> v1:172.21.15.150:6789/0 conn(0x7f5e8014ce90 legacy=0x7f5e8006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:28.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:28.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 -- 172.21.15.150:0/3638001020 --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800c49d0 con 0x7f5e600035f0 2022-08-10T17:54:28.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.895+0000 7f5e7cff9700 1 -- 172.21.15.150:0/3638001020 --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800c47c0 con 0x7f5e60007320 2022-08-10T17:54:28.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.900+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:28.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.901+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:28.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.901+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:28.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.901+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:28.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:28.901+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:29.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.102+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:29.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.102+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:29.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.102+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:29.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.102+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:29.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.102+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:54:29.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.511+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:29.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.511+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:29.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.511+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:29.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.511+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:29.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.511+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:54:29.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.937+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178008052 0 0) 0x7f5e800c49d0 con 0x7f5e600035f0 2022-08-10T17:54:29.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.937+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e6c003430 con 0x7f5e600035f0 2022-08-10T17:54:29.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.1 v1:172.21.15.197:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 957052641 0 0) 0x7f5e6c003430 con 0x7f5e600035f0 2022-08-10T17:54:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 msgr2=0x7f5e600097d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:29.962 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 --2- 172.21.15.150:0/3638001020 >> v2:172.21.15.197:3300/0 conn(0x7f5e60007320 0x7f5e600097d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 --> v1:172.21.15.197:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6000aed0 con 0x7f5e600035f0 2022-08-10T17:54:29.963 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.1 v1:172.21.15.197:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f5e700016b0 con 0x7f5e600035f0 2022-08-10T17:54:29.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 >> v1:172.21.15.197:6789/0 conn(0x7f5e600035f0 legacy=0x7f5e60005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:29.964 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 reap_dead start 2022-08-10T17:54:29.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e6c003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.965 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e6c0046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6c004c10 0x7f5e6c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.966 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800c47c0 con 0x7f5e6c003880 2022-08-10T17:54:29.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c00ba20 con 0x7f5e6c004c10 2022-08-10T17:54:29.967 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.956+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c00bb90 con 0x7f5e8006c050 2022-08-10T17:54:29.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.957+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e6c0046d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:29.968 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.957+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e6c0046d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:29.969 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.957+0000 7f5e7effd700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e6c003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:29.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.959+0000 7f5e7effd700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 msgr2=0x7f5e6c0046d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:29.971 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.959+0000 7f5e7effd700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e8006c050 0x7f5e6c0046d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.959+0000 7f5e7effd700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6c004c10 msgr2=0x7f5e6c005080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:29.972 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.959+0000 7f5e7effd700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e6c004c10 0x7f5e6c005080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.959+0000 7f5e7effd700 1 -- 172.21.15.150:0/3638001020 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6000aed0 con 0x7f5e6c003880 2022-08-10T17:54:29.973 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.960+0000 7f5e7effd700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e6c003c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e70001eb0 tx=0x7f5e6c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cecf9ae2044d744 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.960+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000cbd0 con 0x7f5e6c003880 2022-08-10T17:54:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.960+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7000cd30 con 0x7f5e6c003880 2022-08-10T17:54:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.960+0000 7f5e7dffb700 1 -- 172.21.15.150:0/3638001020 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70007310 con 0x7f5e6c003880 2022-08-10T17:54:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.961+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 reap_dead start 2022-08-10T17:54:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.961+0000 7f5e7f7fe700 1 -- 172.21.15.150:0/3638001020 reap_dead start 2022-08-10T17:54:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.961+0000 7f5e858c3700 1 -- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 msgr2=0x7f5e6c003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:29.975 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.961+0000 7f5e858c3700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e6c003c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e70001eb0 tx=0x7f5e6c005700 comp rx=0 tx=0).stop 2022-08-10T17:54:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.962+0000 7f5e858c3700 1 -- 172.21.15.150:0/3638001020 shutdown_connections 2022-08-10T17:54:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.962+0000 7f5e858c3700 1 --2- 172.21.15.150:0/3638001020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e6c003c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.962+0000 7f5e858c3700 1 -- 172.21.15.150:0/3638001020 >> 172.21.15.150:0/3638001020 conn(0x7f5e800c8a10 msgr2=0x7f5e800c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.962+0000 7f5e858c3700 1 -- 172.21.15.150:0/3638001020 shutdown_connections 2022-08-10T17:54:29.976 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.962+0000 7f5e858c3700 1 -- 172.21.15.150:0/3638001020 wait complete. 2022-08-10T17:54:29.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.964+0000 7f5e858c3700 1 Processor -- start 2022-08-10T17:54:29.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.965+0000 7f5e858c3700 1 -- start start 2022-08-10T17:54:29.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.977 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 0x7f5e801ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e800c1000 0x7f5e8014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800c1ca0 con 0x7f5e6c003880 2022-08-10T17:54:29.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800c2cd0 con 0x7f5e800c1000 2022-08-10T17:54:29.978 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.966+0000 7f5e858c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800c0b70 con 0x7f5e800c2830 2022-08-10T17:54:29.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:29.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7effd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44978/0 (socket says 172.21.15.150:44978) 2022-08-10T17:54:29.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7effd700 1 -- 172.21.15.150:0/1660594059 learned_addr learned my addr 172.21.15.150:0/1660594059 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:29.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7e7fc700 1 -- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 msgr2=0x7f5e801ece00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:29.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 0x7f5e801ece00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:29.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.969+0000 7f5e7f7fe700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e800c1000 0x7f5e8014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:29.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.970+0000 7f5e7effd700 1 -- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 msgr2=0x7f5e801ece00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:29.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.970+0000 7f5e7effd700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 0x7f5e801ece00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.970+0000 7f5e7effd700 1 -- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e800c1000 msgr2=0x7f5e8014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:29.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.970+0000 7f5e7effd700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e800c1000 0x7f5e8014b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:29.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.970+0000 7f5e7effd700 1 -- 172.21.15.150:0/1660594059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8014c2b0 con 0x7f5e6c003880 2022-08-10T17:54:29.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e7effd700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c6a0 tx=0x7f5e700018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:29.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700074e0 con 0x7f5e6c003880 2022-08-10T17:54:29.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70007640 con 0x7f5e6c003880 2022-08-10T17:54:29.983 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005240 con 0x7f5e6c003880 2022-08-10T17:54:29.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8014c830 con 0x7f5e6c003880 2022-08-10T17:54:29.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.975+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e800c0800 con 0x7f5e6c003880 2022-08-10T17:54:29.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.978+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5e7002d070 con 0x7f5e6c003880 2022-08-10T17:54:29.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.979+0000 7f5e67fff700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 0x7f5e600681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:29.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.979+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5e70083420 con 0x7f5e6c003880 2022-08-10T17:54:29.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.983+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c005170 con 0x7f5e6c003880 2022-08-10T17:54:29.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.985+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 0x7f5e600681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:30.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.991+0000 7f5e7e7fc700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 0x7f5e600681e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5e78003ad0 tx=0x7f5e78003a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:30.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:29.991+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f5e70017080 con 0x7f5e6c003880 2022-08-10T17:54:30.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.573+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5e5c0059a0 con 0x7f5e6c003880 2022-08-10T17:54:30.579 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.576+0000 7f5e67fff700 1 -- 172.21.15.150:0/1660594059 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7f5e70054dc0 con 0x7f5e6c003880 2022-08-10T17:54:30.586 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:30.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.592+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 msgr2=0x7f5e600681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:30.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.592+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 0x7f5e600681e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5e78003ad0 tx=0x7f5e78003a40 comp rx=0 tx=0).stop 2022-08-10T17:54:30.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.592+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 msgr2=0x7f5e80149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:30.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.592+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c6a0 tx=0x7f5e700018d0 comp rx=0 tx=0).stop 2022-08-10T17:54:30.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 shutdown_connections 2022-08-10T17:54:30.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5e800c1000 0x7f5e8014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:30.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e6c003880 0x7f5e80149410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:30.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5e60065d30 0x7f5e600681e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:30.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 --2- 172.21.15.150:0/1660594059 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5e800c2830 0x7f5e801ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:30.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 >> 172.21.15.150:0/1660594059 conn(0x7f5e800c8a10 msgr2=0x7f5e8006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:30.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.597+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 shutdown_connections 2022-08-10T17:54:30.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:30.598+0000 7f5e858c3700 1 -- 172.21.15.150:0/1660594059 wait complete. 2022-08-10T17:54:30.634 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2022-08-10T17:54:30.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:54:31.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.074+0000 7f5f1d11c700 1 Processor -- start 2022-08-10T17:54:31.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.074+0000 7f5f1d11c700 1 -- start start 2022-08-10T17:54:31.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f1d11c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f18071550 0x7f5f180c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f1d11c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 0x7f5f1815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f1d11c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f18070810 con 0x7f5f1815ef40 2022-08-10T17:54:31.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f1d11c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180c7510 con 0x7f5f18071550 2022-08-10T17:54:31.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f1d11c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1815e290 con 0x7f5f180c4420 2022-08-10T17:54:31.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f16d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f18071550 0x7f5f180c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f16d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f18071550 0x7f5f180c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45000/0 (socket says 172.21.15.150:45000) 2022-08-10T17:54:31.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.075+0000 7f5f16d9d700 1 -- 172.21.15.150:0/1887052028 learned_addr learned my addr 172.21.15.150:0/1887052028 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:31.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f1659c700 1 -- 172.21.15.150:0/1887052028 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 msgr2=0x7f5f1815ea00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:31.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f1659c700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 0x7f5f1815ea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:31.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f16d9d700 1 -- 172.21.15.150:0/1887052028 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 msgr2=0x7f5f1815ea00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:31.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 0x7f5f1815ea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f16d9d700 1 -- 172.21.15.150:0/1887052028 >> v1:172.21.15.197:6789/0 conn(0x7f5f1815ef40 legacy=0x7f5f1806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:31.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.081+0000 7f5f16d9d700 1 -- 172.21.15.150:0/1887052028 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1815e570 con 0x7f5f18071550 2022-08-10T17:54:31.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.082+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18071550 0x7f5f180c6fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009780 tx=0x7f5f00009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a3b7f6b47a5e73 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.098+0000 7f5f15d9b700 1 -- 172.21.15.150:0/1887052028 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00011830 con 0x7f5f18071550 2022-08-10T17:54:31.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.098+0000 7f5f15d9b700 1 -- 172.21.15.150:0/1887052028 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f00011990 con 0x7f5f18071550 2022-08-10T17:54:31.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.098+0000 7f5f15d9b700 1 -- 172.21.15.150:0/1887052028 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00011d40 con 0x7f5f18071550 2022-08-10T17:54:31.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.099+0000 7f5f1d11c700 1 -- 172.21.15.150:0/1887052028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18071550 msgr2=0x7f5f180c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.099+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18071550 0x7f5f180c6fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009780 tx=0x7f5f00009a90 comp rx=0 tx=0).stop 2022-08-10T17:54:31.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.110+0000 7f5f1d11c700 1 -- 172.21.15.150:0/1887052028 shutdown_connections 2022-08-10T17:54:31.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.110+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18071550 0x7f5f180c6fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.110+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/1887052028 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f180c4420 0x7f5f1815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.110+0000 7f5f1d11c700 1 -- 172.21.15.150:0/1887052028 >> 172.21.15.150:0/1887052028 conn(0x7f5f1806d0d0 msgr2=0x7f5f180c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:31.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.115+0000 7f5f1d11c700 1 -- 172.21.15.150:0/1887052028 shutdown_connections 2022-08-10T17:54:31.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.115+0000 7f5f1d11c700 1 -- 172.21.15.150:0/1887052028 wait complete. 2022-08-10T17:54:31.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.117+0000 7f5f1d11c700 1 Processor -- start 2022-08-10T17:54:31.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.117+0000 7f5f1d11c700 1 -- start start 2022-08-10T17:54:31.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f18071550 0x7f5f18144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180c4420 0x7f5f18147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 0x7f5f18147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18144360 con 0x7f5f180c4420 2022-08-10T17:54:31.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1813f1a0 con 0x7f5f1815ef40 2022-08-10T17:54:31.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.118+0000 7f5f1d11c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18143700 con 0x7f5f18071550 2022-08-10T17:54:31.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.119+0000 7f5f16d9d700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f18071550 msgr2=0x7f5f18144e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:31.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.119+0000 7f5f16d9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f18071550 0x7f5f18144e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:31.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.119+0000 7f5f1759e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 0x7f5f18147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.119+0000 7f5f1759e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 0x7f5f18147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:55598/0 (socket says 172.21.15.150:55598) 2022-08-10T17:54:31.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.119+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 learned_addr learned my addr 172.21.15.150:0/2323789767 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:31.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f18071550 msgr2=0x7f5f18144e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:31.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f5f18071550 0x7f5f18144e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180c4420 msgr2=0x7f5f18147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f180c4420 0x7f5f18147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000093e0 con 0x7f5f1815ef40 2022-08-10T17:54:31.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.120+0000 7f5f1759e700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 0x7f5f18147a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000b780 tx=0x7f5f1000bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.128+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011890 con 0x7f5f1815ef40 2022-08-10T17:54:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.128+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f100119f0 con 0x7f5f1815ef40 2022-08-10T17:54:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.128+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011da0 con 0x7f5f1815ef40 2022-08-10T17:54:31.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.128+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f181470c0 con 0x7f5f1815ef40 2022-08-10T17:54:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.128+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18143490 con 0x7f5f1815ef40 2022-08-10T17:54:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.129+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 0x7f5f18145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.129+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180672f0 con 0x7f5f18145990 2022-08-10T17:54:31.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.129+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 0x7f5f18145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f16d9d700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f181453a0 con 0x7f5f18145990 2022-08-10T17:54:31.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 0x7f5f18145d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009780 tx=0x7f5f000045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0001a830 con 0x7f5f18145990 2022-08-10T17:54:31.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f5f0001a990 con 0x7f5f18145990 2022-08-10T17:54:31.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 msgr2=0x7f5f18145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 0x7f5f18145d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009780 tx=0x7f5f000045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 msgr2=0x7f5f18145d60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:31.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.130+0000 7f5f0f7fe700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f18145990 0x7f5f18145d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.137+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f5f10017020 con 0x7f5f1815ef40 2022-08-10T17:54:31.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.137+0000 7f5f0f7fe700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5ef8064f20 0x7f5ef80673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.137+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5f10082610 con 0x7f5f1815ef40 2022-08-10T17:54:31.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.138+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5ef8064f20 0x7f5ef80673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.145+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 0x7f5ef0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.145+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0007c20 con 0x7f5ef00028f0 2022-08-10T17:54:31.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.146+0000 7f5f1659c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 0x7f5ef0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.146+0000 7f5f1659c700 1 -- 172.21.15.150:0/2323789767 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5ef0007de0 con 0x7f5ef00028f0 2022-08-10T17:54:31.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f1659c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 0x7f5ef0004d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f1814cd80 tx=0x7f5f0800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08003ae0 con 0x7f5ef00028f0 2022-08-10T17:54:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5021 (secure 0 0 0) 0x7f5f08003c40 con 0x7f5ef00028f0 2022-08-10T17:54:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 msgr2=0x7f5ef0004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 0x7f5ef0004d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f1814cd80 tx=0x7f5f0800b6a0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 msgr2=0x7f5ef0004d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:31.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.147+0000 7f5f0f7fe700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ef00028f0 0x7f5ef0004d80 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f1814cd80 tx=0x7f5f0800b6a0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:31.155 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:31.156 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:31.156 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:54:31.156 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 144, 2022-08-10T17:54:31.156 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:31.157 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:31.157 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:54:31.157 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.157 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:54:31.158 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:31.158 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:31.158 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:31.158 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.159 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.159 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.159 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.159 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.160 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.160 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.160 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.160 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.160 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.161 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:31.161 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:31.161 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.161 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.162 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.162 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.162 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.162 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.163 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.163 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.163 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.163 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.164 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:31.164 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:31.164 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:31.165 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:31.165 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:31.165 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:31.165 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:31.166 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:31.166 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:31.166 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:31.166 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:31.167 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:31.167 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:31.167 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:31.167 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:31.168 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:31.168 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.168 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.168 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.169 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.169 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.169 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.169 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.170 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.170 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.170 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.170 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:31.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.171 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:31.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.171 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:31.171 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:31.172 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.172 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.172 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.173 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:31.173 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.174 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.174 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:31.174 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.174 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.175 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.175 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:31.175 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:31.175 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.176 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.176 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.177 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:31.177 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:31.177 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.177 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.178 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.178 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:31.178 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.179 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.179 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:31.179 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.180 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.180 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.180 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:31.181 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:31.181 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.181 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.181 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.182 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:31.182 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:31.183 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.183 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.183 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.184 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:31.184 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.185 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.185 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:31.185 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.185 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.186 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:31.186 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:31.186 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.187 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.187 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.187 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.187 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.188 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:31.188 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:31.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.189 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.189 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.189 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:31.189 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.189 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.190 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:31.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.190 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.190 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.191 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:54:31.191 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.191 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.191 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:31.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.192 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.192 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.192 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:54:31.192 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.193 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.193 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:31.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.193 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:54:31.194 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.194 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:31.194 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.194 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.195 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.195 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.195 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:54:31.195 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.196 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.196 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:54:31.196 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.196 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.196 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.197 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:31.197 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.197 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.197 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.198 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:31.198 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:31.199 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.163+0000 7f5f16d9d700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5ef8064f20 0x7f5ef80673d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f180c41e0 tx=0x7f5f00021000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5ef8064f20 msgr2=0x7f5ef80673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f5ef8064f20 0x7f5ef80673d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f180c41e0 tx=0x7f5f00021000 comp rx=0 tx=0).stop 2022-08-10T17:54:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 msgr2=0x7f5f18147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1d11c700 1 --2- 172.21.15.150:0/2323789767 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5f1815ef40 0x7f5f18147a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000b780 tx=0x7f5f1000bb40 comp rx=0 tx=0).stop 2022-08-10T17:54:31.200 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 reap_dead start 2022-08-10T17:54:31.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.182+0000 7f5f1759e700 1 -- 172.21.15.150:0/2323789767 reap_dead start 2022-08-10T17:54:31.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.184+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 shutdown_connections 2022-08-10T17:54:31.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.184+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 >> 172.21.15.150:0/2323789767 conn(0x7f5f1806d0d0 msgr2=0x7f5f18071920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:31.201 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.184+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 shutdown_connections 2022-08-10T17:54:31.202 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.184+0000 7f5f1d11c700 1 -- 172.21.15.150:0/2323789767 wait complete. 2022-08-10T17:54:31.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:54:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.661+0000 7f9d7945b700 1 Processor -- start 2022-08-10T17:54:31.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.671+0000 7f9d7945b700 1 -- start start 2022-08-10T17:54:31.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d7945b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d7406d9c0 0x7f9d740c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d7945b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7414d250 con 0x7f9d740c8950 2022-08-10T17:54:31.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d7945b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406a910 con 0x7f9d740c3340 2022-08-10T17:54:31.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d7945b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d740c37b0 con 0x7f9d7406d9c0 2022-08-10T17:54:31.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d7406d9c0 0x7f9d740c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d7406d9c0 0x7f9d740c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45018/0 (socket says 172.21.15.150:45018) 2022-08-10T17:54:31.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 -- 172.21.15.150:0/1472924437 learned_addr learned my addr 172.21.15.150:0/1472924437 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:31.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 -- 172.21.15.150:0/1472924437 >> v1:172.21.15.197:6789/0 conn(0x7f9d740c3340 legacy=0x7f9d74153470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:31.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 -- 172.21.15.150:0/1472924437 >> v1:172.21.15.150:6789/0 conn(0x7f9d740c8950 legacy=0x7f9d7406df10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:31.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.673+0000 7f9d72ffd700 1 -- 172.21.15.150:0/1472924437 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740c98c0 con 0x7f9d7406d9c0 2022-08-10T17:54:31.680 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.674+0000 7f9d72ffd700 1 --2- 172.21.15.150:0/1472924437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d740c2250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d68006fd0 tx=0x7f9d68009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2199bce3621b75a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.682+0000 7f9d71ffb700 1 -- 172.21.15.150:0/1472924437 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68004230 con 0x7f9d7406d9c0 2022-08-10T17:54:31.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.682+0000 7f9d71ffb700 1 -- 172.21.15.150:0/1472924437 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68004390 con 0x7f9d7406d9c0 2022-08-10T17:54:31.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.682+0000 7f9d71ffb700 1 -- 172.21.15.150:0/1472924437 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011870 con 0x7f9d7406d9c0 2022-08-10T17:54:31.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.683+0000 7f9d7945b700 1 -- 172.21.15.150:0/1472924437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 msgr2=0x7f9d740c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.683+0000 7f9d7945b700 1 --2- 172.21.15.150:0/1472924437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d740c2250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d68006fd0 tx=0x7f9d68009a60 comp rx=0 tx=0).stop 2022-08-10T17:54:31.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.709+0000 7f9d7945b700 1 -- 172.21.15.150:0/1472924437 shutdown_connections 2022-08-10T17:54:31.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.709+0000 7f9d7945b700 1 --2- 172.21.15.150:0/1472924437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d740c2250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.709+0000 7f9d7945b700 1 -- 172.21.15.150:0/1472924437 >> 172.21.15.150:0/1472924437 conn(0x7f9d7406b500 msgr2=0x7f9d7406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:31.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.709+0000 7f9d7945b700 1 -- 172.21.15.150:0/1472924437 shutdown_connections 2022-08-10T17:54:31.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.709+0000 7f9d7945b700 1 -- 172.21.15.150:0/1472924437 wait complete. 2022-08-10T17:54:31.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.711+0000 7f9d7945b700 1 Processor -- start 2022-08-10T17:54:31.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.711+0000 7f9d7945b700 1 -- start start 2022-08-10T17:54:31.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d7414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d740c3340 0x7f9d7414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9d740c8950 0x7f9d740bb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7413fe90 con 0x7f9d7406d9c0 2022-08-10T17:54:31.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7413ee80 con 0x7f9d740c3340 2022-08-10T17:54:31.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d7945b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7413fa00 con 0x7f9d740c8950 2022-08-10T17:54:31.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d737fe700 1 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9d740c8950 msgr2=0x7f9d740bb940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.197:3301/0 2022-08-10T17:54:31.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.712+0000 7f9d737fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9d740c8950 0x7f9d740bb940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:31.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.722+0000 7f9d727fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d740c3340 0x7f9d7414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.726+0000 7f9d727fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d740c3340 0x7f9d7414ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:55616/0 (socket says 172.21.15.150:55616) 2022-08-10T17:54:31.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.727+0000 7f9d727fc700 1 -- 172.21.15.150:0/766490763 learned_addr learned my addr 172.21.15.150:0/766490763 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:31.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.728+0000 7f9d72ffd700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d7414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.732 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9d740c8950 msgr2=0x7f9d740bb940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f9d740c8950 0x7f9d740bb940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d740c3340 msgr2=0x7f9d7414ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.733 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d740c3340 0x7f9d7414ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680093e0 con 0x7f9d7406d9c0 2022-08-10T17:54:31.734 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.729+0000 7f9d72ffd700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d7414d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d68013000 tx=0x7f9d680045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.730+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011d60 con 0x7f9d7406d9c0 2022-08-10T17:54:31.735 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.730+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68003520 con 0x7f9d7406d9c0 2022-08-10T17:54:31.736 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.730+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680038d0 con 0x7f9d7406d9c0 2022-08-10T17:54:31.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.731+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d741f0780 con 0x7f9d7406d9c0 2022-08-10T17:54:31.741 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.731+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7413f3b0 con 0x7f9d7406d9c0 2022-08-10T17:54:31.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.734+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f9d6800f050 con 0x7f9d7406d9c0 2022-08-10T17:54:31.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.735+0000 7f9d5b7fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9d60065260 0x7f9d60067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.742 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.735+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f9d68082a00 con 0x7f9d7406d9c0 2022-08-10T17:54:31.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.735+0000 7f9d7945b700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 0x7f9d54004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.735+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54007d90 con 0x7f9d54002a40 2022-08-10T17:54:31.743 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.739+0000 7f9d737fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 0x7f9d54004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.746+0000 7f9d727fc700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9d60065260 0x7f9d60067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.746+0000 7f9d737fe700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d54007f50 con 0x7f9d54002a40 2022-08-10T17:54:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.749+0000 7f9d737fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 0x7f9d54004ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b310 tx=0x7f9d6400b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64005270 con 0x7f9d54002a40 2022-08-10T17:54:31.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f9d640053d0 con 0x7f9d54002a40 2022-08-10T17:54:31.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 msgr2=0x7f9d54004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 0x7f9d54004ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b310 tx=0x7f9d6400b6d0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 msgr2=0x7f9d54004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:31.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.757+0000 7f9d5b7fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54002a40 0x7f9d54004ef0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b310 tx=0x7f9d6400b6d0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.764+0000 7f9d727fc700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9d60065260 0x7f9d60067710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e200 tx=0x7f9d6c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.780+0000 7f9d7945b700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 0x7f9d540072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:31.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.780+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54007910 con 0x7f9d54006e30 2022-08-10T17:54:31.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.781+0000 7f9d737fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 0x7f9d540072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:31.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.781+0000 7f9d737fe700 1 -- 172.21.15.150:0/766490763 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9d54007ad0 con 0x7f9d54006e30 2022-08-10T17:54:31.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.781+0000 7f9d737fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 0x7f9d540072b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d64013000 tx=0x7f9d64005820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:31.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64012890 con 0x7f9d54006e30 2022-08-10T17:54:31.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4706 (secure 0 0 0) 0x7f9d640129f0 con 0x7f9d54006e30 2022-08-10T17:54:31.787 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 msgr2=0x7f9d540072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 0x7f9d540072b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d64013000 tx=0x7f9d64005820 comp rx=0 tx=0).stop 2022-08-10T17:54:31.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 msgr2=0x7f9d540072b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:54:31.788 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.782+0000 7f9d5b7fe700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f9d54006e30 0x7f9d540072b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.789 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:54:31.789 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:31.789 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:31.790 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:54:31.790 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 144, 2022-08-10T17:54:31.790 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:54:31.790 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:54:31.791 INFO:teuthology.orchestra.run.smithi150.stdout: 1 2022-08-10T17:54:31.791 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.791 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 1, 2022-08-10T17:54:31.792 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:31.792 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:54:31.792 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:54:31.792 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.793 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.793 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.793 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.793 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.794 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.794 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.794 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.794 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.795 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.795 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:54:31.795 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:54:31.796 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.796 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.796 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.796 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.797 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.797 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.797 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.797 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.798 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.798 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.798 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.798 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:54:31.799 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:54:31.799 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:54:31.799 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:54:31.799 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:54:31.800 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:54:31.800 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:31.801 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:54:31.801 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:54:31.801 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:54:31.801 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:54:31.802 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:54:31.802 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:54:31.802 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:54:31.802 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:54:31.803 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:54:31.803 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:54:31.803 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:54:31.803 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:54:31.804 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:54:31.804 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:54:31.804 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:54:31.805 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:54:31.805 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:54:31.805 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:54:31.805 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.805 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:54:31.806 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.806 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:54:31.806 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.806 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:54:31.807 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:54:31.807 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.807 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.807 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.808 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.808 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:54:31.808 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.808 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.809 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.809 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.809 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:54:31.809 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.809 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.810 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.810 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.810 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:54:31.810 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:54:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.812 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.812 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:54:31.812 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:54:31.812 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.813 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.813 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.813 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.813 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:54:31.813 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.814 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.814 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.814 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:54:31.815 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.815 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.815 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.815 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.816 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:54:31.816 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:54:31.816 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.816 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.817 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.817 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.817 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:54:31.817 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:54:31.818 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:54:31.818 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:54:31.818 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.818 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:54:31.819 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:54:31.819 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.819 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.819 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.820 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:54:31.820 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:54:31.820 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:54:31.820 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.821 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.821 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.821 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:54:31.821 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:54:31.822 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:54:31.822 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:54:31.822 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:54:31.822 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.823 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.823 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:54:31.823 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:54:31.824 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.824 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.824 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.824 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:54:31.825 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.825 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.825 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:54:31.825 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.825 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.826 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.826 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:31.826 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.826 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.827 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:54:31.827 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.827 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.827 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.828 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:54:31.828 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.828 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:54:31.828 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:54:31.829 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:54:31.829 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:54:31.829 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:54:31.829 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:54:31.829 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:54:31.830 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:54:31.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:54:31.830 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:54:31.830 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:54:31.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9d60065260 msgr2=0x7f9d60067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.832 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f9d60065260 0x7f9d60067710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e200 tx=0x7f9d6c00b040 comp rx=0 tx=0).stop 2022-08-10T17:54:31.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 msgr2=0x7f9d7414d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:31.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 --2- 172.21.15.150:0/766490763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d7406d9c0 0x7f9d7414d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d68013000 tx=0x7f9d680045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:31.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d737fe700 1 -- 172.21.15.150:0/766490763 reap_dead start 2022-08-10T17:54:31.833 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 shutdown_connections 2022-08-10T17:54:31.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.783+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 >> 172.21.15.150:0/766490763 conn(0x7f9d7406b500 msgr2=0x7f9d740c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:31.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.786+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 shutdown_connections 2022-08-10T17:54:31.834 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:31.786+0000 7f9d7945b700 1 -- 172.21.15.150:0/766490763 wait complete. 2022-08-10T17:54:31.835 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2022-08-10T17:54:51.835 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2022-08-10T17:54:51.836 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2022-08-10T17:54:51.837 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-10T17:54:51.837 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-10T17:54:51.840 INFO:tasks.ceph.mon.c:Started 2022-08-10T17:54:51.841 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:54:51.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:51.984 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.971+0000 7fee66cd5700 1 Processor -- start 2022-08-10T17:54:51.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.971+0000 7fee66cd5700 1 -- start start 2022-08-10T17:54:51.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee60150800 0x7fee600699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fee60150bd0 0x7fee601572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6015ab00 con 0x7fee60150800 2022-08-10T17:54:51.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60157820 con 0x7fee60150bd0 2022-08-10T17:54:51.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee66cd5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6006a050 con 0x7fee600c6540 2022-08-10T17:54:51.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee64a71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee60150800 0x7fee600699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee64a71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee60150800 0x7fee600699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45160/0 (socket says 172.21.15.150:45160) 2022-08-10T17:54:51.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee64a71700 1 -- 172.21.15.150:0/2927836244 learned_addr learned my addr 172.21.15.150:0/2927836244 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:51.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee5ffff700 1 --2- 172.21.15.150:0/2927836244 >> v2:172.21.15.197:3300/0 conn(0x7fee60150bd0 0x7fee601572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.972+0000 7fee65272700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee65272700 1 -- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee600c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:51.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee65272700 1 -- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee600c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:51.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee65272700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:51.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee65272700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:51.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 -- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee600c69e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:54:51.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 -- 172.21.15.150:0/2927836244 >> v2:172.21.15.197:3300/0 conn(0x7fee60150bd0 msgr2=0x7fee601572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:54:51.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 --2- 172.21.15.150:0/2927836244 >> v2:172.21.15.197:3300/0 conn(0x7fee60150bd0 0x7fee601572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 -- 172.21.15.150:0/2927836244 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60159ef0 con 0x7fee60150800 2022-08-10T17:54:51.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee64a71700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee600699e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee6008a160 tx=0x7fee54009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715fc6cc486bd927 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:51.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee5f7fe700 1 -- 172.21.15.150:0/2927836244 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54004230 con 0x7fee60150800 2022-08-10T17:54:51.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee5f7fe700 1 -- 172.21.15.150:0/2927836244 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54004390 con 0x7fee60150800 2022-08-10T17:54:51.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee5f7fe700 1 -- 172.21.15.150:0/2927836244 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011850 con 0x7fee60150800 2022-08-10T17:54:51.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 -- 172.21.15.150:0/2927836244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 msgr2=0x7fee600699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:51.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee600699e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee6008a160 tx=0x7fee54009a60 comp rx=0 tx=0).stop 2022-08-10T17:54:51.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 -- 172.21.15.150:0/2927836244 shutdown_connections 2022-08-10T17:54:51.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee600c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 --2- 172.21.15.150:0/2927836244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee600699e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 --2- 172.21.15.150:0/2927836244 >> v2:172.21.15.197:3300/0 conn(0x7fee60150bd0 0x7fee601572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 -- 172.21.15.150:0/2927836244 >> 172.21.15.150:0/2927836244 conn(0x7fee60071e40 msgr2=0x7fee600692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:51.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.973+0000 7fee66cd5700 1 -- 172.21.15.150:0/2927836244 shutdown_connections 2022-08-10T17:54:51.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.974+0000 7fee66cd5700 1 -- 172.21.15.150:0/2927836244 wait complete. 2022-08-10T17:54:51.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.975+0000 7fee66cd5700 1 Processor -- start 2022-08-10T17:54:51.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.975+0000 7fee66cd5700 1 -- start start 2022-08-10T17:54:51.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.975+0000 7fee66cd5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fee60151af0 0x7fee60153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:51.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee60153890 con 0x7fee60150800 2022-08-10T17:54:51.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee601513f0 con 0x7fee60151af0 2022-08-10T17:54:51.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6014da50 con 0x7fee600c6540 2022-08-10T17:54:51.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45166/0 (socket says 172.21.15.150:45166) 2022-08-10T17:54:51.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 -- 172.21.15.150:0/4232057367 learned_addr learned my addr 172.21.15.150:0/4232057367 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:51.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee64a71700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee65272700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fee60151af0 0x7fee60153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:51.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee64a71700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee601ec340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-08-10T17:54:51.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee64a71700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee601ec340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:54:51.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee64a71700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:51.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee64a71700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:51.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 msgr2=0x7fee601ec340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:51.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:51.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fee60151af0 msgr2=0x7fee60153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fee60151af0 0x7fee60153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 -- 172.21.15.150:0/4232057367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540093e0 con 0x7fee60150800 2022-08-10T17:54:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5ffff700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e8a0 tx=0x7fee4c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:52.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c009400 con 0x7fee60150800 2022-08-10T17:54:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c013680 con 0x7fee60150800 2022-08-10T17:54:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee600c9d50 con 0x7fee60150800 2022-08-10T17:54:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0139f0 con 0x7fee60150800 2022-08-10T17:54:52.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.976+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee600c9fa0 con 0x7fee60150800 2022-08-10T17:54:52.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.977+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60072890 con 0x7fee60150800 2022-08-10T17:54:52.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.978+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fee4c019030 con 0x7fee60150800 2022-08-10T17:54:52.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.978+0000 7fee5d7fa700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 0x7fee48067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:52.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.978+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fee4c081d70 con 0x7fee60150800 2022-08-10T17:54:52.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.978+0000 7fee64a71700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 0x7fee48067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:52.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.979+0000 7fee64a71700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 0x7fee48067560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee54009fd0 tx=0x7fee54008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:52.004 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:51.982+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fee4c04fd50 con 0x7fee60150800 2022-08-10T17:54:52.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.237+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fee6015a1d0 con 0x7fee60150800 2022-08-10T17:54:52.241 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.237+0000 7fee5d7fa700 1 -- 172.21.15.150:0/4232057367 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7fee4c021600 con 0x7fee60150800 2022-08-10T17:54:52.242 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:52.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 msgr2=0x7fee48067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:52.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 0x7fee48067560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee54009fd0 tx=0x7fee54008030 comp rx=0 tx=0).stop 2022-08-10T17:54:52.244 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 msgr2=0x7fee6014d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:52.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e8a0 tx=0x7fee4c00ebb0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 shutdown_connections 2022-08-10T17:54:52.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fee60151af0 0x7fee60153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fee480650b0 0x7fee48067560 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fee600c6540 0x7fee601ec340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 --2- 172.21.15.150:0/4232057367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60150800 0x7fee6014d510 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:52.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.239+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 >> 172.21.15.150:0/4232057367 conn(0x7fee60071e40 msgr2=0x7fee6014f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:52.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.240+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 shutdown_connections 2022-08-10T17:54:52.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:52.240+0000 7fee66cd5700 1 -- 172.21.15.150:0/4232057367 wait complete. 2022-08-10T17:54:55.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:55.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.378+0000 7fc82bb9e700 1 Processor -- start 2022-08-10T17:54:55.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.378+0000 7fc82bb9e700 1 -- start start 2022-08-10T17:54:55.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82bb9e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fc824150f50 0x7fc824156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82bb9e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824070620 con 0x7fc824150b80 2022-08-10T17:54:55.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82bb9e700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8240ca810 con 0x7fc8240c7d80 2022-08-10T17:54:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82bb9e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8240c5ac0 con 0x7fc824150f50 2022-08-10T17:54:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82993a700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc824150b80 0x7fc8240c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57860/0 (socket says 172.21.15.150:57860) 2022-08-10T17:54:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc82993a700 1 -- 172.21.15.150:0/3903155739 learned_addr learned my addr 172.21.15.150:0/3903155739 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:55.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc829139700 1 --2- 172.21.15.150:0/3903155739 >> v2:172.21.15.197:3300/0 conn(0x7fc824150f50 0x7fc824156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349478073 0 0) 0x7fc824070620 con 0x7fc824150b80 2022-08-10T17:54:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc80c003430 con 0x7fc824150b80 2022-08-10T17:54:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228284981 0 0) 0x7fc8240ca810 con 0x7fc8240c7d80 2022-08-10T17:54:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824070620 con 0x7fc8240c7d80 2022-08-10T17:54:55.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc829139700 1 -- 172.21.15.150:0/3903155739 >> v1:172.21.15.197:6789/0 conn(0x7fc8240c7d80 legacy=0x7fc8241611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc829139700 1 -- 172.21.15.150:0/3903155739 >> v1:172.21.15.150:6789/0 conn(0x7fc824150b80 legacy=0x7fc8240c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.379+0000 7fc829139700 1 -- 172.21.15.150:0/3903155739 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824070010 con 0x7fc824150f50 2022-08-10T17:54:55.394 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc829139700 1 --2- 172.21.15.150:0/3903155739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc824150f50 0x7fc824156cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8140096b0 tx=0x7fc8140099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aede11fa2f66e0d3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140107b0 con 0x7fc824150f50 2022-08-10T17:54:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814010910 con 0x7fc824150f50 2022-08-10T17:54:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc828938700 1 -- 172.21.15.150:0/3903155739 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814010cc0 con 0x7fc824150f50 2022-08-10T17:54:55.395 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 -- 172.21.15.150:0/3903155739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc824150f50 msgr2=0x7fc824156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/3903155739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc824150f50 0x7fc824156cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8140096b0 tx=0x7fc8140099c0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 -- 172.21.15.150:0/3903155739 shutdown_connections 2022-08-10T17:54:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/3903155739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc824150f50 0x7fc824156cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.396 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 -- 172.21.15.150:0/3903155739 >> 172.21.15.150:0/3903155739 conn(0x7fc824071e40 msgr2=0x7fc82406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 -- 172.21.15.150:0/3903155739 shutdown_connections 2022-08-10T17:54:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.380+0000 7fc82bb9e700 1 -- 172.21.15.150:0/3903155739 wait complete. 2022-08-10T17:54:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.381+0000 7fc82bb9e700 1 Processor -- start 2022-08-10T17:54:55.397 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 -- start start 2022-08-10T17:54:55.401 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 0x7fc82414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:55.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:55.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:55.402 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824159630 con 0x7fc824150b80 2022-08-10T17:54:55.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241ec180 con 0x7fc8240c7d80 2022-08-10T17:54:55.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82bb9e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241ec440 con 0x7fc824150f50 2022-08-10T17:54:55.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc829139700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:55.403 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc829139700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45188/0 (socket says 172.21.15.150:45188) 2022-08-10T17:54:55.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82993a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 0x7fc82414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:55.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc829139700 1 -- 172.21.15.150:0/1502477153 learned_addr learned my addr 172.21.15.150:0/1502477153 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:54:55.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.382+0000 7fc82a13b700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:55.404 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82a13b700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 msgr2=0x7fc824158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:54:55.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82a13b700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 msgr2=0x7fc824158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:54:55.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82a13b700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:55.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82a13b700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:55.405 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 msgr2=0x7fc824158cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:54:55.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 msgr2=0x7fc82414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 0x7fc82414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.406 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 -- 172.21.15.150:0/1502477153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009310 con 0x7fc824150b80 2022-08-10T17:54:55.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82993a700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 0x7fc82414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:54:55.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc829139700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc814013040 tx=0x7fc8140045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:55.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814010a80 con 0x7fc824150b80 2022-08-10T17:54:55.407 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81401f070 con 0x7fc824150b80 2022-08-10T17:54:55.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8241ec720 con 0x7fc824150b80 2022-08-10T17:54:55.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814026480 con 0x7fc824150b80 2022-08-10T17:54:55.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.383+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8241ecce0 con 0x7fc824150b80 2022-08-10T17:54:55.408 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.384+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc824069060 con 0x7fc824150b80 2022-08-10T17:54:55.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.384+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fc81400f070 con 0x7fc824150b80 2022-08-10T17:54:55.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.385+0000 7fc8127fc700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 0x7fc804067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:55.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.385+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fc814021070 con 0x7fc824150b80 2022-08-10T17:54:55.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.385+0000 7fc82993a700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 0x7fc804067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:55.409 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.385+0000 7fc82993a700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 0x7fc804067590 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc820007fd0 tx=0x7fc820007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:54:55.410 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.389+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fc814051af0 con 0x7fc824150b80 2022-08-10T17:54:55.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.647+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc824068d80 con 0x7fc824150b80 2022-08-10T17:54:55.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.647+0000 7fc8127fc700 1 -- 172.21.15.150:0/1502477153 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1514 (secure 0 0 0) 0x7fc814055110 con 0x7fc824150b80 2022-08-10T17:54:55.651 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:54:55.653 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 msgr2=0x7fc804067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 0x7fc804067590 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc820007fd0 tx=0x7fc820007c80 comp rx=0 tx=0).stop 2022-08-10T17:54:55.654 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 msgr2=0x7fc824158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:54:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc814013040 tx=0x7fc8140045d0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 shutdown_connections 2022-08-10T17:54:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fc8040650e0 0x7fc804067590 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fc824150f50 0x7fc824158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.655 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fc8240c7d80 0x7fc82414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 --2- 172.21.15.150:0/1502477153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc824150b80 0x7fc824158780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:54:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.649+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 >> 172.21.15.150:0/1502477153 conn(0x7fc824071e40 msgr2=0x7fc8240c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:54:55.656 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.650+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 shutdown_connections 2022-08-10T17:54:55.657 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:55.650+0000 7fc82bb9e700 1 -- 172.21.15.150:0/1502477153 wait complete. 2022-08-10T17:54:58.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:54:58.791 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.784+0000 7facbdd2e700 1 Processor -- start 2022-08-10T17:54:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.784+0000 7facbdd2e700 1 -- start start 2022-08-10T17:54:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facbdd2e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:58.792 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facbdd2e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:54:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facbdd2e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb815ae50 con 0x7facb80c4330 2022-08-10T17:54:58.793 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facbdd2e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb80c7cf0 con 0x7facb80c8a20 2022-08-10T17:54:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facbdd2e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c7f90 con 0x7facb80c4700 2022-08-10T17:54:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb77fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7facb80c4330 0x7facb8068eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57876/0 (socket says 172.21.15.150:57876) 2022-08-10T17:54:58.794 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb77fe700 1 -- 172.21.15.150:0/818904763 learned_addr learned my addr 172.21.15.150:0/818904763 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:54:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:58.795 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:58.796 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:58.797 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.785+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:54:58.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:58.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:58.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:58.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:54:58.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:58.986+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-08-10T17:54:59.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:59.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:54:59.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:54:59.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:54:59.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:59.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:54:59.392 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:59.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:54:59.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:54:59.393 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:54:59.387+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-08-10T17:55:00.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-08-10T17:55:00.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-08-10T17:55:00.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb6ffd700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:55:00.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-08-10T17:55:00.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:55:00.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:55:00.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:55:00.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.188+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-08-10T17:55:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857946435 0 0) 0x7facb815ae50 con 0x7facb80c4330 2022-08-10T17:55:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca4003430 con 0x7facb80c4330 2022-08-10T17:55:00.859 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3827804893 0 0) 0x7faca4003430 con 0x7facb80c4330 2022-08-10T17:55:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7facb8150880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:55:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7facb8150880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 msgr2=0x7facb80cda00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-08-10T17:55:00.860 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 --2- 172.21.15.150:0/818904763 >> v2:172.21.15.197:3300/0 conn(0x7facb80c8a20 0x7facb80cda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb815a090 con 0x7facb80c4330 2022-08-10T17:55:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7faca8001670 con 0x7facb80c4330 2022-08-10T17:55:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.853+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 >> v1:172.21.15.150:6789/0 conn(0x7facb80c4330 legacy=0x7facb8068eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:00.861 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7faca4003880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4003f00 0x7faca40046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca4004c10 0x7faca4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.862 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c7cf0 con 0x7faca4004c10 2022-08-10T17:55:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c7f90 con 0x7faca4003f00 2022-08-10T17:55:00.863 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca400ba80 con 0x7facb80c4700 2022-08-10T17:55:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca4004c10 0x7faca4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4003f00 0x7faca40046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.864 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb77fe700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7faca4003880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 msgr2=0x7faca4003880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb80c4700 0x7faca4003880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4003f00 msgr2=0x7faca40046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:00.865 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4003f00 0x7faca40046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4003430 con 0x7faca4004c10 2022-08-10T17:55:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb6ffd700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4003f00 0x7faca40046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:00.866 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.854+0000 7facb7fff700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca4004c10 0x7faca4005080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7facb0009610 tx=0x7faca4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22433d7d4fe76393 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:00.871 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0009d30 con 0x7faca4004c10 2022-08-10T17:55:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000f040 con 0x7faca4004c10 2022-08-10T17:55:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facb67fc700 1 -- 172.21.15.150:0/818904763 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00166a0 con 0x7faca4004c10 2022-08-10T17:55:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facbdd2e700 1 -- 172.21.15.150:0/818904763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca4004c10 msgr2=0x7faca4005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:00.872 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facbdd2e700 1 --2- 172.21.15.150:0/818904763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca4004c10 0x7faca4005080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7facb0009610 tx=0x7faca4005700 comp rx=0 tx=0).stop 2022-08-10T17:55:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.856+0000 7facb7fff700 1 -- 172.21.15.150:0/818904763 reap_dead start 2022-08-10T17:55:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.857+0000 7facbdd2e700 1 -- 172.21.15.150:0/818904763 shutdown_connections 2022-08-10T17:55:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.857+0000 7facbdd2e700 1 -- 172.21.15.150:0/818904763 >> 172.21.15.150:0/818904763 conn(0x7facb80ccef0 msgr2=0x7facb80cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:00.873 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.857+0000 7facbdd2e700 1 -- 172.21.15.150:0/818904763 shutdown_connections 2022-08-10T17:55:00.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.857+0000 7facbdd2e700 1 -- 172.21.15.150:0/818904763 wait complete. 2022-08-10T17:55:00.874 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.858+0000 7facbdd2e700 1 Processor -- start 2022-08-10T17:55:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.858+0000 7facbdd2e700 1 -- start start 2022-08-10T17:55:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4004c10 0x7facb80c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.875 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb814efd0 con 0x7facb80c1700 2022-08-10T17:55:00.876 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8159c70 con 0x7faca4004c10 2022-08-10T17:55:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facbdd2e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb8149750 con 0x7facb8159740 2022-08-10T17:55:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45222/0 (socket says 172.21.15.150:45222) 2022-08-10T17:55:00.878 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 -- 172.21.15.150:0/3158504224 learned_addr learned my addr 172.21.15.150:0/3158504224 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb7fff700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb77fe700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4004c10 0x7facb80c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb7fff700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 msgr2=0x7facb8149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-08-10T17:55:00.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb7fff700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 msgr2=0x7facb8149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-08-10T17:55:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb7fff700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-08-10T17:55:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb7fff700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-08-10T17:55:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 msgr2=0x7facb8149210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-08-10T17:55:00.880 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4004c10 msgr2=0x7facb80c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4004c10 0x7facb80c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 -- 172.21.15.150:0/3158504224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb814ea10 con 0x7facb80c1700 2022-08-10T17:55:00.881 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.859+0000 7facb6ffd700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7facac016a90 tx=0x7facac016da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.860+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac014900 con 0x7facb80c1700 2022-08-10T17:55:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.860+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac01b070 con 0x7facb80c1700 2022-08-10T17:55:00.882 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.860+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb814ecf0 con 0x7facb80c1700 2022-08-10T17:55:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.860+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac014c60 con 0x7facb80c1700 2022-08-10T17:55:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.860+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80c33d0 con 0x7facb80c1700 2022-08-10T17:55:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.861+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80c3740 con 0x7facb80c1700 2022-08-10T17:55:00.883 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.861+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7facac026020 con 0x7facb80c1700 2022-08-10T17:55:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.861+0000 7fac9ffff700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 0x7fac98067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.861+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7facac082f40 con 0x7facb80c1700 2022-08-10T17:55:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.861+0000 7facb77fe700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 0x7fac98067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:00.884 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.862+0000 7facb77fe700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 0x7fac98067560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faca80017a0 tx=0x7faca8001e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:00.885 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:00.865+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7facac0b36b0 con 0x7facb80c1700 2022-08-10T17:55:01.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.120+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7facb80cda40 con 0x7facb80c1700 2022-08-10T17:55:01.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.120+0000 7fac9ffff700 1 -- 172.21.15.150:0/3158504224 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1513 (secure 0 0 0) 0x7facac050f20 con 0x7facb80c1700 2022-08-10T17:55:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":148,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:55:01.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.122+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 msgr2=0x7fac98067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:01.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 0x7fac98067560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faca80017a0 tx=0x7faca8001e00 comp rx=0 tx=0).stop 2022-08-10T17:55:01.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 msgr2=0x7facb81eb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:01.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7facac016a90 tx=0x7facac016da0 comp rx=0 tx=0).stop 2022-08-10T17:55:01.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 shutdown_connections 2022-08-10T17:55:01.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fac980650b0 0x7fac98067560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:01.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7facb8159740 0x7facb8149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:01.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faca4004c10 0x7facb80c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 --2- 172.21.15.150:0/3158504224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facb80c1700 0x7facb81eb9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 >> 172.21.15.150:0/3158504224 conn(0x7facb80ccef0 msgr2=0x7facb8150650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 shutdown_connections 2022-08-10T17:55:01.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:01.123+0000 7facbdd2e700 1 -- 172.21.15.150:0/3158504224 wait complete. 2022-08-10T17:55:04.140 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:55:04.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.259+0000 7f815e7f5700 1 Processor -- start 2022-08-10T17:55:04.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.259+0000 7f815e7f5700 1 -- start start 2022-08-10T17:55:04.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815e7f5700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f815806bea0 0x7f815806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815e7f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580c9f90 con 0x7f8158150aa0 2022-08-10T17:55:04.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815e7f5700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158156a70 con 0x7f815815a610 2022-08-10T17:55:04.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815e7f5700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815806c3d0 con 0x7f815806bea0 2022-08-10T17:55:04.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8157fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8158150aa0 0x7f8158159f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57910/0 (socket says 172.21.15.150:57910) 2022-08-10T17:55:04.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8157fff700 1 -- 172.21.15.150:0/2177633107 learned_addr learned my addr 172.21.15.150:0/2177633107 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:04.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815cd92700 1 --2- 172.21.15.150:0/2177633107 >> v2:172.21.15.197:3300/0 conn(0x7f815806bea0 0x7f815806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790466741 0 0) 0x7f81580c9f90 con 0x7f8158150aa0 2022-08-10T17:55:04.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8144003430 con 0x7f8158150aa0 2022-08-10T17:55:04.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662933223 0 0) 0x7f8158156a70 con 0x7f815815a610 2022-08-10T17:55:04.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81580c9f90 con 0x7f815815a610 2022-08-10T17:55:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815cd92700 1 -- 172.21.15.150:0/2177633107 >> v1:172.21.15.197:6789/0 conn(0x7f815815a610 legacy=0x7f815806f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815cd92700 1 -- 172.21.15.150:0/2177633107 >> v1:172.21.15.150:6789/0 conn(0x7f8158150aa0 legacy=0x7f8158159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.260+0000 7f815cd92700 1 -- 172.21.15.150:0/2177633107 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158156d50 con 0x7f815806bea0 2022-08-10T17:55:04.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815cd92700 1 --2- 172.21.15.150:0/2177633107 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f815806fdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8150009d90 tx=0x7f815000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=444ff95d2bb9f88d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000e070 con 0x7f815806bea0 2022-08-10T17:55:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000bb20 con 0x7f815806bea0 2022-08-10T17:55:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f8156ffd700 1 -- 172.21.15.150:0/2177633107 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150012430 con 0x7f815806bea0 2022-08-10T17:55:04.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 -- 172.21.15.150:0/2177633107 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 msgr2=0x7f815806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 --2- 172.21.15.150:0/2177633107 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f815806fdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8150009d90 tx=0x7f815000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 -- 172.21.15.150:0/2177633107 shutdown_connections 2022-08-10T17:55:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 --2- 172.21.15.150:0/2177633107 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f815806fdb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 -- 172.21.15.150:0/2177633107 >> 172.21.15.150:0/2177633107 conn(0x7f81580c92f0 msgr2=0x7f81580c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 -- 172.21.15.150:0/2177633107 shutdown_connections 2022-08-10T17:55:04.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.261+0000 7f815e7f5700 1 -- 172.21.15.150:0/2177633107 wait complete. 2022-08-10T17:55:04.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.263+0000 7f815e7f5700 1 Processor -- start 2022-08-10T17:55:04.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.263+0000 7f815e7f5700 1 -- start start 2022-08-10T17:55:04.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f8158157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8158150aa0 0x7f8158153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81581576f0 con 0x7f815815a610 2022-08-10T17:55:04.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158152f50 con 0x7f815806bea0 2022-08-10T17:55:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815e7f5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8158152640 con 0x7f8158150aa0 2022-08-10T17:55:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f8157fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f8158157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45240/0 (socket says 172.21.15.150:45240) 2022-08-10T17:55:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f8157fff700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f8158157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:55828/0 (socket says 172.21.15.150:55828) 2022-08-10T17:55:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 -- 172.21.15.150:0/3831750864 learned_addr learned my addr 172.21.15.150:0/3831750864 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f81577fe700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8158150aa0 0x7f8158153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 -- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8158150aa0 msgr2=0x7f8158153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8158150aa0 0x7f8158153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 -- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 msgr2=0x7f8158157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f8158157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 -- 172.21.15.150:0/3831750864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150009a70 con 0x7f815815a610 2022-08-10T17:55:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f815cd92700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8150013000 tx=0x7f8150004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.264+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150012430 con 0x7f815815a610 2022-08-10T17:55:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.265+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150020070 con 0x7f815815a610 2022-08-10T17:55:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.265+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81581ecba0 con 0x7f815815a610 2022-08-10T17:55:04.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.265+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815001ba50 con 0x7f815815a610 2022-08-10T17:55:04.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.265+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158152890 con 0x7f815815a610 2022-08-10T17:55:04.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.266+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158153090 con 0x7f815815a610 2022-08-10T17:55:04.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.266+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f815002e070 con 0x7f815815a610 2022-08-10T17:55:04.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.266+0000 7f8154ff9700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 0x7f8138067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.266+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8150022070 con 0x7f815815a610 2022-08-10T17:55:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.267+0000 7f8157fff700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 0x7f8138067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.267+0000 7f8157fff700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 0x7f8138067560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8148007fd0 tx=0x7f8148007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.271+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8158153090 con 0x7f815815a610 2022-08-10T17:55:04.530 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.528+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8158153090 con 0x7f815815a610 2022-08-10T17:55:04.531 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.528+0000 7f8154ff9700 1 -- 172.21.15.150:0/3831750864 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1519 (secure 0 0 0) 0x7f8158153090 con 0x7f815815a610 2022-08-10T17:55:04.531 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:55:04.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 msgr2=0x7f8138067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.533 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 0x7f8138067560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8148007fd0 tx=0x7f8148007c80 comp rx=0 tx=0).stop 2022-08-10T17:55:04.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 msgr2=0x7f81580c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8150013000 tx=0x7f8150004950 comp rx=0 tx=0).stop 2022-08-10T17:55:04.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 shutdown_connections 2022-08-10T17:55:04.534 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f815815a610 0x7f81580c8330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f815806bea0 0x7f8158157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f81380650b0 0x7f8138067560 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.535 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 --2- 172.21.15.150:0/3831750864 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8158150aa0 0x7f8158153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 >> 172.21.15.150:0/3831750864 conn(0x7f81580c92f0 msgr2=0x7f815814f370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 shutdown_connections 2022-08-10T17:55:04.536 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.530+0000 7f815e7f5700 1 -- 172.21.15.150:0/3831750864 wait complete. 2022-08-10T17:55:04.545 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:55:04.546 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2022-08-10T17:55:04.667 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.665+0000 7ff23faa1700 1 Processor -- start 2022-08-10T17:55:04.668 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.665+0000 7ff23faa1700 1 -- start start 2022-08-10T17:55:04.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23faa1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff23806d750 0x7ff2380c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23faa1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2381550a0 0x7ff238155540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.671 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23faa1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2380c6b10 con 0x7ff23806db20 2022-08-10T17:55:04.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23faa1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2380b0f80 con 0x7ff2381550a0 2022-08-10T17:55:04.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23faa1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23806b2f0 con 0x7ff23806d750 2022-08-10T17:55:04.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2381550a0 0x7ff238155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.672 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23d03c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff23806db20 0x7ff2380b0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57926/0 (socket says 172.21.15.150:57926) 2022-08-10T17:55:04.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23d03c700 1 -- 172.21.15.150:0/828995873 learned_addr learned my addr 172.21.15.150:0/828995873 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:04.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23d83d700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff23806d750 0x7ff2380c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 -- 172.21.15.150:0/828995873 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff23806d750 msgr2=0x7ff2380c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:04.673 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff23806d750 0x7ff2380c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 -- 172.21.15.150:0/828995873 >> v1:172.21.15.150:6789/0 conn(0x7ff23806db20 legacy=0x7ff2380b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 -- 172.21.15.150:0/828995873 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2380c6df0 con 0x7ff2381550a0 2022-08-10T17:55:04.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23e03e700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381550a0 0x7ff238155540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff230009d90 tx=0x7ff23000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddefcbd3dcb6e2a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.674 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.666+0000 7ff23c83b700 1 -- 172.21.15.150:0/828995873 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000e070 con 0x7ff2381550a0 2022-08-10T17:55:04.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23c83b700 1 -- 172.21.15.150:0/828995873 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000bb20 con 0x7ff2381550a0 2022-08-10T17:55:04.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23c83b700 1 -- 172.21.15.150:0/828995873 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230012430 con 0x7ff2381550a0 2022-08-10T17:55:04.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 -- 172.21.15.150:0/828995873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381550a0 msgr2=0x7ff238155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.675 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381550a0 0x7ff238155540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff230009d90 tx=0x7ff23000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:04.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 -- 172.21.15.150:0/828995873 shutdown_connections 2022-08-10T17:55:04.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381550a0 0x7ff238155540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.676 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 --2- 172.21.15.150:0/828995873 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff23806d750 0x7ff2380c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 -- 172.21.15.150:0/828995873 >> 172.21.15.150:0/828995873 conn(0x7ff238071e40 msgr2=0x7ff2380c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.677 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 -- 172.21.15.150:0/828995873 shutdown_connections 2022-08-10T17:55:04.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.667+0000 7ff23faa1700 1 -- 172.21.15.150:0/828995873 wait complete. 2022-08-10T17:55:04.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.668+0000 7ff23faa1700 1 Processor -- start 2022-08-10T17:55:04.678 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.668+0000 7ff23faa1700 1 -- start start 2022-08-10T17:55:04.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff23806d750 0x7ff2381e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 0x7ff2381def40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2381550a0 0x7ff23814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.684 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23814db30 con 0x7ff23806db20 2022-08-10T17:55:04.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381ec990 con 0x7ff23806d750 2022-08-10T17:55:04.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23faa1700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23814fa40 con 0x7ff2381550a0 2022-08-10T17:55:04.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d03c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 0x7ff2381def40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.685 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d03c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 0x7ff2381def40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45252/0 (socket says 172.21.15.150:45252) 2022-08-10T17:55:04.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d03c700 1 -- 172.21.15.150:0/40297560 learned_addr learned my addr 172.21.15.150:0/40297560 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:04.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23e03e700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2381550a0 0x7ff23814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d83d700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff23806d750 0x7ff2381e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.686 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d03c700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2381550a0 msgr2=0x7ff23814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.669+0000 7ff23d03c700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2381550a0 0x7ff23814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23d03c700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff23806d750 msgr2=0x7ff2381e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23d03c700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff23806d750 0x7ff2381e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.687 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23d03c700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff230009a70 con 0x7ff23806db20 2022-08-10T17:55:04.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23d03c700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 0x7ff2381def40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22800c3f0 tx=0x7ff22800c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280074e0 con 0x7ff23806db20 2022-08-10T17:55:04.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228007640 con 0x7ff23806db20 2022-08-10T17:55:04.688 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228005a00 con 0x7ff23806db20 2022-08-10T17:55:04.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23814fce0 con 0x7ff23806db20 2022-08-10T17:55:04.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.670+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2381ecec0 con 0x7ff23806db20 2022-08-10T17:55:04.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff23faa1700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 0x7ff23814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.689 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238072890 con 0x7ff2381dc700 2022-08-10T17:55:04.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff23d83d700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 0x7ff23814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff23d83d700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2380c2a40 con 0x7ff2381dc700 2022-08-10T17:55:04.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff23d83d700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 0x7ff23814b020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2340114c0 tx=0x7ff234011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.690 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.671+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234004230 con 0x7ff2381dc700 2022-08-10T17:55:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff234011ed0 con 0x7ff2381dc700 2022-08-10T17:55:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 msgr2=0x7ff23814b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 0x7ff23814b020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2340114c0 tx=0x7ff234011880 comp rx=0 tx=0).stop 2022-08-10T17:55:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 msgr2=0x7ff23814b020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:04.691 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2381dc700 0x7ff23814b020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff228019030 con 0x7ff23806db20 2022-08-10T17:55:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff218064df0 0x7ff2180672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff228081370 con 0x7ff23806db20 2022-08-10T17:55:04.692 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.672+0000 7ff23d83d700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff218064df0 0x7ff2180672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.673+0000 7ff23d83d700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff218064df0 0x7ff2180672a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff234008010 tx=0x7ff23400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff23faa1700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 0x7ff23814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23806a320 con 0x7ff23814bde0 2022-08-10T17:55:04.693 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff23e03e700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 0x7ff23814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff23e03e700 1 -- 172.21.15.150:0/40297560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff23806a950 con 0x7ff23814bde0 2022-08-10T17:55:04.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff23e03e700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 0x7ff23814c240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff230009d90 tx=0x7ff230004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230004250 con 0x7ff23814bde0 2022-08-10T17:55:04.694 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 <== mon.0 v2:172.21.15.150:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5032 (secure 0 0 0) 0x7ff2300043b0 con 0x7ff23814bde0 2022-08-10T17:55:04.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 msgr2=0x7ff23814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 0x7ff23814c240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff230009d90 tx=0x7ff230004950 comp rx=0 tx=0).stop 2022-08-10T17:55:04.695 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 msgr2=0x7ff23814c240 secure :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:04.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.679+0000 7ff2267fc700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23814bde0 0x7ff23814c240 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff230009d90 tx=0x7ff230004950 comp rx=0 tx=0).stop 2022-08-10T17:55:04.696 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:04.697 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:55:04.697 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:55:04.697 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "leader", 2022-08-10T17:55:04.697 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 150, 2022-08-10T17:55:04.698 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:55:04.698 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:55:04.698 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:55:04.698 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:55:04.699 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.699 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 2, 2022-08-10T17:55:04.699 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:04.699 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:55:04.700 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:55:04.700 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.700 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.700 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.701 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.701 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.702 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.702 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.702 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.703 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.703 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.703 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:55:04.703 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:55:04.704 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.704 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.704 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.705 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.705 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.706 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.706 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.707 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.707 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.708 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.709 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:55:04.709 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:55:04.710 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:55:04.710 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:55:04.711 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:55:04.711 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:55:04.712 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:04.712 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:04.712 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:55:04.713 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:55:04.713 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:55:04.713 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:55:04.713 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:55:04.714 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:55:04.714 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:04.714 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:55:04.715 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.715 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.715 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.715 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.716 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.716 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.716 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.716 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.717 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.717 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.717 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:55:04.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.718 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:55:04.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.718 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:55:04.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:55:04.719 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.719 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.719 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.720 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:55:04.720 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.721 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.721 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:55:04.721 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.721 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.722 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.723 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:55:04.724 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:55:04.724 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.725 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.725 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.727 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:55:04.727 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:55:04.727 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.727 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.728 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.729 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:55:04.729 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.730 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.730 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.730 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:55:04.730 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.731 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.731 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:55:04.732 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:55:04.732 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.732 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.733 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.733 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:55:04.734 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:55:04.734 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.734 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.735 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.735 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:55:04.735 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:55:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.737 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.737 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.737 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:55:04.738 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:55:04.738 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.738 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.738 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.739 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.739 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.739 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:55:04.740 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:55:04.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.740 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.740 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.741 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:55:04.741 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.741 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.742 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:55:04.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.742 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.742 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.743 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:55:04.743 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.743 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.744 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:55:04.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.744 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.744 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.744 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 6 2022-08-10T17:55:04.745 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.745 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.745 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:55:04.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.746 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x2f018fb87aa4aafe", 2022-08-10T17:55:04.746 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.746 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:55:04.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.747 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.747 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.748 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.748 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4 2022-08-10T17:55:04.748 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.748 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.749 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr": [ 2022-08-10T17:55:04.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.749 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.749 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.749 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:55:04.750 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.750 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.751 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:55:04.751 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:04.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff218064df0 msgr2=0x7ff2180672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff218064df0 0x7ff2180672a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff234008010 tx=0x7ff23400f000 comp rx=0 tx=0).stop 2022-08-10T17:55:04.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 msgr2=0x7ff2381def40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 --2- 172.21.15.150:0/40297560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff23806db20 0x7ff2381def40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22800c3f0 tx=0x7ff22800c700 comp rx=0 tx=0).stop 2022-08-10T17:55:04.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23e03e700 1 -- 172.21.15.150:0/40297560 reap_dead start 2022-08-10T17:55:04.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 shutdown_connections 2022-08-10T17:55:04.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 >> 172.21.15.150:0/40297560 conn(0x7ff238071e40 msgr2=0x7ff2380c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 shutdown_connections 2022-08-10T17:55:04.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.680+0000 7ff23faa1700 1 -- 172.21.15.150:0/40297560 wait complete. 2022-08-10T17:55:04.756 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2022-08-10T17:55:04.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.876+0000 7ff580586700 1 Processor -- start 2022-08-10T17:55:04.879 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.876+0000 7ff580586700 1 -- start start 2022-08-10T17:55:04.888 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff580586700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff57806e5e0 0x7ff5780c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff580586700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57806c730 con 0x7ff5780c3f20 2022-08-10T17:55:04.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff580586700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57806ba70 con 0x7ff5780c5050 2022-08-10T17:55:04.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff580586700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578157040 con 0x7ff57806e5e0 2022-08-10T17:55:04.889 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff57db21700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff5780c3f20 0x7ff57815f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57942/0 (socket says 172.21.15.150:57942) 2022-08-10T17:55:04.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff57db21700 1 -- 172.21.15.150:0/2869788580 learned_addr learned my addr 172.21.15.150:0/2869788580 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:04.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.877+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff57806e5e0 0x7ff5780c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.890 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904636263 0 0) 0x7ff57806c730 con 0x7ff5780c3f20 2022-08-10T17:55:04.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff560003430 con 0x7ff5780c3f20 2022-08-10T17:55:04.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1447587545 0 0) 0x7ff560003430 con 0x7ff5780c3f20 2022-08-10T17:55:04.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff57806e5e0 msgr2=0x7ff5780c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:04.891 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff57806e5e0 0x7ff5780c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 >> v1:172.21.15.197:6789/0 conn(0x7ff5780c5050 legacy=0x7ff57806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57806bd30 con 0x7ff5780c3f20 2022-08-10T17:55:04.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7ff574001670 con 0x7ff5780c3f20 2022-08-10T17:55:04.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 >> v1:172.21.15.150:6789/0 conn(0x7ff5780c3f20 legacy=0x7ff57815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.892 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5600038b0 0x7ff560003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600046d0 0x7ff560004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff560005080 0x7ff56000b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.893 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578157040 con 0x7ff5600046d0 2022-08-10T17:55:04.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56000bf10 con 0x7ff5600038b0 2022-08-10T17:55:04.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56000c0d0 con 0x7ff560005080 2022-08-10T17:55:04.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff57806e5e0 0x7ff5780c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:04.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600046d0 0x7ff560004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57e322700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5600038b0 0x7ff560003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff560005080 0x7ff56000b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 -- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff560005080 msgr2=0x7ff56000b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:04.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff560005080 0x7ff56000b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 -- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5600038b0 msgr2=0x7ff560003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:04.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5600038b0 0x7ff560003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.896 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.878+0000 7ff57db21700 1 -- 172.21.15.150:0/2869788580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560003430 con 0x7ff5600046d0 2022-08-10T17:55:04.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff57db21700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600046d0 0x7ff560004b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff574007fd0 tx=0x7ff560005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aecaa0043697e0b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574007a90 con 0x7ff5600046d0 2022-08-10T17:55:04.897 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57400cc70 con 0x7ff5600046d0 2022-08-10T17:55:04.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff57d320700 1 -- 172.21.15.150:0/2869788580 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740070d0 con 0x7ff5600046d0 2022-08-10T17:55:04.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 -- 172.21.15.150:0/2869788580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600046d0 msgr2=0x7ff560004b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 --2- 172.21.15.150:0/2869788580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600046d0 0x7ff560004b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff574007fd0 tx=0x7ff560005700 comp rx=0 tx=0).stop 2022-08-10T17:55:04.898 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff57eb23700 1 -- 172.21.15.150:0/2869788580 reap_dead start 2022-08-10T17:55:04.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 -- 172.21.15.150:0/2869788580 shutdown_connections 2022-08-10T17:55:04.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 -- 172.21.15.150:0/2869788580 >> 172.21.15.150:0/2869788580 conn(0x7ff5780c5940 msgr2=0x7ff5780c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 -- 172.21.15.150:0/2869788580 shutdown_connections 2022-08-10T17:55:04.899 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.879+0000 7ff580586700 1 -- 172.21.15.150:0/2869788580 wait complete. 2022-08-10T17:55:04.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.880+0000 7ff580586700 1 Processor -- start 2022-08-10T17:55:04.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 -- start start 2022-08-10T17:55:04.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5600046d0 0x7ff5780ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.900 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 0x7ff5780bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abad0 0x7ff5780ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780adc90 con 0x7ff5781ec8e0 2022-08-10T17:55:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780bff20 con 0x7ff5780abad0 2022-08-10T17:55:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff580586700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c0aa0 con 0x7ff5600046d0 2022-08-10T17:55:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff57db21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 0x7ff5780bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff57db21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 0x7ff5780bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45276/0 (socket says 172.21.15.150:45276) 2022-08-10T17:55:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.881+0000 7ff57db21700 1 -- 172.21.15.150:0/2863217691 learned_addr learned my addr 172.21.15.150:0/2863217691 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57e322700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5600046d0 0x7ff5780ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abad0 0x7ff5780ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5600046d0 msgr2=0x7ff5780ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff5600046d0 0x7ff5780ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abad0 msgr2=0x7ff5780ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abad0 0x7ff5780ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780aec30 con 0x7ff5781ec8e0 2022-08-10T17:55:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff57db21700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 0x7ff5780bf180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff574001850 tx=0x7ff574001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740072d0 con 0x7ff5781ec8e0 2022-08-10T17:55:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574007430 con 0x7ff5781ec8e0 2022-08-10T17:55:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740046f0 con 0x7ff5781ec8e0 2022-08-10T17:55:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5780c0170 con 0x7ff5781ec8e0 2022-08-10T17:55:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.882+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5780c0730 con 0x7ff5781ec8e0 2022-08-10T17:55:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff580586700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 0x7ff5780acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578068380 con 0x7ff5780abea0 2022-08-10T17:55:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff57e322700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 0x7ff5780acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff57e322700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5780c08f0 con 0x7ff5780abea0 2022-08-10T17:55:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff574024070 con 0x7ff5781ec8e0 2022-08-10T17:55:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.883+0000 7ff57e322700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 0x7ff5780acc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff57806c8c0 tx=0x7ff568001570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5580650b0 0x7ff558067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff574083550 con 0x7ff5781ec8e0 2022-08-10T17:55:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5580650b0 0x7ff558067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568001d30 con 0x7ff5780abea0 2022-08-10T17:55:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7ff568007260 con 0x7ff5780abea0 2022-08-10T17:55:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 msgr2=0x7ff5780acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 0x7ff5780acc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff57806c8c0 tx=0x7ff568001570 comp rx=0 tx=0).stop 2022-08-10T17:55:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 msgr2=0x7ff5780acc40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff566ffd700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5780abea0 0x7ff5780acc40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.884+0000 7ff57eb23700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5580650b0 0x7ff558067560 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff560003880 tx=0x7ff57000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.891+0000 7ff580586700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 0x7ff5781ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.891+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780adc90 con 0x7ff5781ef460 2022-08-10T17:55:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.891+0000 7ff57e322700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 0x7ff5781ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.891+0000 7ff57e322700 1 -- 172.21.15.150:0/2863217691 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff5780ac270 con 0x7ff5781ef460 2022-08-10T17:55:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.891+0000 7ff57e322700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 0x7ff5781ef860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff57806c8c0 tx=0x7ff568001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568015c10 con 0x7ff5781ef460 2022-08-10T17:55:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 <== mon.1 v2:172.21.15.197:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4717 (secure 0 0 0) 0x7ff568006e60 con 0x7ff5781ef460 2022-08-10T17:55:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 msgr2=0x7ff5781ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 0x7ff5781ef860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff57806c8c0 tx=0x7ff568001120 comp rx=0 tx=0).stop 2022-08-10T17:55:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 msgr2=0x7ff5781ef860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff566ffd700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff5781ef460 0x7ff5781ef860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:04.914 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:55:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:55:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:55:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 150, 2022-08-10T17:55:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:55:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:55:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:55:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:55:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:55:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:55:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:55:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:55:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:55:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:55:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:55:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:55:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:55:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:55:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:55:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:55:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:55:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:55:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:55:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:55:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:55:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:55:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:55:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:55:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:55:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:55:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:55:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:55:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:55:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:55:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:55:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:55:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:55:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:55:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:55:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:55:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:55:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:55:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:55:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:55:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:55:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:55:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:55:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:55:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:55:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": [ 2022-08-10T17:55:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:55:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "osd": [ 2022-08-10T17:55:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 2 2022-08-10T17:55:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:55:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 3 2022-08-10T17:55:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:55:04.956 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:04.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5580650b0 msgr2=0x7ff558067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff5580650b0 0x7ff558067560 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff560003880 tx=0x7ff57000b040 comp rx=0 tx=0).stop 2022-08-10T17:55:04.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 msgr2=0x7ff5780bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:04.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 --2- 172.21.15.150:0/2863217691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5781ec8e0 0x7ff5780bf180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff574001850 tx=0x7ff574001a00 comp rx=0 tx=0).stop 2022-08-10T17:55:04.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff57eb23700 1 -- 172.21.15.150:0/2863217691 reap_dead start 2022-08-10T17:55:04.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff57eb23700 1 -- 172.21.15.150:0/2863217691 reap_dead start 2022-08-10T17:55:04.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 shutdown_connections 2022-08-10T17:55:04.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 >> 172.21.15.150:0/2863217691 conn(0x7ff5780c5940 msgr2=0x7ff5781dd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:04.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 shutdown_connections 2022-08-10T17:55:04.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:04.892+0000 7ff580586700 1 -- 172.21.15.150:0/2863217691 wait complete. 2022-08-10T17:55:04.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2022-08-10T17:55:05.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.081+0000 7f3cbe1f2700 1 Processor -- start 2022-08-10T17:55:05.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.081+0000 7f3cbe1f2700 1 -- start start 2022-08-10T17:55:05.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cbe1f2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 0x7f3cb80c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cbe1f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80c39a0 con 0x7f3cb806d850 2022-08-10T17:55:05.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cbe1f2700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80b0ff0 con 0x7f3cb806d480 2022-08-10T17:55:05.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cbe1f2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb806e120 con 0x7f3cb80c4b20 2022-08-10T17:55:05.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb6ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3cb806d850 0x7f3cb80c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57968/0 (socket says 172.21.15.150:57968) 2022-08-10T17:55:05.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb6ffd700 1 -- 172.21.15.150:0/1864545400 learned_addr learned my addr 172.21.15.150:0/1864545400 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:05.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb7fff700 1 --2- 172.21.15.150:0/1864545400 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 0x7f3cb80c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411496228 0 0) 0x7f3cb80c39a0 con 0x7f3cb806d850 2022-08-10T17:55:05.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c98003430 con 0x7f3cb806d850 2022-08-10T17:55:05.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933724530 0 0) 0x7f3cb80b0ff0 con 0x7f3cb806d480 2022-08-10T17:55:05.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.082+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb80c39a0 con 0x7f3cb806d480 2022-08-10T17:55:05.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb7fff700 1 -- 172.21.15.150:0/1864545400 >> v1:172.21.15.197:6789/0 conn(0x7f3cb806d480 legacy=0x7f3cb80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb7fff700 1 -- 172.21.15.150:0/1864545400 >> v1:172.21.15.150:6789/0 conn(0x7f3cb806d850 legacy=0x7f3cb80c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb7fff700 1 -- 172.21.15.150:0/1864545400 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80c5620 con 0x7f3cb80c4b20 2022-08-10T17:55:05.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb7fff700 1 --2- 172.21.15.150:0/1864545400 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 0x7f3cb80c1f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009dc0 tx=0x7f3ca800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a2c44a3f804df0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800e070 con 0x7f3cb80c4b20 2022-08-10T17:55:05.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca800bb20 con 0x7f3cb80c4b20 2022-08-10T17:55:05.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cb67fc700 1 -- 172.21.15.150:0/1864545400 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8012430 con 0x7f3cb80c4b20 2022-08-10T17:55:05.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/1864545400 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 msgr2=0x7f3cb80c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/1864545400 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 0x7f3cb80c1f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009dc0 tx=0x7f3ca800b330 comp rx=0 tx=0).stop 2022-08-10T17:55:05.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/1864545400 shutdown_connections 2022-08-10T17:55:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/1864545400 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb80c4b20 0x7f3cb80c1f60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.083+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/1864545400 >> 172.21.15.150:0/1864545400 conn(0x7f3cb806b3b0 msgr2=0x7f3cb806fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.084+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/1864545400 shutdown_connections 2022-08-10T17:55:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.084+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/1864545400 wait complete. 2022-08-10T17:55:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 Processor -- start 2022-08-10T17:55:05.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 -- start start 2022-08-10T17:55:05.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb806d480 0x7f3cb8156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 0x7f3cb8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3cb80c4b20 0x7f3cb8069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80caf30 con 0x7f3cb806d850 2022-08-10T17:55:05.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb81534b0 con 0x7f3cb80c4b20 2022-08-10T17:55:05.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.085+0000 7f3cbe1f2700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8155b10 con 0x7f3cb806d480 2022-08-10T17:55:05.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 0x7f3cb8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 0x7f3cb8156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45294/0 (socket says 172.21.15.150:45294) 2022-08-10T17:55:05.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 -- 172.21.15.150:0/2272461542 learned_addr learned my addr 172.21.15.150:0/2272461542 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:05.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb806d480 0x7f3cb8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb7fff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3cb80c4b20 0x7f3cb8069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb806d480 msgr2=0x7f3cb8156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb806d480 0x7f3cb8156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3cb80c4b20 msgr2=0x7f3cb8069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3cb80c4b20 0x7f3cb8069750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8009a70 con 0x7f3cb806d850 2022-08-10T17:55:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb806d480 0x7f3cb8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cb6ffd700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 0x7f3cb8156c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c430 tx=0x7f3ca000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00072d0 con 0x7f3cb806d850 2022-08-10T17:55:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0007430 con 0x7f3cb806d850 2022-08-10T17:55:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb80cac70 con 0x7f3cb806d850 2022-08-10T17:55:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00057c0 con 0x7f3cb806d850 2022-08-10T17:55:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.086+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8155d60 con 0x7f3cb806d850 2022-08-10T17:55:05.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.087+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 0x7f3cb814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.087+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80673d0 con 0x7f3cb8069c90 2022-08-10T17:55:05.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.087+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 0x7f3cb814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3cb77fe700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cb8072890 con 0x7f3cb8069c90 2022-08-10T17:55:05.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 0x7f3cb814eb80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0001220 tx=0x7f3cb000fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3ca0019030 con 0x7f3cb806d850 2022-08-10T17:55:05.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3c9c0650e0 0x7f3c9c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000fea0 con 0x7f3cb8069c90 2022-08-10T17:55:05.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3ca0081420 con 0x7f3cb806d850 2022-08-10T17:55:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3cb7fff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3c9c0650e0 0x7f3c9c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+7982 (secure 0 0 0) 0x7f3cb00052e0 con 0x7f3cb8069c90 2022-08-10T17:55:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 msgr2=0x7f3cb814eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 0x7f3cb814eb80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0001220 tx=0x7f3cb000fc60 comp rx=0 tx=0).stop 2022-08-10T17:55:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 msgr2=0x7f3cb814eb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.088+0000 7f3caffff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb8069c90 0x7f3cb814eb80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.089+0000 7f3cb7fff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3c9c0650e0 0x7f3c9c067590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80c4f80 tx=0x7f3ca801e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.095+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 0x7f3cb81f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.095+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80cb7e0 con 0x7f3cb814f0c0 2022-08-10T17:55:05.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 0x7f3cb81f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3cb77fe700 1 -- 172.21.15.150:0/2272461542 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3cb81558f0 con 0x7f3cb814f0c0 2022-08-10T17:55:05.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3cb77fe700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 0x7f3cb81f0110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0017000 tx=0x7f3cb0001190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0003d20 con 0x7f3cb814f0c0 2022-08-10T17:55:05.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 <== mon.2 v2:172.21.15.197:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4377 (secure 0 0 0) 0x7f3cb0003e80 con 0x7f3cb814f0c0 2022-08-10T17:55:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 msgr2=0x7f3cb81f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 0x7f3cb81f0110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0017000 tx=0x7f3cb0001190 comp rx=0 tx=0).stop 2022-08-10T17:55:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 msgr2=0x7f3cb81f0110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2022-08-10T17:55:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.096+0000 7f3caffff700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3cb814f0c0 0x7f3cb81f0110 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:55:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:55:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "peon", 2022-08-10T17:55:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "election_epoch": 150, 2022-08-10T17:55:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum": [ 2022-08-10T17:55:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: 0, 2022-08-10T17:55:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: 1, 2022-08-10T17:55:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: 2 2022-08-10T17:55:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_age": 3, 2022-08-10T17:55:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "required_con": "2449958755906961412", 2022-08-10T17:55:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "required_mon": [ 2022-08-10T17:55:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_con": "4540138320759226367", 2022-08-10T17:55:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "quorum_mon": [ 2022-08-10T17:55:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "outside_quorum": [], 2022-08-10T17:55:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "extra_probe_peers": [], 2022-08-10T17:55:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "sync_provider": [], 2022-08-10T17:55:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: "monmap": { 2022-08-10T17:55:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 1, 2022-08-10T17:55:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: "fsid": "1038d638-5c3e-47f8-a696-c70f19144095", 2022-08-10T17:55:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: "modified": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: "created": "2022-08-10T17:34:37.404807Z", 2022-08-10T17:55:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release": 17, 2022-08-10T17:55:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "min_mon_release_name": "quincy", 2022-08-10T17:55:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "election_strategy": 1, 2022-08-10T17:55:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: "disallowed_leaders: ": "", 2022-08-10T17:55:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false, 2022-08-10T17:55:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: "tiebreaker_mon": "", 2022-08-10T17:55:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: "features": { 2022-08-10T17:55:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: "persistent": [ 2022-08-10T17:55:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "kraken", 2022-08-10T17:55:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "luminous", 2022-08-10T17:55:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "mimic", 2022-08-10T17:55:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap-prune", 2022-08-10T17:55:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "nautilus", 2022-08-10T17:55:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus", 2022-08-10T17:55:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific", 2022-08-10T17:55:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: "elector-pinging", 2022-08-10T17:55:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy" 2022-08-10T17:55:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: "optional": [] 2022-08-10T17:55:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: "mons": [ 2022-08-10T17:55:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 0, 2022-08-10T17:55:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "a", 2022-08-10T17:55:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:3300", 2022-08-10T17:55:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789", 2022-08-10T17:55:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6789/0", 2022-08-10T17:55:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.150:6789/0", 2022-08-10T17:55:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 1, 2022-08-10T17:55:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "b", 2022-08-10T17:55:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3300", 2022-08-10T17:55:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789", 2022-08-10T17:55:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6789/0", 2022-08-10T17:55:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6789/0", 2022-08-10T17:55:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: "rank": 2, 2022-08-10T17:55:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "c", 2022-08-10T17:55:05.139 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addrs": { 2022-08-10T17:55:05.140 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2022-08-10T17:55:05.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.140 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2022-08-10T17:55:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:3301", 2022-08-10T17:55:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.142 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2022-08-10T17:55:05.142 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790", 2022-08-10T17:55:05.142 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 0 2022-08-10T17:55:05.142 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.143 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.143 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.197:6790/0", 2022-08-10T17:55:05.144 INFO:teuthology.orchestra.run.smithi150.stdout: "public_addr": "172.21.15.197:6790/0", 2022-08-10T17:55:05.144 INFO:teuthology.orchestra.run.smithi150.stdout: "priority": 0, 2022-08-10T17:55:05.144 INFO:teuthology.orchestra.run.smithi150.stdout: "weight": 0, 2022-08-10T17:55:05.144 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_location": "{}" 2022-08-10T17:55:05.144 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.145 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.145 INFO:teuthology.orchestra.run.smithi150.stdout: "feature_map": { 2022-08-10T17:55:05.145 INFO:teuthology.orchestra.run.smithi150.stdout: "mon": [ 2022-08-10T17:55:05.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.146 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:05.146 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:05.146 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:55:05.147 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.147 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2022-08-10T17:55:05.147 INFO:teuthology.orchestra.run.smithi150.stdout: "client": [ 2022-08-10T17:55:05.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2022-08-10T17:55:05.148 INFO:teuthology.orchestra.run.smithi150.stdout: "features": "0x3f01cfbf7ffdffff", 2022-08-10T17:55:05.148 INFO:teuthology.orchestra.run.smithi150.stdout: "release": "luminous", 2022-08-10T17:55:05.148 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 1 2022-08-10T17:55:05.148 INFO:teuthology.orchestra.run.smithi150.stdout: } 2022-08-10T17:55:05.149 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2022-08-10T17:55:05.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2022-08-10T17:55:05.149 INFO:teuthology.orchestra.run.smithi150.stdout: "stretch_mode": false 2022-08-10T17:55:05.149 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:05.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3c9c0650e0 msgr2=0x7f3c9c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3c9c0650e0 0x7f3c9c067590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80c4f80 tx=0x7f3ca801e040 comp rx=0 tx=0).stop 2022-08-10T17:55:05.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 msgr2=0x7f3cb8156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 --2- 172.21.15.150:0/2272461542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb806d850 0x7f3cb8156c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c430 tx=0x7f3ca000c740 comp rx=0 tx=0).stop 2022-08-10T17:55:05.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cb7fff700 1 -- 172.21.15.150:0/2272461542 reap_dead start 2022-08-10T17:55:05.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cb7fff700 1 -- 172.21.15.150:0/2272461542 reap_dead start 2022-08-10T17:55:05.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 shutdown_connections 2022-08-10T17:55:05.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 >> 172.21.15.150:0/2272461542 conn(0x7f3cb806b3b0 msgr2=0x7f3cb8154280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:05.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 shutdown_connections 2022-08-10T17:55:05.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.097+0000 7f3cbe1f2700 1 -- 172.21.15.150:0/2272461542 wait complete. 2022-08-10T17:55:05.154 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2022-08-10T17:55:05.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2022-08-10T17:55:05.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.274+0000 7fa081fc4700 1 Processor -- start 2022-08-10T17:55:05.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.274+0000 7fa081fc4700 1 -- start start 2022-08-10T17:55:05.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa081fc4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fa07c068110 0x7fa07c0699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa081fc4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c156c30 con 0x7fa07c0b0cb0 2022-08-10T17:55:05.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa081fc4700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c156f10 con 0x7fa07c1564d0 2022-08-10T17:55:05.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa081fc4700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c1578b0 con 0x7fa07c068110 2022-08-10T17:55:05.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa07bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa07c0b0cb0 0x7fa07c157ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:57988/0 (socket says 172.21.15.150:57988) 2022-08-10T17:55:05.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa07bfff700 1 -- 172.21.15.150:0/958804000 learned_addr learned my addr 172.21.15.150:0/958804000 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:05.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.275+0000 7fa07affd700 1 --2- 172.21.15.150:0/958804000 >> v2:172.21.15.197:3300/0 conn(0x7fa07c068110 0x7fa07c0699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899246232 0 0) 0x7fa07c156c30 con 0x7fa07c0b0cb0 2022-08-10T17:55:05.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa068003430 con 0x7fa07c0b0cb0 2022-08-10T17:55:05.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042546848 0 0) 0x7fa07c156f10 con 0x7fa07c1564d0 2022-08-10T17:55:05.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa07c156c30 con 0x7fa07c1564d0 2022-08-10T17:55:05.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07affd700 1 -- 172.21.15.150:0/958804000 >> v1:172.21.15.197:6789/0 conn(0x7fa07c1564d0 legacy=0x7fa07c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07affd700 1 -- 172.21.15.150:0/958804000 >> v1:172.21.15.150:6789/0 conn(0x7fa07c0b0cb0 legacy=0x7fa07c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07affd700 1 -- 172.21.15.150:0/958804000 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c1571f0 con 0x7fa07c068110 2022-08-10T17:55:05.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07affd700 1 --2- 172.21.15.150:0/958804000 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c068110 0x7fa07c0699b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700096b0 tx=0x7fa0700099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc07cbc2d7af366 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700107b0 con 0x7fa07c068110 2022-08-10T17:55:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070010910 con 0x7fa07c068110 2022-08-10T17:55:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.276+0000 7fa07a7fc700 1 -- 172.21.15.150:0/958804000 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070010cc0 con 0x7fa07c068110 2022-08-10T17:55:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 -- 172.21.15.150:0/958804000 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c068110 msgr2=0x7fa07c0699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 --2- 172.21.15.150:0/958804000 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c068110 0x7fa07c0699b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700096b0 tx=0x7fa0700099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 -- 172.21.15.150:0/958804000 shutdown_connections 2022-08-10T17:55:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 --2- 172.21.15.150:0/958804000 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c068110 0x7fa07c0699b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 -- 172.21.15.150:0/958804000 >> 172.21.15.150:0/958804000 conn(0x7fa07c06b3b0 msgr2=0x7fa07c06fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 -- 172.21.15.150:0/958804000 shutdown_connections 2022-08-10T17:55:05.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.277+0000 7fa081fc4700 1 -- 172.21.15.150:0/958804000 wait complete. 2022-08-10T17:55:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.278+0000 7fa081fc4700 1 Processor -- start 2022-08-10T17:55:05.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.278+0000 7fa081fc4700 1 -- start start 2022-08-10T17:55:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 0x7fa07c0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa07c1564d0 0x7fa07c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c1bb0 con 0x7fa07c068110 2022-08-10T17:55:05.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c0fa0 con 0x7fa07c0b0cb0 2022-08-10T17:55:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa081fc4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c1280 con 0x7fa07c1564d0 2022-08-10T17:55:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45310/0 (socket says 172.21.15.150:45310) 2022-08-10T17:55:05.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 -- 172.21.15.150:0/113063702 learned_addr learned my addr 172.21.15.150:0/113063702 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:05.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07affd700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 0x7fa07c0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07bfff700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa07c1564d0 0x7fa07c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 -- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa07c1564d0 msgr2=0x7fa07c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa07c1564d0 0x7fa07c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 -- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 msgr2=0x7fa07c0c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 0x7fa07c0c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 -- 172.21.15.150:0/113063702 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009310 con 0x7fa07c068110 2022-08-10T17:55:05.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07affd700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 0x7fa07c0c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:05.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa07b7fe700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c430 tx=0x7fa06c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.279+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0052d0 con 0x7fa07c068110 2022-08-10T17:55:05.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.280+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c003500 con 0x7fa07c068110 2022-08-10T17:55:05.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.280+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0038b0 con 0x7fa07c068110 2022-08-10T17:55:05.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.280+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0c1560 con 0x7fa07c068110 2022-08-10T17:55:05.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.280+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0c9c70 con 0x7fa07c068110 2022-08-10T17:55:05.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.281+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fa06c019030 con 0x7fa07c068110 2022-08-10T17:55:05.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.281+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c072890 con 0x7fa07c068110 2022-08-10T17:55:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.281+0000 7fa063fff700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 0x7fa05c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.281+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fa06c081430 con 0x7fa07c068110 2022-08-10T17:55:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.281+0000 7fa07affd700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 0x7fa05c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.282+0000 7fa07affd700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 0x7fa05c067560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0700090b0 tx=0x7fa070008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:05.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.286+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fa06c04f410 con 0x7fa07c068110 2022-08-10T17:55:05.552 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.549+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa07c1574d0 con 0x7fa07c068110 2022-08-10T17:55:05.553 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.550+0000 7fa063fff700 1 -- 172.21.15.150:0/113063702 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa06c017080 con 0x7fa07c068110 2022-08-10T17:55:05.555 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 msgr2=0x7fa05c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 0x7fa05c067560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0700090b0 tx=0x7fa070008030 comp rx=0 tx=0).stop 2022-08-10T17:55:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 msgr2=0x7fa07c0bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c430 tx=0x7fa06c00c740 comp rx=0 tx=0).stop 2022-08-10T17:55:05.556 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 shutdown_connections 2022-08-10T17:55:05.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fa05c0650b0 0x7fa05c067560 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fa07c1564d0 0x7fa07c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa07c068110 0x7fa07c0bf4b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 --2- 172.21.15.150:0/113063702 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fa07c0b0cb0 0x7fa07c0c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 >> 172.21.15.150:0/113063702 conn(0x7fa07c06b3b0 msgr2=0x7fa07c0c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.552+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 shutdown_connections 2022-08-10T17:55:05.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:05.553+0000 7fa081fc4700 1 -- 172.21.15.150:0/113063702 wait complete. 2022-08-10T17:55:05.568 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2022-08-10T17:55:15.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:55:15.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.689+0000 7f503f701700 1 Processor -- start 2022-08-10T17:55:15.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.689+0000 7f503f701700 1 -- start start 2022-08-10T17:55:15.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503f701700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f50380c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503f701700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f50380c96b0 0x7f50380c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503f701700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503806e070 con 0x7f50380c4f10 2022-08-10T17:55:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503f701700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50380c53b0 con 0x7f50380c96b0 2022-08-10T17:55:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503f701700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503806ec10 con 0x7f50380c8af0 2022-08-10T17:55:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503dc9e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f50380c4f10 0x7f503806e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58014/0 (socket says 172.21.15.150:58014) 2022-08-10T17:55:15.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.690+0000 7f503dc9e700 1 -- 172.21.15.150:0/1045132008 learned_addr learned my addr 172.21.15.150:0/1045132008 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.691+0000 7f503cc9c700 1 --2- 172.21.15.150:0/1045132008 >> v2:172.21.15.197:3300/0 conn(0x7f50380c96b0 0x7f50380c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.691+0000 7f503d49d700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f50380c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.691+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342055298 0 0) 0x7f503806e070 con 0x7f50380c4f10 2022-08-10T17:55:15.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5024003880 con 0x7f50380c4f10 2022-08-10T17:55:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3563397852 0 0) 0x7f5024003880 con 0x7f50380c4f10 2022-08-10T17:55:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 msgr2=0x7f50380c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f50380c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 >> v2:172.21.15.197:3300/0 conn(0x7f50380c96b0 msgr2=0x7f50380c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 --2- 172.21.15.150:0/1045132008 >> v2:172.21.15.197:3300/0 conn(0x7f50380c96b0 0x7f50380c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380701c0 con 0x7f50380c4f10 2022-08-10T17:55:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3756392934 0 0) 0x7f50300019f0 con 0x7f50380c4f10 2022-08-10T17:55:15.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 >> v1:172.21.15.150:6789/0 conn(0x7f50380c4f10 legacy=0x7f503806e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f5024003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5024004410 0x7f5024004b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f5024005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380c53b0 con 0x7f5024003ac0 2022-08-10T17:55:15.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503806ec10 con 0x7f5024004410 2022-08-10T17:55:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.698+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024005670 con 0x7f50380c8af0 2022-08-10T17:55:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f5024003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503dc9e700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f5024005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.716 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503cc9c700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5024004410 0x7f5024004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 -- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 msgr2=0x7f5024005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50380c8af0 0x7f5024005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 -- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5024004410 msgr2=0x7f5024004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:15.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f5024004410 0x7f5024004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 -- 172.21.15.150:0/1045132008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024003880 con 0x7f5024003ac0 2022-08-10T17:55:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f503d49d700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f5024003ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f503400dd00 tx=0x7f5024005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5519f144dff7ee3 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400d0d0 con 0x7f5024003ac0 2022-08-10T17:55:15.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034013040 con 0x7f5024003ac0 2022-08-10T17:55:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.699+0000 7f502ffff700 1 -- 172.21.15.150:0/1045132008 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034012910 con 0x7f5024003ac0 2022-08-10T17:55:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 -- 172.21.15.150:0/1045132008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 msgr2=0x7f5024003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 --2- 172.21.15.150:0/1045132008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f5024003ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f503400dd00 tx=0x7f5024005b50 comp rx=0 tx=0).stop 2022-08-10T17:55:15.719 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503dc9e700 1 -- 172.21.15.150:0/1045132008 reap_dead start 2022-08-10T17:55:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 -- 172.21.15.150:0/1045132008 shutdown_connections 2022-08-10T17:55:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 -- 172.21.15.150:0/1045132008 >> 172.21.15.150:0/1045132008 conn(0x7f503806b500 msgr2=0x7f503806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:15.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 -- 172.21.15.150:0/1045132008 shutdown_connections 2022-08-10T17:55:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.700+0000 7f503f701700 1 -- 172.21.15.150:0/1045132008 wait complete. 2022-08-10T17:55:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.701+0000 7f503f701700 1 Processor -- start 2022-08-10T17:55:15.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 -- start start 2022-08-10T17:55:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 0x7f50381ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50381ede20 0x7f50380c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038165bb0 con 0x7f5024003ac0 2022-08-10T17:55:15.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380bee00 con 0x7f50380be7a0 2022-08-10T17:55:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.702+0000 7f503f701700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50381622e0 con 0x7f50381ede20 2022-08-10T17:55:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45346/0 (socket says 172.21.15.150:45346) 2022-08-10T17:55:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 -- 172.21.15.150:0/3904797131 learned_addr learned my addr 172.21.15.150:0/3904797131 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503cc9c700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 0x7f50381ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503dc9e700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50381ede20 0x7f50380c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 -- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50381ede20 msgr2=0x7f50380c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50381ede20 0x7f50380c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 -- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 msgr2=0x7f50381ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 0x7f50381ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.726 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 -- 172.21.15.150:0/3904797131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50381625c0 con 0x7f5024003ac0 2022-08-10T17:55:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503cc9c700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 0x7f50381ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:55:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503d49d700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50240055c0 tx=0x7f503400d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034012d20 con 0x7f5024003ac0 2022-08-10T17:55:15.727 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034012e80 con 0x7f5024003ac0 2022-08-10T17:55:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034003760 con 0x7f5024003ac0 2022-08-10T17:55:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50381628a0 con 0x7f5024003ac0 2022-08-10T17:55:15.728 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.703+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50380bf330 con 0x7f5024003ac0 2022-08-10T17:55:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.704+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5038072890 con 0x7f5024003ac0 2022-08-10T17:55:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.705+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f50340038c0 con 0x7f5024003ac0 2022-08-10T17:55:15.729 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.705+0000 7f502dffb700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 0x7f5020067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.705+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5034087d00 con 0x7f5024003ac0 2022-08-10T17:55:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.705+0000 7f503cc9c700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 0x7f5020067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:15.730 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.706+0000 7f503cc9c700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 0x7f5020067590 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50381eeff0 tx=0x7f502800f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:15.731 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.709+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f503408b030 con 0x7f5024003ac0 2022-08-10T17:55:15.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.933+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50380c4110 con 0x7f5024003ac0 2022-08-10T17:55:15.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.933+0000 7f502dffb700 1 -- 172.21.15.150:0/3904797131 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6154 (secure 0 0 0) 0x7f5034031070 con 0x7f5024003ac0 2022-08-10T17:55:15.938 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:15.938 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:54:30.928956+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":40,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:55:15.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 msgr2=0x7f5020067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 0x7f5020067590 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50381eeff0 tx=0x7f502800f040 comp rx=0 tx=0).stop 2022-08-10T17:55:15.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 msgr2=0x7f50380bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:15.943 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50240055c0 tx=0x7f503400d4f0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 shutdown_connections 2022-08-10T17:55:15.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f50200650e0 0x7f5020067590 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f50381ede20 0x7f50380c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5024003ac0 0x7f50380bdea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 --2- 172.21.15.150:0/3904797131 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f50380be7a0 0x7f50381ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:15.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 >> 172.21.15.150:0/3904797131 conn(0x7f503806b500 msgr2=0x7f5038164a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:15.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 shutdown_connections 2022-08-10T17:55:15.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:15.936+0000 7f503f701700 1 -- 172.21.15.150:0/3904797131 wait complete. 2022-08-10T17:55:15.946 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 24 2022-08-10T17:55:15.952 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2022-08-10T17:55:15.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2022-08-10T17:55:16.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.069+0000 7fef7d016700 1 Processor -- start 2022-08-10T17:55:16.073 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.069+0000 7fef7d016700 1 -- start start 2022-08-10T17:55:16.076 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef7806fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fef78069f30 0x7fef78070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef78150e70 0x7fef78071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.077 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7806f8b0 con 0x7fef78150e70 2022-08-10T17:55:16.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7806f050 con 0x7fef78069f30 2022-08-10T17:55:16.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7d016700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7815a990 con 0x7fef78150aa0 2022-08-10T17:55:16.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef78150e70 0x7fef78071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.078 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef78150e70 0x7fef78071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45354/0 (socket says 172.21.15.150:45354) 2022-08-10T17:55:16.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 -- 172.21.15.150:0/4212883074 learned_addr learned my addr 172.21.15.150:0/4212883074 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:16.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef76d9d700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef7806fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.079 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7659c700 1 --2- 172.21.15.150:0/4212883074 >> v2:172.21.15.197:3300/0 conn(0x7fef78069f30 0x7fef78070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 -- 172.21.15.150:0/4212883074 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 msgr2=0x7fef7806fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:16.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef7806fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.080 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 -- 172.21.15.150:0/4212883074 >> v2:172.21.15.197:3300/0 conn(0x7fef78069f30 msgr2=0x7fef78070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:16.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.070+0000 7fef7759e700 1 --2- 172.21.15.150:0/4212883074 >> v2:172.21.15.197:3300/0 conn(0x7fef78069f30 0x7fef78070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7759e700 1 -- 172.21.15.150:0/4212883074 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7815ac70 con 0x7fef78150e70 2022-08-10T17:55:16.081 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7759e700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef78071370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef780ba3d0 tx=0x7fef7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbf3f13ea92dd5e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:16.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef75d9b700 1 -- 172.21.15.150:0/4212883074 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000e070 con 0x7fef78150e70 2022-08-10T17:55:16.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef75d9b700 1 -- 172.21.15.150:0/4212883074 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000b910 con 0x7fef78150e70 2022-08-10T17:55:16.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef75d9b700 1 -- 172.21.15.150:0/4212883074 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000bcc0 con 0x7fef78150e70 2022-08-10T17:55:16.082 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 -- 172.21.15.150:0/4212883074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 msgr2=0x7fef78071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:16.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef78071370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef780ba3d0 tx=0x7fef7000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:16.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 -- 172.21.15.150:0/4212883074 shutdown_connections 2022-08-10T17:55:16.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef78071370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 --2- 172.21.15.150:0/4212883074 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef7806fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.083 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 --2- 172.21.15.150:0/4212883074 >> v2:172.21.15.197:3300/0 conn(0x7fef78069f30 0x7fef78070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 -- 172.21.15.150:0/4212883074 >> 172.21.15.150:0/4212883074 conn(0x7fef7806c570 msgr2=0x7fef7806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:16.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 -- 172.21.15.150:0/4212883074 shutdown_connections 2022-08-10T17:55:16.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.071+0000 7fef7d016700 1 -- 172.21.15.150:0/4212883074 wait complete. 2022-08-10T17:55:16.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.073+0000 7fef7d016700 1 Processor -- start 2022-08-10T17:55:16.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.073+0000 7fef7d016700 1 -- start start 2022-08-10T17:55:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.073+0000 7fef7d016700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fef78069f30 0x7fef781ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.073+0000 7fef7d016700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef780bec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780bb780 con 0x7fef78150e70 2022-08-10T17:55:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781ecd20 con 0x7fef78069f30 2022-08-10T17:55:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780bf160 con 0x7fef78150aa0 2022-08-10T17:55:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45360/0 (socket says 172.21.15.150:45360) 2022-08-10T17:55:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 -- 172.21.15.150:0/3028138471 learned_addr learned my addr 172.21.15.150:0/3028138471 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7659c700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef780bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef76d9d700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fef78069f30 0x7fef781ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 -- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 msgr2=0x7fef780bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef780bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 -- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fef78069f30 msgr2=0x7fef781ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fef78069f30 0x7fef781ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 -- 172.21.15.150:0/3028138471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009b30 con 0x7fef78150e70 2022-08-10T17:55:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7759e700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fef780cab70 tx=0x7fef70004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:16.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700099b0 con 0x7fef78150e70 2022-08-10T17:55:16.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700092e0 con 0x7fef78150e70 2022-08-10T17:55:16.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70004470 con 0x7fef78150e70 2022-08-10T17:55:16.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef780ba890 con 0x7fef78150e70 2022-08-10T17:55:16.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.074+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef780bae50 con 0x7fef78150e70 2022-08-10T17:55:16.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.076+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fef7002c070 con 0x7fef78150e70 2022-08-10T17:55:16.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.076+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef780bb930 con 0x7fef78150e70 2022-08-10T17:55:16.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.076+0000 7fef5f7fe700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 0x7fef58067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:16.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.076+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fef700836c0 con 0x7fef78150e70 2022-08-10T17:55:16.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.076+0000 7fef76d9d700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 0x7fef58067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:16.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.077+0000 7fef76d9d700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 0x7fef58067560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef68009a50 tx=0x7fef680090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:16.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.080+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fef780bb930 con 0x7fef78150e70 2022-08-10T17:55:16.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.338+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fef780bb8c0 con 0x7fef78150e70 2022-08-10T17:55:16.342 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.338+0000 7fef5f7fe700 1 -- 172.21.15.150:0/3028138471 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1520 (secure 0 0 0) 0x7fef70020070 con 0x7fef78150e70 2022-08-10T17:55:16.343 INFO:teuthology.orchestra.run.smithi150.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138320759226367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","modified":"2022-08-10T17:34:37.404807Z","created":"2022-08-10T17:34:37.404807Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3300","nonce":0},{"type":"v1","addr":"172.21.15.197:6789","nonce":0}]},"addr":"172.21.15.197:6789/0","public_addr":"172.21.15.197:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:3301","nonce":0},{"type":"v1","addr":"172.21.15.197:6790","nonce":0}]},"addr":"172.21.15.197:6790/0","public_addr":"172.21.15.197:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2022-08-10T17:55:16.344 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 msgr2=0x7fef58067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:16.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 0x7fef58067560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef68009a50 tx=0x7fef680090e0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 msgr2=0x7fef780bccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:16.345 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fef780cab70 tx=0x7fef70004950 comp rx=0 tx=0).stop 2022-08-10T17:55:16.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 shutdown_connections 2022-08-10T17:55:16.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef78150e70 0x7fef780bccb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fef78069f30 0x7fef781ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.346 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fef580650b0 0x7fef58067560 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 --2- 172.21.15.150:0/3028138471 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fef78150aa0 0x7fef780bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:16.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 >> 172.21.15.150:0/3028138471 conn(0x7fef7806c570 msgr2=0x7fef7814f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:16.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 shutdown_connections 2022-08-10T17:55:16.347 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:16.340+0000 7fef7d016700 1 -- 172.21.15.150:0/3028138471 wait complete. 2022-08-10T17:55:16.357 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2022-08-10T17:55:16.357 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2022-08-10T17:55:16.370 INFO:tasks.kclient:Unmounting kernel clients... 2022-08-10T17:55:16.370 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-08-10T17:55:16.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:55:16.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2022-08-10T17:55:16.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:55:16.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:55:16.486 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-08-10T17:55:16.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:55:16.587 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2022-08-10T17:55:16.847 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2022-08-10T17:55:16.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:55:16.848 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2022-08-10T17:55:16.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-08-10T17:55:16.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2022-08-10T17:55:16.999 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2022-08-10T17:55:17.022 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2022-08-10T17:55:17.023 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:55:17.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.142+0000 7fe9935e6700 1 Processor -- start 2022-08-10T17:55:17.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 -- start start 2022-08-10T17:55:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe98c0c2000 0x7fe98c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 0x7fe98c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 0x7fe98c0c3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0c2ef0 con 0x7fe98c0c2000 2022-08-10T17:55:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0c26e0 con 0x7fe98c06d9c0 2022-08-10T17:55:17.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe9935e6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c98c0 con 0x7fe98c0c5090 2022-08-10T17:55:17.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.143+0000 7fe991382700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe98c0c2000 0x7fe98c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe98c0c2000 0x7fe98c0c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45374/0 (socket says 172.21.15.150:45374) 2022-08-10T17:55:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe990b81700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 0x7fe98c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991b83700 1 --2- 172.21.15.150:0/2665235586 >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 0x7fe98c0c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 -- 172.21.15.150:0/2665235586 learned_addr learned my addr 172.21.15.150:0/2665235586 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 -- 172.21.15.150:0/2665235586 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 msgr2=0x7fe98c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 0x7fe98c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 -- 172.21.15.150:0/2665235586 >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 msgr2=0x7fe98c0c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 --2- 172.21.15.150:0/2665235586 >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 0x7fe98c0c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 -- 172.21.15.150:0/2665235586 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c154270 con 0x7fe98c0c2000 2022-08-10T17:55:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe990b81700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 0x7fe98c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:17.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991b83700 1 --2- 172.21.15.150:0/2665235586 >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 0x7fe98c0c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe991382700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c2000 0x7fe98c0c8910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe98c154170 tx=0x7fe988009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a528d38f22120af0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe97bfff700 1 -- 172.21.15.150:0/2665235586 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988004230 con 0x7fe98c0c2000 2022-08-10T17:55:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe97bfff700 1 -- 172.21.15.150:0/2665235586 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988004390 con 0x7fe98c0c2000 2022-08-10T17:55:17.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.144+0000 7fe97bfff700 1 -- 172.21.15.150:0/2665235586 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988011850 con 0x7fe98c0c2000 2022-08-10T17:55:17.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 -- 172.21.15.150:0/2665235586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c2000 msgr2=0x7fe98c0c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.162 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c2000 0x7fe98c0c8910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe98c154170 tx=0x7fe988009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:17.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 -- 172.21.15.150:0/2665235586 shutdown_connections 2022-08-10T17:55:17.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2665235586 >> v2:172.21.15.197:3300/0 conn(0x7fe98c06d9c0 0x7fe98c0c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.163 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c2000 0x7fe98c0c8910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2665235586 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c5090 0x7fe98c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.164 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 -- 172.21.15.150:0/2665235586 >> 172.21.15.150:0/2665235586 conn(0x7fe98c06b500 msgr2=0x7fe98c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:17.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 -- 172.21.15.150:0/2665235586 shutdown_connections 2022-08-10T17:55:17.165 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.145+0000 7fe9935e6700 1 -- 172.21.15.150:0/2665235586 wait complete. 2022-08-10T17:55:17.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.146+0000 7fe9935e6700 1 Processor -- start 2022-08-10T17:55:17.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.146+0000 7fe9935e6700 1 -- start start 2022-08-10T17:55:17.166 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 0x7fe98c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 0x7fe98c1478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.167 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14cd10 con 0x7fe98c0c5090 2022-08-10T17:55:17.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14bb90 con 0x7fe98c06d9c0 2022-08-10T17:55:17.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe9935e6700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14b890 con 0x7fe98c0c2000 2022-08-10T17:55:17.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.168 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991382700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 0x7fe98c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45384/0 (socket says 172.21.15.150:45384) 2022-08-10T17:55:17.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 -- 172.21.15.150:0/2901504583 learned_addr learned my addr 172.21.15.150:0/2901504583 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:17.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe990b81700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 0x7fe98c1478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 -- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 msgr2=0x7fe98c1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.169 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 0x7fe98c1478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 -- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 msgr2=0x7fe98c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 0x7fe98c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 -- 172.21.15.150:0/2901504583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009a70 con 0x7fe98c0c5090 2022-08-10T17:55:17.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe990b81700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 0x7fe98c1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:17.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991382700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 0x7fe98c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:17.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe991b83700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe98400b310 tx=0x7fe98400b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.147+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984015070 con 0x7fe98c0c5090 2022-08-10T17:55:17.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.148+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98400bc90 con 0x7fe98c0c5090 2022-08-10T17:55:17.171 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.148+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c009310 con 0x7fe98c0c5090 2022-08-10T17:55:17.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.148+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984009cd0 con 0x7fe98c0c5090 2022-08-10T17:55:17.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.148+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880093e0 con 0x7fe98c0c5090 2022-08-10T17:55:17.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.149+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c147df0 con 0x7fe98c0c5090 2022-08-10T17:55:17.172 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.149+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe984019410 con 0x7fe98c0c5090 2022-08-10T17:55:17.173 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.149+0000 7fe979ffb700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 0x7fe96c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.149+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe9840860d0 con 0x7fe98c0c5090 2022-08-10T17:55:17.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.150+0000 7fe991382700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 0x7fe96c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.150+0000 7fe991382700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 0x7fe96c067590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe988009fd0 tx=0x7fe988008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.174 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.154+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fe9840506b0 con 0x7fe98c0c5090 2022-08-10T17:55:17.348 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.344+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe98c14bd00 con 0x7fe98c0c5090 2022-08-10T17:55:17.349 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.345+0000 7fe979ffb700 1 -- 172.21.15.150:0/2901504583 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7fe984054050 con 0x7fe98c0c5090 2022-08-10T17:55:17.349 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:17.350 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:55:17.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 msgr2=0x7fe96c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 0x7fe96c067590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe988009fd0 tx=0x7fe988008030 comp rx=0 tx=0).stop 2022-08-10T17:55:17.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 msgr2=0x7fe98c1436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.352 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe98400b310 tx=0x7fe98400b620 comp rx=0 tx=0).stop 2022-08-10T17:55:17.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 shutdown_connections 2022-08-10T17:55:17.353 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0c5090 0x7fe98c1436b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe98c06d9c0 0x7fe98c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe96c0650e0 0x7fe96c067590 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 --2- 172.21.15.150:0/2901504583 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe98c0c2000 0x7fe98c1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.354 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 >> 172.21.15.150:0/2901504583 conn(0x7fe98c06b500 msgr2=0x7fe98c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.347+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 shutdown_connections 2022-08-10T17:55:17.355 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.348+0000 7fe9935e6700 1 -- 172.21.15.150:0/2901504583 wait complete. 2022-08-10T17:55:17.365 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-08-10T17:55:17.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:55:17.487 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 Processor -- start 2022-08-10T17:55:17.488 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 -- start start 2022-08-10T17:55:17.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd6c40c7850 0x7fd6c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40c7cb0 con 0x7fd6c4158170 2022-08-10T17:55:17.491 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40c1f40 con 0x7fd6c4151290 2022-08-10T17:55:17.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.484+0000 7fd6c9590700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c4069130 con 0x7fd6c40c7850 2022-08-10T17:55:17.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c27fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd6c4158170 0x7fd6c40c2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58070/0 (socket says 172.21.15.150:58070) 2022-08-10T17:55:17.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c27fc700 1 -- 172.21.15.150:0/917050555 learned_addr learned my addr 172.21.15.150:0/917050555 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:17.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c37fe700 1 --2- 172.21.15.150:0/917050555 >> v2:172.21.15.197:3300/0 conn(0x7fd6c40c7850 0x7fd6c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.492 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948382847 0 0) 0x7fd6c40c7cb0 con 0x7fd6c4158170 2022-08-10T17:55:17.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b0003430 con 0x7fd6c4158170 2022-08-10T17:55:17.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28165968 0 0) 0x7fd6c40c1f40 con 0x7fd6c4151290 2022-08-10T17:55:17.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c40c7cb0 con 0x7fd6c4151290 2022-08-10T17:55:17.493 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c37fe700 1 -- 172.21.15.150:0/917050555 >> v1:172.21.15.197:6789/0 conn(0x7fd6c4151290 legacy=0x7fd6c4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c37fe700 1 -- 172.21.15.150:0/917050555 >> v1:172.21.15.150:6789/0 conn(0x7fd6c4158170 legacy=0x7fd6c40c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.0 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4213618368 0 0) 0x7fd6b0003430 con 0x7fd6c4158170 2022-08-10T17:55:17.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c37fe700 1 -- 172.21.15.150:0/917050555 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40c2220 con 0x7fd6c40c7850 2022-08-10T17:55:17.494 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c37fe700 1 --2- 172.21.15.150:0/917050555 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c40c7850 0x7fd6c4068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009d90 tx=0x7fd6bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba0af4ef62d366 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00e070 con 0x7fd6c40c7850 2022-08-10T17:55:17.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc00ba20 con 0x7fd6c40c7850 2022-08-10T17:55:17.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.485+0000 7fd6c1ffb700 1 -- 172.21.15.150:0/917050555 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8001670 con 0x7fd6c40c7850 2022-08-10T17:55:17.495 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 -- 172.21.15.150:0/917050555 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c40c7850 msgr2=0x7fd6c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 --2- 172.21.15.150:0/917050555 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c40c7850 0x7fd6c4068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009d90 tx=0x7fd6bc00b330 comp rx=0 tx=0).stop 2022-08-10T17:55:17.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 -- 172.21.15.150:0/917050555 shutdown_connections 2022-08-10T17:55:17.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 --2- 172.21.15.150:0/917050555 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c40c7850 0x7fd6c4068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.496 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 -- 172.21.15.150:0/917050555 >> 172.21.15.150:0/917050555 conn(0x7fd6c406f880 msgr2=0x7fd6c406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:17.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 -- 172.21.15.150:0/917050555 shutdown_connections 2022-08-10T17:55:17.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.486+0000 7fd6c9590700 1 -- 172.21.15.150:0/917050555 wait complete. 2022-08-10T17:55:17.497 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.487+0000 7fd6c9590700 1 Processor -- start 2022-08-10T17:55:17.498 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.487+0000 7fd6c9590700 1 -- start start 2022-08-10T17:55:17.504 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6c40c7850 0x7fd6c41ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c4158170 0x7fd6c414bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c41ecd60 con 0x7fd6c4151290 2022-08-10T17:55:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c414d610 con 0x7fd6c4158170 2022-08-10T17:55:17.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c9590700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c414cc90 con 0x7fd6c40c7850 2022-08-10T17:55:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.507 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45396/0 (socket says 172.21.15.150:45396) 2022-08-10T17:55:17.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 -- 172.21.15.150:0/3224306104 learned_addr learned my addr 172.21.15.150:0/3224306104 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:17.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c37fe700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c4158170 0x7fd6c414bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c2ffd700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6c40c7850 0x7fd6c41ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 -- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6c40c7850 msgr2=0x7fd6c41ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6c40c7850 0x7fd6c41ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 -- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c4158170 msgr2=0x7fd6c414bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c4158170 0x7fd6c414bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.488+0000 7fd6c27fc700 1 -- 172.21.15.150:0/3224306104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009a70 con 0x7fd6c4151290 2022-08-10T17:55:17.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6c27fc700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001eb0 tx=0x7fd6b800c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80072d0 con 0x7fd6c4151290 2022-08-10T17:55:17.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8007430 con 0x7fd6c4151290 2022-08-10T17:55:17.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8004910 con 0x7fd6c4151290 2022-08-10T17:55:17.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c414d050 con 0x7fd6c4151290 2022-08-10T17:55:17.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.489+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c41ec980 con 0x7fd6c4151290 2022-08-10T17:55:17.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.490+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c41ec7e0 con 0x7fd6c4151290 2022-08-10T17:55:17.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.490+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd6b801a020 con 0x7fd6c4151290 2022-08-10T17:55:17.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.491+0000 7fd6ab7fe700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 0x7fd6a4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.491+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fd6b8081c20 con 0x7fd6c4151290 2022-08-10T17:55:17.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.491+0000 7fd6c2ffd700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 0x7fd6a4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.516 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.491+0000 7fd6c2ffd700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 0x7fd6a4067590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4001230 tx=0x7fd6b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.517 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.495+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd6c41ec7e0 con 0x7fd6c4151290 2022-08-10T17:55:17.679 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.675+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6c41ecea0 con 0x7fd6a40650e0 2022-08-10T17:55:17.800 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.796+0000 7fd6ab7fe700 1 -- 172.21.15.150:0/3224306104 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391447 (secure 0 0 0) 0x7fd6c41ecea0 con 0x7fd6a40650e0 2022-08-10T17:55:17.806 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:17.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 msgr2=0x7fd6a4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 0x7fd6a4067590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4001230 tx=0x7fd6b4009040 comp rx=0 tx=0).stop 2022-08-10T17:55:17.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 msgr2=0x7fd6c4146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001eb0 tx=0x7fd6b800c6b0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 shutdown_connections 2022-08-10T17:55:17.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd6c4158170 0x7fd6c414bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd6a40650e0 0x7fd6a4067590 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd6c40c7850 0x7fd6c41ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 --2- 172.21.15.150:0/3224306104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c4151290 0x7fd6c4146000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 >> 172.21.15.150:0/3224306104 conn(0x7fd6c406f880 msgr2=0x7fd6c414fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:17.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 shutdown_connections 2022-08-10T17:55:17.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.800+0000 7fd6c9590700 1 -- 172.21.15.150:0/3224306104 wait complete. 2022-08-10T17:55:17.813 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:55:17.817 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":617,"stamp":"2022-08-10T17:55:15.681463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16861660,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250695,"num_write_kb":19248754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151541,"ondisk_log_size":151541,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4260336,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4237760,"kb_avail":750714384,"statfs":{"total":773094113280,"available":768731529216,"internally_reserved":0,"allocated":23052288,"data_stored":34792840,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4339466240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"4.3f","version":"29'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:40.334230+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:54:40.334230+0000","last_peered":"2022-08-10T17:54:40.334230+0000","last_clean":"2022-08-10T17:54:40.334230+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:54:40.334230+0000","last_undegraded":"2022-08-10T17:54:40.334230+0000","last_fullsized":"2022-08-10T17:54:40.334230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'5","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:07.593395+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:39:07.593395+0000","last_peered":"2022-08-10T17:39:07.593395+0000","last_clean":"2022-08-10T17:39:07.593395+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:39:07.593395+0000","last_undegraded":"2022-08-10T17:39:07.593395+0000","last_fullsized":"2022-08-10T17:39:07.593395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:37.884595+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:54:37.884595+0000","last_peered":"2022-08-10T17:54:37.884595+0000","last_clean":"2022-08-10T17:54:37.884595+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:54:37.884595+0000","last_undegraded":"2022-08-10T17:54:37.884595+0000","last_fullsized":"2022-08-10T17:54:37.884595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'7","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.231708+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:54:42.231708+0000","last_peered":"2022-08-10T17:54:42.231708+0000","last_clean":"2022-08-10T17:54:42.231708+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:54:42.231708+0000","last_undegraded":"2022-08-10T17:54:42.231708+0000","last_fullsized":"2022-08-10T17:54:42.231708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.743773+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:54:42.743773+0000","last_peered":"2022-08-10T17:54:42.743773+0000","last_clean":"2022-08-10T17:54:42.743773+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:54:42.743773+0000","last_undegraded":"2022-08-10T17:54:42.743773+0000","last_fullsized":"2022-08-10T17:54:42.743773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.873491+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:54:28.873491+0000","last_peered":"2022-08-10T17:54:28.873491+0000","last_clean":"2022-08-10T17:54:28.873491+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:54:28.873491+0000","last_undegraded":"2022-08-10T17:54:28.873491+0000","last_fullsized":"2022-08-10T17:54:28.873491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'7","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:33.601803+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:54:33.601803+0000","last_peered":"2022-08-10T17:54:33.601803+0000","last_clean":"2022-08-10T17:54:33.601803+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:54:33.601803+0000","last_undegraded":"2022-08-10T17:54:33.601803+0000","last_fullsized":"2022-08-10T17:54:33.601803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.232106+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:54:42.232106+0000","last_peered":"2022-08-10T17:54:42.232106+0000","last_clean":"2022-08-10T17:54:42.232106+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:54:42.232106+0000","last_undegraded":"2022-08-10T17:54:42.232106+0000","last_fullsized":"2022-08-10T17:54:42.232106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:34.853085+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:54:34.853085+0000","last_peered":"2022-08-10T17:54:34.853085+0000","last_clean":"2022-08-10T17:54:34.853085+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:54:34.853085+0000","last_undegraded":"2022-08-10T17:54:34.853085+0000","last_fullsized":"2022-08-10T17:54:34.853085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.770286+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:54:42.770286+0000","last_peered":"2022-08-10T17:54:42.770286+0000","last_clean":"2022-08-10T17:54:42.770286+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:54:42.770286+0000","last_undegraded":"2022-08-10T17:54:42.770286+0000","last_fullsized":"2022-08-10T17:54:42.770286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.986307+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:54:38.986307+0000","last_peered":"2022-08-10T17:54:38.986307+0000","last_clean":"2022-08-10T17:54:38.986307+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:54:38.986307+0000","last_undegraded":"2022-08-10T17:54:38.986307+0000","last_fullsized":"2022-08-10T17:54:38.986307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:32.843892+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:54:32.843892+0000","last_peered":"2022-08-10T17:54:32.843892+0000","last_clean":"2022-08-10T17:54:32.843892+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:54:32.843892+0000","last_undegraded":"2022-08-10T17:54:32.843892+0000","last_fullsized":"2022-08-10T17:54:32.843892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.461168+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:54:42.461168+0000","last_peered":"2022-08-10T17:54:42.461168+0000","last_clean":"2022-08-10T17:54:42.461168+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:54:42.461168+0000","last_undegraded":"2022-08-10T17:54:42.461168+0000","last_fullsized":"2022-08-10T17:54:42.461168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.095079+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:54:42.095079+0000","last_peered":"2022-08-10T17:54:42.095079+0000","last_clean":"2022-08-10T17:54:42.095079+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:54:42.095079+0000","last_undegraded":"2022-08-10T17:54:42.095079+0000","last_fullsized":"2022-08-10T17:54:42.095079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'13","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.005766+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:54:43.005766+0000","last_peered":"2022-08-10T17:54:43.005766+0000","last_clean":"2022-08-10T17:54:43.005766+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:54:43.005766+0000","last_undegraded":"2022-08-10T17:54:43.005766+0000","last_fullsized":"2022-08-10T17:54:43.005766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.953607+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:54:42.953607+0000","last_peered":"2022-08-10T17:54:42.953607+0000","last_clean":"2022-08-10T17:54:42.953607+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:54:42.953607+0000","last_undegraded":"2022-08-10T17:54:42.953607+0000","last_fullsized":"2022-08-10T17:54:42.953607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.741205+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:39:18.741205+0000","last_peered":"2022-08-10T17:39:18.741205+0000","last_clean":"2022-08-10T17:39:18.741205+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:39:18.741205+0000","last_undegraded":"2022-08-10T17:39:18.741205+0000","last_fullsized":"2022-08-10T17:39:18.741205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'19","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705603+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:54:42.705603+0000","last_peered":"2022-08-10T17:54:42.705603+0000","last_clean":"2022-08-10T17:54:42.705603+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:54:42.705603+0000","last_undegraded":"2022-08-10T17:54:42.705603+0000","last_fullsized":"2022-08-10T17:54:42.705603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:39.746555+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:54:39.746555+0000","last_peered":"2022-08-10T17:54:39.746555+0000","last_clean":"2022-08-10T17:54:39.746555+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:54:39.746555+0000","last_undegraded":"2022-08-10T17:54:39.746555+0000","last_fullsized":"2022-08-10T17:54:39.746555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.838422+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:54:42.838422+0000","last_peered":"2022-08-10T17:54:42.838422+0000","last_clean":"2022-08-10T17:54:42.838422+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:54:42.838422+0000","last_undegraded":"2022-08-10T17:54:42.838422+0000","last_fullsized":"2022-08-10T17:54:42.838422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'17","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.623478+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:54:42.623478+0000","last_peered":"2022-08-10T17:54:42.623478+0000","last_clean":"2022-08-10T17:54:42.623478+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:54:42.623478+0000","last_undegraded":"2022-08-10T17:54:42.623478+0000","last_fullsized":"2022-08-10T17:54:42.623478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.797343+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:39:18.797343+0000","last_peered":"2022-08-10T17:39:18.797343+0000","last_clean":"2022-08-10T17:39:18.797343+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:39:18.797343+0000","last_undegraded":"2022-08-10T17:39:18.797343+0000","last_fullsized":"2022-08-10T17:39:18.797343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.436819+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:54:42.436819+0000","last_peered":"2022-08-10T17:54:42.436819+0000","last_clean":"2022-08-10T17:54:42.436819+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:54:42.436819+0000","last_undegraded":"2022-08-10T17:54:42.436819+0000","last_fullsized":"2022-08-10T17:54:42.436819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922500+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:54:42.922500+0000","last_peered":"2022-08-10T17:54:42.922500+0000","last_clean":"2022-08-10T17:54:42.922500+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:54:42.922500+0000","last_undegraded":"2022-08-10T17:54:42.922500+0000","last_fullsized":"2022-08-10T17:54:42.922500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.891954+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:54:42.891954+0000","last_peered":"2022-08-10T17:54:42.891954+0000","last_clean":"2022-08-10T17:54:42.891954+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:54:42.891954+0000","last_undegraded":"2022-08-10T17:54:42.891954+0000","last_fullsized":"2022-08-10T17:54:42.891954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705308+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:54:42.705308+0000","last_peered":"2022-08-10T17:54:42.705308+0000","last_clean":"2022-08-10T17:54:42.705308+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:54:42.705308+0000","last_undegraded":"2022-08-10T17:54:42.705308+0000","last_fullsized":"2022-08-10T17:54:42.705308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928284+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:54:42.928284+0000","last_peered":"2022-08-10T17:54:42.928284+0000","last_clean":"2022-08-10T17:54:42.928284+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:54:42.928284+0000","last_undegraded":"2022-08-10T17:54:42.928284+0000","last_fullsized":"2022-08-10T17:54:42.928284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4457,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.234292+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.234292+0000","last_peered":"2022-08-10T17:54:42.234292+0000","last_clean":"2022-08-10T17:54:42.234292+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.234292+0000","last_undegraded":"2022-08-10T17:54:42.234292+0000","last_fullsized":"2022-08-10T17:54:42.234292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.118864+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.118864+0000","last_peered":"2022-08-10T17:54:42.118864+0000","last_clean":"2022-08-10T17:54:42.118864+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.118864+0000","last_undegraded":"2022-08-10T17:54:42.118864+0000","last_fullsized":"2022-08-10T17:54:42.118864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:36.635634+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:54:36.635634+0000","last_peered":"2022-08-10T17:54:36.635634+0000","last_clean":"2022-08-10T17:54:36.635634+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:54:36.635634+0000","last_undegraded":"2022-08-10T17:54:36.635634+0000","last_fullsized":"2022-08-10T17:54:36.635634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4707,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.914053+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:54:42.914053+0000","last_peered":"2022-08-10T17:54:42.914053+0000","last_clean":"2022-08-10T17:54:42.914053+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:54:42.914053+0000","last_undegraded":"2022-08-10T17:54:42.914053+0000","last_fullsized":"2022-08-10T17:54:42.914053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'12","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085069+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:54:43.085069+0000","last_peered":"2022-08-10T17:54:43.085069+0000","last_clean":"2022-08-10T17:54:43.085069+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:54:43.085069+0000","last_undegraded":"2022-08-10T17:54:43.085069+0000","last_fullsized":"2022-08-10T17:54:43.085069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.817071+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:54:42.817071+0000","last_peered":"2022-08-10T17:54:42.817071+0000","last_clean":"2022-08-10T17:54:42.817071+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:54:42.817071+0000","last_undegraded":"2022-08-10T17:54:42.817071+0000","last_fullsized":"2022-08-10T17:54:42.817071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4367,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.875031+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:42.875031+0000","last_peered":"2022-08-10T17:54:42.875031+0000","last_clean":"2022-08-10T17:54:42.875031+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:42.875031+0000","last_undegraded":"2022-08-10T17:54:42.875031+0000","last_fullsized":"2022-08-10T17:54:42.875031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.234808+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:19.234808+0000","last_peered":"2022-08-10T17:36:19.234808+0000","last_clean":"2022-08-10T17:36:19.234808+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:19.234808+0000","last_undegraded":"2022-08-10T17:36:19.234808+0000","last_fullsized":"2022-08-10T17:36:19.234808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.289577+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:54:42.289577+0000","last_peered":"2022-08-10T17:54:42.289577+0000","last_clean":"2022-08-10T17:54:42.289577+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:54:42.289577+0000","last_undegraded":"2022-08-10T17:54:42.289577+0000","last_fullsized":"2022-08-10T17:54:42.289577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.013544+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:54:43.013544+0000","last_peered":"2022-08-10T17:54:43.013544+0000","last_clean":"2022-08-10T17:54:43.013544+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:54:43.013544+0000","last_undegraded":"2022-08-10T17:54:43.013544+0000","last_fullsized":"2022-08-10T17:54:43.013544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'62","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.930136+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:54:19.930136+0000","last_peered":"2022-08-10T17:54:19.930136+0000","last_clean":"2022-08-10T17:54:19.930136+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:54:19.930136+0000","last_undegraded":"2022-08-10T17:54:19.930136+0000","last_fullsized":"2022-08-10T17:54:19.930136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.743599+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:54:42.743599+0000","last_peered":"2022-08-10T17:54:42.743599+0000","last_clean":"2022-08-10T17:54:42.743599+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:54:42.743599+0000","last_undegraded":"2022-08-10T17:54:42.743599+0000","last_fullsized":"2022-08-10T17:54:42.743599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4171,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.978723+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:42.978723+0000","last_peered":"2022-08-10T17:54:42.978723+0000","last_clean":"2022-08-10T17:54:42.978723+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:42.978723+0000","last_undegraded":"2022-08-10T17:54:42.978723+0000","last_fullsized":"2022-08-10T17:54:42.978723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922864+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:54:42.922864+0000","last_peered":"2022-08-10T17:54:42.922864+0000","last_clean":"2022-08-10T17:54:42.922864+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:54:42.922864+0000","last_undegraded":"2022-08-10T17:54:42.922864+0000","last_fullsized":"2022-08-10T17:54:42.922864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5938,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.820151+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:42.820151+0000","last_peered":"2022-08-10T17:54:42.820151+0000","last_clean":"2022-08-10T17:54:42.820151+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:42.820151+0000","last_undegraded":"2022-08-10T17:54:42.820151+0000","last_fullsized":"2022-08-10T17:54:42.820151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'21","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.397147+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:54:43.397147+0000","last_peered":"2022-08-10T17:54:43.397147+0000","last_clean":"2022-08-10T17:54:43.397147+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:54:43.397147+0000","last_undegraded":"2022-08-10T17:54:43.397147+0000","last_fullsized":"2022-08-10T17:54:43.397147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.497198+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:54:42.497198+0000","last_peered":"2022-08-10T17:54:42.497198+0000","last_clean":"2022-08-10T17:54:42.497198+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:54:42.497198+0000","last_undegraded":"2022-08-10T17:54:42.497198+0000","last_fullsized":"2022-08-10T17:54:42.497198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4198,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.963480+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:54:42.963480+0000","last_peered":"2022-08-10T17:54:42.963480+0000","last_clean":"2022-08-10T17:54:42.963480+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:54:42.963480+0000","last_undegraded":"2022-08-10T17:54:42.963480+0000","last_fullsized":"2022-08-10T17:54:42.963480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'305","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:33.622068+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:54:33.622068+0000","last_peered":"2022-08-10T17:54:33.622068+0000","last_clean":"2022-08-10T17:54:33.622068+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:54:33.622068+0000","last_undegraded":"2022-08-10T17:54:33.622068+0000","last_fullsized":"2022-08-10T17:54:33.622068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'18","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.830077+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:54:42.830077+0000","last_peered":"2022-08-10T17:54:42.830077+0000","last_clean":"2022-08-10T17:54:42.830077+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:54:42.830077+0000","last_undegraded":"2022-08-10T17:54:42.830077+0000","last_fullsized":"2022-08-10T17:54:42.830077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5817,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.411690+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.411690+0000","last_peered":"2022-08-10T17:54:42.411690+0000","last_clean":"2022-08-10T17:54:42.411690+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.411690+0000","last_undegraded":"2022-08-10T17:54:42.411690+0000","last_fullsized":"2022-08-10T17:54:42.411690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887295+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.887295+0000","last_peered":"2022-08-10T17:38:04.887295+0000","last_clean":"2022-08-10T17:38:04.887295+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.887295+0000","last_undegraded":"2022-08-10T17:38:04.887295+0000","last_fullsized":"2022-08-10T17:38:04.887295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:52.324439+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:39:52.324439+0000","last_peered":"2022-08-10T17:39:52.324439+0000","last_clean":"2022-08-10T17:39:52.324439+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:39:52.324439+0000","last_undegraded":"2022-08-10T17:39:52.324439+0000","last_fullsized":"2022-08-10T17:39:52.324439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4271,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.022626+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:54:42.022626+0000","last_peered":"2022-08-10T17:54:42.022626+0000","last_clean":"2022-08-10T17:54:42.022626+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:54:42.022626+0000","last_undegraded":"2022-08-10T17:54:42.022626+0000","last_fullsized":"2022-08-10T17:54:42.022626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794257+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:54:42.794257+0000","last_peered":"2022-08-10T17:54:42.794257+0000","last_clean":"2022-08-10T17:54:42.794257+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:54:42.794257+0000","last_undegraded":"2022-08-10T17:54:42.794257+0000","last_fullsized":"2022-08-10T17:54:42.794257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'9","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.136113+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:54:28.136113+0000","last_peered":"2022-08-10T17:54:28.136113+0000","last_clean":"2022-08-10T17:54:28.136113+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:54:28.136113+0000","last_undegraded":"2022-08-10T17:54:28.136113+0000","last_fullsized":"2022-08-10T17:54:28.136113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4380,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.503273+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:54:42.503273+0000","last_peered":"2022-08-10T17:54:42.503273+0000","last_clean":"2022-08-10T17:54:42.503273+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:54:42.503273+0000","last_undegraded":"2022-08-10T17:54:42.503273+0000","last_fullsized":"2022-08-10T17:54:42.503273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'301","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.335608+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:54:42.335608+0000","last_peered":"2022-08-10T17:54:42.335608+0000","last_clean":"2022-08-10T17:54:42.335608+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:54:42.335608+0000","last_undegraded":"2022-08-10T17:54:42.335608+0000","last_fullsized":"2022-08-10T17:54:42.335608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741737,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:40.875250+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:54:40.875250+0000","last_peered":"2022-08-10T17:54:40.875250+0000","last_clean":"2022-08-10T17:54:40.875250+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:54:40.875250+0000","last_undegraded":"2022-08-10T17:54:40.875250+0000","last_fullsized":"2022-08-10T17:54:40.875250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4919,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.775714+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:54:42.775714+0000","last_peered":"2022-08-10T17:54:42.775714+0000","last_clean":"2022-08-10T17:54:42.775714+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:54:42.775714+0000","last_undegraded":"2022-08-10T17:54:42.775714+0000","last_fullsized":"2022-08-10T17:54:42.775714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794349+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:54:42.794349+0000","last_peered":"2022-08-10T17:54:42.794349+0000","last_clean":"2022-08-10T17:54:42.794349+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:54:42.794349+0000","last_undegraded":"2022-08-10T17:54:42.794349+0000","last_fullsized":"2022-08-10T17:54:42.794349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:41.059030+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:54:41.059030+0000","last_peered":"2022-08-10T17:54:41.059030+0000","last_clean":"2022-08-10T17:54:41.059030+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:54:41.059030+0000","last_undegraded":"2022-08-10T17:54:41.059030+0000","last_fullsized":"2022-08-10T17:54:41.059030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5306,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.823506+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.823506+0000","last_peered":"2022-08-10T17:54:42.823506+0000","last_clean":"2022-08-10T17:54:42.823506+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.823506+0000","last_undegraded":"2022-08-10T17:54:42.823506+0000","last_fullsized":"2022-08-10T17:54:42.823506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'45","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.999725+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:54:19.999725+0000","last_peered":"2022-08-10T17:54:19.999725+0000","last_clean":"2022-08-10T17:54:19.999725+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:54:19.999725+0000","last_undegraded":"2022-08-10T17:54:19.999725+0000","last_fullsized":"2022-08-10T17:54:19.999725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.237197+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:54:42.237197+0000","last_peered":"2022-08-10T17:54:42.237197+0000","last_clean":"2022-08-10T17:54:42.237197+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:54:42.237197+0000","last_undegraded":"2022-08-10T17:54:42.237197+0000","last_fullsized":"2022-08-10T17:54:42.237197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928347+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:54:42.928347+0000","last_peered":"2022-08-10T17:54:42.928347+0000","last_clean":"2022-08-10T17:54:42.928347+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:54:42.928347+0000","last_undegraded":"2022-08-10T17:54:42.928347+0000","last_fullsized":"2022-08-10T17:54:42.928347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.527905+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:39:02.527905+0000","last_peered":"2022-08-10T17:39:02.527905+0000","last_clean":"2022-08-10T17:39:02.527905+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:39:02.527905+0000","last_undegraded":"2022-08-10T17:39:02.527905+0000","last_fullsized":"2022-08-10T17:39:02.527905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818367+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:54:42.818367+0000","last_peered":"2022-08-10T17:54:42.818367+0000","last_clean":"2022-08-10T17:54:42.818367+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:54:42.818367+0000","last_undegraded":"2022-08-10T17:54:42.818367+0000","last_fullsized":"2022-08-10T17:54:42.818367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4694,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.767189+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:54:42.767189+0000","last_peered":"2022-08-10T17:54:42.767189+0000","last_clean":"2022-08-10T17:54:42.767189+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:54:42.767189+0000","last_undegraded":"2022-08-10T17:54:42.767189+0000","last_fullsized":"2022-08-10T17:54:42.767189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.849623+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:39:41.849623+0000","last_peered":"2022-08-10T17:39:41.849623+0000","last_clean":"2022-08-10T17:39:41.849623+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:39:41.849623+0000","last_undegraded":"2022-08-10T17:39:41.849623+0000","last_fullsized":"2022-08-10T17:39:41.849623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.502216+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:54:42.502216+0000","last_peered":"2022-08-10T17:54:42.502216+0000","last_clean":"2022-08-10T17:54:42.502216+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:54:42.502216+0000","last_undegraded":"2022-08-10T17:54:42.502216+0000","last_fullsized":"2022-08-10T17:54:42.502216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3818,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.980477+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:54:42.980477+0000","last_peered":"2022-08-10T17:54:42.980477+0000","last_clean":"2022-08-10T17:54:42.980477+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:54:42.980477+0000","last_undegraded":"2022-08-10T17:54:42.980477+0000","last_fullsized":"2022-08-10T17:54:42.980477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.919068+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:39:18.919068+0000","last_peered":"2022-08-10T17:39:18.919068+0000","last_clean":"2022-08-10T17:39:18.919068+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:39:18.919068+0000","last_undegraded":"2022-08-10T17:39:18.919068+0000","last_fullsized":"2022-08-10T17:39:18.919068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.626548+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:54:42.626548+0000","last_peered":"2022-08-10T17:54:42.626548+0000","last_clean":"2022-08-10T17:54:42.626548+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:54:42.626548+0000","last_undegraded":"2022-08-10T17:54:42.626548+0000","last_fullsized":"2022-08-10T17:54:42.626548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3292,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:41.907134+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:54:41.907134+0000","last_peered":"2022-08-10T17:54:41.907134+0000","last_clean":"2022-08-10T17:54:41.907134+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:54:41.907134+0000","last_undegraded":"2022-08-10T17:54:41.907134+0000","last_fullsized":"2022-08-10T17:54:41.907134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'331","reported_seq":347,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.790315+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:54:42.790315+0000","last_peered":"2022-08-10T17:54:42.790315+0000","last_clean":"2022-08-10T17:54:42.790315+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:54:42.790315+0000","last_undegraded":"2022-08-10T17:54:42.790315+0000","last_fullsized":"2022-08-10T17:54:42.790315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655568,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.920538+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:54:42.920538+0000","last_peered":"2022-08-10T17:54:42.920538+0000","last_clean":"2022-08-10T17:54:42.920538+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:54:42.920538+0000","last_undegraded":"2022-08-10T17:54:42.920538+0000","last_fullsized":"2022-08-10T17:54:42.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5060,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.032924+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:54:43.032924+0000","last_peered":"2022-08-10T17:54:43.032924+0000","last_clean":"2022-08-10T17:54:43.032924+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:54:43.032924+0000","last_undegraded":"2022-08-10T17:54:43.032924+0000","last_fullsized":"2022-08-10T17:54:43.032924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'55","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.387180+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:54:42.387180+0000","last_peered":"2022-08-10T17:54:42.387180+0000","last_clean":"2022-08-10T17:54:42.387180+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:54:42.387180+0000","last_undegraded":"2022-08-10T17:54:42.387180+0000","last_fullsized":"2022-08-10T17:54:42.387180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:35.564003+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:54:35.564003+0000","last_peered":"2022-08-10T17:54:35.564003+0000","last_clean":"2022-08-10T17:54:35.564003+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:54:35.564003+0000","last_undegraded":"2022-08-10T17:54:35.564003+0000","last_fullsized":"2022-08-10T17:54:35.564003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6353,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.572490+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.572490+0000","last_peered":"2022-08-10T17:54:42.572490+0000","last_clean":"2022-08-10T17:54:42.572490+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.572490+0000","last_undegraded":"2022-08-10T17:54:42.572490+0000","last_fullsized":"2022-08-10T17:54:42.572490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:23.787138+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:23.787138+0000","last_peered":"2022-08-10T17:54:23.787138+0000","last_clean":"2022-08-10T17:54:23.787138+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:23.787138+0000","last_undegraded":"2022-08-10T17:54:23.787138+0000","last_fullsized":"2022-08-10T17:54:23.787138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:36.190454+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:54:36.190454+0000","last_peered":"2022-08-10T17:54:36.190454+0000","last_clean":"2022-08-10T17:54:36.190454+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:54:36.190454+0000","last_undegraded":"2022-08-10T17:54:36.190454+0000","last_fullsized":"2022-08-10T17:54:36.190454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6045,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709336+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:42.709336+0000","last_peered":"2022-08-10T17:54:42.709336+0000","last_clean":"2022-08-10T17:54:42.709336+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:42.709336+0000","last_undegraded":"2022-08-10T17:54:42.709336+0000","last_fullsized":"2022-08-10T17:54:42.709336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.850560+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:39:41.850560+0000","last_peered":"2022-08-10T17:39:41.850560+0000","last_clean":"2022-08-10T17:39:41.850560+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:39:41.850560+0000","last_undegraded":"2022-08-10T17:39:41.850560+0000","last_fullsized":"2022-08-10T17:39:41.850560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.562368+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:54:42.562368+0000","last_peered":"2022-08-10T17:54:42.562368+0000","last_clean":"2022-08-10T17:54:42.562368+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:54:42.562368+0000","last_undegraded":"2022-08-10T17:54:42.562368+0000","last_fullsized":"2022-08-10T17:54:42.562368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4544,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.330973+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.330973+0000","last_peered":"2022-08-10T17:54:42.330973+0000","last_clean":"2022-08-10T17:54:42.330973+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.330973+0000","last_undegraded":"2022-08-10T17:54:42.330973+0000","last_fullsized":"2022-08-10T17:54:42.330973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.840772+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:54:42.840772+0000","last_peered":"2022-08-10T17:54:42.840772+0000","last_clean":"2022-08-10T17:54:42.840772+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:54:42.840772+0000","last_undegraded":"2022-08-10T17:54:42.840772+0000","last_fullsized":"2022-08-10T17:54:42.840772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.459739+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:54:24.459739+0000","last_peered":"2022-08-10T17:54:24.459739+0000","last_clean":"2022-08-10T17:54:24.459739+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:54:24.459739+0000","last_undegraded":"2022-08-10T17:54:24.459739+0000","last_fullsized":"2022-08-10T17:54:24.459739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4359,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.960673+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:42.960673+0000","last_peered":"2022-08-10T17:54:42.960673+0000","last_clean":"2022-08-10T17:54:42.960673+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:42.960673+0000","last_undegraded":"2022-08-10T17:54:42.960673+0000","last_fullsized":"2022-08-10T17:54:42.960673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.660704+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:24.660704+0000","last_peered":"2022-08-10T17:54:24.660704+0000","last_clean":"2022-08-10T17:54:24.660704+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:24.660704+0000","last_undegraded":"2022-08-10T17:54:24.660704+0000","last_fullsized":"2022-08-10T17:54:24.660704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818293+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:54:42.818293+0000","last_peered":"2022-08-10T17:54:42.818293+0000","last_clean":"2022-08-10T17:54:42.818293+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:54:42.818293+0000","last_undegraded":"2022-08-10T17:54:42.818293+0000","last_fullsized":"2022-08-10T17:54:42.818293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4659,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.800751+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:54:42.800751+0000","last_peered":"2022-08-10T17:54:42.800751+0000","last_clean":"2022-08-10T17:54:42.800751+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:54:42.800751+0000","last_undegraded":"2022-08-10T17:54:42.800751+0000","last_fullsized":"2022-08-10T17:54:42.800751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.889796+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:38:04.889796+0000","last_peered":"2022-08-10T17:38:04.889796+0000","last_clean":"2022-08-10T17:38:04.889796+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:38:04.889796+0000","last_undegraded":"2022-08-10T17:38:04.889796+0000","last_fullsized":"2022-08-10T17:38:04.889796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.649086+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:54:42.649086+0000","last_peered":"2022-08-10T17:54:42.649086+0000","last_clean":"2022-08-10T17:54:42.649086+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:54:42.649086+0000","last_undegraded":"2022-08-10T17:54:42.649086+0000","last_fullsized":"2022-08-10T17:54:42.649086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4786,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.967437+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:42.967437+0000","last_peered":"2022-08-10T17:54:42.967437+0000","last_clean":"2022-08-10T17:54:42.967437+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:42.967437+0000","last_undegraded":"2022-08-10T17:54:42.967437+0000","last_fullsized":"2022-08-10T17:54:42.967437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.530687+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:39:02.530687+0000","last_peered":"2022-08-10T17:39:02.530687+0000","last_clean":"2022-08-10T17:39:02.530687+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:39:02.530687+0000","last_undegraded":"2022-08-10T17:39:02.530687+0000","last_fullsized":"2022-08-10T17:39:02.530687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.946664+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:54:42.946664+0000","last_peered":"2022-08-10T17:54:42.946664+0000","last_clean":"2022-08-10T17:54:42.946664+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:54:42.946664+0000","last_undegraded":"2022-08-10T17:54:42.946664+0000","last_fullsized":"2022-08-10T17:54:42.946664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.882397+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.882397+0000","last_peered":"2022-08-10T17:54:42.882397+0000","last_clean":"2022-08-10T17:54:42.882397+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.882397+0000","last_undegraded":"2022-08-10T17:54:42.882397+0000","last_fullsized":"2022-08-10T17:54:42.882397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'81","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.797747+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:54:42.797747+0000","last_peered":"2022-08-10T17:54:42.797747+0000","last_clean":"2022-08-10T17:54:42.797747+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:54:42.797747+0000","last_undegraded":"2022-08-10T17:54:42.797747+0000","last_fullsized":"2022-08-10T17:54:42.797747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":79,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'18","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.599299+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:54:42.599299+0000","last_peered":"2022-08-10T17:54:42.599299+0000","last_clean":"2022-08-10T17:54:42.599299+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:54:42.599299+0000","last_undegraded":"2022-08-10T17:54:42.599299+0000","last_fullsized":"2022-08-10T17:54:42.599299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5875,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.568847+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:54:42.568847+0000","last_peered":"2022-08-10T17:54:42.568847+0000","last_clean":"2022-08-10T17:54:42.568847+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:54:42.568847+0000","last_undegraded":"2022-08-10T17:54:42.568847+0000","last_fullsized":"2022-08-10T17:54:42.568847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.948551+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:39:18.948551+0000","last_peered":"2022-08-10T17:39:18.948551+0000","last_clean":"2022-08-10T17:39:18.948551+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:39:18.948551+0000","last_undegraded":"2022-08-10T17:39:18.948551+0000","last_fullsized":"2022-08-10T17:39:18.948551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2959,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.508415+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.508415+0000","last_peered":"2022-08-10T17:54:42.508415+0000","last_clean":"2022-08-10T17:54:42.508415+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.508415+0000","last_undegraded":"2022-08-10T17:54:42.508415+0000","last_fullsized":"2022-08-10T17:54:42.508415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859723+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:37:58.859723+0000","last_peered":"2022-08-10T17:37:58.859723+0000","last_clean":"2022-08-10T17:37:58.859723+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:37:58.859723+0000","last_undegraded":"2022-08-10T17:37:58.859723+0000","last_fullsized":"2022-08-10T17:37:58.859723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'16","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.999680+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:54:42.999680+0000","last_peered":"2022-08-10T17:54:42.999680+0000","last_clean":"2022-08-10T17:54:42.999680+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:54:42.999680+0000","last_undegraded":"2022-08-10T17:54:42.999680+0000","last_fullsized":"2022-08-10T17:54:42.999680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4329,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.003375+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.003375+0000","last_peered":"2022-08-10T17:54:43.003375+0000","last_clean":"2022-08-10T17:54:43.003375+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.003375+0000","last_undegraded":"2022-08-10T17:54:43.003375+0000","last_fullsized":"2022-08-10T17:54:43.003375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'71","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.572737+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:54:38.572737+0000","last_peered":"2022-08-10T17:54:38.572737+0000","last_clean":"2022-08-10T17:54:38.572737+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:54:38.572737+0000","last_undegraded":"2022-08-10T17:54:38.572737+0000","last_fullsized":"2022-08-10T17:54:38.572737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.502348+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:54:42.502348+0000","last_peered":"2022-08-10T17:54:42.502348+0000","last_clean":"2022-08-10T17:54:42.502348+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:54:42.502348+0000","last_undegraded":"2022-08-10T17:54:42.502348+0000","last_fullsized":"2022-08-10T17:54:42.502348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4823,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.392349+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:54:42.392349+0000","last_peered":"2022-08-10T17:54:42.392349+0000","last_clean":"2022-08-10T17:54:42.392349+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:54:42.392349+0000","last_undegraded":"2022-08-10T17:54:42.392349+0000","last_fullsized":"2022-08-10T17:54:42.392349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1829","reported_seq":1844,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:25.148933+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:54:25.148933+0000","last_peered":"2022-08-10T17:54:25.148933+0000","last_clean":"2022-08-10T17:54:25.148933+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:54:25.148933+0000","last_undegraded":"2022-08-10T17:54:25.148933+0000","last_fullsized":"2022-08-10T17:54:25.148933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1829,"log_dups_size":0,"ondisk_log_size":1829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":8926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'9","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:31.688949+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:54:31.688949+0000","last_peered":"2022-08-10T17:54:31.688949+0000","last_clean":"2022-08-10T17:54:31.688949+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:54:31.688949+0000","last_undegraded":"2022-08-10T17:54:31.688949+0000","last_fullsized":"2022-08-10T17:54:31.688949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4542,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.578670+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.578670+0000","last_peered":"2022-08-10T17:54:42.578670+0000","last_clean":"2022-08-10T17:54:42.578670+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.578670+0000","last_undegraded":"2022-08-10T17:54:42.578670+0000","last_fullsized":"2022-08-10T17:54:42.578670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057640+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:19.057640+0000","last_peered":"2022-08-10T17:36:19.057640+0000","last_clean":"2022-08-10T17:36:19.057640+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:19.057640+0000","last_undegraded":"2022-08-10T17:36:19.057640+0000","last_fullsized":"2022-08-10T17:36:19.057640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.361881+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:54:42.361881+0000","last_peered":"2022-08-10T17:54:42.361881+0000","last_clean":"2022-08-10T17:54:42.361881+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:54:42.361881+0000","last_undegraded":"2022-08-10T17:54:42.361881+0000","last_fullsized":"2022-08-10T17:54:42.361881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3894,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.753421+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:54:42.753421+0000","last_peered":"2022-08-10T17:54:42.753421+0000","last_clean":"2022-08-10T17:54:42.753421+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:54:42.753421+0000","last_undegraded":"2022-08-10T17:54:42.753421+0000","last_fullsized":"2022-08-10T17:54:42.753421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.730686+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:39:18.730686+0000","last_peered":"2022-08-10T17:39:18.730686+0000","last_clean":"2022-08-10T17:39:18.730686+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:39:18.730686+0000","last_undegraded":"2022-08-10T17:39:18.730686+0000","last_fullsized":"2022-08-10T17:39:18.730686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'13","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.242055+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:54:42.242055+0000","last_peered":"2022-08-10T17:54:42.242055+0000","last_clean":"2022-08-10T17:54:42.242055+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:54:42.242055+0000","last_undegraded":"2022-08-10T17:54:42.242055+0000","last_fullsized":"2022-08-10T17:54:42.242055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4423,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.557967+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.557967+0000","last_peered":"2022-08-10T17:54:42.557967+0000","last_clean":"2022-08-10T17:54:42.557967+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.557967+0000","last_undegraded":"2022-08-10T17:54:42.557967+0000","last_fullsized":"2022-08-10T17:54:42.557967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535607+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:54:42.535607+0000","last_peered":"2022-08-10T17:54:42.535607+0000","last_clean":"2022-08-10T17:54:42.535607+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:54:42.535607+0000","last_undegraded":"2022-08-10T17:54:42.535607+0000","last_fullsized":"2022-08-10T17:54:42.535607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.037986+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:54:42.037986+0000","last_peered":"2022-08-10T17:54:42.037986+0000","last_clean":"2022-08-10T17:54:42.037986+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:54:42.037986+0000","last_undegraded":"2022-08-10T17:54:42.037986+0000","last_fullsized":"2022-08-10T17:54:42.037986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5520,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.059549+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:54:42.059549+0000","last_peered":"2022-08-10T17:54:42.059549+0000","last_clean":"2022-08-10T17:54:42.059549+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:54:42.059549+0000","last_undegraded":"2022-08-10T17:54:42.059549+0000","last_fullsized":"2022-08-10T17:54:42.059549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709261+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:54:42.709261+0000","last_peered":"2022-08-10T17:54:42.709261+0000","last_clean":"2022-08-10T17:54:42.709261+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:54:42.709261+0000","last_undegraded":"2022-08-10T17:54:42.709261+0000","last_fullsized":"2022-08-10T17:54:42.709261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'17","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535624+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:54:42.535624+0000","last_peered":"2022-08-10T17:54:42.535624+0000","last_clean":"2022-08-10T17:54:42.535624+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:54:42.535624+0000","last_undegraded":"2022-08-10T17:54:42.535624+0000","last_fullsized":"2022-08-10T17:54:42.535624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.786782+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:39:18.786782+0000","last_peered":"2022-08-10T17:39:18.786782+0000","last_clean":"2022-08-10T17:39:18.786782+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:39:18.786782+0000","last_undegraded":"2022-08-10T17:39:18.786782+0000","last_fullsized":"2022-08-10T17:39:18.786782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:33.812726+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:54:33.812726+0000","last_peered":"2022-08-10T17:54:33.812726+0000","last_clean":"2022-08-10T17:54:33.812726+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:54:33.812726+0000","last_undegraded":"2022-08-10T17:54:33.812726+0000","last_fullsized":"2022-08-10T17:54:33.812726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'15","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.550686+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:54:42.550686+0000","last_peered":"2022-08-10T17:54:42.550686+0000","last_clean":"2022-08-10T17:54:42.550686+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:54:42.550686+0000","last_undegraded":"2022-08-10T17:54:42.550686+0000","last_fullsized":"2022-08-10T17:54:42.550686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'13","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.321321+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:54:42.321321+0000","last_peered":"2022-08-10T17:54:42.321321+0000","last_clean":"2022-08-10T17:54:42.321321+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:54:42.321321+0000","last_undegraded":"2022-08-10T17:54:42.321321+0000","last_fullsized":"2022-08-10T17:54:42.321321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.684602+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:54:42.684602+0000","last_peered":"2022-08-10T17:54:42.684602+0000","last_clean":"2022-08-10T17:54:42.684602+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:54:42.684602+0000","last_undegraded":"2022-08-10T17:54:42.684602+0000","last_fullsized":"2022-08-10T17:54:42.684602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":714,"ondisk_log_size":714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271292,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3451,"num_write_kb":18439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32542584,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3236,"ondisk_log_size":3236,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478068,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475072,"kb_avail":93893772,"statfs":{"total":96636764160,"available":96147222528,"internally_reserved":0,"allocated":3059712,"data_stored":6661537,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486473728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.57399999999999995}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.443},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.312}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.28599999999999998},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.33900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504004,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503680,"kb_avail":93867836,"statfs":{"total":96636764160,"available":96120664064,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515768320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":10.569000000000001,"15min":11.555},"min":{"1min":0.23400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57299999999999995,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.309},{"interface":"front","average":{"1min":0.41599999999999998,"5min":10.672000000000001,"15min":12.423999999999999},"min":{"1min":0.251,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.71799999999999997,"5min":129.767,"15min":129.767},"last":0.33800000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":11.362,"15min":13.35},"min":{"1min":0.26100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.65400000000000003,"5min":114.83,"15min":318.94299999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":11.228999999999999,"15min":11.75},"min":{"1min":0.33000000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":0.64700000000000002,"5min":114.842,"15min":119.708},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.84799999999999998,"15min":4.5620000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.72599999999999998,"5min":17.885999999999999,"15min":107.033},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.745,"15min":4.8959999999999999},"min":{"1min":0.27600000000000002,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.74299999999999999,"5min":17.895,"15min":107.062},"last":0.443}]},{"osd":3,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":2.7210000000000001},"min":{"1min":0.318,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":1.2130000000000001,"15min":96.834999999999994},"last":0.38},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.501,"15min":2.996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":0.61099999999999999,"5min":3.0459999999999998,"15min":96.870000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":3.8100000000000001,"15min":6.5519999999999996},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.183},"max":{"1min":0.54300000000000004,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":3.8700000000000001,"15min":6.6059999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.41799999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":7.7720000000000002,"15min":8.1690000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":0.63800000000000001,"5min":79.944999999999993,"15min":100.741},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":7.8630000000000004,"15min":8.0990000000000002},"min":{"1min":0.29299999999999998,"5min":0.249,"15min":0.22},"max":{"1min":0.65100000000000002,"5min":80.159000000000006,"15min":100.715},"last":0.35599999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:54:12 2022","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.73399999999999999,"15min":3.956},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":0.59299999999999997,"5min":8.4489999999999998,"15min":59.606999999999999},"last":0.37},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.63500000000000001,"15min":3.5129999999999999},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.251},"max":{"1min":0.66200000000000003,"5min":8.4659999999999993,"15min":59.384},"last":0.46300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575086,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621580,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621248,"kb_avail":93750260,"statfs":{"total":96636764160,"available":96000266240,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636157952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.308},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.26200000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.371},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.46200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.495},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834575086,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603792,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596096,"kb_avail":93768048,"statfs":{"total":96636764160,"available":96018481152,"internally_reserved":0,"allocated":7872512,"data_stored":11046620,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610402304},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":12.071999999999999,"15min":12.028},"min":{"1min":0.191,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":57.822000000000003,"5min":90.528999999999996,"15min":111.419},"last":0.27200000000000002},{"interface":"front","average":{"1min":3.169,"5min":12.108000000000001,"15min":12.244},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":57.835999999999999,"5min":93.111999999999995,"15min":111.506},"last":0.32300000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.64700000000000002,"15min":6.4180000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.189},"max":{"1min":0.68700000000000006,"5min":10.821999999999999,"15min":130.566},"last":0.245},{"interface":"front","average":{"1min":0.38100000000000001,"5min":1.4039999999999999,"15min":6.4359999999999999},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.222},"max":{"1min":0.66500000000000004,"5min":50.625,"15min":130.63300000000001},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.80000000000000004,"15min":4.4560000000000004},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60799999999999998,"5min":31.167999999999999,"15min":111.333},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.1719999999999999,"15min":4.641},"min":{"1min":0.28199999999999997,"5min":0.20899999999999999,"15min":0.19700000000000001},"max":{"1min":0.72799999999999998,"5min":50.686999999999998,"15min":111.377},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":2.7250000000000001,"15min":7.0570000000000004},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":90.531000000000006,"15min":127.629},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":3.1960000000000002,"15min":7.2679999999999998},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.76600000000000001,"5min":90.509,"15min":127.497},"last":0.374}]},{"osd":5,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":4.7359999999999998,"15min":8.3179999999999996},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":2.4860000000000002,"5min":88.512,"15min":127.77500000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":5.7759999999999998,"15min":8.4789999999999992},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64600000000000002,"5min":88.429000000000002,"15min":127.798},"last":0.38400000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":1.1299999999999999,"15min":4.6859999999999999},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":50.664000000000001,"15min":114.8},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.448,"15min":5.032},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.747,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.432}]},{"osd":7,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.198,"15min":3.2629999999999999},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.63600000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4390000000000001,"15min":3.855},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.30199999999999999},"max":{"1min":1.343,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.44600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472320,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472000,"kb_avail":93899520,"statfs":{"total":96636764160,"available":96153108480,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483328000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.23699999999999999},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.315}]},{"osd":1,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":11.993,"15min":15.167},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":37.323,"5min":150.911,"15min":433.41199999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":5.6980000000000004,"5min":12.128,"15min":13.394},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":37.259999999999998,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.27200000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:54:18 2022","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.44,"15min":4.4889999999999999},"min":{"1min":0.25800000000000001,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.55600000000000005,"5min":4.0659999999999998,"15min":250.44200000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.504,"15min":3.351},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":4.109,"15min":142.11699999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":3.48,"15min":7.9800000000000004},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":30.893000000000001,"5min":47.207999999999998,"15min":114.259},"last":0.40600000000000003},{"interface":"front","average":{"1min":4.4050000000000002,"5min":3.3700000000000001,"15min":8.2829999999999995},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":30.867999999999999,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":2.2109999999999999,"5min":4.1440000000000001,"15min":7.8929999999999998},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":9.0790000000000006,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.976,"5min":4.2249999999999996,"15min":8.1769999999999996},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":19.873000000000001,"5min":63.508000000000003,"15min":100.22},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":1.2350000000000001,"15min":3.774},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":19.789999999999999,"5min":19.789999999999999,"15min":83.046000000000006},"last":0.58099999999999996},{"interface":"front","average":{"1min":4.2530000000000001,"5min":1.4470000000000001,"15min":3.4809999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":28.131,"5min":28.131,"15min":60.445},"last":0.505}]},{"osd":7,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":1.4490000000000001,"15min":4.3289999999999997},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.904000000000003,"5min":34.904000000000003,"15min":94.753},"last":0.53100000000000003},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.405,"15min":4.7729999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":19.922999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473688,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":471744,"kb_avail":93898152,"statfs":{"total":96636764160,"available":96151707648,"internally_reserved":0,"allocated":1982464,"data_stored":2795516,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483065856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.30599999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.23100000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.26300000000000001},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.65500000000000003}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.63},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575089,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559732,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551104,"kb_avail":93812108,"statfs":{"total":96636764160,"available":96063598592,"internally_reserved":0,"allocated":8826880,"data_stored":13742318,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564330496},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.38200000000000001},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.371},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.34499999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.434},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.41599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547152,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546816,"kb_avail":93824688,"statfs":{"total":96636764160,"available":96076480512,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":559939584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.437}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10322562,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2661826,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13608628,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937479,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:55:17.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:55:17.981 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.978+0000 7fb491c58700 1 Processor -- start 2022-08-10T17:55:17.982 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.978+0000 7fb491c58700 1 -- start start 2022-08-10T17:55:17.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.978+0000 7fb491c58700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb48c14ce90 0x7fb48c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.978+0000 7fb491c58700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0c98f0 con 0x7fb48c06dc90 2022-08-10T17:55:17.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.978+0000 7fb491c58700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0c4880 con 0x7fb48c06a760 2022-08-10T17:55:17.985 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb491c58700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0c4e20 con 0x7fb48c14ce90 2022-08-10T17:55:17.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb48c14ce90 0x7fb48c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb48c06dc90 0x7fb48c069910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58084/0 (socket says 172.21.15.150:58084) 2022-08-10T17:55:17.986 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb48c14ce90 0x7fb48c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45402/0 (socket says 172.21.15.150:45402) 2022-08-10T17:55:17.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48affd700 1 -- 172.21.15.150:0/1703613459 learned_addr learned my addr 172.21.15.150:0/1703613459 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:17.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 -- 172.21.15.150:0/1703613459 >> v1:172.21.15.197:6789/0 conn(0x7fb48c06a760 legacy=0x7fb48c0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 -- 172.21.15.150:0/1703613459 >> v1:172.21.15.150:6789/0 conn(0x7fb48c06dc90 legacy=0x7fb48c069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 -- 172.21.15.150:0/1703613459 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0c4b40 con 0x7fb48c14ce90 2022-08-10T17:55:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48b7fe700 1 --2- 172.21.15.150:0/1703613459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c156b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0096b0 tx=0x7fb47c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c194b951125b96 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48a7fc700 1 -- 172.21.15.150:0/1703613459 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c010800 con 0x7fb48c14ce90 2022-08-10T17:55:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48a7fc700 1 -- 172.21.15.150:0/1703613459 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c010960 con 0x7fb48c14ce90 2022-08-10T17:55:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.979+0000 7fb48a7fc700 1 -- 172.21.15.150:0/1703613459 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c010d10 con 0x7fb48c14ce90 2022-08-10T17:55:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 -- 172.21.15.150:0/1703613459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 msgr2=0x7fb48c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 --2- 172.21.15.150:0/1703613459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c156b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0096b0 tx=0x7fb47c0099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 -- 172.21.15.150:0/1703613459 shutdown_connections 2022-08-10T17:55:17.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 --2- 172.21.15.150:0/1703613459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c156b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 -- 172.21.15.150:0/1703613459 >> 172.21.15.150:0/1703613459 conn(0x7fb48c06b500 msgr2=0x7fb48c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:17.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 -- 172.21.15.150:0/1703613459 shutdown_connections 2022-08-10T17:55:17.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.980+0000 7fb491c58700 1 -- 172.21.15.150:0/1703613459 wait complete. 2022-08-10T17:55:17.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.981+0000 7fb491c58700 1 Processor -- start 2022-08-10T17:55:17.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.981+0000 7fb491c58700 1 -- start start 2022-08-10T17:55:17.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb48c06a760 0x7fb48c145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb48c06dc90 0x7fb48c14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:17.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c14d620 con 0x7fb48c14ce90 2022-08-10T17:55:17.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c14d8c0 con 0x7fb48c06dc90 2022-08-10T17:55:17.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb491c58700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c1f0180 con 0x7fb48c06a760 2022-08-10T17:55:17.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb48bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb48bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45412/0 (socket says 172.21.15.150:45412) 2022-08-10T17:55:17.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb48affd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb48c06dc90 0x7fb48c14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb48bfff700 1 -- 172.21.15.150:0/3780904467 learned_addr learned my addr 172.21.15.150:0/3780904467 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:17.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.982+0000 7fb48b7fe700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb48c06a760 0x7fb48c145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:17.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 -- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb48c06a760 msgr2=0x7fb48c145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb48c06a760 0x7fb48c145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 -- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb48c06dc90 msgr2=0x7fb48c14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:17.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb48c06dc90 0x7fb48c14e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:17.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 -- 172.21.15.150:0/3780904467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c009310 con 0x7fb48c14ce90 2022-08-10T17:55:17.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb48bfff700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c6e0 tx=0x7fb48400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:17.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484003a80 con 0x7fb48c14ce90 2022-08-10T17:55:17.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484003be0 con 0x7fb48c14ce90 2022-08-10T17:55:17.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c155ac0 con 0x7fb48c14ce90 2022-08-10T17:55:17.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4840050d0 con 0x7fb48c14ce90 2022-08-10T17:55:17.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.983+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c0c7fb0 con 0x7fb48c14ce90 2022-08-10T17:55:17.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.984+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c06d8c0 con 0x7fb48c14ce90 2022-08-10T17:55:17.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.984+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb484019030 con 0x7fb48c14ce90 2022-08-10T17:55:18.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.985+0000 7fb473fff700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 0x7fb46c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.985+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb4840816d0 con 0x7fb48c14ce90 2022-08-10T17:55:18.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.985+0000 7fb48b7fe700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 0x7fb46c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.985+0000 7fb48b7fe700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 0x7fb46c067560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000c00 tx=0x7fb47c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:17.989+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb48404f6b0 con 0x7fb48c14ce90 2022-08-10T17:55:18.175 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.171+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb48c155fe0 con 0x7fb46c0650b0 2022-08-10T17:55:18.186 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.182+0000 7fb473fff700 1 -- 172.21.15.150:0/3780904467 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391440 (secure 0 0 0) 0x7fb48c155fe0 con 0x7fb46c0650b0 2022-08-10T17:55:18.191 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:18.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.185+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 msgr2=0x7fb46c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.194 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.185+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 0x7fb46c067560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000c00 tx=0x7fb47c008030 comp rx=0 tx=0).stop 2022-08-10T17:55:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.185+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 msgr2=0x7fb48c14ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.185+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c6e0 tx=0x7fb48400c9f0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 shutdown_connections 2022-08-10T17:55:18.195 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb48c14ce90 0x7fb48c14ed70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb46c0650b0 0x7fb46c067560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb48c06a760 0x7fb48c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 --2- 172.21.15.150:0/3780904467 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb48c06dc90 0x7fb48c14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.196 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 >> 172.21.15.150:0/3780904467 conn(0x7fb48c06b500 msgr2=0x7fb48c0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:18.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 shutdown_connections 2022-08-10T17:55:18.197 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.186+0000 7fb491c58700 1 -- 172.21.15.150:0/3780904467 wait complete. 2022-08-10T17:55:18.197 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:55:18.202 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":618,"stamp":"2022-08-10T17:55:17.797328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16861974,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250697,"num_write_kb":19248756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151945,"ondisk_log_size":151945,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4260720,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4238144,"kb_avail":750714000,"statfs":{"total":773094113280,"available":768731136000,"internally_reserved":0,"allocated":23052288,"data_stored":34793013,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4339859456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":140,"apply_latency_ms":140,"commit_latency_ns":140000000,"apply_latency_ns":140000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":314,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.118262"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.530765+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:55:16.530765+0000","last_peered":"2022-08-10T17:55:16.530765+0000","last_clean":"2022-08-10T17:55:16.530765+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:16.530765+0000","last_undegraded":"2022-08-10T17:55:16.530765+0000","last_fullsized":"2022-08-10T17:55:16.530765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'5","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:07.593395+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:39:07.593395+0000","last_peered":"2022-08-10T17:39:07.593395+0000","last_clean":"2022-08-10T17:39:07.593395+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:39:07.593395+0000","last_undegraded":"2022-08-10T17:39:07.593395+0000","last_fullsized":"2022-08-10T17:39:07.593395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:37.884595+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:54:37.884595+0000","last_peered":"2022-08-10T17:54:37.884595+0000","last_clean":"2022-08-10T17:54:37.884595+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:54:37.884595+0000","last_undegraded":"2022-08-10T17:54:37.884595+0000","last_fullsized":"2022-08-10T17:54:37.884595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547841+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:55:16.547841+0000","last_peered":"2022-08-10T17:55:16.547841+0000","last_clean":"2022-08-10T17:55:16.547841+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:16.547841+0000","last_undegraded":"2022-08-10T17:55:16.547841+0000","last_fullsized":"2022-08-10T17:55:16.547841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.743773+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:54:42.743773+0000","last_peered":"2022-08-10T17:54:42.743773+0000","last_clean":"2022-08-10T17:54:42.743773+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:54:42.743773+0000","last_undegraded":"2022-08-10T17:54:42.743773+0000","last_fullsized":"2022-08-10T17:54:42.743773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.873491+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:54:28.873491+0000","last_peered":"2022-08-10T17:54:28.873491+0000","last_clean":"2022-08-10T17:54:28.873491+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:54:28.873491+0000","last_undegraded":"2022-08-10T17:54:28.873491+0000","last_fullsized":"2022-08-10T17:54:28.873491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549244+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:55:16.549244+0000","last_peered":"2022-08-10T17:55:16.549244+0000","last_clean":"2022-08-10T17:55:16.549244+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:55:16.549244+0000","last_undegraded":"2022-08-10T17:55:16.549244+0000","last_fullsized":"2022-08-10T17:55:16.549244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.232106+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:54:42.232106+0000","last_peered":"2022-08-10T17:54:42.232106+0000","last_clean":"2022-08-10T17:54:42.232106+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:54:42.232106+0000","last_undegraded":"2022-08-10T17:54:42.232106+0000","last_fullsized":"2022-08-10T17:54:42.232106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:34.853085+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:54:34.853085+0000","last_peered":"2022-08-10T17:54:34.853085+0000","last_clean":"2022-08-10T17:54:34.853085+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:54:34.853085+0000","last_undegraded":"2022-08-10T17:54:34.853085+0000","last_fullsized":"2022-08-10T17:54:34.853085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.770286+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:54:42.770286+0000","last_peered":"2022-08-10T17:54:42.770286+0000","last_clean":"2022-08-10T17:54:42.770286+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:54:42.770286+0000","last_undegraded":"2022-08-10T17:54:42.770286+0000","last_fullsized":"2022-08-10T17:54:42.770286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.986307+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:54:38.986307+0000","last_peered":"2022-08-10T17:54:38.986307+0000","last_clean":"2022-08-10T17:54:38.986307+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:54:38.986307+0000","last_undegraded":"2022-08-10T17:54:38.986307+0000","last_fullsized":"2022-08-10T17:54:38.986307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527871+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:55:16.527871+0000","last_peered":"2022-08-10T17:55:16.527871+0000","last_clean":"2022-08-10T17:55:16.527871+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:16.527871+0000","last_undegraded":"2022-08-10T17:55:16.527871+0000","last_fullsized":"2022-08-10T17:55:16.527871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.531128+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:55:16.531128+0000","last_peered":"2022-08-10T17:55:16.531128+0000","last_clean":"2022-08-10T17:55:16.531128+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:16.531128+0000","last_undegraded":"2022-08-10T17:55:16.531128+0000","last_fullsized":"2022-08-10T17:55:16.531128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.095079+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:54:42.095079+0000","last_peered":"2022-08-10T17:54:42.095079+0000","last_clean":"2022-08-10T17:54:42.095079+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:54:42.095079+0000","last_undegraded":"2022-08-10T17:54:42.095079+0000","last_fullsized":"2022-08-10T17:54:42.095079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549328+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:55:16.549328+0000","last_peered":"2022-08-10T17:55:16.549328+0000","last_clean":"2022-08-10T17:55:16.549328+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:55:16.549328+0000","last_undegraded":"2022-08-10T17:55:16.549328+0000","last_fullsized":"2022-08-10T17:55:16.549328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.953607+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:54:42.953607+0000","last_peered":"2022-08-10T17:54:42.953607+0000","last_clean":"2022-08-10T17:54:42.953607+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:54:42.953607+0000","last_undegraded":"2022-08-10T17:54:42.953607+0000","last_fullsized":"2022-08-10T17:54:42.953607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.741205+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:39:18.741205+0000","last_peered":"2022-08-10T17:39:18.741205+0000","last_clean":"2022-08-10T17:39:18.741205+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:39:18.741205+0000","last_undegraded":"2022-08-10T17:39:18.741205+0000","last_fullsized":"2022-08-10T17:39:18.741205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'19","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705603+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:54:42.705603+0000","last_peered":"2022-08-10T17:54:42.705603+0000","last_clean":"2022-08-10T17:54:42.705603+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:54:42.705603+0000","last_undegraded":"2022-08-10T17:54:42.705603+0000","last_fullsized":"2022-08-10T17:54:42.705603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534955+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:55:16.534955+0000","last_peered":"2022-08-10T17:55:16.534955+0000","last_clean":"2022-08-10T17:55:16.534955+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:16.534955+0000","last_undegraded":"2022-08-10T17:55:16.534955+0000","last_fullsized":"2022-08-10T17:55:16.534955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.838422+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:54:42.838422+0000","last_peered":"2022-08-10T17:54:42.838422+0000","last_clean":"2022-08-10T17:54:42.838422+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:54:42.838422+0000","last_undegraded":"2022-08-10T17:54:42.838422+0000","last_fullsized":"2022-08-10T17:54:42.838422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535492+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:55:16.535492+0000","last_peered":"2022-08-10T17:55:16.535492+0000","last_clean":"2022-08-10T17:55:16.535492+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:55:16.535492+0000","last_undegraded":"2022-08-10T17:55:16.535492+0000","last_fullsized":"2022-08-10T17:55:16.535492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.797343+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:39:18.797343+0000","last_peered":"2022-08-10T17:39:18.797343+0000","last_clean":"2022-08-10T17:39:18.797343+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:39:18.797343+0000","last_undegraded":"2022-08-10T17:39:18.797343+0000","last_fullsized":"2022-08-10T17:39:18.797343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547260+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:55:16.547260+0000","last_peered":"2022-08-10T17:55:16.547260+0000","last_clean":"2022-08-10T17:55:16.547260+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:16.547260+0000","last_undegraded":"2022-08-10T17:55:16.547260+0000","last_fullsized":"2022-08-10T17:55:16.547260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533494+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:55:16.533494+0000","last_peered":"2022-08-10T17:55:16.533494+0000","last_clean":"2022-08-10T17:55:16.533494+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:55:16.533494+0000","last_undegraded":"2022-08-10T17:55:16.533494+0000","last_fullsized":"2022-08-10T17:55:16.533494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.891954+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:54:42.891954+0000","last_peered":"2022-08-10T17:54:42.891954+0000","last_clean":"2022-08-10T17:54:42.891954+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:54:42.891954+0000","last_undegraded":"2022-08-10T17:54:42.891954+0000","last_fullsized":"2022-08-10T17:54:42.891954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705308+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:54:42.705308+0000","last_peered":"2022-08-10T17:54:42.705308+0000","last_clean":"2022-08-10T17:54:42.705308+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:54:42.705308+0000","last_undegraded":"2022-08-10T17:54:42.705308+0000","last_fullsized":"2022-08-10T17:54:42.705308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928284+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:54:42.928284+0000","last_peered":"2022-08-10T17:54:42.928284+0000","last_clean":"2022-08-10T17:54:42.928284+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:54:42.928284+0000","last_undegraded":"2022-08-10T17:54:42.928284+0000","last_fullsized":"2022-08-10T17:54:42.928284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4457,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.234292+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.234292+0000","last_peered":"2022-08-10T17:54:42.234292+0000","last_clean":"2022-08-10T17:54:42.234292+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.234292+0000","last_undegraded":"2022-08-10T17:54:42.234292+0000","last_fullsized":"2022-08-10T17:54:42.234292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.118864+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.118864+0000","last_peered":"2022-08-10T17:54:42.118864+0000","last_clean":"2022-08-10T17:54:42.118864+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.118864+0000","last_undegraded":"2022-08-10T17:54:42.118864+0000","last_fullsized":"2022-08-10T17:54:42.118864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.553379+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:55:16.553379+0000","last_peered":"2022-08-10T17:55:16.553379+0000","last_clean":"2022-08-10T17:55:16.553379+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:16.553379+0000","last_undegraded":"2022-08-10T17:55:16.553379+0000","last_fullsized":"2022-08-10T17:55:16.553379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4707,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.914053+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:54:42.914053+0000","last_peered":"2022-08-10T17:54:42.914053+0000","last_clean":"2022-08-10T17:54:42.914053+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:54:42.914053+0000","last_undegraded":"2022-08-10T17:54:42.914053+0000","last_fullsized":"2022-08-10T17:54:42.914053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'12","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085069+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:54:43.085069+0000","last_peered":"2022-08-10T17:54:43.085069+0000","last_clean":"2022-08-10T17:54:43.085069+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:54:43.085069+0000","last_undegraded":"2022-08-10T17:54:43.085069+0000","last_fullsized":"2022-08-10T17:54:43.085069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.817071+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:54:42.817071+0000","last_peered":"2022-08-10T17:54:42.817071+0000","last_clean":"2022-08-10T17:54:42.817071+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:54:42.817071+0000","last_undegraded":"2022-08-10T17:54:42.817071+0000","last_fullsized":"2022-08-10T17:54:42.817071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4367,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.875031+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:42.875031+0000","last_peered":"2022-08-10T17:54:42.875031+0000","last_clean":"2022-08-10T17:54:42.875031+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:42.875031+0000","last_undegraded":"2022-08-10T17:54:42.875031+0000","last_fullsized":"2022-08-10T17:54:42.875031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.234808+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:19.234808+0000","last_peered":"2022-08-10T17:36:19.234808+0000","last_clean":"2022-08-10T17:36:19.234808+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:19.234808+0000","last_undegraded":"2022-08-10T17:36:19.234808+0000","last_fullsized":"2022-08-10T17:36:19.234808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545814+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:55:16.545814+0000","last_peered":"2022-08-10T17:55:16.545814+0000","last_clean":"2022-08-10T17:55:16.545814+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:16.545814+0000","last_undegraded":"2022-08-10T17:55:16.545814+0000","last_fullsized":"2022-08-10T17:55:16.545814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.013544+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:54:43.013544+0000","last_peered":"2022-08-10T17:54:43.013544+0000","last_clean":"2022-08-10T17:54:43.013544+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:54:43.013544+0000","last_undegraded":"2022-08-10T17:54:43.013544+0000","last_fullsized":"2022-08-10T17:54:43.013544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'62","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.930136+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:54:19.930136+0000","last_peered":"2022-08-10T17:54:19.930136+0000","last_clean":"2022-08-10T17:54:19.930136+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:54:19.930136+0000","last_undegraded":"2022-08-10T17:54:19.930136+0000","last_fullsized":"2022-08-10T17:54:19.930136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548915+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:55:16.548915+0000","last_peered":"2022-08-10T17:55:16.548915+0000","last_clean":"2022-08-10T17:55:16.548915+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:55:16.548915+0000","last_undegraded":"2022-08-10T17:55:16.548915+0000","last_fullsized":"2022-08-10T17:55:16.548915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4171,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.978723+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:42.978723+0000","last_peered":"2022-08-10T17:54:42.978723+0000","last_clean":"2022-08-10T17:54:42.978723+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:42.978723+0000","last_undegraded":"2022-08-10T17:54:42.978723+0000","last_fullsized":"2022-08-10T17:54:42.978723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535315+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:55:16.535315+0000","last_peered":"2022-08-10T17:55:16.535315+0000","last_clean":"2022-08-10T17:55:16.535315+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:16.535315+0000","last_undegraded":"2022-08-10T17:55:16.535315+0000","last_fullsized":"2022-08-10T17:55:16.535315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5938,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.820151+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:42.820151+0000","last_peered":"2022-08-10T17:54:42.820151+0000","last_clean":"2022-08-10T17:54:42.820151+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:42.820151+0000","last_undegraded":"2022-08-10T17:54:42.820151+0000","last_fullsized":"2022-08-10T17:54:42.820151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'21","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.397147+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:54:43.397147+0000","last_peered":"2022-08-10T17:54:43.397147+0000","last_clean":"2022-08-10T17:54:43.397147+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:54:43.397147+0000","last_undegraded":"2022-08-10T17:54:43.397147+0000","last_fullsized":"2022-08-10T17:54:43.397147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.497198+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:54:42.497198+0000","last_peered":"2022-08-10T17:54:42.497198+0000","last_clean":"2022-08-10T17:54:42.497198+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:54:42.497198+0000","last_undegraded":"2022-08-10T17:54:42.497198+0000","last_fullsized":"2022-08-10T17:54:42.497198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4198,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.963480+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:54:42.963480+0000","last_peered":"2022-08-10T17:54:42.963480+0000","last_clean":"2022-08-10T17:54:42.963480+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:54:42.963480+0000","last_undegraded":"2022-08-10T17:54:42.963480+0000","last_fullsized":"2022-08-10T17:54:42.963480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'305","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:33.622068+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:54:33.622068+0000","last_peered":"2022-08-10T17:54:33.622068+0000","last_clean":"2022-08-10T17:54:33.622068+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:54:33.622068+0000","last_undegraded":"2022-08-10T17:54:33.622068+0000","last_fullsized":"2022-08-10T17:54:33.622068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'18","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.830077+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:54:42.830077+0000","last_peered":"2022-08-10T17:54:42.830077+0000","last_clean":"2022-08-10T17:54:42.830077+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:54:42.830077+0000","last_undegraded":"2022-08-10T17:54:42.830077+0000","last_fullsized":"2022-08-10T17:54:42.830077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5817,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.411690+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.411690+0000","last_peered":"2022-08-10T17:54:42.411690+0000","last_clean":"2022-08-10T17:54:42.411690+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.411690+0000","last_undegraded":"2022-08-10T17:54:42.411690+0000","last_fullsized":"2022-08-10T17:54:42.411690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887295+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.887295+0000","last_peered":"2022-08-10T17:38:04.887295+0000","last_clean":"2022-08-10T17:38:04.887295+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.887295+0000","last_undegraded":"2022-08-10T17:38:04.887295+0000","last_fullsized":"2022-08-10T17:38:04.887295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549930+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:55:16.549930+0000","last_peered":"2022-08-10T17:55:16.549930+0000","last_clean":"2022-08-10T17:55:16.549930+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:16.549930+0000","last_undegraded":"2022-08-10T17:55:16.549930+0000","last_fullsized":"2022-08-10T17:55:16.549930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4271,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.022626+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:54:42.022626+0000","last_peered":"2022-08-10T17:54:42.022626+0000","last_clean":"2022-08-10T17:54:42.022626+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:54:42.022626+0000","last_undegraded":"2022-08-10T17:54:42.022626+0000","last_fullsized":"2022-08-10T17:54:42.022626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794257+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:54:42.794257+0000","last_peered":"2022-08-10T17:54:42.794257+0000","last_clean":"2022-08-10T17:54:42.794257+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:54:42.794257+0000","last_undegraded":"2022-08-10T17:54:42.794257+0000","last_fullsized":"2022-08-10T17:54:42.794257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'9","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.136113+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:54:28.136113+0000","last_peered":"2022-08-10T17:54:28.136113+0000","last_clean":"2022-08-10T17:54:28.136113+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:54:28.136113+0000","last_undegraded":"2022-08-10T17:54:28.136113+0000","last_fullsized":"2022-08-10T17:54:28.136113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4380,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.503273+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:54:42.503273+0000","last_peered":"2022-08-10T17:54:42.503273+0000","last_clean":"2022-08-10T17:54:42.503273+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:54:42.503273+0000","last_undegraded":"2022-08-10T17:54:42.503273+0000","last_fullsized":"2022-08-10T17:54:42.503273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'302","reported_seq":318,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.686364+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:54:42.686364+0000","last_peered":"2022-08-10T17:54:42.686364+0000","last_clean":"2022-08-10T17:54:42.686364+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:54:42.686364+0000","last_undegraded":"2022-08-10T17:54:42.686364+0000","last_fullsized":"2022-08-10T17:54:42.686364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:40.875250+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:54:40.875250+0000","last_peered":"2022-08-10T17:54:40.875250+0000","last_clean":"2022-08-10T17:54:40.875250+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:54:40.875250+0000","last_undegraded":"2022-08-10T17:54:40.875250+0000","last_fullsized":"2022-08-10T17:54:40.875250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4919,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.775714+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:54:42.775714+0000","last_peered":"2022-08-10T17:54:42.775714+0000","last_clean":"2022-08-10T17:54:42.775714+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:54:42.775714+0000","last_undegraded":"2022-08-10T17:54:42.775714+0000","last_fullsized":"2022-08-10T17:54:42.775714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794349+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:54:42.794349+0000","last_peered":"2022-08-10T17:54:42.794349+0000","last_clean":"2022-08-10T17:54:42.794349+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:54:42.794349+0000","last_undegraded":"2022-08-10T17:54:42.794349+0000","last_fullsized":"2022-08-10T17:54:42.794349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527577+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:55:16.527577+0000","last_peered":"2022-08-10T17:55:16.527577+0000","last_clean":"2022-08-10T17:55:16.527577+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:16.527577+0000","last_undegraded":"2022-08-10T17:55:16.527577+0000","last_fullsized":"2022-08-10T17:55:16.527577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5306,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.823506+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.823506+0000","last_peered":"2022-08-10T17:54:42.823506+0000","last_clean":"2022-08-10T17:54:42.823506+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.823506+0000","last_undegraded":"2022-08-10T17:54:42.823506+0000","last_fullsized":"2022-08-10T17:54:42.823506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'45","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.999725+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:54:19.999725+0000","last_peered":"2022-08-10T17:54:19.999725+0000","last_clean":"2022-08-10T17:54:19.999725+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:54:19.999725+0000","last_undegraded":"2022-08-10T17:54:19.999725+0000","last_fullsized":"2022-08-10T17:54:19.999725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.237197+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:54:42.237197+0000","last_peered":"2022-08-10T17:54:42.237197+0000","last_clean":"2022-08-10T17:54:42.237197+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:54:42.237197+0000","last_undegraded":"2022-08-10T17:54:42.237197+0000","last_fullsized":"2022-08-10T17:54:42.237197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928347+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:54:42.928347+0000","last_peered":"2022-08-10T17:54:42.928347+0000","last_clean":"2022-08-10T17:54:42.928347+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:54:42.928347+0000","last_undegraded":"2022-08-10T17:54:42.928347+0000","last_fullsized":"2022-08-10T17:54:42.928347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.527905+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:39:02.527905+0000","last_peered":"2022-08-10T17:39:02.527905+0000","last_clean":"2022-08-10T17:39:02.527905+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:39:02.527905+0000","last_undegraded":"2022-08-10T17:39:02.527905+0000","last_fullsized":"2022-08-10T17:39:02.527905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818367+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:54:42.818367+0000","last_peered":"2022-08-10T17:54:42.818367+0000","last_clean":"2022-08-10T17:54:42.818367+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:54:42.818367+0000","last_undegraded":"2022-08-10T17:54:42.818367+0000","last_fullsized":"2022-08-10T17:54:42.818367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4694,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.767189+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:54:42.767189+0000","last_peered":"2022-08-10T17:54:42.767189+0000","last_clean":"2022-08-10T17:54:42.767189+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:54:42.767189+0000","last_undegraded":"2022-08-10T17:54:42.767189+0000","last_fullsized":"2022-08-10T17:54:42.767189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.849623+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:39:41.849623+0000","last_peered":"2022-08-10T17:39:41.849623+0000","last_clean":"2022-08-10T17:39:41.849623+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:39:41.849623+0000","last_undegraded":"2022-08-10T17:39:41.849623+0000","last_fullsized":"2022-08-10T17:39:41.849623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545652+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:55:16.545652+0000","last_peered":"2022-08-10T17:55:16.545652+0000","last_clean":"2022-08-10T17:55:16.545652+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:16.545652+0000","last_undegraded":"2022-08-10T17:55:16.545652+0000","last_fullsized":"2022-08-10T17:55:16.545652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3818,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.980477+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:54:42.980477+0000","last_peered":"2022-08-10T17:54:42.980477+0000","last_clean":"2022-08-10T17:54:42.980477+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:54:42.980477+0000","last_undegraded":"2022-08-10T17:54:42.980477+0000","last_fullsized":"2022-08-10T17:54:42.980477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.919068+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:39:18.919068+0000","last_peered":"2022-08-10T17:39:18.919068+0000","last_clean":"2022-08-10T17:39:18.919068+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:39:18.919068+0000","last_undegraded":"2022-08-10T17:39:18.919068+0000","last_fullsized":"2022-08-10T17:39:18.919068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.626548+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:54:42.626548+0000","last_peered":"2022-08-10T17:54:42.626548+0000","last_clean":"2022-08-10T17:54:42.626548+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:54:42.626548+0000","last_undegraded":"2022-08-10T17:54:42.626548+0000","last_fullsized":"2022-08-10T17:54:42.626548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3292,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:41.907134+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:54:41.907134+0000","last_peered":"2022-08-10T17:54:41.907134+0000","last_clean":"2022-08-10T17:54:41.907134+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:54:41.907134+0000","last_undegraded":"2022-08-10T17:54:41.907134+0000","last_fullsized":"2022-08-10T17:54:41.907134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'332","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.790392+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:54:42.790392+0000","last_peered":"2022-08-10T17:54:42.790392+0000","last_clean":"2022-08-10T17:54:42.790392+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:54:42.790392+0000","last_undegraded":"2022-08-10T17:54:42.790392+0000","last_fullsized":"2022-08-10T17:54:42.790392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655741,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":2774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.920538+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:54:42.920538+0000","last_peered":"2022-08-10T17:54:42.920538+0000","last_clean":"2022-08-10T17:54:42.920538+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:54:42.920538+0000","last_undegraded":"2022-08-10T17:54:42.920538+0000","last_fullsized":"2022-08-10T17:54:42.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5060,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.032924+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:54:43.032924+0000","last_peered":"2022-08-10T17:54:43.032924+0000","last_clean":"2022-08-10T17:54:43.032924+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:54:43.032924+0000","last_undegraded":"2022-08-10T17:54:43.032924+0000","last_fullsized":"2022-08-10T17:54:43.032924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'55","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.387180+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:54:42.387180+0000","last_peered":"2022-08-10T17:54:42.387180+0000","last_clean":"2022-08-10T17:54:42.387180+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:54:42.387180+0000","last_undegraded":"2022-08-10T17:54:42.387180+0000","last_fullsized":"2022-08-10T17:54:42.387180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:35.564003+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:54:35.564003+0000","last_peered":"2022-08-10T17:54:35.564003+0000","last_clean":"2022-08-10T17:54:35.564003+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:54:35.564003+0000","last_undegraded":"2022-08-10T17:54:35.564003+0000","last_fullsized":"2022-08-10T17:54:35.564003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6353,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.572490+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.572490+0000","last_peered":"2022-08-10T17:54:42.572490+0000","last_clean":"2022-08-10T17:54:42.572490+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.572490+0000","last_undegraded":"2022-08-10T17:54:42.572490+0000","last_fullsized":"2022-08-10T17:54:42.572490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:23.787138+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:23.787138+0000","last_peered":"2022-08-10T17:54:23.787138+0000","last_clean":"2022-08-10T17:54:23.787138+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:23.787138+0000","last_undegraded":"2022-08-10T17:54:23.787138+0000","last_fullsized":"2022-08-10T17:54:23.787138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:36.190454+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:54:36.190454+0000","last_peered":"2022-08-10T17:54:36.190454+0000","last_clean":"2022-08-10T17:54:36.190454+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:54:36.190454+0000","last_undegraded":"2022-08-10T17:54:36.190454+0000","last_fullsized":"2022-08-10T17:54:36.190454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6045,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709336+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:42.709336+0000","last_peered":"2022-08-10T17:54:42.709336+0000","last_clean":"2022-08-10T17:54:42.709336+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:42.709336+0000","last_undegraded":"2022-08-10T17:54:42.709336+0000","last_fullsized":"2022-08-10T17:54:42.709336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.850560+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:39:41.850560+0000","last_peered":"2022-08-10T17:39:41.850560+0000","last_clean":"2022-08-10T17:39:41.850560+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:39:41.850560+0000","last_undegraded":"2022-08-10T17:39:41.850560+0000","last_fullsized":"2022-08-10T17:39:41.850560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546523+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:55:16.546523+0000","last_peered":"2022-08-10T17:55:16.546523+0000","last_clean":"2022-08-10T17:55:16.546523+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:16.546523+0000","last_undegraded":"2022-08-10T17:55:16.546523+0000","last_fullsized":"2022-08-10T17:55:16.546523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4544,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.330973+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.330973+0000","last_peered":"2022-08-10T17:54:42.330973+0000","last_clean":"2022-08-10T17:54:42.330973+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.330973+0000","last_undegraded":"2022-08-10T17:54:42.330973+0000","last_fullsized":"2022-08-10T17:54:42.330973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.840772+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:54:42.840772+0000","last_peered":"2022-08-10T17:54:42.840772+0000","last_clean":"2022-08-10T17:54:42.840772+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:54:42.840772+0000","last_undegraded":"2022-08-10T17:54:42.840772+0000","last_fullsized":"2022-08-10T17:54:42.840772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.459739+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:54:24.459739+0000","last_peered":"2022-08-10T17:54:24.459739+0000","last_clean":"2022-08-10T17:54:24.459739+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:54:24.459739+0000","last_undegraded":"2022-08-10T17:54:24.459739+0000","last_fullsized":"2022-08-10T17:54:24.459739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4359,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.960673+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:42.960673+0000","last_peered":"2022-08-10T17:54:42.960673+0000","last_clean":"2022-08-10T17:54:42.960673+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:42.960673+0000","last_undegraded":"2022-08-10T17:54:42.960673+0000","last_fullsized":"2022-08-10T17:54:42.960673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.660704+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:24.660704+0000","last_peered":"2022-08-10T17:54:24.660704+0000","last_clean":"2022-08-10T17:54:24.660704+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:24.660704+0000","last_undegraded":"2022-08-10T17:54:24.660704+0000","last_fullsized":"2022-08-10T17:54:24.660704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818293+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:54:42.818293+0000","last_peered":"2022-08-10T17:54:42.818293+0000","last_clean":"2022-08-10T17:54:42.818293+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:54:42.818293+0000","last_undegraded":"2022-08-10T17:54:42.818293+0000","last_fullsized":"2022-08-10T17:54:42.818293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4659,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.800751+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:54:42.800751+0000","last_peered":"2022-08-10T17:54:42.800751+0000","last_clean":"2022-08-10T17:54:42.800751+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:54:42.800751+0000","last_undegraded":"2022-08-10T17:54:42.800751+0000","last_fullsized":"2022-08-10T17:54:42.800751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.889796+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:38:04.889796+0000","last_peered":"2022-08-10T17:38:04.889796+0000","last_clean":"2022-08-10T17:38:04.889796+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:38:04.889796+0000","last_undegraded":"2022-08-10T17:38:04.889796+0000","last_fullsized":"2022-08-10T17:38:04.889796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.649086+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:54:42.649086+0000","last_peered":"2022-08-10T17:54:42.649086+0000","last_clean":"2022-08-10T17:54:42.649086+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:54:42.649086+0000","last_undegraded":"2022-08-10T17:54:42.649086+0000","last_fullsized":"2022-08-10T17:54:42.649086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4786,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.967437+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:42.967437+0000","last_peered":"2022-08-10T17:54:42.967437+0000","last_clean":"2022-08-10T17:54:42.967437+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:42.967437+0000","last_undegraded":"2022-08-10T17:54:42.967437+0000","last_fullsized":"2022-08-10T17:54:42.967437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.530687+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:39:02.530687+0000","last_peered":"2022-08-10T17:39:02.530687+0000","last_clean":"2022-08-10T17:39:02.530687+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:39:02.530687+0000","last_undegraded":"2022-08-10T17:39:02.530687+0000","last_fullsized":"2022-08-10T17:39:02.530687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527672+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:55:16.527672+0000","last_peered":"2022-08-10T17:55:16.527672+0000","last_clean":"2022-08-10T17:55:16.527672+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:16.527672+0000","last_undegraded":"2022-08-10T17:55:16.527672+0000","last_fullsized":"2022-08-10T17:55:16.527672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.882397+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.882397+0000","last_peered":"2022-08-10T17:54:42.882397+0000","last_clean":"2022-08-10T17:54:42.882397+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.882397+0000","last_undegraded":"2022-08-10T17:54:42.882397+0000","last_fullsized":"2022-08-10T17:54:42.882397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'81","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.797747+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:54:42.797747+0000","last_peered":"2022-08-10T17:54:42.797747+0000","last_clean":"2022-08-10T17:54:42.797747+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:54:42.797747+0000","last_undegraded":"2022-08-10T17:54:42.797747+0000","last_fullsized":"2022-08-10T17:54:42.797747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":79,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'18","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.599299+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:54:42.599299+0000","last_peered":"2022-08-10T17:54:42.599299+0000","last_clean":"2022-08-10T17:54:42.599299+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:54:42.599299+0000","last_undegraded":"2022-08-10T17:54:42.599299+0000","last_fullsized":"2022-08-10T17:54:42.599299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5875,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.568847+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:54:42.568847+0000","last_peered":"2022-08-10T17:54:42.568847+0000","last_clean":"2022-08-10T17:54:42.568847+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:54:42.568847+0000","last_undegraded":"2022-08-10T17:54:42.568847+0000","last_fullsized":"2022-08-10T17:54:42.568847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.948551+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:39:18.948551+0000","last_peered":"2022-08-10T17:39:18.948551+0000","last_clean":"2022-08-10T17:39:18.948551+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:39:18.948551+0000","last_undegraded":"2022-08-10T17:39:18.948551+0000","last_fullsized":"2022-08-10T17:39:18.948551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2959,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.508415+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.508415+0000","last_peered":"2022-08-10T17:54:42.508415+0000","last_clean":"2022-08-10T17:54:42.508415+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.508415+0000","last_undegraded":"2022-08-10T17:54:42.508415+0000","last_fullsized":"2022-08-10T17:54:42.508415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859723+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:37:58.859723+0000","last_peered":"2022-08-10T17:37:58.859723+0000","last_clean":"2022-08-10T17:37:58.859723+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:37:58.859723+0000","last_undegraded":"2022-08-10T17:37:58.859723+0000","last_fullsized":"2022-08-10T17:37:58.859723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.526764+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:55:16.526764+0000","last_peered":"2022-08-10T17:55:16.526764+0000","last_clean":"2022-08-10T17:55:16.526764+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:16.526764+0000","last_undegraded":"2022-08-10T17:55:16.526764+0000","last_fullsized":"2022-08-10T17:55:16.526764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4329,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.003375+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.003375+0000","last_peered":"2022-08-10T17:54:43.003375+0000","last_clean":"2022-08-10T17:54:43.003375+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.003375+0000","last_undegraded":"2022-08-10T17:54:43.003375+0000","last_fullsized":"2022-08-10T17:54:43.003375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'71","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.572737+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:54:38.572737+0000","last_peered":"2022-08-10T17:54:38.572737+0000","last_clean":"2022-08-10T17:54:38.572737+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:54:38.572737+0000","last_undegraded":"2022-08-10T17:54:38.572737+0000","last_fullsized":"2022-08-10T17:54:38.572737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.502348+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:54:42.502348+0000","last_peered":"2022-08-10T17:54:42.502348+0000","last_clean":"2022-08-10T17:54:42.502348+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:54:42.502348+0000","last_undegraded":"2022-08-10T17:54:42.502348+0000","last_fullsized":"2022-08-10T17:54:42.502348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4823,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.392349+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:54:42.392349+0000","last_peered":"2022-08-10T17:54:42.392349+0000","last_clean":"2022-08-10T17:54:42.392349+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:54:42.392349+0000","last_undegraded":"2022-08-10T17:54:42.392349+0000","last_fullsized":"2022-08-10T17:54:42.392349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1829","reported_seq":1844,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:25.148933+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:54:25.148933+0000","last_peered":"2022-08-10T17:54:25.148933+0000","last_clean":"2022-08-10T17:54:25.148933+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:54:25.148933+0000","last_undegraded":"2022-08-10T17:54:25.148933+0000","last_fullsized":"2022-08-10T17:54:25.148933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1829,"log_dups_size":0,"ondisk_log_size":1829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":8926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549319+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:55:16.549319+0000","last_peered":"2022-08-10T17:55:16.549319+0000","last_clean":"2022-08-10T17:55:16.549319+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:16.549319+0000","last_undegraded":"2022-08-10T17:55:16.549319+0000","last_fullsized":"2022-08-10T17:55:16.549319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4542,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.578670+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.578670+0000","last_peered":"2022-08-10T17:54:42.578670+0000","last_clean":"2022-08-10T17:54:42.578670+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.578670+0000","last_undegraded":"2022-08-10T17:54:42.578670+0000","last_fullsized":"2022-08-10T17:54:42.578670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057640+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:19.057640+0000","last_peered":"2022-08-10T17:36:19.057640+0000","last_clean":"2022-08-10T17:36:19.057640+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:19.057640+0000","last_undegraded":"2022-08-10T17:36:19.057640+0000","last_fullsized":"2022-08-10T17:36:19.057640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.361881+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:54:42.361881+0000","last_peered":"2022-08-10T17:54:42.361881+0000","last_clean":"2022-08-10T17:54:42.361881+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:54:42.361881+0000","last_undegraded":"2022-08-10T17:54:42.361881+0000","last_fullsized":"2022-08-10T17:54:42.361881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3894,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.753421+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:54:42.753421+0000","last_peered":"2022-08-10T17:54:42.753421+0000","last_clean":"2022-08-10T17:54:42.753421+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:54:42.753421+0000","last_undegraded":"2022-08-10T17:54:42.753421+0000","last_fullsized":"2022-08-10T17:54:42.753421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.730686+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:39:18.730686+0000","last_peered":"2022-08-10T17:39:18.730686+0000","last_clean":"2022-08-10T17:39:18.730686+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:39:18.730686+0000","last_undegraded":"2022-08-10T17:39:18.730686+0000","last_fullsized":"2022-08-10T17:39:18.730686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'13","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.242055+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:54:42.242055+0000","last_peered":"2022-08-10T17:54:42.242055+0000","last_clean":"2022-08-10T17:54:42.242055+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:54:42.242055+0000","last_undegraded":"2022-08-10T17:54:42.242055+0000","last_fullsized":"2022-08-10T17:54:42.242055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4423,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.557967+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.557967+0000","last_peered":"2022-08-10T17:54:42.557967+0000","last_clean":"2022-08-10T17:54:42.557967+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.557967+0000","last_undegraded":"2022-08-10T17:54:42.557967+0000","last_fullsized":"2022-08-10T17:54:42.557967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535607+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:54:42.535607+0000","last_peered":"2022-08-10T17:54:42.535607+0000","last_clean":"2022-08-10T17:54:42.535607+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:54:42.535607+0000","last_undegraded":"2022-08-10T17:54:42.535607+0000","last_fullsized":"2022-08-10T17:54:42.535607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533382+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:55:16.533382+0000","last_peered":"2022-08-10T17:55:16.533382+0000","last_clean":"2022-08-10T17:55:16.533382+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:16.533382+0000","last_undegraded":"2022-08-10T17:55:16.533382+0000","last_fullsized":"2022-08-10T17:55:16.533382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5520,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.059549+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:54:42.059549+0000","last_peered":"2022-08-10T17:54:42.059549+0000","last_clean":"2022-08-10T17:54:42.059549+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:54:42.059549+0000","last_undegraded":"2022-08-10T17:54:42.059549+0000","last_fullsized":"2022-08-10T17:54:42.059549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709261+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:54:42.709261+0000","last_peered":"2022-08-10T17:54:42.709261+0000","last_clean":"2022-08-10T17:54:42.709261+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:54:42.709261+0000","last_undegraded":"2022-08-10T17:54:42.709261+0000","last_fullsized":"2022-08-10T17:54:42.709261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'17","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535624+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:54:42.535624+0000","last_peered":"2022-08-10T17:54:42.535624+0000","last_clean":"2022-08-10T17:54:42.535624+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:54:42.535624+0000","last_undegraded":"2022-08-10T17:54:42.535624+0000","last_fullsized":"2022-08-10T17:54:42.535624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527655+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:55:16.527655+0000","last_peered":"2022-08-10T17:55:16.527655+0000","last_clean":"2022-08-10T17:55:16.527655+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:16.527655+0000","last_undegraded":"2022-08-10T17:55:16.527655+0000","last_fullsized":"2022-08-10T17:55:16.527655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.551578+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:55:16.551578+0000","last_peered":"2022-08-10T17:55:16.551578+0000","last_clean":"2022-08-10T17:55:16.551578+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:16.551578+0000","last_undegraded":"2022-08-10T17:55:16.551578+0000","last_fullsized":"2022-08-10T17:55:16.551578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'15","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.550686+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:54:42.550686+0000","last_peered":"2022-08-10T17:54:42.550686+0000","last_clean":"2022-08-10T17:54:42.550686+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:54:42.550686+0000","last_undegraded":"2022-08-10T17:54:42.550686+0000","last_fullsized":"2022-08-10T17:54:42.550686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527138+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:55:16.527138+0000","last_peered":"2022-08-10T17:55:16.527138+0000","last_clean":"2022-08-10T17:55:16.527138+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:16.527138+0000","last_undegraded":"2022-08-10T17:55:16.527138+0000","last_fullsized":"2022-08-10T17:55:16.527138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.684602+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:54:42.684602+0000","last_peered":"2022-08-10T17:54:42.684602+0000","last_clean":"2022-08-10T17:54:42.684602+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:54:42.684602+0000","last_undegraded":"2022-08-10T17:54:42.684602+0000","last_fullsized":"2022-08-10T17:54:42.684602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1116,"ondisk_log_size":1116,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271606,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3453,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32542898,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3238,"ondisk_log_size":3238,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575089,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478068,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475072,"kb_avail":93893772,"statfs":{"total":96636764160,"available":96147222528,"internally_reserved":0,"allocated":3059712,"data_stored":6661537,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486473728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.312},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.42499999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.436}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.379},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.32300000000000001},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.36799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504068,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503744,"kb_avail":93867772,"statfs":{"total":96636764160,"available":96120598528,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515833856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.7009999999999996,"5min":10.398,"15min":11.797000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":38.445,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":4.4139999999999997,"5min":10.430999999999999,"15min":12.347},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":29.300999999999998,"5min":129.767,"15min":129.767},"last":0.376}]},{"osd":1,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.2009999999999996,"5min":11.039999999999999,"15min":13.378},"min":{"1min":0.34899999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":25.206,"5min":114.83,"15min":318.94299999999998},"last":0.434},{"interface":"front","average":{"1min":4.4109999999999996,"5min":11.000999999999999,"15min":11.98},"min":{"1min":0.33600000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":21.338999999999999,"5min":114.842,"15min":119.708},"last":0.47199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.407,"5min":1.405,"15min":4.6799999999999997},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.224},"max":{"1min":16.099,"5min":17.885999999999999,"15min":107.033},"last":0.39400000000000002},{"interface":"front","average":{"1min":3.9049999999999998,"5min":1.4019999999999999,"15min":5.0629999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":16.277999999999999,"5min":17.895,"15min":107.062},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.3210000000000002,"5min":1.0029999999999999,"15min":2.9049999999999998},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.254},"max":{"1min":16.376999999999999,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":3.3799999999999999,"5min":1.0840000000000001,"15min":3.1459999999999999},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":16.331,"5min":16.331,"15min":96.870000000000005},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.8500000000000001,"5min":3.0350000000000001,"15min":6.7670000000000003},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.183},"max":{"1min":22.443000000000001,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.419,"5min":3.004,"15min":6.7670000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":22.484999999999999,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":2.4569999999999999,"5min":6.5010000000000003,"15min":8.2929999999999993},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":16.129999999999999,"5min":79.944999999999993,"15min":100.741},"last":0.315},{"interface":"front","average":{"1min":4.9290000000000003,"5min":7.0510000000000002,"15min":8.3940000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":38.378999999999998,"5min":80.159000000000006,"15min":100.715},"last":0.38300000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":1.238,"15min":4.101},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":15.968999999999999,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.7769999999999999,"5min":0.873,"15min":3.597},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":10.551,"5min":10.551,"15min":59.384},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575086,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621580,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621248,"kb_avail":93750260,"statfs":{"total":96636764160,"available":96000266240,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636157952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.308},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.26200000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.371},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.46200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.495},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834575086,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603792,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596096,"kb_avail":93768048,"statfs":{"total":96636764160,"available":96018481152,"internally_reserved":0,"allocated":7872512,"data_stored":11046620,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610402304},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":12.071999999999999,"15min":12.028},"min":{"1min":0.191,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":57.822000000000003,"5min":90.528999999999996,"15min":111.419},"last":0.27200000000000002},{"interface":"front","average":{"1min":3.169,"5min":12.108000000000001,"15min":12.244},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":57.835999999999999,"5min":93.111999999999995,"15min":111.506},"last":0.32300000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.64700000000000002,"15min":6.4180000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.189},"max":{"1min":0.68700000000000006,"5min":10.821999999999999,"15min":130.566},"last":0.245},{"interface":"front","average":{"1min":0.38100000000000001,"5min":1.4039999999999999,"15min":6.4359999999999999},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.222},"max":{"1min":0.66500000000000004,"5min":50.625,"15min":130.63300000000001},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.80000000000000004,"15min":4.4560000000000004},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60799999999999998,"5min":31.167999999999999,"15min":111.333},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.1719999999999999,"15min":4.641},"min":{"1min":0.28199999999999997,"5min":0.20899999999999999,"15min":0.19700000000000001},"max":{"1min":0.72799999999999998,"5min":50.686999999999998,"15min":111.377},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":2.7250000000000001,"15min":7.0570000000000004},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":90.531000000000006,"15min":127.629},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":3.1960000000000002,"15min":7.2679999999999998},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.76600000000000001,"5min":90.509,"15min":127.497},"last":0.374}]},{"osd":5,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":4.7359999999999998,"15min":8.3179999999999996},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":2.4860000000000002,"5min":88.512,"15min":127.77500000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":5.7759999999999998,"15min":8.4789999999999992},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64600000000000002,"5min":88.429000000000002,"15min":127.798},"last":0.38400000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":1.1299999999999999,"15min":4.6859999999999999},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":50.664000000000001,"15min":114.8},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.448,"15min":5.032},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.747,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.432}]},{"osd":7,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.198,"15min":3.2629999999999999},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.63600000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4390000000000001,"15min":3.855},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.30199999999999999},"max":{"1min":1.343,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.44600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":11.993,"15min":15.167},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":37.323,"5min":150.911,"15min":433.41199999999998},"last":0.19},{"interface":"front","average":{"1min":5.6980000000000004,"5min":12.128,"15min":13.394},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":37.259999999999998,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.23100000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:54:18 2022","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.44,"15min":4.4889999999999999},"min":{"1min":0.25800000000000001,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.55600000000000005,"5min":4.0659999999999998,"15min":250.44200000000001},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.504,"15min":3.351},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":4.109,"15min":142.11699999999999},"last":0.29399999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":3.48,"15min":7.9800000000000004},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":30.893000000000001,"5min":47.207999999999998,"15min":114.259},"last":0.41999999999999998},{"interface":"front","average":{"1min":4.4050000000000002,"5min":3.3700000000000001,"15min":8.2829999999999995},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":30.867999999999999,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":2.2109999999999999,"5min":4.1440000000000001,"15min":7.8929999999999998},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":9.0790000000000006,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.976,"5min":4.2249999999999996,"15min":8.1769999999999996},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":19.873000000000001,"5min":63.508000000000003,"15min":100.22},"last":0.437}]},{"osd":6,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":1.2350000000000001,"15min":3.774},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":19.789999999999999,"5min":19.789999999999999,"15min":83.046000000000006},"last":0.42999999999999999},{"interface":"front","average":{"1min":4.2530000000000001,"5min":1.4470000000000001,"15min":3.4809999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":28.131,"5min":28.131,"15min":60.445},"last":0.373}]},{"osd":7,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":1.4490000000000001,"15min":4.3289999999999997},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.904000000000003,"5min":34.904000000000003,"15min":94.753},"last":0.34899999999999998},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.405,"15min":4.7729999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":19.922999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.41199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575088,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473880,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":471936,"kb_avail":93897960,"statfs":{"total":96636764160,"available":96151511040,"internally_reserved":0,"allocated":1982464,"data_stored":2795689,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483262464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.30599999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.23100000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.26300000000000001},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.65500000000000003}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.63},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575089,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559732,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551104,"kb_avail":93812108,"statfs":{"total":96636764160,"available":96063598592,"internally_reserved":0,"allocated":8826880,"data_stored":13742318,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564330496},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.38200000000000001},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.371},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.34499999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.434},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.41599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547152,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546816,"kb_avail":93824688,"statfs":{"total":96636764160,"available":96076480512,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":559939584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.437}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10322562,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2661999,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13608628,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:55:18.214 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-08-10T17:55:18.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:55:18.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.361+0000 7f6f5ecfc700 1 Processor -- start 2022-08-10T17:55:18.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.361+0000 7f6f5ecfc700 1 -- start start 2022-08-10T17:55:18.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ecfc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f580c2000 0x7f6f580c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ecfc700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6f580c5090 0x7f6f580c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ecfc700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f580c2ef0 con 0x7f6f5806d9c0 2022-08-10T17:55:18.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ecfc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f580c26e0 con 0x7f6f580c2000 2022-08-10T17:55:18.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ecfc700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f580c98c0 con 0x7f6f580c5090 2022-08-10T17:55:18.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f580c2000 0x7f6f580c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f580c2000 0x7f6f580c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45416/0 (socket says 172.21.15.150:45416) 2022-08-10T17:55:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1488795373 learned_addr learned my addr 172.21.15.150:0/1488795373 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:18.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f57fff700 1 --2- 172.21.15.150:0/1488795373 >> v2:172.21.15.197:3300/0 conn(0x7f6f580c5090 0x7f6f580c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1488795373 >> v2:172.21.15.197:3300/0 conn(0x7f6f580c5090 msgr2=0x7f6f580c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 --2- 172.21.15.150:0/1488795373 >> v2:172.21.15.197:3300/0 conn(0x7f6f580c5090 0x7f6f580c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1488795373 >> v1:172.21.15.197:6789/0 conn(0x7f6f5806d9c0 legacy=0x7f6f580c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.362+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1488795373 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58154270 con 0x7f6f580c2000 2022-08-10T17:55:18.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ca98700 1 --2- 172.21.15.150:0/1488795373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f580c2000 0x7f6f580c8910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f580b9480 tx=0x7f6f5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af1d7cb6b56d6cc server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f577fe700 1 -- 172.21.15.150:0/1488795373 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000bb10 con 0x7f6f580c2000 2022-08-10T17:55:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f577fe700 1 -- 172.21.15.150:0/1488795373 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000bc70 con 0x7f6f580c2000 2022-08-10T17:55:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f577fe700 1 -- 172.21.15.150:0/1488795373 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50011460 con 0x7f6f580c2000 2022-08-10T17:55:18.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1488795373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f580c2000 msgr2=0x7f6f580c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1488795373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f580c2000 0x7f6f580c8910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f580b9480 tx=0x7f6f5000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1488795373 shutdown_connections 2022-08-10T17:55:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1488795373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f580c2000 0x7f6f580c8910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1488795373 >> v2:172.21.15.197:3300/0 conn(0x7f6f580c5090 0x7f6f580c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1488795373 >> 172.21.15.150:0/1488795373 conn(0x7f6f5806b500 msgr2=0x7f6f5806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:18.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1488795373 shutdown_connections 2022-08-10T17:55:18.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.363+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1488795373 wait complete. 2022-08-10T17:55:18.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.364+0000 7f6f5ecfc700 1 Processor -- start 2022-08-10T17:55:18.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 -- start start 2022-08-10T17:55:18.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 0x7f6f581e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 0x7f6f58151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.383 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5814f480 con 0x7f6f5806d9c0 2022-08-10T17:55:18.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5814f680 con 0x7f6f580c5090 2022-08-10T17:55:18.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ecfc700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5814f960 con 0x7f6f580c2000 2022-08-10T17:55:18.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ca98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.384 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ca98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45422/0 (socket says 172.21.15.150:45422) 2022-08-10T17:55:18.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.365+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1546431033 learned_addr learned my addr 172.21.15.150:0/1546431033 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:18.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f57fff700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 0x7f6f581e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5d299700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 0x7f6f58151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.385 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 msgr2=0x7f6f581e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 0x7f6f581e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 msgr2=0x7f6f58151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 0x7f6f58151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.386 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 -- 172.21.15.150:0/1546431033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50009b30 con 0x7f6f5806d9c0 2022-08-10T17:55:18.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f57fff700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 0x7f6f581e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:55:18.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5d299700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 0x7f6f58151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:55:18.387 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ca98700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f5806d0f0 tx=0x7f6f50004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50004450 con 0x7f6f5806d9c0 2022-08-10T17:55:18.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f500045b0 con 0x7f6f5806d9c0 2022-08-10T17:55:18.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5814fc40 con 0x7f6f5806d9c0 2022-08-10T17:55:18.388 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500099b0 con 0x7f6f5806d9c0 2022-08-10T17:55:18.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.366+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f58150200 con 0x7f6f5806d9c0 2022-08-10T17:55:18.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.367+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f58072890 con 0x7f6f5806d9c0 2022-08-10T17:55:18.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.367+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6f50029030 con 0x7f6f5806d9c0 2022-08-10T17:55:18.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.368+0000 7f6f557fa700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 0x7f6f3c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.389 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.368+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6f500839b0 con 0x7f6f5806d9c0 2022-08-10T17:55:18.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.368+0000 7f6f57fff700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 0x7f6f3c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.390 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.368+0000 7f6f57fff700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 0x7f6f3c067560 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6f5814d240 tx=0x7f6f40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.391 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.372+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6f50051990 con 0x7f6f5806d9c0 2022-08-10T17:55:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.558+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f58154550 con 0x7f6f3c0650b0 2022-08-10T17:55:18.577 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.569+0000 7f6f557fa700 1 -- 172.21.15.150:0/1546431033 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391440 (secure 0 0 0) 0x7f6f58154550 con 0x7f6f3c0650b0 2022-08-10T17:55:18.582 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:18.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.572+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 msgr2=0x7f6f3c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.587 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.572+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 0x7f6f3c067560 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6f5814d240 tx=0x7f6f40008040 comp rx=0 tx=0).stop 2022-08-10T17:55:18.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.572+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 msgr2=0x7f6f58150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.572+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f5806d0f0 tx=0x7f6f50004950 comp rx=0 tx=0).stop 2022-08-10T17:55:18.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 shutdown_connections 2022-08-10T17:55:18.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6f580c5090 0x7f6f58151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f5806d9c0 0x7f6f58150a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.590 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6f3c0650b0 0x7f6f3c067560 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 --2- 172.21.15.150:0/1546431033 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6f580c2000 0x7f6f581e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 >> 172.21.15.150:0/1546431033 conn(0x7f6f5806b500 msgr2=0x7f6f580be7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:18.591 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 shutdown_connections 2022-08-10T17:55:18.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.573+0000 7f6f5ecfc700 1 -- 172.21.15.150:0/1546431033 wait complete. 2022-08-10T17:55:18.592 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:55:18.594 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":618,"stamp":"2022-08-10T17:55:17.797328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16861974,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250697,"num_write_kb":19248756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151945,"ondisk_log_size":151945,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4260720,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4238144,"kb_avail":750714000,"statfs":{"total":773094113280,"available":768731136000,"internally_reserved":0,"allocated":23052288,"data_stored":34793013,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4339859456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":140,"apply_latency_ms":140,"commit_latency_ns":140000000,"apply_latency_ns":140000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":314,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.118262"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.530765+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:55:16.530765+0000","last_peered":"2022-08-10T17:55:16.530765+0000","last_clean":"2022-08-10T17:55:16.530765+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:16.530765+0000","last_undegraded":"2022-08-10T17:55:16.530765+0000","last_fullsized":"2022-08-10T17:55:16.530765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:25:06.162001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'5","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:07.593395+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:39:07.593395+0000","last_peered":"2022-08-10T17:39:07.593395+0000","last_clean":"2022-08-10T17:39:07.593395+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:39:07.593395+0000","last_undegraded":"2022-08-10T17:39:07.593395+0000","last_fullsized":"2022-08-10T17:39:07.593395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:37.884595+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:54:37.884595+0000","last_peered":"2022-08-10T17:54:37.884595+0000","last_clean":"2022-08-10T17:54:37.884595+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:54:37.884595+0000","last_undegraded":"2022-08-10T17:54:37.884595+0000","last_fullsized":"2022-08-10T17:54:37.884595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547841+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:55:16.547841+0000","last_peered":"2022-08-10T17:55:16.547841+0000","last_clean":"2022-08-10T17:55:16.547841+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:16.547841+0000","last_undegraded":"2022-08-10T17:55:16.547841+0000","last_fullsized":"2022-08-10T17:55:16.547841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.743773+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:54:42.743773+0000","last_peered":"2022-08-10T17:54:42.743773+0000","last_clean":"2022-08-10T17:54:42.743773+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:54:42.743773+0000","last_undegraded":"2022-08-10T17:54:42.743773+0000","last_fullsized":"2022-08-10T17:54:42.743773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.873491+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:54:28.873491+0000","last_peered":"2022-08-10T17:54:28.873491+0000","last_clean":"2022-08-10T17:54:28.873491+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:54:28.873491+0000","last_undegraded":"2022-08-10T17:54:28.873491+0000","last_fullsized":"2022-08-10T17:54:28.873491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549244+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:55:16.549244+0000","last_peered":"2022-08-10T17:55:16.549244+0000","last_clean":"2022-08-10T17:55:16.549244+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:55:16.549244+0000","last_undegraded":"2022-08-10T17:55:16.549244+0000","last_fullsized":"2022-08-10T17:55:16.549244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.232106+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:54:42.232106+0000","last_peered":"2022-08-10T17:54:42.232106+0000","last_clean":"2022-08-10T17:54:42.232106+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:54:42.232106+0000","last_undegraded":"2022-08-10T17:54:42.232106+0000","last_fullsized":"2022-08-10T17:54:42.232106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:34.853085+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:54:34.853085+0000","last_peered":"2022-08-10T17:54:34.853085+0000","last_clean":"2022-08-10T17:54:34.853085+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:54:34.853085+0000","last_undegraded":"2022-08-10T17:54:34.853085+0000","last_fullsized":"2022-08-10T17:54:34.853085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.770286+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:54:42.770286+0000","last_peered":"2022-08-10T17:54:42.770286+0000","last_clean":"2022-08-10T17:54:42.770286+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:54:42.770286+0000","last_undegraded":"2022-08-10T17:54:42.770286+0000","last_fullsized":"2022-08-10T17:54:42.770286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.986307+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:54:38.986307+0000","last_peered":"2022-08-10T17:54:38.986307+0000","last_clean":"2022-08-10T17:54:38.986307+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:54:38.986307+0000","last_undegraded":"2022-08-10T17:54:38.986307+0000","last_fullsized":"2022-08-10T17:54:38.986307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527871+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:55:16.527871+0000","last_peered":"2022-08-10T17:55:16.527871+0000","last_clean":"2022-08-10T17:55:16.527871+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:16.527871+0000","last_undegraded":"2022-08-10T17:55:16.527871+0000","last_fullsized":"2022-08-10T17:55:16.527871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:39:51.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.531128+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:55:16.531128+0000","last_peered":"2022-08-10T17:55:16.531128+0000","last_clean":"2022-08-10T17:55:16.531128+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:16.531128+0000","last_undegraded":"2022-08-10T17:55:16.531128+0000","last_fullsized":"2022-08-10T17:55:16.531128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:55:11.553190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'14","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.095079+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:54:42.095079+0000","last_peered":"2022-08-10T17:54:42.095079+0000","last_clean":"2022-08-10T17:54:42.095079+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:54:42.095079+0000","last_undegraded":"2022-08-10T17:54:42.095079+0000","last_fullsized":"2022-08-10T17:54:42.095079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549328+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:55:16.549328+0000","last_peered":"2022-08-10T17:55:16.549328+0000","last_clean":"2022-08-10T17:55:16.549328+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:55:16.549328+0000","last_undegraded":"2022-08-10T17:55:16.549328+0000","last_fullsized":"2022-08-10T17:55:16.549328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.953607+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:54:42.953607+0000","last_peered":"2022-08-10T17:54:42.953607+0000","last_clean":"2022-08-10T17:54:42.953607+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:54:42.953607+0000","last_undegraded":"2022-08-10T17:54:42.953607+0000","last_fullsized":"2022-08-10T17:54:42.953607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.741205+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:39:18.741205+0000","last_peered":"2022-08-10T17:39:18.741205+0000","last_clean":"2022-08-10T17:39:18.741205+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:39:18.741205+0000","last_undegraded":"2022-08-10T17:39:18.741205+0000","last_fullsized":"2022-08-10T17:39:18.741205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'19","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705603+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:54:42.705603+0000","last_peered":"2022-08-10T17:54:42.705603+0000","last_clean":"2022-08-10T17:54:42.705603+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:54:42.705603+0000","last_undegraded":"2022-08-10T17:54:42.705603+0000","last_fullsized":"2022-08-10T17:54:42.705603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534955+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:55:16.534955+0000","last_peered":"2022-08-10T17:55:16.534955+0000","last_clean":"2022-08-10T17:55:16.534955+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:16.534955+0000","last_undegraded":"2022-08-10T17:55:16.534955+0000","last_fullsized":"2022-08-10T17:55:16.534955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:46:15.741628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.838422+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:54:42.838422+0000","last_peered":"2022-08-10T17:54:42.838422+0000","last_clean":"2022-08-10T17:54:42.838422+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:54:42.838422+0000","last_undegraded":"2022-08-10T17:54:42.838422+0000","last_fullsized":"2022-08-10T17:54:42.838422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535492+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:55:16.535492+0000","last_peered":"2022-08-10T17:55:16.535492+0000","last_clean":"2022-08-10T17:55:16.535492+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:55:16.535492+0000","last_undegraded":"2022-08-10T17:55:16.535492+0000","last_fullsized":"2022-08-10T17:55:16.535492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.797343+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:39:18.797343+0000","last_peered":"2022-08-10T17:39:18.797343+0000","last_clean":"2022-08-10T17:39:18.797343+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:39:18.797343+0000","last_undegraded":"2022-08-10T17:39:18.797343+0000","last_fullsized":"2022-08-10T17:39:18.797343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547260+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:55:16.547260+0000","last_peered":"2022-08-10T17:55:16.547260+0000","last_clean":"2022-08-10T17:55:16.547260+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:16.547260+0000","last_undegraded":"2022-08-10T17:55:16.547260+0000","last_fullsized":"2022-08-10T17:55:16.547260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:02.778595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533494+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:55:16.533494+0000","last_peered":"2022-08-10T17:55:16.533494+0000","last_clean":"2022-08-10T17:55:16.533494+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:55:16.533494+0000","last_undegraded":"2022-08-10T17:55:16.533494+0000","last_fullsized":"2022-08-10T17:55:16.533494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.891954+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:54:42.891954+0000","last_peered":"2022-08-10T17:54:42.891954+0000","last_clean":"2022-08-10T17:54:42.891954+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:54:42.891954+0000","last_undegraded":"2022-08-10T17:54:42.891954+0000","last_fullsized":"2022-08-10T17:54:42.891954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:46:38.209770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.705308+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:54:42.705308+0000","last_peered":"2022-08-10T17:54:42.705308+0000","last_clean":"2022-08-10T17:54:42.705308+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:54:42.705308+0000","last_undegraded":"2022-08-10T17:54:42.705308+0000","last_fullsized":"2022-08-10T17:54:42.705308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:56.062713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928284+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:54:42.928284+0000","last_peered":"2022-08-10T17:54:42.928284+0000","last_clean":"2022-08-10T17:54:42.928284+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:54:42.928284+0000","last_undegraded":"2022-08-10T17:54:42.928284+0000","last_fullsized":"2022-08-10T17:54:42.928284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4457,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.234292+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.234292+0000","last_peered":"2022-08-10T17:54:42.234292+0000","last_clean":"2022-08-10T17:54:42.234292+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.234292+0000","last_undegraded":"2022-08-10T17:54:42.234292+0000","last_fullsized":"2022-08-10T17:54:42.234292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.118864+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.118864+0000","last_peered":"2022-08-10T17:54:42.118864+0000","last_clean":"2022-08-10T17:54:42.118864+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.118864+0000","last_undegraded":"2022-08-10T17:54:42.118864+0000","last_fullsized":"2022-08-10T17:54:42.118864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.553379+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:55:16.553379+0000","last_peered":"2022-08-10T17:55:16.553379+0000","last_clean":"2022-08-10T17:55:16.553379+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:16.553379+0000","last_undegraded":"2022-08-10T17:55:16.553379+0000","last_fullsized":"2022-08-10T17:55:16.553379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:58.641186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4707,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.914053+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:54:42.914053+0000","last_peered":"2022-08-10T17:54:42.914053+0000","last_clean":"2022-08-10T17:54:42.914053+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:54:42.914053+0000","last_undegraded":"2022-08-10T17:54:42.914053+0000","last_fullsized":"2022-08-10T17:54:42.914053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'12","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085069+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:54:43.085069+0000","last_peered":"2022-08-10T17:54:43.085069+0000","last_clean":"2022-08-10T17:54:43.085069+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:54:43.085069+0000","last_undegraded":"2022-08-10T17:54:43.085069+0000","last_fullsized":"2022-08-10T17:54:43.085069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:42.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.817071+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:54:42.817071+0000","last_peered":"2022-08-10T17:54:42.817071+0000","last_clean":"2022-08-10T17:54:42.817071+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:54:42.817071+0000","last_undegraded":"2022-08-10T17:54:42.817071+0000","last_fullsized":"2022-08-10T17:54:42.817071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4367,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.875031+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:42.875031+0000","last_peered":"2022-08-10T17:54:42.875031+0000","last_clean":"2022-08-10T17:54:42.875031+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:42.875031+0000","last_undegraded":"2022-08-10T17:54:42.875031+0000","last_fullsized":"2022-08-10T17:54:42.875031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.234808+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:36:19.234808+0000","last_peered":"2022-08-10T17:36:19.234808+0000","last_clean":"2022-08-10T17:36:19.234808+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:36:19.234808+0000","last_undegraded":"2022-08-10T17:36:19.234808+0000","last_fullsized":"2022-08-10T17:36:19.234808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:39:02.217559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545814+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:55:16.545814+0000","last_peered":"2022-08-10T17:55:16.545814+0000","last_clean":"2022-08-10T17:55:16.545814+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:16.545814+0000","last_undegraded":"2022-08-10T17:55:16.545814+0000","last_fullsized":"2022-08-10T17:55:16.545814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.013544+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:54:43.013544+0000","last_peered":"2022-08-10T17:54:43.013544+0000","last_clean":"2022-08-10T17:54:43.013544+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:54:43.013544+0000","last_undegraded":"2022-08-10T17:54:43.013544+0000","last_fullsized":"2022-08-10T17:54:43.013544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'62","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.930136+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:54:19.930136+0000","last_peered":"2022-08-10T17:54:19.930136+0000","last_clean":"2022-08-10T17:54:19.930136+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:54:19.930136+0000","last_undegraded":"2022-08-10T17:54:19.930136+0000","last_fullsized":"2022-08-10T17:54:19.930136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548915+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:55:16.548915+0000","last_peered":"2022-08-10T17:55:16.548915+0000","last_clean":"2022-08-10T17:55:16.548915+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:55:16.548915+0000","last_undegraded":"2022-08-10T17:55:16.548915+0000","last_fullsized":"2022-08-10T17:55:16.548915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:53.110976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4171,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.978723+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:42.978723+0000","last_peered":"2022-08-10T17:54:42.978723+0000","last_clean":"2022-08-10T17:54:42.978723+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:42.978723+0000","last_undegraded":"2022-08-10T17:54:42.978723+0000","last_fullsized":"2022-08-10T17:54:42.978723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535315+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:55:16.535315+0000","last_peered":"2022-08-10T17:55:16.535315+0000","last_clean":"2022-08-10T17:55:16.535315+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:16.535315+0000","last_undegraded":"2022-08-10T17:55:16.535315+0000","last_fullsized":"2022-08-10T17:55:16.535315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:42:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5938,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.820151+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:42.820151+0000","last_peered":"2022-08-10T17:54:42.820151+0000","last_clean":"2022-08-10T17:54:42.820151+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:42.820151+0000","last_undegraded":"2022-08-10T17:54:42.820151+0000","last_fullsized":"2022-08-10T17:54:42.820151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:01:11.837727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'21","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.397147+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:54:43.397147+0000","last_peered":"2022-08-10T17:54:43.397147+0000","last_clean":"2022-08-10T17:54:43.397147+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:54:43.397147+0000","last_undegraded":"2022-08-10T17:54:43.397147+0000","last_fullsized":"2022-08-10T17:54:43.397147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.497198+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:54:42.497198+0000","last_peered":"2022-08-10T17:54:42.497198+0000","last_clean":"2022-08-10T17:54:42.497198+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:54:42.497198+0000","last_undegraded":"2022-08-10T17:54:42.497198+0000","last_fullsized":"2022-08-10T17:54:42.497198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:58.274087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4198,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.963480+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:54:42.963480+0000","last_peered":"2022-08-10T17:54:42.963480+0000","last_clean":"2022-08-10T17:54:42.963480+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:54:42.963480+0000","last_undegraded":"2022-08-10T17:54:42.963480+0000","last_fullsized":"2022-08-10T17:54:42.963480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:10.580378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'305","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:33.622068+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:54:33.622068+0000","last_peered":"2022-08-10T17:54:33.622068+0000","last_clean":"2022-08-10T17:54:33.622068+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:54:33.622068+0000","last_undegraded":"2022-08-10T17:54:33.622068+0000","last_fullsized":"2022-08-10T17:54:33.622068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'18","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.830077+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:54:42.830077+0000","last_peered":"2022-08-10T17:54:42.830077+0000","last_clean":"2022-08-10T17:54:42.830077+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:54:42.830077+0000","last_undegraded":"2022-08-10T17:54:42.830077+0000","last_fullsized":"2022-08-10T17:54:42.830077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5817,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.411690+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.411690+0000","last_peered":"2022-08-10T17:54:42.411690+0000","last_clean":"2022-08-10T17:54:42.411690+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.411690+0000","last_undegraded":"2022-08-10T17:54:42.411690+0000","last_fullsized":"2022-08-10T17:54:42.411690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887295+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.887295+0000","last_peered":"2022-08-10T17:38:04.887295+0000","last_clean":"2022-08-10T17:38:04.887295+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.887295+0000","last_undegraded":"2022-08-10T17:38:04.887295+0000","last_fullsized":"2022-08-10T17:38:04.887295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549930+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:55:16.549930+0000","last_peered":"2022-08-10T17:55:16.549930+0000","last_clean":"2022-08-10T17:55:16.549930+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:16.549930+0000","last_undegraded":"2022-08-10T17:55:16.549930+0000","last_fullsized":"2022-08-10T17:55:16.549930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:05:28.539560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4271,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.022626+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:54:42.022626+0000","last_peered":"2022-08-10T17:54:42.022626+0000","last_clean":"2022-08-10T17:54:42.022626+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:54:42.022626+0000","last_undegraded":"2022-08-10T17:54:42.022626+0000","last_fullsized":"2022-08-10T17:54:42.022626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:36:36.564316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794257+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:54:42.794257+0000","last_peered":"2022-08-10T17:54:42.794257+0000","last_clean":"2022-08-10T17:54:42.794257+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:54:42.794257+0000","last_undegraded":"2022-08-10T17:54:42.794257+0000","last_fullsized":"2022-08-10T17:54:42.794257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'9","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:28.136113+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:54:28.136113+0000","last_peered":"2022-08-10T17:54:28.136113+0000","last_clean":"2022-08-10T17:54:28.136113+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:54:28.136113+0000","last_undegraded":"2022-08-10T17:54:28.136113+0000","last_fullsized":"2022-08-10T17:54:28.136113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4380,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.503273+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:54:42.503273+0000","last_peered":"2022-08-10T17:54:42.503273+0000","last_clean":"2022-08-10T17:54:42.503273+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:54:42.503273+0000","last_undegraded":"2022-08-10T17:54:42.503273+0000","last_fullsized":"2022-08-10T17:54:42.503273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:31:23.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'302","reported_seq":318,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.686364+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:54:42.686364+0000","last_peered":"2022-08-10T17:54:42.686364+0000","last_clean":"2022-08-10T17:54:42.686364+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:54:42.686364+0000","last_undegraded":"2022-08-10T17:54:42.686364+0000","last_fullsized":"2022-08-10T17:54:42.686364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'13","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:40.875250+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:54:40.875250+0000","last_peered":"2022-08-10T17:54:40.875250+0000","last_clean":"2022-08-10T17:54:40.875250+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:54:40.875250+0000","last_undegraded":"2022-08-10T17:54:40.875250+0000","last_fullsized":"2022-08-10T17:54:40.875250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4919,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.775714+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:54:42.775714+0000","last_peered":"2022-08-10T17:54:42.775714+0000","last_clean":"2022-08-10T17:54:42.775714+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:54:42.775714+0000","last_undegraded":"2022-08-10T17:54:42.775714+0000","last_fullsized":"2022-08-10T17:54:42.775714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794349+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:54:42.794349+0000","last_peered":"2022-08-10T17:54:42.794349+0000","last_clean":"2022-08-10T17:54:42.794349+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:54:42.794349+0000","last_undegraded":"2022-08-10T17:54:42.794349+0000","last_fullsized":"2022-08-10T17:54:42.794349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527577+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:55:16.527577+0000","last_peered":"2022-08-10T17:55:16.527577+0000","last_clean":"2022-08-10T17:55:16.527577+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:16.527577+0000","last_undegraded":"2022-08-10T17:55:16.527577+0000","last_fullsized":"2022-08-10T17:55:16.527577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:20:45.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5306,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.823506+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.823506+0000","last_peered":"2022-08-10T17:54:42.823506+0000","last_clean":"2022-08-10T17:54:42.823506+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.823506+0000","last_undegraded":"2022-08-10T17:54:42.823506+0000","last_fullsized":"2022-08-10T17:54:42.823506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'45","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.999725+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:54:19.999725+0000","last_peered":"2022-08-10T17:54:19.999725+0000","last_clean":"2022-08-10T17:54:19.999725+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:54:19.999725+0000","last_undegraded":"2022-08-10T17:54:19.999725+0000","last_fullsized":"2022-08-10T17:54:19.999725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.237197+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:54:42.237197+0000","last_peered":"2022-08-10T17:54:42.237197+0000","last_clean":"2022-08-10T17:54:42.237197+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:54:42.237197+0000","last_undegraded":"2022-08-10T17:54:42.237197+0000","last_fullsized":"2022-08-10T17:54:42.237197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.928347+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:54:42.928347+0000","last_peered":"2022-08-10T17:54:42.928347+0000","last_clean":"2022-08-10T17:54:42.928347+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:54:42.928347+0000","last_undegraded":"2022-08-10T17:54:42.928347+0000","last_fullsized":"2022-08-10T17:54:42.928347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:15.974942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.527905+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:39:02.527905+0000","last_peered":"2022-08-10T17:39:02.527905+0000","last_clean":"2022-08-10T17:39:02.527905+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:39:02.527905+0000","last_undegraded":"2022-08-10T17:39:02.527905+0000","last_fullsized":"2022-08-10T17:39:02.527905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818367+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:54:42.818367+0000","last_peered":"2022-08-10T17:54:42.818367+0000","last_clean":"2022-08-10T17:54:42.818367+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:54:42.818367+0000","last_undegraded":"2022-08-10T17:54:42.818367+0000","last_fullsized":"2022-08-10T17:54:42.818367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4694,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.767189+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:54:42.767189+0000","last_peered":"2022-08-10T17:54:42.767189+0000","last_clean":"2022-08-10T17:54:42.767189+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:54:42.767189+0000","last_undegraded":"2022-08-10T17:54:42.767189+0000","last_fullsized":"2022-08-10T17:54:42.767189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:52.171786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.849623+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:39:41.849623+0000","last_peered":"2022-08-10T17:39:41.849623+0000","last_clean":"2022-08-10T17:39:41.849623+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:39:41.849623+0000","last_undegraded":"2022-08-10T17:39:41.849623+0000","last_fullsized":"2022-08-10T17:39:41.849623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545652+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:55:16.545652+0000","last_peered":"2022-08-10T17:55:16.545652+0000","last_clean":"2022-08-10T17:55:16.545652+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:16.545652+0000","last_undegraded":"2022-08-10T17:55:16.545652+0000","last_fullsized":"2022-08-10T17:55:16.545652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3818,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.980477+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:54:42.980477+0000","last_peered":"2022-08-10T17:54:42.980477+0000","last_clean":"2022-08-10T17:54:42.980477+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:54:42.980477+0000","last_undegraded":"2022-08-10T17:54:42.980477+0000","last_fullsized":"2022-08-10T17:54:42.980477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:11:45.693283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.919068+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:39:18.919068+0000","last_peered":"2022-08-10T17:39:18.919068+0000","last_clean":"2022-08-10T17:39:18.919068+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:39:18.919068+0000","last_undegraded":"2022-08-10T17:39:18.919068+0000","last_fullsized":"2022-08-10T17:39:18.919068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'11","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.626548+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:54:42.626548+0000","last_peered":"2022-08-10T17:54:42.626548+0000","last_clean":"2022-08-10T17:54:42.626548+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:54:42.626548+0000","last_undegraded":"2022-08-10T17:54:42.626548+0000","last_fullsized":"2022-08-10T17:54:42.626548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3292,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:41.907134+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:54:41.907134+0000","last_peered":"2022-08-10T17:54:41.907134+0000","last_clean":"2022-08-10T17:54:41.907134+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:54:41.907134+0000","last_undegraded":"2022-08-10T17:54:41.907134+0000","last_fullsized":"2022-08-10T17:54:41.907134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:49:31.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'332","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.790392+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:54:42.790392+0000","last_peered":"2022-08-10T17:54:42.790392+0000","last_clean":"2022-08-10T17:54:42.790392+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:54:42.790392+0000","last_undegraded":"2022-08-10T17:54:42.790392+0000","last_fullsized":"2022-08-10T17:54:42.790392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:49:23.276551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655741,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":2774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.920538+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:54:42.920538+0000","last_peered":"2022-08-10T17:54:42.920538+0000","last_clean":"2022-08-10T17:54:42.920538+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:54:42.920538+0000","last_undegraded":"2022-08-10T17:54:42.920538+0000","last_fullsized":"2022-08-10T17:54:42.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5060,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.032924+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:54:43.032924+0000","last_peered":"2022-08-10T17:54:43.032924+0000","last_clean":"2022-08-10T17:54:43.032924+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:54:43.032924+0000","last_undegraded":"2022-08-10T17:54:43.032924+0000","last_fullsized":"2022-08-10T17:54:43.032924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:28:12.398816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'55","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.387180+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:54:42.387180+0000","last_peered":"2022-08-10T17:54:42.387180+0000","last_clean":"2022-08-10T17:54:42.387180+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:54:42.387180+0000","last_undegraded":"2022-08-10T17:54:42.387180+0000","last_fullsized":"2022-08-10T17:54:42.387180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'11","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:35.564003+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:54:35.564003+0000","last_peered":"2022-08-10T17:54:35.564003+0000","last_clean":"2022-08-10T17:54:35.564003+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:54:35.564003+0000","last_undegraded":"2022-08-10T17:54:35.564003+0000","last_fullsized":"2022-08-10T17:54:35.564003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6353,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.572490+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.572490+0000","last_peered":"2022-08-10T17:54:42.572490+0000","last_clean":"2022-08-10T17:54:42.572490+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.572490+0000","last_undegraded":"2022-08-10T17:54:42.572490+0000","last_fullsized":"2022-08-10T17:54:42.572490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:23.787138+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:23.787138+0000","last_peered":"2022-08-10T17:54:23.787138+0000","last_clean":"2022-08-10T17:54:23.787138+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:23.787138+0000","last_undegraded":"2022-08-10T17:54:23.787138+0000","last_fullsized":"2022-08-10T17:54:23.787138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:36.190454+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:54:36.190454+0000","last_peered":"2022-08-10T17:54:36.190454+0000","last_clean":"2022-08-10T17:54:36.190454+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:54:36.190454+0000","last_undegraded":"2022-08-10T17:54:36.190454+0000","last_fullsized":"2022-08-10T17:54:36.190454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6045,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709336+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:42.709336+0000","last_peered":"2022-08-10T17:54:42.709336+0000","last_clean":"2022-08-10T17:54:42.709336+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:42.709336+0000","last_undegraded":"2022-08-10T17:54:42.709336+0000","last_fullsized":"2022-08-10T17:54:42.709336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.850560+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:39:41.850560+0000","last_peered":"2022-08-10T17:39:41.850560+0000","last_clean":"2022-08-10T17:39:41.850560+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:39:41.850560+0000","last_undegraded":"2022-08-10T17:39:41.850560+0000","last_fullsized":"2022-08-10T17:39:41.850560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:59:38.422677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546523+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:55:16.546523+0000","last_peered":"2022-08-10T17:55:16.546523+0000","last_clean":"2022-08-10T17:55:16.546523+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:16.546523+0000","last_undegraded":"2022-08-10T17:55:16.546523+0000","last_fullsized":"2022-08-10T17:55:16.546523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:29.752925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4544,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.330973+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.330973+0000","last_peered":"2022-08-10T17:54:42.330973+0000","last_clean":"2022-08-10T17:54:42.330973+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.330973+0000","last_undegraded":"2022-08-10T17:54:42.330973+0000","last_fullsized":"2022-08-10T17:54:42.330973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681334+0000","last_change":"2022-08-10T17:35:32.321952+0000","last_active":"2022-08-10T17:36:17.681334+0000","last_peered":"2022-08-10T17:36:17.681334+0000","last_clean":"2022-08-10T17:36:17.681334+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:36:17.681334+0000","last_undegraded":"2022-08-10T17:36:17.681334+0000","last_fullsized":"2022-08-10T17:36:17.681334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:38:48.458556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.840772+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:54:42.840772+0000","last_peered":"2022-08-10T17:54:42.840772+0000","last_clean":"2022-08-10T17:54:42.840772+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:54:42.840772+0000","last_undegraded":"2022-08-10T17:54:42.840772+0000","last_fullsized":"2022-08-10T17:54:42.840772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.459739+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:54:24.459739+0000","last_peered":"2022-08-10T17:54:24.459739+0000","last_clean":"2022-08-10T17:54:24.459739+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:54:24.459739+0000","last_undegraded":"2022-08-10T17:54:24.459739+0000","last_fullsized":"2022-08-10T17:54:24.459739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:44:58.288557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4359,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.960673+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:42.960673+0000","last_peered":"2022-08-10T17:54:42.960673+0000","last_clean":"2022-08-10T17:54:42.960673+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:42.960673+0000","last_undegraded":"2022-08-10T17:54:42.960673+0000","last_fullsized":"2022-08-10T17:54:42.960673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.660704+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:24.660704+0000","last_peered":"2022-08-10T17:54:24.660704+0000","last_clean":"2022-08-10T17:54:24.660704+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:24.660704+0000","last_undegraded":"2022-08-10T17:54:24.660704+0000","last_fullsized":"2022-08-10T17:54:24.660704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818293+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:54:42.818293+0000","last_peered":"2022-08-10T17:54:42.818293+0000","last_clean":"2022-08-10T17:54:42.818293+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:54:42.818293+0000","last_undegraded":"2022-08-10T17:54:42.818293+0000","last_fullsized":"2022-08-10T17:54:42.818293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:19:31.796890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4659,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.800751+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:54:42.800751+0000","last_peered":"2022-08-10T17:54:42.800751+0000","last_clean":"2022-08-10T17:54:42.800751+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:54:42.800751+0000","last_undegraded":"2022-08-10T17:54:42.800751+0000","last_fullsized":"2022-08-10T17:54:42.800751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:47:34.106492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.679249+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:17.679249+0000","last_peered":"2022-08-10T17:36:17.679249+0000","last_clean":"2022-08-10T17:36:17.679249+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:17.679249+0000","last_undegraded":"2022-08-10T17:36:17.679249+0000","last_fullsized":"2022-08-10T17:36:17.679249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:29:30.799432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.889796+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:38:04.889796+0000","last_peered":"2022-08-10T17:38:04.889796+0000","last_clean":"2022-08-10T17:38:04.889796+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:38:04.889796+0000","last_undegraded":"2022-08-10T17:38:04.889796+0000","last_fullsized":"2022-08-10T17:38:04.889796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:40:46.832624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'14","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.649086+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:54:42.649086+0000","last_peered":"2022-08-10T17:54:42.649086+0000","last_clean":"2022-08-10T17:54:42.649086+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:54:42.649086+0000","last_undegraded":"2022-08-10T17:54:42.649086+0000","last_fullsized":"2022-08-10T17:54:42.649086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:08:01.922681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4786,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.967437+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:42.967437+0000","last_peered":"2022-08-10T17:54:42.967437+0000","last_clean":"2022-08-10T17:54:42.967437+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:42.967437+0000","last_undegraded":"2022-08-10T17:54:42.967437+0000","last_fullsized":"2022-08-10T17:54:42.967437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.530687+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:39:02.530687+0000","last_peered":"2022-08-10T17:39:02.530687+0000","last_clean":"2022-08-10T17:39:02.530687+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:39:02.530687+0000","last_undegraded":"2022-08-10T17:39:02.530687+0000","last_fullsized":"2022-08-10T17:39:02.530687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:35:28.905552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527672+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:55:16.527672+0000","last_peered":"2022-08-10T17:55:16.527672+0000","last_clean":"2022-08-10T17:55:16.527672+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:16.527672+0000","last_undegraded":"2022-08-10T17:55:16.527672+0000","last_fullsized":"2022-08-10T17:55:16.527672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.882397+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.882397+0000","last_peered":"2022-08-10T17:54:42.882397+0000","last_clean":"2022-08-10T17:54:42.882397+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.882397+0000","last_undegraded":"2022-08-10T17:54:42.882397+0000","last_fullsized":"2022-08-10T17:54:42.882397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'81","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.797747+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:54:42.797747+0000","last_peered":"2022-08-10T17:54:42.797747+0000","last_clean":"2022-08-10T17:54:42.797747+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:54:42.797747+0000","last_undegraded":"2022-08-10T17:54:42.797747+0000","last_fullsized":"2022-08-10T17:54:42.797747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":79,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'18","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.599299+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:54:42.599299+0000","last_peered":"2022-08-10T17:54:42.599299+0000","last_clean":"2022-08-10T17:54:42.599299+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:54:42.599299+0000","last_undegraded":"2022-08-10T17:54:42.599299+0000","last_fullsized":"2022-08-10T17:54:42.599299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5875,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.568847+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:54:42.568847+0000","last_peered":"2022-08-10T17:54:42.568847+0000","last_clean":"2022-08-10T17:54:42.568847+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:54:42.568847+0000","last_undegraded":"2022-08-10T17:54:42.568847+0000","last_fullsized":"2022-08-10T17:54:42.568847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681561+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:17.681561+0000","last_peered":"2022-08-10T17:36:17.681561+0000","last_clean":"2022-08-10T17:36:17.681561+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:17.681561+0000","last_undegraded":"2022-08-10T17:36:17.681561+0000","last_fullsized":"2022-08-10T17:36:17.681561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:41:49.372170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.948551+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:39:18.948551+0000","last_peered":"2022-08-10T17:39:18.948551+0000","last_clean":"2022-08-10T17:39:18.948551+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:39:18.948551+0000","last_undegraded":"2022-08-10T17:39:18.948551+0000","last_fullsized":"2022-08-10T17:39:18.948551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2959,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.508415+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.508415+0000","last_peered":"2022-08-10T17:54:42.508415+0000","last_clean":"2022-08-10T17:54:42.508415+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.508415+0000","last_undegraded":"2022-08-10T17:54:42.508415+0000","last_fullsized":"2022-08-10T17:54:42.508415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859723+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:37:58.859723+0000","last_peered":"2022-08-10T17:37:58.859723+0000","last_clean":"2022-08-10T17:37:58.859723+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:37:58.859723+0000","last_undegraded":"2022-08-10T17:37:58.859723+0000","last_fullsized":"2022-08-10T17:37:58.859723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:05:33.565723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.681575+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:17.681575+0000","last_peered":"2022-08-10T17:36:17.681575+0000","last_clean":"2022-08-10T17:36:17.681575+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:17.681575+0000","last_undegraded":"2022-08-10T17:36:17.681575+0000","last_fullsized":"2022-08-10T17:36:17.681575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:01:02.374060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.526764+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:55:16.526764+0000","last_peered":"2022-08-10T17:55:16.526764+0000","last_clean":"2022-08-10T17:55:16.526764+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:16.526764+0000","last_undegraded":"2022-08-10T17:55:16.526764+0000","last_fullsized":"2022-08-10T17:55:16.526764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:34:43.525320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4329,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.003375+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.003375+0000","last_peered":"2022-08-10T17:54:43.003375+0000","last_clean":"2022-08-10T17:54:43.003375+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.003375+0000","last_undegraded":"2022-08-10T17:54:43.003375+0000","last_fullsized":"2022-08-10T17:54:43.003375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:13.251246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'71","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:38.572737+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:54:38.572737+0000","last_peered":"2022-08-10T17:54:38.572737+0000","last_clean":"2022-08-10T17:54:38.572737+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:54:38.572737+0000","last_undegraded":"2022-08-10T17:54:38.572737+0000","last_fullsized":"2022-08-10T17:54:38.572737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.502348+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:54:42.502348+0000","last_peered":"2022-08-10T17:54:42.502348+0000","last_clean":"2022-08-10T17:54:42.502348+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:54:42.502348+0000","last_undegraded":"2022-08-10T17:54:42.502348+0000","last_fullsized":"2022-08-10T17:54:42.502348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4823,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.392349+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:54:42.392349+0000","last_peered":"2022-08-10T17:54:42.392349+0000","last_clean":"2022-08-10T17:54:42.392349+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:54:42.392349+0000","last_undegraded":"2022-08-10T17:54:42.392349+0000","last_fullsized":"2022-08-10T17:54:42.392349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:05:09.393624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1829","reported_seq":1844,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:25.148933+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:54:25.148933+0000","last_peered":"2022-08-10T17:54:25.148933+0000","last_clean":"2022-08-10T17:54:25.148933+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:54:25.148933+0000","last_undegraded":"2022-08-10T17:54:25.148933+0000","last_fullsized":"2022-08-10T17:54:25.148933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1829,"log_dups_size":0,"ondisk_log_size":1829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":8926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549319+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:55:16.549319+0000","last_peered":"2022-08-10T17:55:16.549319+0000","last_clean":"2022-08-10T17:55:16.549319+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:16.549319+0000","last_undegraded":"2022-08-10T17:55:16.549319+0000","last_fullsized":"2022-08-10T17:55:16.549319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:24.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4542,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.578670+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.578670+0000","last_peered":"2022-08-10T17:54:42.578670+0000","last_clean":"2022-08-10T17:54:42.578670+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.578670+0000","last_undegraded":"2022-08-10T17:54:42.578670+0000","last_fullsized":"2022-08-10T17:54:42.578670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057640+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:19.057640+0000","last_peered":"2022-08-10T17:36:19.057640+0000","last_clean":"2022-08-10T17:36:19.057640+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:19.057640+0000","last_undegraded":"2022-08-10T17:36:19.057640+0000","last_fullsized":"2022-08-10T17:36:19.057640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.361881+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:54:42.361881+0000","last_peered":"2022-08-10T17:54:42.361881+0000","last_clean":"2022-08-10T17:54:42.361881+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:54:42.361881+0000","last_undegraded":"2022-08-10T17:54:42.361881+0000","last_fullsized":"2022-08-10T17:54:42.361881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3894,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.753421+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:54:42.753421+0000","last_peered":"2022-08-10T17:54:42.753421+0000","last_clean":"2022-08-10T17:54:42.753421+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:54:42.753421+0000","last_undegraded":"2022-08-10T17:54:42.753421+0000","last_fullsized":"2022-08-10T17:54:42.753421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.730686+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:39:18.730686+0000","last_peered":"2022-08-10T17:39:18.730686+0000","last_clean":"2022-08-10T17:39:18.730686+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:39:18.730686+0000","last_undegraded":"2022-08-10T17:39:18.730686+0000","last_fullsized":"2022-08-10T17:39:18.730686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'13","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.242055+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:54:42.242055+0000","last_peered":"2022-08-10T17:54:42.242055+0000","last_clean":"2022-08-10T17:54:42.242055+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:54:42.242055+0000","last_undegraded":"2022-08-10T17:54:42.242055+0000","last_fullsized":"2022-08-10T17:54:42.242055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4423,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.557967+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.557967+0000","last_peered":"2022-08-10T17:54:42.557967+0000","last_clean":"2022-08-10T17:54:42.557967+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.557967+0000","last_undegraded":"2022-08-10T17:54:42.557967+0000","last_fullsized":"2022-08-10T17:54:42.557967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535607+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:54:42.535607+0000","last_peered":"2022-08-10T17:54:42.535607+0000","last_clean":"2022-08-10T17:54:42.535607+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:54:42.535607+0000","last_undegraded":"2022-08-10T17:54:42.535607+0000","last_fullsized":"2022-08-10T17:54:42.535607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:53:39.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533382+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:55:16.533382+0000","last_peered":"2022-08-10T17:55:16.533382+0000","last_clean":"2022-08-10T17:55:16.533382+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:16.533382+0000","last_undegraded":"2022-08-10T17:55:16.533382+0000","last_fullsized":"2022-08-10T17:55:16.533382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:05:03.196247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5520,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.059549+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:54:42.059549+0000","last_peered":"2022-08-10T17:54:42.059549+0000","last_clean":"2022-08-10T17:54:42.059549+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:54:42.059549+0000","last_undegraded":"2022-08-10T17:54:42.059549+0000","last_fullsized":"2022-08-10T17:54:42.059549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:23:15.201208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709261+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:54:42.709261+0000","last_peered":"2022-08-10T17:54:42.709261+0000","last_clean":"2022-08-10T17:54:42.709261+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:54:42.709261+0000","last_undegraded":"2022-08-10T17:54:42.709261+0000","last_fullsized":"2022-08-10T17:54:42.709261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'17","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.535624+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:54:42.535624+0000","last_peered":"2022-08-10T17:54:42.535624+0000","last_clean":"2022-08-10T17:54:42.535624+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:54:42.535624+0000","last_undegraded":"2022-08-10T17:54:42.535624+0000","last_fullsized":"2022-08-10T17:54:42.535624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527655+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:55:16.527655+0000","last_peered":"2022-08-10T17:55:16.527655+0000","last_clean":"2022-08-10T17:55:16.527655+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:16.527655+0000","last_undegraded":"2022-08-10T17:55:16.527655+0000","last_fullsized":"2022-08-10T17:55:16.527655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.551578+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:55:16.551578+0000","last_peered":"2022-08-10T17:55:16.551578+0000","last_clean":"2022-08-10T17:55:16.551578+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:16.551578+0000","last_undegraded":"2022-08-10T17:55:16.551578+0000","last_fullsized":"2022-08-10T17:55:16.551578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:21:02.335637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'15","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.550686+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:54:42.550686+0000","last_peered":"2022-08-10T17:54:42.550686+0000","last_clean":"2022-08-10T17:54:42.550686+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:54:42.550686+0000","last_undegraded":"2022-08-10T17:54:42.550686+0000","last_fullsized":"2022-08-10T17:54:42.550686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527138+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:55:16.527138+0000","last_peered":"2022-08-10T17:55:16.527138+0000","last_clean":"2022-08-10T17:55:16.527138+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:16.527138+0000","last_undegraded":"2022-08-10T17:55:16.527138+0000","last_fullsized":"2022-08-10T17:55:16.527138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:30:34.062104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.684602+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:54:42.684602+0000","last_peered":"2022-08-10T17:54:42.684602+0000","last_clean":"2022-08-10T17:54:42.684602+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:54:42.684602+0000","last_undegraded":"2022-08-10T17:54:42.684602+0000","last_fullsized":"2022-08-10T17:54:42.684602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:07:33.902499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1116,"ondisk_log_size":1116,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271606,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3453,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32542898,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3238,"ondisk_log_size":3238,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575089,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478068,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475072,"kb_avail":93893772,"statfs":{"total":96636764160,"available":96147222528,"internally_reserved":0,"allocated":3059712,"data_stored":6661537,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486473728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.312},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.42499999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.436}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.379},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.32300000000000001},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.36799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504068,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503744,"kb_avail":93867772,"statfs":{"total":96636764160,"available":96120598528,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515833856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.7009999999999996,"5min":10.398,"15min":11.797000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":38.445,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":4.4139999999999997,"5min":10.430999999999999,"15min":12.347},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":29.300999999999998,"5min":129.767,"15min":129.767},"last":0.376}]},{"osd":1,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.2009999999999996,"5min":11.039999999999999,"15min":13.378},"min":{"1min":0.34899999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":25.206,"5min":114.83,"15min":318.94299999999998},"last":0.434},{"interface":"front","average":{"1min":4.4109999999999996,"5min":11.000999999999999,"15min":11.98},"min":{"1min":0.33600000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":21.338999999999999,"5min":114.842,"15min":119.708},"last":0.47199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.407,"5min":1.405,"15min":4.6799999999999997},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.224},"max":{"1min":16.099,"5min":17.885999999999999,"15min":107.033},"last":0.39400000000000002},{"interface":"front","average":{"1min":3.9049999999999998,"5min":1.4019999999999999,"15min":5.0629999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":16.277999999999999,"5min":17.895,"15min":107.062},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.3210000000000002,"5min":1.0029999999999999,"15min":2.9049999999999998},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.254},"max":{"1min":16.376999999999999,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":3.3799999999999999,"5min":1.0840000000000001,"15min":3.1459999999999999},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":16.331,"5min":16.331,"15min":96.870000000000005},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.8500000000000001,"5min":3.0350000000000001,"15min":6.7670000000000003},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.183},"max":{"1min":22.443000000000001,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.419,"5min":3.004,"15min":6.7670000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":22.484999999999999,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":2.4569999999999999,"5min":6.5010000000000003,"15min":8.2929999999999993},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":16.129999999999999,"5min":79.944999999999993,"15min":100.741},"last":0.315},{"interface":"front","average":{"1min":4.9290000000000003,"5min":7.0510000000000002,"15min":8.3940000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":38.378999999999998,"5min":80.159000000000006,"15min":100.715},"last":0.38300000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":1.238,"15min":4.101},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":15.968999999999999,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.7769999999999999,"5min":0.873,"15min":3.597},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":10.551,"5min":10.551,"15min":59.384},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575086,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621580,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621248,"kb_avail":93750260,"statfs":{"total":96636764160,"available":96000266240,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636157952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.308},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.26200000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.371},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.46200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.495},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834575086,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603792,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596096,"kb_avail":93768048,"statfs":{"total":96636764160,"available":96018481152,"internally_reserved":0,"allocated":7872512,"data_stored":11046620,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610402304},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":12.071999999999999,"15min":12.028},"min":{"1min":0.191,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":57.822000000000003,"5min":90.528999999999996,"15min":111.419},"last":0.27200000000000002},{"interface":"front","average":{"1min":3.169,"5min":12.108000000000001,"15min":12.244},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":57.835999999999999,"5min":93.111999999999995,"15min":111.506},"last":0.32300000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.64700000000000002,"15min":6.4180000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.189},"max":{"1min":0.68700000000000006,"5min":10.821999999999999,"15min":130.566},"last":0.245},{"interface":"front","average":{"1min":0.38100000000000001,"5min":1.4039999999999999,"15min":6.4359999999999999},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.222},"max":{"1min":0.66500000000000004,"5min":50.625,"15min":130.63300000000001},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.80000000000000004,"15min":4.4560000000000004},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60799999999999998,"5min":31.167999999999999,"15min":111.333},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.1719999999999999,"15min":4.641},"min":{"1min":0.28199999999999997,"5min":0.20899999999999999,"15min":0.19700000000000001},"max":{"1min":0.72799999999999998,"5min":50.686999999999998,"15min":111.377},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":2.7250000000000001,"15min":7.0570000000000004},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":90.531000000000006,"15min":127.629},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":3.1960000000000002,"15min":7.2679999999999998},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.76600000000000001,"5min":90.509,"15min":127.497},"last":0.374}]},{"osd":5,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":4.7359999999999998,"15min":8.3179999999999996},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":2.4860000000000002,"5min":88.512,"15min":127.77500000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":5.7759999999999998,"15min":8.4789999999999992},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64600000000000002,"5min":88.429000000000002,"15min":127.798},"last":0.38400000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":1.1299999999999999,"15min":4.6859999999999999},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":50.664000000000001,"15min":114.8},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.448,"15min":5.032},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.747,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.432}]},{"osd":7,"last update":"Wed Aug 10 17:54:11 2022","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.198,"15min":3.2629999999999999},"min":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.63600000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4390000000000001,"15min":3.855},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.30199999999999999},"max":{"1min":1.343,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.44600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":11.993,"15min":15.167},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":37.323,"5min":150.911,"15min":433.41199999999998},"last":0.19},{"interface":"front","average":{"1min":5.6980000000000004,"5min":12.128,"15min":13.394},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":37.259999999999998,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.23100000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:54:18 2022","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.44,"15min":4.4889999999999999},"min":{"1min":0.25800000000000001,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.55600000000000005,"5min":4.0659999999999998,"15min":250.44200000000001},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.504,"15min":3.351},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":4.109,"15min":142.11699999999999},"last":0.29399999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":3.48,"15min":7.9800000000000004},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":30.893000000000001,"5min":47.207999999999998,"15min":114.259},"last":0.41999999999999998},{"interface":"front","average":{"1min":4.4050000000000002,"5min":3.3700000000000001,"15min":8.2829999999999995},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":30.867999999999999,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":2.2109999999999999,"5min":4.1440000000000001,"15min":7.8929999999999998},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":9.0790000000000006,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.976,"5min":4.2249999999999996,"15min":8.1769999999999996},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":19.873000000000001,"5min":63.508000000000003,"15min":100.22},"last":0.437}]},{"osd":6,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":1.2350000000000001,"15min":3.774},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":19.789999999999999,"5min":19.789999999999999,"15min":83.046000000000006},"last":0.42999999999999999},{"interface":"front","average":{"1min":4.2530000000000001,"5min":1.4470000000000001,"15min":3.4809999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":28.131,"5min":28.131,"15min":60.445},"last":0.373}]},{"osd":7,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":1.4490000000000001,"15min":4.3289999999999997},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.904000000000003,"5min":34.904000000000003,"15min":94.753},"last":0.34899999999999998},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.405,"15min":4.7729999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":19.922999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.41199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575088,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473880,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":471936,"kb_avail":93897960,"statfs":{"total":96636764160,"available":96151511040,"internally_reserved":0,"allocated":1982464,"data_stored":2795689,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483262464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.30599999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.23100000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.26300000000000001},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.65500000000000003}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.63},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575089,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559732,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551104,"kb_avail":93812108,"statfs":{"total":96636764160,"available":96063598592,"internally_reserved":0,"allocated":8826880,"data_stored":13742318,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564330496},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.38200000000000001},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.371},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.34499999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.434},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.41599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547152,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546816,"kb_avail":93824688,"statfs":{"total":96636764160,"available":96076480512,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":559939584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.437}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10322562,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2661999,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13608628,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:55:18.603 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:55:18.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.753+0000 7ff2283c3700 1 Processor -- start 2022-08-10T17:55:18.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.753+0000 7ff2283c3700 1 -- start start 2022-08-10T17:55:18.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff2283c3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff220068110 0x7ff2200c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff2283c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff220153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff2283c3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff220158dc0 con 0x7ff2200c3410 2022-08-10T17:55:18.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff2283c3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff220070580 con 0x7ff220068110 2022-08-10T17:55:18.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff2283c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22006fd90 con 0x7ff2200c37e0 2022-08-10T17:55:18.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff22595e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff220068110 0x7ff2200c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff22595e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff220068110 0x7ff2200c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45432/0 (socket says 172.21.15.150:45432) 2022-08-10T17:55:18.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff22595e700 1 -- 172.21.15.150:0/1756287258 learned_addr learned my addr 172.21.15.150:0/1756287258 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:18.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff22615f700 1 --1- 172.21.15.150:0/1756287258 >> v1:172.21.15.150:6789/0 conn(0x7ff2200c3410 0x7ff220155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58110/0 (socket says 172.21.15.150:58110) 2022-08-10T17:55:18.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.754+0000 7ff226960700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff220153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22595e700 1 -- 172.21.15.150:0/1756287258 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 msgr2=0x7ff220153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:18.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22595e700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff220153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22595e700 1 -- 172.21.15.150:0/1756287258 >> v1:172.21.15.150:6789/0 conn(0x7ff2200c3410 legacy=0x7ff220155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22595e700 1 -- 172.21.15.150:0/1756287258 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220158240 con 0x7ff220068110 2022-08-10T17:55:18.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22515d700 1 -- 172.21.15.150:0/1756287258 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369258631 0 0) 0x7ff220158dc0 con 0x7ff2200c3410 2022-08-10T17:55:18.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22595e700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff220068110 0x7ff2200c7070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd454c26ec036bbb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22515d700 1 -- 172.21.15.150:0/1756287258 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214004230 con 0x7ff220068110 2022-08-10T17:55:18.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22515d700 1 -- 172.21.15.150:0/1756287258 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214004390 con 0x7ff220068110 2022-08-10T17:55:18.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff22515d700 1 -- 172.21.15.150:0/1756287258 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214011830 con 0x7ff220068110 2022-08-10T17:55:18.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff2283c3700 1 -- 172.21.15.150:0/1756287258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff220068110 msgr2=0x7ff2200c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.755+0000 7ff2283c3700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff220068110 0x7ff2200c7070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:18.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 -- 172.21.15.150:0/1756287258 shutdown_connections 2022-08-10T17:55:18.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff220153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 --2- 172.21.15.150:0/1756287258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff220068110 0x7ff2200c7070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 -- 172.21.15.150:0/1756287258 >> 172.21.15.150:0/1756287258 conn(0x7ff22006d0d0 msgr2=0x7ff2200c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:18.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 -- 172.21.15.150:0/1756287258 shutdown_connections 2022-08-10T17:55:18.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.756+0000 7ff2283c3700 1 -- 172.21.15.150:0/1756287258 wait complete. 2022-08-10T17:55:18.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 Processor -- start 2022-08-10T17:55:18.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 -- start start 2022-08-10T17:55:18.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff220068110 0x7ff22014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff22014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220150890 con 0x7ff2200c3410 2022-08-10T17:55:18.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201ea600 con 0x7ff220068110 2022-08-10T17:55:18.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.757+0000 7ff2283c3700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c0000 con 0x7ff2200c37e0 2022-08-10T17:55:18.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45438/0 (socket says 172.21.15.150:45438) 2022-08-10T17:55:18.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 -- 172.21.15.150:0/2012000643 learned_addr learned my addr 172.21.15.150:0/2012000643 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:18.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff226960700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff22014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22615f700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff220068110 0x7ff22014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 -- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 msgr2=0x7ff22014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff22014e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 -- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff220068110 msgr2=0x7ff22014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff220068110 0x7ff22014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 -- 172.21.15.150:0/2012000643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140093e0 con 0x7ff2200c3410 2022-08-10T17:55:18.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff22595e700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff214000c00 tx=0x7ff2140045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.783 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214011df0 con 0x7ff2200c3410 2022-08-10T17:55:18.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21401f070 con 0x7ff2200c3410 2022-08-10T17:55:18.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2200c02e0 con 0x7ff2200c3410 2022-08-10T17:55:18.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214003760 con 0x7ff2200c3410 2022-08-10T17:55:18.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.758+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2200c08a0 con 0x7ff2200c3410 2022-08-10T17:55:18.784 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.759+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220072890 con 0x7ff2200c3410 2022-08-10T17:55:18.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.760+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff214017020 con 0x7ff2200c3410 2022-08-10T17:55:18.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.760+0000 7ff21effd700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 0x7ff200067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:18.785 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.760+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff214021070 con 0x7ff2200c3410 2022-08-10T17:55:18.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.760+0000 7ff22615f700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 0x7ff200067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:18.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.760+0000 7ff22615f700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 0x7ff200067560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff218007fd0 tx=0x7ff218007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:18.786 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.764+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff214051a80 con 0x7ff2200c3410 2022-08-10T17:55:18.950 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.947+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff220069240 con 0x7ff2200c3410 2022-08-10T17:55:18.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.948+0000 7ff21effd700 1 -- 172.21.15.150:0/2012000643 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7ff2140550a0 con 0x7ff2200c3410 2022-08-10T17:55:18.952 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:18.952 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:55:18.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 msgr2=0x7ff200067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 0x7ff200067560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff218007fd0 tx=0x7ff218007c60 comp rx=0 tx=0).stop 2022-08-10T17:55:18.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 msgr2=0x7ff22014dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:18.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff214000c00 tx=0x7ff2140045d0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 shutdown_connections 2022-08-10T17:55:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff2000650b0 0x7ff200067560 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff2200c37e0 0x7ff22014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff220068110 0x7ff22014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 --2- 172.21.15.150:0/2012000643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2200c3410 0x7ff22014dd70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:18.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 >> 172.21.15.150:0/2012000643 conn(0x7ff22006d0d0 msgr2=0x7ff220154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:18.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 shutdown_connections 2022-08-10T17:55:18.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:18.950+0000 7ff2283c3700 1 -- 172.21.15.150:0/2012000643 wait complete. 2022-08-10T17:55:19.967 INFO:tasks.ceph:Scrubbing osd.0 2022-08-10T17:55:19.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:20.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.093+0000 7f3d9a4e8700 1 Processor -- start 2022-08-10T17:55:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.093+0000 7f3d9a4e8700 1 -- start start 2022-08-10T17:55:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d9a4e8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 0x7f3d940bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d9a4e8700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 0x7f3d940c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d9a4e8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9406f130 con 0x7f3d940c9f10 2022-08-10T17:55:20.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d9a4e8700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940c4a80 con 0x7f3d9406f380 2022-08-10T17:55:20.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d9a4e8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9406ea00 con 0x7f3d940c6760 2022-08-10T17:55:20.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d98a85700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3d940c9f10 0x7f3d94153e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58128/0 (socket says 172.21.15.150:58128) 2022-08-10T17:55:20.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d98a85700 1 -- 172.21.15.150:0/1148195722 learned_addr learned my addr 172.21.15.150:0/1148195722 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:20.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d937fe700 1 --2- 172.21.15.150:0/1148195722 >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 0x7f3d940c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.094+0000 7f3d93fff700 1 --2- 172.21.15.150:0/1148195722 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 0x7f3d940bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d92ffd700 1 -- 172.21.15.150:0/1148195722 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608238306 0 0) 0x7f3d9406f130 con 0x7f3d940c9f10 2022-08-10T17:55:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d92ffd700 1 -- 172.21.15.150:0/1148195722 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80003430 con 0x7f3d940c9f10 2022-08-10T17:55:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d93fff700 1 -- 172.21.15.150:0/1148195722 >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 msgr2=0x7f3d940c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d93fff700 1 --2- 172.21.15.150:0/1148195722 >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 0x7f3d940c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d93fff700 1 -- 172.21.15.150:0/1148195722 >> v1:172.21.15.150:6789/0 conn(0x7f3d940c9f10 legacy=0x7f3d94153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d93fff700 1 -- 172.21.15.150:0/1148195722 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940ca6d0 con 0x7f3d940c6760 2022-08-10T17:55:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d937fe700 1 --2- 172.21.15.150:0/1148195722 >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 0x7f3d940c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d93fff700 1 --2- 172.21.15.150:0/1148195722 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 0x7f3d940bd460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d840096b0 tx=0x7f3d840099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5752fc0534f50a43 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d92ffd700 1 -- 172.21.15.150:0/1148195722 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840107b0 con 0x7f3d940c6760 2022-08-10T17:55:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d92ffd700 1 -- 172.21.15.150:0/1148195722 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84010910 con 0x7f3d940c6760 2022-08-10T17:55:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.095+0000 7f3d92ffd700 1 -- 172.21.15.150:0/1148195722 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84010cc0 con 0x7f3d940c6760 2022-08-10T17:55:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/1148195722 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 msgr2=0x7f3d940bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/1148195722 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 0x7f3d940bd460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d840096b0 tx=0x7f3d840099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/1148195722 shutdown_connections 2022-08-10T17:55:20.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/1148195722 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d940c6760 0x7f3d940bd460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/1148195722 >> v2:172.21.15.197:3300/0 conn(0x7f3d9406f380 0x7f3d940c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/1148195722 >> 172.21.15.150:0/1148195722 conn(0x7f3d94068110 msgr2=0x7f3d94068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/1148195722 shutdown_connections 2022-08-10T17:55:20.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.096+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/1148195722 wait complete. 2022-08-10T17:55:20.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.098+0000 7f3d9a4e8700 1 Processor -- start 2022-08-10T17:55:20.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.098+0000 7f3d9a4e8700 1 -- start start 2022-08-10T17:55:20.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d9406f380 0x7f3d9414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 0x7f3d94150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d940c9f10 0x7f3d941ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9414ce90 con 0x7f3d940c6760 2022-08-10T17:55:20.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9414de40 con 0x7f3d940c9f10 2022-08-10T17:55:20.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d9a4e8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9414c880 con 0x7f3d9406f380 2022-08-10T17:55:20.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 0x7f3d94150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 0x7f3d94150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45452/0 (socket says 172.21.15.150:45452) 2022-08-10T17:55:20.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 -- 172.21.15.150:0/3670400632 learned_addr learned my addr 172.21.15.150:0/3670400632 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:20.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d98a85700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d940c9f10 0x7f3d941ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d93fff700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d9406f380 0x7f3d9414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 -- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d9406f380 msgr2=0x7f3d9414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f3d9406f380 0x7f3d9414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 -- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d940c9f10 msgr2=0x7f3d941ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f3d940c9f10 0x7f3d941ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009310 con 0x7f3d940c6760 2022-08-10T17:55:20.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.099+0000 7f3d937fe700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 0x7f3d94150990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800e8d0 tx=0x7f3d8800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.100+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88013680 con 0x7f3d940c6760 2022-08-10T17:55:20.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.100+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880137e0 con 0x7f3d940c6760 2022-08-10T17:55:20.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.100+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88013b70 con 0x7f3d940c6760 2022-08-10T17:55:20.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.100+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d84009310 con 0x7f3d940c6760 2022-08-10T17:55:20.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.100+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9414d880 con 0x7f3d940c6760 2022-08-10T17:55:20.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.101+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d94072890 con 0x7f3d940c6760 2022-08-10T17:55:20.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.101+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f3d88023070 con 0x7f3d940c6760 2022-08-10T17:55:20.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.101+0000 7f3d90ff9700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d740650e0 0x7f3d74067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.101+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f3d880823b0 con 0x7f3d940c6760 2022-08-10T17:55:20.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.101+0000 7f3d93fff700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d740650e0 0x7f3d74067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d90ff9700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f3d7406eeb0 0x7f3d74071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d740719d0 con 0x7f3d7406eeb0 2022-08-10T17:55:20.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d88084a80 con 0x7f3d940c6760 2022-08-10T17:55:20.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d98a85700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f3d7406eeb0 0x7f3d74071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d93fff700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d740650e0 0x7f3d74067590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3d840090b0 tx=0x7f3d84008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.102+0000 7f3d98a85700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f3d7406eeb0 0x7f3d74071300 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.103+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== osd.0 v2:172.21.15.150:6800/97995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f3d740719d0 con 0x7f3d7406eeb0 2022-08-10T17:55:20.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 --> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d940ca990 con 0x7f3d7406eeb0 2022-08-10T17:55:20.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d90ff9700 1 -- 172.21.15.150:0/3670400632 <== osd.0 v2:172.21.15.150:6800/97995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d940ca990 con 0x7f3d7406eeb0 2022-08-10T17:55:20.133 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:20.134 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:20.134 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:20.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f3d7406eeb0 msgr2=0x7f3d74071300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:6800/97995,v1:172.21.15.150:6801/97995] conn(0x7f3d7406eeb0 0x7f3d74071300 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d740650e0 msgr2=0x7f3d74067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f3d740650e0 0x7f3d74067590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3d840090b0 tx=0x7f3d84008030 comp rx=0 tx=0).stop 2022-08-10T17:55:20.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 msgr2=0x7f3d94150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d9a4e8700 1 --2- 172.21.15.150:0/3670400632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d940c6760 0x7f3d94150990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800e8d0 tx=0x7f3d8800ebe0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.129+0000 7f3d98a85700 1 -- 172.21.15.150:0/3670400632 reap_dead start 2022-08-10T17:55:20.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.130+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 shutdown_connections 2022-08-10T17:55:20.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.130+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 >> 172.21.15.150:0/3670400632 conn(0x7f3d94068110 msgr2=0x7f3d941529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.130+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 shutdown_connections 2022-08-10T17:55:20.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.130+0000 7f3d9a4e8700 1 -- 172.21.15.150:0/3670400632 wait complete. 2022-08-10T17:55:20.145 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2022-08-10T17:55:20.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.265+0000 7f5524f8a700 1 Processor -- start 2022-08-10T17:55:20.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.265+0000 7f5524f8a700 1 -- start start 2022-08-10T17:55:20.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f5524f8a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f55201544d0 0x7f5520071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f5524f8a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 0x7f55200718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f5524f8a700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552006a050 con 0x7f552006ea90 2022-08-10T17:55:20.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f5524f8a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55200c6220 con 0x7f55201544d0 2022-08-10T17:55:20.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f5524f8a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c4420 con 0x7f552015a970 2022-08-10T17:55:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f55201544d0 0x7f5520071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551ed9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 0x7f55200718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551dd9b700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f552006ea90 0x7f552015a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:44494/0 (socket says 172.21.15.150:44494) 2022-08-10T17:55:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f55201544d0 0x7f5520071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:56052/0 (socket says 172.21.15.150:56052) 2022-08-10T17:55:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551dd9b700 1 -- 172.21.15.150:0/2741711887 learned_addr learned my addr 172.21.15.150:0/2741711887 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 -- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 msgr2=0x7f55200718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:20.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 0x7f55200718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 -- 172.21.15.150:0/2741711887 >> v1:172.21.15.197:6789/0 conn(0x7f552006ea90 legacy=0x7f552015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 -- 172.21.15.150:0/2741711887 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200c4700 con 0x7f55201544d0 2022-08-10T17:55:20.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551ed9d700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 0x7f55200718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:20.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551e59c700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f55201544d0 0x7f5520071370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55100096b0 tx=0x7f55100099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=583dedbfb2915a9d server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551d59a700 1 -- 172.21.15.150:0/2741711887 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55100107b0 con 0x7f55201544d0 2022-08-10T17:55:20.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551d59a700 1 -- 172.21.15.150:0/2741711887 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5510010910 con 0x7f55201544d0 2022-08-10T17:55:20.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.266+0000 7f551d59a700 1 -- 172.21.15.150:0/2741711887 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510010cc0 con 0x7f55201544d0 2022-08-10T17:55:20.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 -- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f55201544d0 msgr2=0x7f5520071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f55201544d0 0x7f5520071370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55100096b0 tx=0x7f55100099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 -- 172.21.15.150:0/2741711887 shutdown_connections 2022-08-10T17:55:20.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552015a970 0x7f55200718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 --2- 172.21.15.150:0/2741711887 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f55201544d0 0x7f5520071370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 -- 172.21.15.150:0/2741711887 >> 172.21.15.150:0/2741711887 conn(0x7f5520068110 msgr2=0x7f5520068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 -- 172.21.15.150:0/2741711887 shutdown_connections 2022-08-10T17:55:20.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.267+0000 7f5524f8a700 1 -- 172.21.15.150:0/2741711887 wait complete. 2022-08-10T17:55:20.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.268+0000 7f5524f8a700 1 Processor -- start 2022-08-10T17:55:20.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.268+0000 7f5524f8a700 1 -- start start 2022-08-10T17:55:20.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 0x7f55201eec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f552015a970 0x7f55200c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c1650 con 0x7f55201544d0 2022-08-10T17:55:20.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c1e80 con 0x7f552015a970 2022-08-10T17:55:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f5524f8a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c1c10 con 0x7f552006ea90 2022-08-10T17:55:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551dd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 0x7f55201eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551e59c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:59688/0 (socket says 172.21.15.150:59688) 2022-08-10T17:55:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551e59c700 1 -- 172.21.15.150:0/973562309 learned_addr learned my addr 172.21.15.150:0/973562309 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551ed9d700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f552015a970 0x7f55200c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551e59c700 1 -- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f552015a970 msgr2=0x7f55200c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.269+0000 7f551e59c700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f552015a970 0x7f55200c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f551e59c700 1 -- 172.21.15.150:0/973562309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 msgr2=0x7f55201eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f551e59c700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 0x7f55201eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f551e59c700 1 -- 172.21.15.150:0/973562309 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5518009a70 con 0x7f552006ea90 2022-08-10T17:55:20.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f551dd9b700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 0x7f55201eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:20.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f551e59c700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5510013040 tx=0x7f55100045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510010a80 con 0x7f552006ea90 2022-08-10T17:55:20.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551001f070 con 0x7f552006ea90 2022-08-10T17:55:20.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510004020 con 0x7f552006ea90 2022-08-10T17:55:20.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5510009310 con 0x7f552006ea90 2022-08-10T17:55:20.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.270+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552014fa60 con 0x7f552006ea90 2022-08-10T17:55:20.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.271+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5520072890 con 0x7f552006ea90 2022-08-10T17:55:20.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.272+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f551000f070 con 0x7f552006ea90 2022-08-10T17:55:20.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.272+0000 7f550effd700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 0x7f54fc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.298 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.272+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f5510021070 con 0x7f552006ea90 2022-08-10T17:55:20.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.272+0000 7f551dd9b700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 0x7f54fc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.299 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.272+0000 7f551dd9b700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 0x7f54fc067560 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f55200ca220 tx=0x7f5514007d90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.277+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f55100518d0 con 0x7f552006ea90 2022-08-10T17:55:20.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.456+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f552006ac20 con 0x7f54fc0650b0 2022-08-10T17:55:20.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.457+0000 7f550effd700 1 -- 172.21.15.150:0/973562309 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f552006ac20 con 0x7f54fc0650b0 2022-08-10T17:55:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 msgr2=0x7f54fc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 0x7f54fc067560 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f55200ca220 tx=0x7f5514007d90 comp rx=0 tx=0).stop 2022-08-10T17:55:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 msgr2=0x7f55201ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5510013040 tx=0x7f55100045d0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 shutdown_connections 2022-08-10T17:55:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f552015a970 0x7f55200c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f54fc0650b0 0x7f54fc067560 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.458+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f552006ea90 0x7f55201ee700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.459+0000 7f5524f8a700 1 --2- 172.21.15.150:0/973562309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55201544d0 0x7f55201eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.459+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 >> 172.21.15.150:0/973562309 conn(0x7f5520068110 msgr2=0x7f55200684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.459+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 shutdown_connections 2022-08-10T17:55:20.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.459+0000 7f5524f8a700 1 -- 172.21.15.150:0/973562309 wait complete. 2022-08-10T17:55:20.466 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 0 to deep-scrub 2022-08-10T17:55:20.474 INFO:tasks.ceph:Scrubbing osd.1 2022-08-10T17:55:20.475 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.598+0000 7f6c4be86700 1 Processor -- start 2022-08-10T17:55:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.598+0000 7f6c4be86700 1 -- start start 2022-08-10T17:55:20.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4be86700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c440c8770 0x7f6c44156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4be86700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c440c81b0 con 0x7f6c440cda40 2022-08-10T17:55:20.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4be86700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c440c8490 con 0x7f6c44150d50 2022-08-10T17:55:20.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4be86700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c440ccc80 con 0x7f6c440c8770 2022-08-10T17:55:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4a423700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c440c8770 0x7f6c44156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4a423700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c440c8770 0x7f6c44156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45478/0 (socket says 172.21.15.150:45478) 2022-08-10T17:55:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c49421700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6c440cda40 0x7f6c44156850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58156/0 (socket says 172.21.15.150:58156) 2022-08-10T17:55:20.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4a423700 1 -- 172.21.15.150:0/3810740080 learned_addr learned my addr 172.21.15.150:0/3810740080 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.599+0000 7f6c4a423700 1 -- 172.21.15.150:0/3810740080 >> v1:172.21.15.197:6789/0 conn(0x7f6c44150d50 legacy=0x7f6c440c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c48c20700 1 -- 172.21.15.150:0/3810740080 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171448598 0 0) 0x7f6c440c81b0 con 0x7f6c440cda40 2022-08-10T17:55:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4a423700 1 -- 172.21.15.150:0/3810740080 >> v1:172.21.15.150:6789/0 conn(0x7f6c440cda40 legacy=0x7f6c44156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4a423700 1 -- 172.21.15.150:0/3810740080 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440ccf60 con 0x7f6c440c8770 2022-08-10T17:55:20.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4a423700 1 --2- 172.21.15.150:0/3810740080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440c8770 0x7f6c44156f60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009e50 tx=0x7f6c3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58672da05a62c87 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c48c20700 1 -- 172.21.15.150:0/3810740080 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00e070 con 0x7f6c440c8770 2022-08-10T17:55:20.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c48c20700 1 -- 172.21.15.150:0/3810740080 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c00b9c0 con 0x7f6c440c8770 2022-08-10T17:55:20.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c48c20700 1 -- 172.21.15.150:0/3810740080 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00bd70 con 0x7f6c440c8770 2022-08-10T17:55:20.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4be86700 1 -- 172.21.15.150:0/3810740080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440c8770 msgr2=0x7f6c44156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4be86700 1 --2- 172.21.15.150:0/3810740080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440c8770 0x7f6c44156f60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009e50 tx=0x7f6c3c00b330 comp rx=0 tx=0).stop 2022-08-10T17:55:20.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4be86700 1 -- 172.21.15.150:0/3810740080 shutdown_connections 2022-08-10T17:55:20.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4be86700 1 --2- 172.21.15.150:0/3810740080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440c8770 0x7f6c44156f60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.600+0000 7f6c4be86700 1 -- 172.21.15.150:0/3810740080 >> 172.21.15.150:0/3810740080 conn(0x7f6c44071370 msgr2=0x7f6c44071740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.601+0000 7f6c4be86700 1 -- 172.21.15.150:0/3810740080 shutdown_connections 2022-08-10T17:55:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.601+0000 7f6c4be86700 1 -- 172.21.15.150:0/3810740080 wait complete. 2022-08-10T17:55:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 Processor -- start 2022-08-10T17:55:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 -- start start 2022-08-10T17:55:20.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6c440c8770 0x7f6c4414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 0x7f6c441e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6c44150d50 0x7f6c441e0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441dfde0 con 0x7f6c440cda40 2022-08-10T17:55:20.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441ebef0 con 0x7f6c44150d50 2022-08-10T17:55:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c4be86700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441ec1b0 con 0x7f6c440c8770 2022-08-10T17:55:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c49421700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 0x7f6c441e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c49421700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 0x7f6c441e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45482/0 (socket says 172.21.15.150:45482) 2022-08-10T17:55:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.602+0000 7f6c49421700 1 -- 172.21.15.150:0/1988398421 learned_addr learned my addr 172.21.15.150:0/1988398421 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:20.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c4a423700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6c44150d50 0x7f6c441e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49c22700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6c440c8770 0x7f6c4414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 -- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6c440c8770 msgr2=0x7f6c4414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6c440c8770 0x7f6c4414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 -- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6c44150d50 msgr2=0x7f6c441e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6c44150d50 0x7f6c441e0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c009b30 con 0x7f6c440cda40 2022-08-10T17:55:20.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c49421700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 0x7f6c441e02c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c410 tx=0x7f6c3400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340072d0 con 0x7f6c440cda40 2022-08-10T17:55:20.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34007470 con 0x7f6c440cda40 2022-08-10T17:55:20.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c441ec490 con 0x7f6c440cda40 2022-08-10T17:55:20.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34004930 con 0x7f6c440cda40 2022-08-10T17:55:20.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.603+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c441eca50 con 0x7f6c440cda40 2022-08-10T17:55:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.604+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c44072890 con 0x7f6c440cda40 2022-08-10T17:55:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6c3401a020 con 0x7f6c440cda40 2022-08-10T17:55:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6c240650b0 0x7f6c24067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6c340824d0 con 0x7f6c440cda40 2022-08-10T17:55:20.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c49c22700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6c240650b0 0x7f6c24067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7f6c2406ee80 0x7f6c240712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c240719a0 con 0x7f6c2406ee80 2022-08-10T17:55:20.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c34082930 con 0x7f6c440cda40 2022-08-10T17:55:20.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c4a423700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7f6c2406ee80 0x7f6c240712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.605+0000 7f6c49c22700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6c240650b0 0x7f6c24067560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.606+0000 7f6c4a423700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7f6c2406ee80 0x7f6c240712d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.606+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== osd.1 v2:172.21.15.150:6816/98006 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f6c240719a0 con 0x7f6c2406ee80 2022-08-10T17:55:20.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.620+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 --> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c440cd240 con 0x7f6c2406ee80 2022-08-10T17:55:20.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c327fc700 1 -- 172.21.15.150:0/1988398421 <== osd.1 v2:172.21.15.150:6816/98006 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6c440cd240 con 0x7f6c2406ee80 2022-08-10T17:55:20.625 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:20.625 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:20.625 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:20.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7f6c2406ee80 msgr2=0x7f6c240712d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:6816/98006,v1:172.21.15.150:6817/98006] conn(0x7f6c2406ee80 0x7f6c240712d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6c240650b0 msgr2=0x7f6c24067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6c240650b0 0x7f6c24067560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40009040 comp rx=0 tx=0).stop 2022-08-10T17:55:20.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 msgr2=0x7f6c441e02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 --2- 172.21.15.150:0/1988398421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c440cda40 0x7f6c441e02c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c410 tx=0x7f6c3400c720 comp rx=0 tx=0).stop 2022-08-10T17:55:20.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4a423700 1 -- 172.21.15.150:0/1988398421 reap_dead start 2022-08-10T17:55:20.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 shutdown_connections 2022-08-10T17:55:20.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 >> 172.21.15.150:0/1988398421 conn(0x7f6c44071370 msgr2=0x7f6c44152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 shutdown_connections 2022-08-10T17:55:20.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.621+0000 7f6c4be86700 1 -- 172.21.15.150:0/1988398421 wait complete. 2022-08-10T17:55:20.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2022-08-10T17:55:20.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.753+0000 7f4aa4f76700 1 Processor -- start 2022-08-10T17:55:20.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.753+0000 7f4aa4f76700 1 -- start start 2022-08-10T17:55:20.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4aa4f76700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4aa4f76700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00699c0 con 0x7f4aa00c7220 2022-08-10T17:55:20.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4aa4f76700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa0068e40 con 0x7f4aa00c4d90 2022-08-10T17:55:20.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4aa4f76700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00c5e10 con 0x7f4aa00c2790 2022-08-10T17:55:20.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4a9dd9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4aa00c7220 0x7f4aa00c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58172/0 (socket says 172.21.15.150:58172) 2022-08-10T17:55:20.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.754+0000 7f4a9dd9b700 1 -- 172.21.15.150:0/1737860844 learned_addr learned my addr 172.21.15.150:0/1737860844 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:20.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9ed9d700 1 --2- 172.21.15.150:0/1737860844 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509723784 0 0) 0x7f4aa00699c0 con 0x7f4aa00c7220 2022-08-10T17:55:20.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a84003430 con 0x7f4aa00c7220 2022-08-10T17:55:20.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378417745 0 0) 0x7f4aa0068e40 con 0x7f4aa00c4d90 2022-08-10T17:55:20.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00699c0 con 0x7f4aa00c4d90 2022-08-10T17:55:20.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9ed9d700 1 -- 172.21.15.150:0/1737860844 >> v1:172.21.15.197:6789/0 conn(0x7f4aa00c4d90 legacy=0x7f4aa00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9ed9d700 1 -- 172.21.15.150:0/1737860844 >> v1:172.21.15.150:6789/0 conn(0x7f4aa00c7220 legacy=0x7f4aa00c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9ed9d700 1 -- 172.21.15.150:0/1737860844 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa0069120 con 0x7f4aa00c2790 2022-08-10T17:55:20.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9ed9d700 1 --2- 172.21.15.150:0/1737860844 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa006fca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009dc0 tx=0x7f4a9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde2d2f6358892d8 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800e070 con 0x7f4aa00c2790 2022-08-10T17:55:20.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800bb20 con 0x7f4aa00c2790 2022-08-10T17:55:20.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.755+0000 7f4a9d59a700 1 -- 172.21.15.150:0/1737860844 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98012430 con 0x7f4aa00c2790 2022-08-10T17:55:20.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 -- 172.21.15.150:0/1737860844 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 msgr2=0x7f4aa006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/1737860844 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa006fca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009dc0 tx=0x7f4a9800b330 comp rx=0 tx=0).stop 2022-08-10T17:55:20.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 -- 172.21.15.150:0/1737860844 shutdown_connections 2022-08-10T17:55:20.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/1737860844 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa006fca0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 -- 172.21.15.150:0/1737860844 >> 172.21.15.150:0/1737860844 conn(0x7f4aa006d0d0 msgr2=0x7f4aa00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 -- 172.21.15.150:0/1737860844 shutdown_connections 2022-08-10T17:55:20.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.756+0000 7f4aa4f76700 1 -- 172.21.15.150:0/1737860844 wait complete. 2022-08-10T17:55:20.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.757+0000 7f4aa4f76700 1 Processor -- start 2022-08-10T17:55:20.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.757+0000 7f4aa4f76700 1 -- start start 2022-08-10T17:55:20.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 0x7f4aa00bc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00c02c0 con 0x7f4aa00c7220 2022-08-10T17:55:20.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00beb90 con 0x7f4aa00c4d90 2022-08-10T17:55:20.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4aa4f76700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01f0470 con 0x7f4aa00c2790 2022-08-10T17:55:20.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4a9ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4a9ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45498/0 (socket says 172.21.15.150:45498) 2022-08-10T17:55:20.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4a9ed9d700 1 -- 172.21.15.150:0/2968419116 learned_addr learned my addr 172.21.15.150:0/2968419116 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:20.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4a9e59c700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.758+0000 7f4a9dd9b700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 0x7f4aa00bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 -- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 msgr2=0x7f4aa01522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa01522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 -- 172.21.15.150:0/2968419116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 msgr2=0x7f4aa01f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 -- 172.21.15.150:0/2968419116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98009a70 con 0x7f4aa00c4d90 2022-08-10T17:55:20.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9ed9d700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:20.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9e59c700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa01522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:20.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a9dd9b700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 0x7f4aa00bc640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c3c0 tx=0x7f4a9400c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.778 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940072d0 con 0x7f4aa00c4d90 2022-08-10T17:55:20.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94007430 con 0x7f4aa00c4d90 2022-08-10T17:55:20.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa00b8b40 con 0x7f4aa00c4d90 2022-08-10T17:55:20.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940057c0 con 0x7f4aa00c4d90 2022-08-10T17:55:20.779 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.759+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa01f40b0 con 0x7f4aa00c4d90 2022-08-10T17:55:20.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.760+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0072890 con 0x7f4aa00c4d90 2022-08-10T17:55:20.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.760+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4a94019030 con 0x7f4aa00c4d90 2022-08-10T17:55:20.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.761+0000 7f4a8effd700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 0x7f4a7c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:20.780 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.761+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4a94081390 con 0x7f4aa00c4d90 2022-08-10T17:55:20.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.761+0000 7f4a9e59c700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 0x7f4a7c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:20.781 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.761+0000 7f4a9e59c700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 0x7f4a7c067590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a900011e0 tx=0x7f4a90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:20.782 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.765+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mon.1 v2:172.21.15.197:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f4a9404f370 con 0x7f4aa00c4d90 2022-08-10T17:55:20.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.948+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa00c5bf0 con 0x7f4a7c0650e0 2022-08-10T17:55:20.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.949+0000 7f4a8effd700 1 -- 172.21.15.150:0/2968419116 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4aa00c5bf0 con 0x7f4a7c0650e0 2022-08-10T17:55:20.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 msgr2=0x7f4a7c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 0x7f4a7c067590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a900011e0 tx=0x7f4a90009040 comp rx=0 tx=0).stop 2022-08-10T17:55:20.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 msgr2=0x7f4aa00bc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:20.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 0x7f4aa00bc640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c3c0 tx=0x7f4a9400c6d0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 shutdown_connections 2022-08-10T17:55:20.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa00c7220 0x7f4aa01f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f4a7c0650e0 0x7f4a7c067590 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f4aa00c2790 0x7f4aa01522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 --2- 172.21.15.150:0/2968419116 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4aa00c4d90 0x7f4aa00bc640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:20.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 >> 172.21.15.150:0/2968419116 conn(0x7f4aa006d0d0 msgr2=0x7f4aa01541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:20.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 shutdown_connections 2022-08-10T17:55:20.958 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:20.951+0000 7f4aa4f76700 1 -- 172.21.15.150:0/2968419116 wait complete. 2022-08-10T17:55:20.958 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 1 to deep-scrub 2022-08-10T17:55:20.967 INFO:tasks.ceph:Scrubbing osd.2 2022-08-10T17:55:20.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:21.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.090+0000 7f33cd7ea700 1 Processor -- start 2022-08-10T17:55:21.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.090+0000 7f33cd7ea700 1 -- start start 2022-08-10T17:55:21.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 0x7f33c80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 0x7f33c80c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33c80c4420 0x7f33c80c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80c55e0 con 0x7f33c80c4420 2022-08-10T17:55:21.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c81510d0 con 0x7f33c8070250 2022-08-10T17:55:21.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33cd7ea700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8156a50 con 0x7f33c8071e20 2022-08-10T17:55:21.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33c77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33c80c4420 0x7f33c80c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33c77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33c80c4420 0x7f33c80c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45510/0 (socket says 172.21.15.150:45510) 2022-08-10T17:55:21.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33c77fe700 1 -- 172.21.15.150:0/3880125248 learned_addr learned my addr 172.21.15.150:0/3880125248 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:21.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33c67fc700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 0x7f33c80c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.091+0000 7f33c6ffd700 1 --2- 172.21.15.150:0/3880125248 >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 0x7f33c80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 -- 172.21.15.150:0/3880125248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 msgr2=0x7f33c80c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:21.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 0x7f33c80c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 -- 172.21.15.150:0/3880125248 >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 msgr2=0x7f33c80c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:21.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 --2- 172.21.15.150:0/3880125248 >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 0x7f33c80c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 -- 172.21.15.150:0/3880125248 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80c63e0 con 0x7f33c80c4420 2022-08-10T17:55:21.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c6ffd700 1 --2- 172.21.15.150:0/3880125248 >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 0x7f33c80c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:21.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c67fc700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 0x7f33c80c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:21.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c77fe700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c80c3c70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb847b9f5f921e53 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c5ffb700 1 -- 172.21.15.150:0/3880125248 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000e070 con 0x7f33c80c4420 2022-08-10T17:55:21.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c5ffb700 1 -- 172.21.15.150:0/3880125248 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000b8d0 con 0x7f33c80c4420 2022-08-10T17:55:21.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33c5ffb700 1 -- 172.21.15.150:0/3880125248 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000bc80 con 0x7f33c80c4420 2022-08-10T17:55:21.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 -- 172.21.15.150:0/3880125248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 msgr2=0x7f33c80c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c80c3c70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:21.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 -- 172.21.15.150:0/3880125248 shutdown_connections 2022-08-10T17:55:21.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c80c3c70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/3880125248 >> v2:172.21.15.197:3300/0 conn(0x7f33c8070250 0x7f33c80c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.092+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/3880125248 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8071e20 0x7f33c80c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.093+0000 7f33cd7ea700 1 -- 172.21.15.150:0/3880125248 >> 172.21.15.150:0/3880125248 conn(0x7f33c80c9ac0 msgr2=0x7f33c80c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.093+0000 7f33cd7ea700 1 -- 172.21.15.150:0/3880125248 shutdown_connections 2022-08-10T17:55:21.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.093+0000 7f33cd7ea700 1 -- 172.21.15.150:0/3880125248 wait complete. 2022-08-10T17:55:21.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.094+0000 7f33cd7ea700 1 Processor -- start 2022-08-10T17:55:21.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.094+0000 7f33cd7ea700 1 -- start start 2022-08-10T17:55:21.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8070250 0x7f33c81ec060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f33c8071e20 0x7f33c81e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c81ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8148db0 con 0x7f33c80c4420 2022-08-10T17:55:21.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c814d330 con 0x7f33c8071e20 2022-08-10T17:55:21.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33cd7ea700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c814b9e0 con 0x7f33c8070250 2022-08-10T17:55:21.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c81ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c81ef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45516/0 (socket says 172.21.15.150:45516) 2022-08-10T17:55:21.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 -- 172.21.15.150:0/2274397848 learned_addr learned my addr 172.21.15.150:0/2274397848 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:21.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c6ffd700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8070250 0x7f33c81ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c67fc700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f33c8071e20 0x7f33c81e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 -- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8070250 msgr2=0x7f33c81ec060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f33c8070250 0x7f33c81ec060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 -- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f33c8071e20 msgr2=0x7f33c81e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f33c8071e20 0x7f33c81e03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.095+0000 7f33c77fe700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc009310 con 0x7f33c80c4420 2022-08-10T17:55:21.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33c77fe700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c81ef2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f33c0003dd0 tx=0x7f33c0004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00092e0 con 0x7f33c80c4420 2022-08-10T17:55:21.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c00041c0 con 0x7f33c80c4420 2022-08-10T17:55:21.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b8009310 con 0x7f33c80c4420 2022-08-10T17:55:21.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0004570 con 0x7f33c80c4420 2022-08-10T17:55:21.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c0009b30 con 0x7f33c80c4420 2022-08-10T17:55:21.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.096+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33c81eec00 con 0x7f33c80c4420 2022-08-10T17:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.097+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f33c002c070 con 0x7f33c80c4420 2022-08-10T17:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.097+0000 7f33af7fe700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f33a80650b0 0x7f33a8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f33c0083b20 con 0x7f33c80c4420 2022-08-10T17:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33c6ffd700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f33a80650b0 0x7f33a8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33af7fe700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f33a806ed10 0x7f33a8071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33a8071830 con 0x7f33a806ed10 2022-08-10T17:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33c00882a0 con 0x7f33c80c4420 2022-08-10T17:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33c67fc700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f33a806ed10 0x7f33a8071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33c6ffd700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f33a80650b0 0x7f33a8067560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009be0 tx=0x7f33bc0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.098+0000 7f33c67fc700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f33a806ed10 0x7f33a8071160 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.099+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== osd.2 v2:172.21.15.150:6808/98004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f33a8071830 con 0x7f33a806ed10 2022-08-10T17:55:21.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 --> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33c81dfeb0 con 0x7f33a806ed10 2022-08-10T17:55:21.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33af7fe700 1 -- 172.21.15.150:0/2274397848 <== osd.2 v2:172.21.15.150:6808/98004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f33c81dfeb0 con 0x7f33a806ed10 2022-08-10T17:55:21.123 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:21.123 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:21.123 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f33a806ed10 msgr2=0x7f33a8071160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:6808/98004,v1:172.21.15.150:6809/98004] conn(0x7f33a806ed10 0x7f33a8071160 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f33a80650b0 msgr2=0x7f33a8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f33a80650b0 0x7f33a8067560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009be0 tx=0x7f33bc0090e0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 msgr2=0x7f33c81ef2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 --2- 172.21.15.150:0/2274397848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33c80c4420 0x7f33c81ef2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f33c0003dd0 tx=0x7f33c0004950 comp rx=0 tx=0).stop 2022-08-10T17:55:21.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33c77fe700 1 -- 172.21.15.150:0/2274397848 reap_dead start 2022-08-10T17:55:21.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 shutdown_connections 2022-08-10T17:55:21.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.113+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 >> 172.21.15.150:0/2274397848 conn(0x7f33c80c9ac0 msgr2=0x7f33c8150830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.114+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 shutdown_connections 2022-08-10T17:55:21.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.114+0000 7f33cd7ea700 1 -- 172.21.15.150:0/2274397848 wait complete. 2022-08-10T17:55:21.129 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2022-08-10T17:55:21.254 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.251+0000 7fb1c462c700 1 Processor -- start 2022-08-10T17:55:21.255 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.251+0000 7fb1c462c700 1 -- start start 2022-08-10T17:55:21.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c462c700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 0x7fb1bc156c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c462c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c462c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc157bd0 con 0x7fb1bc150e20 2022-08-10T17:55:21.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c462c700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc157150 con 0x7fb1bc1511f0 2022-08-10T17:55:21.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c462c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc157330 con 0x7fb1bc0c6950 2022-08-10T17:55:21.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c23c8700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb1bc150e20 0x7fb1bc15ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58202/0 (socket says 172.21.15.150:58202) 2022-08-10T17:55:21.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c23c8700 1 -- 172.21.15.150:0/2861771645 learned_addr learned my addr 172.21.15.150:0/2861771645 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:21.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/2861771645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c1bc7700 1 --2- 172.21.15.150:0/2861771645 >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 0x7fb1bc156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c13c6700 1 -- 172.21.15.150:0/2861771645 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273462220 0 0) 0x7fb1b8001110 con 0x7fb1bc150e20 2022-08-10T17:55:21.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c13c6700 1 -- 172.21.15.150:0/2861771645 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a4003430 con 0x7fb1bc150e20 2022-08-10T17:55:21.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/2861771645 >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 msgr2=0x7fb1bc156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:21.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/2861771645 >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 0x7fb1bc156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/2861771645 >> v1:172.21.15.150:6789/0 conn(0x7fb1bc150e20 legacy=0x7fb1bc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/2861771645 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc157610 con 0x7fb1bc0c6950 2022-08-10T17:55:21.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c1bc7700 1 --2- 172.21.15.150:0/2861771645 >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 0x7fb1bc156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:21.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.252+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/2861771645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc0c6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009d90 tx=0x7fb1b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afeb2920b0084688 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c13c6700 1 -- 172.21.15.150:0/2861771645 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b400e070 con 0x7fb1bc0c6950 2022-08-10T17:55:21.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c13c6700 1 -- 172.21.15.150:0/2861771645 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b400bb20 con 0x7fb1bc0c6950 2022-08-10T17:55:21.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c13c6700 1 -- 172.21.15.150:0/2861771645 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4012430 con 0x7fb1bc0c6950 2022-08-10T17:55:21.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 -- 172.21.15.150:0/2861771645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 msgr2=0x7fb1bc0c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.266 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 --2- 172.21.15.150:0/2861771645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc0c6dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009d90 tx=0x7fb1b400b330 comp rx=0 tx=0).stop 2022-08-10T17:55:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 -- 172.21.15.150:0/2861771645 shutdown_connections 2022-08-10T17:55:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 --2- 172.21.15.150:0/2861771645 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc0c6dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 --2- 172.21.15.150:0/2861771645 >> v2:172.21.15.197:3300/0 conn(0x7fb1bc1511f0 0x7fb1bc156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.267 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 -- 172.21.15.150:0/2861771645 >> 172.21.15.150:0/2861771645 conn(0x7fb1bc071370 msgr2=0x7fb1bc071770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 -- 172.21.15.150:0/2861771645 shutdown_connections 2022-08-10T17:55:21.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.253+0000 7fb1c462c700 1 -- 172.21.15.150:0/2861771645 wait complete. 2022-08-10T17:55:21.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.254+0000 7fb1c462c700 1 Processor -- start 2022-08-10T17:55:21.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.254+0000 7fb1c462c700 1 -- start start 2022-08-10T17:55:21.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb1bc150e20 0x7fb1bc0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc14d640 con 0x7fb1bc1511f0 2022-08-10T17:55:21.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc153da0 con 0x7fb1bc150e20 2022-08-10T17:55:21.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c462c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc1ec5a0 con 0x7fb1bc0c6950 2022-08-10T17:55:21.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45532/0 (socket says 172.21.15.150:45532) 2022-08-10T17:55:21.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/719843642 learned_addr learned my addr 172.21.15.150:0/719843642 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:21.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c23c8700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c1bc7700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb1bc150e20 0x7fb1bc0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 msgr2=0x7fb1bc152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb1bc150e20 msgr2=0x7fb1bc0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb1bc150e20 0x7fb1bc0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.255+0000 7fb1c2bc9700 1 -- 172.21.15.150:0/719843642 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac009310 con 0x7fb1bc1511f0 2022-08-10T17:55:21.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1c2bc9700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4014040 tx=0x7fb1b4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4012430 con 0x7fb1bc1511f0 2022-08-10T17:55:21.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b4020070 con 0x7fb1bc1511f0 2022-08-10T17:55:21.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40046b0 con 0x7fb1bc1511f0 2022-08-10T17:55:21.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b4009a70 con 0x7fb1bc1511f0 2022-08-10T17:55:21.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.256+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc14cff0 con 0x7fb1bc1511f0 2022-08-10T17:55:21.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.257+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc072890 con 0x7fb1bc1511f0 2022-08-10T17:55:21.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.257+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb1b402e070 con 0x7fb1bc1511f0 2022-08-10T17:55:21.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.257+0000 7fb1aaffd700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 0x7fb19c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.258+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb1b4022070 con 0x7fb1bc1511f0 2022-08-10T17:55:21.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.258+0000 7fb1c23c8700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 0x7fb19c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.258+0000 7fb1c23c8700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 0x7fb19c067590 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001270 tx=0x7fb1b8007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.262+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb1b4051db0 con 0x7fb1bc1511f0 2022-08-10T17:55:21.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.443+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1bc14d780 con 0x7fb19c0650e0 2022-08-10T17:55:21.447 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.443+0000 7fb1aaffd700 1 -- 172.21.15.150:0/719843642 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1bc14d780 con 0x7fb19c0650e0 2022-08-10T17:55:21.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 msgr2=0x7fb19c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.450 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 0x7fb19c067590 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001270 tx=0x7fb1b8007ac0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 msgr2=0x7fb1bc0cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4014040 tx=0x7fb1b4004950 comp rx=0 tx=0).stop 2022-08-10T17:55:21.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 shutdown_connections 2022-08-10T17:55:21.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1bc1511f0 0x7fb1bc0cc3b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb19c0650e0 0x7fb19c067590 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb1bc0c6950 0x7fb1bc152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 --2- 172.21.15.150:0/719843642 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb1bc150e20 0x7fb1bc0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 >> 172.21.15.150:0/719843642 conn(0x7fb1bc071370 msgr2=0x7fb1bc0c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 shutdown_connections 2022-08-10T17:55:21.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.446+0000 7fb1c462c700 1 -- 172.21.15.150:0/719843642 wait complete. 2022-08-10T17:55:21.453 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 2 to deep-scrub 2022-08-10T17:55:21.462 INFO:tasks.ceph:Scrubbing osd.3 2022-08-10T17:55:21.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:21.588 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.584+0000 7f4529c6c700 1 Processor -- start 2022-08-10T17:55:21.589 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4529c6c700 1 -- start start 2022-08-10T17:55:21.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4529c6c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4524071e20 0x7f45240c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4529c6c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45241510d0 con 0x7f4524070250 2022-08-10T17:55:21.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4529c6c700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4524156a50 con 0x7f45240c4420 2022-08-10T17:55:21.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4529c6c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240c55e0 con 0x7f4524071e20 2022-08-10T17:55:21.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f45237fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4524070250 0x7f45240c5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58218/0 (socket says 172.21.15.150:58218) 2022-08-10T17:55:21.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f4522ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4524071e20 0x7f45240c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.585+0000 7f45237fe700 1 -- 172.21.15.150:0/1068546283 learned_addr learned my addr 172.21.15.150:0/1068546283 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:21.593 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f45227fc700 1 -- 172.21.15.150:0/1068546283 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300695534 0 0) 0x7f45241510d0 con 0x7f4524070250 2022-08-10T17:55:21.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f45227fc700 1 -- 172.21.15.150:0/1068546283 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4510003430 con 0x7f4524070250 2022-08-10T17:55:21.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f4522ffd700 1 -- 172.21.15.150:0/1068546283 >> v1:172.21.15.197:6789/0 conn(0x7f45240c4420 legacy=0x7f4524068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f4522ffd700 1 -- 172.21.15.150:0/1068546283 >> v1:172.21.15.150:6789/0 conn(0x7f4524070250 legacy=0x7f45240c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.594 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f4522ffd700 1 -- 172.21.15.150:0/1068546283 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524156cf0 con 0x7f4524071e20 2022-08-10T17:55:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f4522ffd700 1 --2- 172.21.15.150:0/1068546283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45240c3730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45140096b0 tx=0x7f45140099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c09ffae78ee9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f45227fc700 1 -- 172.21.15.150:0/1068546283 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140107b0 con 0x7f4524071e20 2022-08-10T17:55:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f45227fc700 1 -- 172.21.15.150:0/1068546283 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514010910 con 0x7f4524071e20 2022-08-10T17:55:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.586+0000 7f45227fc700 1 -- 172.21.15.150:0/1068546283 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514010cc0 con 0x7f4524071e20 2022-08-10T17:55:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 -- 172.21.15.150:0/1068546283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 msgr2=0x7f45240c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 --2- 172.21.15.150:0/1068546283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45240c3730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45140096b0 tx=0x7f45140099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 -- 172.21.15.150:0/1068546283 shutdown_connections 2022-08-10T17:55:21.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 --2- 172.21.15.150:0/1068546283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45240c3730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.596 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 -- 172.21.15.150:0/1068546283 >> 172.21.15.150:0/1068546283 conn(0x7f45240c9ac0 msgr2=0x7f45240c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 -- 172.21.15.150:0/1068546283 shutdown_connections 2022-08-10T17:55:21.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.587+0000 7f4529c6c700 1 -- 172.21.15.150:0/1068546283 wait complete. 2022-08-10T17:55:21.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.588+0000 7f4529c6c700 1 Processor -- start 2022-08-10T17:55:21.597 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.588+0000 7f4529c6c700 1 -- start start 2022-08-10T17:55:21.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4524070250 0x7f45241e0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45241def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f45240c4420 0x7f452414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c9970 con 0x7f4524071e20 2022-08-10T17:55:21.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45241e0c90 con 0x7f4524070250 2022-08-10T17:55:21.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4529c6c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45241df4b0 con 0x7f45240c4420 2022-08-10T17:55:21.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45241def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f45237fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4524070250 0x7f45241e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45241def70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45544/0 (socket says 172.21.15.150:45544) 2022-08-10T17:55:21.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 -- 172.21.15.150:0/1239346687 learned_addr learned my addr 172.21.15.150:0/1239346687 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:21.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4523fff700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f45240c4420 0x7f452414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 -- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f45240c4420 msgr2=0x7f452414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f45240c4420 0x7f452414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 -- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4524070250 msgr2=0x7f45241e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f4524070250 0x7f45241e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009310 con 0x7f4524071e20 2022-08-10T17:55:21.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.589+0000 7f4522ffd700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45241def70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4514013040 tx=0x7f45140045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011640 con 0x7f4524071e20 2022-08-10T17:55:21.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140117c0 con 0x7f4524071e20 2022-08-10T17:55:21.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45241e0270 con 0x7f4524071e20 2022-08-10T17:55:21.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011b70 con 0x7f4524071e20 2022-08-10T17:55:21.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240c9690 con 0x7f4524071e20 2022-08-10T17:55:21.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.590+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45241e00d0 con 0x7f4524071e20 2022-08-10T17:55:21.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.591+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f451402b030 con 0x7f4524071e20 2022-08-10T17:55:21.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.591+0000 7f450bfff700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f45040650b0 0x7f4504067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4514083940 con 0x7f4524071e20 2022-08-10T17:55:21.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f45237fe700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f45040650b0 0x7f4504067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f450bfff700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7f450406ee80 0x7f45040712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45040719a0 con 0x7f450406ee80 2022-08-10T17:55:21.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4514083da0 con 0x7f4524071e20 2022-08-10T17:55:21.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f4523fff700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7f450406ee80 0x7f45040712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f45237fe700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f45040650b0 0x7f4504067560 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45180011e0 tx=0x7f4518007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.592+0000 7f4523fff700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7f450406ee80 0x7f45040712d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.593+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== osd.3 v2:172.21.15.150:6824/98020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f45040719a0 con 0x7f450406ee80 2022-08-10T17:55:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.606+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 --> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4524072890 con 0x7f450406ee80 2022-08-10T17:55:21.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f450bfff700 1 -- 172.21.15.150:0/1239346687 <== osd.3 v2:172.21.15.150:6824/98020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4524072890 con 0x7f450406ee80 2022-08-10T17:55:21.611 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:21.611 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:21.611 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:21.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7f450406ee80 msgr2=0x7f45040712d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:6824/98020,v1:172.21.15.150:6825/98020] conn(0x7f450406ee80 0x7f45040712d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f45040650b0 msgr2=0x7f4504067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f45040650b0 0x7f4504067560 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45180011e0 tx=0x7f4518007c40 comp rx=0 tx=0).stop 2022-08-10T17:55:21.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 msgr2=0x7f45241def70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 --2- 172.21.15.150:0/1239346687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4524071e20 0x7f45241def70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4514013040 tx=0x7f45140045d0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4523fff700 1 -- 172.21.15.150:0/1239346687 reap_dead start 2022-08-10T17:55:21.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 shutdown_connections 2022-08-10T17:55:21.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 >> 172.21.15.150:0/1239346687 conn(0x7f45240c9ac0 msgr2=0x7f45240c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 shutdown_connections 2022-08-10T17:55:21.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.607+0000 7f4529c6c700 1 -- 172.21.15.150:0/1239346687 wait complete. 2022-08-10T17:55:21.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2022-08-10T17:55:21.745 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.742+0000 7fcf14f3c700 1 Processor -- start 2022-08-10T17:55:21.746 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.742+0000 7fcf14f3c700 1 -- start start 2022-08-10T17:55:21.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf14f3c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf1006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf14f3c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf100c5660 0x7fcf10154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf14f3c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf10155050 con 0x7fcf100c2110 2022-08-10T17:55:21.749 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf14f3c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf10158fa0 con 0x7fcf100c5660 2022-08-10T17:55:21.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf14f3c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10158a00 con 0x7fcf100b09e0 2022-08-10T17:55:21.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf100c5660 0x7fcf10154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0ed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcf100c2110 0x7fcf100c3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58236/0 (socket says 172.21.15.150:58236) 2022-08-10T17:55:21.750 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0ed9d700 1 -- 172.21.15.150:0/1728021086 learned_addr learned my addr 172.21.15.150:0/1728021086 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:21.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0e59c700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf1006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 -- 172.21.15.150:0/1728021086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 msgr2=0x7fcf1006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:21.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf1006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.751 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0d59a700 1 -- 172.21.15.150:0/1728021086 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029729619 0 0) 0x7fcf10155050 con 0x7fcf100c2110 2022-08-10T17:55:21.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 -- 172.21.15.150:0/1728021086 >> v1:172.21.15.150:6789/0 conn(0x7fcf100c2110 legacy=0x7fcf100c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 -- 172.21.15.150:0/1728021086 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10158cc0 con 0x7fcf100c5660 2022-08-10T17:55:21.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0dd9b700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c5660 0x7fcf10154b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf040096b0 tx=0x7fcf040099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac441135a07e17db server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.752 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0d59a700 1 -- 172.21.15.150:0/1728021086 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040107b0 con 0x7fcf100c5660 2022-08-10T17:55:21.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0d59a700 1 -- 172.21.15.150:0/1728021086 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04010910 con 0x7fcf100c5660 2022-08-10T17:55:21.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.743+0000 7fcf0d59a700 1 -- 172.21.15.150:0/1728021086 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04010cc0 con 0x7fcf100c5660 2022-08-10T17:55:21.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1728021086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c5660 msgr2=0x7fcf10154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.753 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c5660 0x7fcf10154b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf040096b0 tx=0x7fcf040099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1728021086 shutdown_connections 2022-08-10T17:55:21.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf1006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1728021086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c5660 0x7fcf10154b10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.754 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1728021086 >> 172.21.15.150:0/1728021086 conn(0x7fcf1006fae0 msgr2=0x7fcf1006fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1728021086 shutdown_connections 2022-08-10T17:55:21.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.744+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1728021086 wait complete. 2022-08-10T17:55:21.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.745+0000 7fcf14f3c700 1 Processor -- start 2022-08-10T17:55:21.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.745+0000 7fcf14f3c700 1 -- start start 2022-08-10T17:55:21.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf101525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcf100c2110 0x7fcf100bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100bf080 con 0x7fcf100c9380 2022-08-10T17:55:21.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101ee2b0 con 0x7fcf100c2110 2022-08-10T17:55:21.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf14f3c700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10153af0 con 0x7fcf100b09e0 2022-08-10T17:55:21.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45562/0 (socket says 172.21.15.150:45562) 2022-08-10T17:55:21.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf0ed9d700 1 -- 172.21.15.150:0/1864803313 learned_addr learned my addr 172.21.15.150:0/1864803313 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:21.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf0e59c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf101525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.746+0000 7fcf0dd9b700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcf100c2110 0x7fcf100bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 -- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 msgr2=0x7fcf101525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf101525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 -- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcf100c2110 msgr2=0x7fcf100bfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcf100c2110 0x7fcf100bfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 -- 172.21.15.150:0/1864803313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009310 con 0x7fcf100c9380 2022-08-10T17:55:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf0ed9d700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7d0 tx=0x7fcf0800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08004e80 con 0x7fcf100c9380 2022-08-10T17:55:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf080070d0 con 0x7fcf100c9380 2022-08-10T17:55:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08007460 con 0x7fcf100c9380 2022-08-10T17:55:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10153dd0 con 0x7fcf100c9380 2022-08-10T17:55:21.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.747+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf100bf540 con 0x7fcf100c9380 2022-08-10T17:55:21.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.748+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10154010 con 0x7fcf100c9380 2022-08-10T17:55:21.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.748+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcf0801a020 con 0x7fcf100c9380 2022-08-10T17:55:21.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.749+0000 7fcefeffd700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 0x7fceec067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:21.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.749+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcf08081f20 con 0x7fcf100c9380 2022-08-10T17:55:21.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.749+0000 7fcf0e59c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 0x7fceec067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:21.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.749+0000 7fcf0e59c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 0x7fceec067590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009a50 tx=0x7fcf000090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:21.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.753+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcf10154010 con 0x7fcf100c9380 2022-08-10T17:55:21.941 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.937+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf10154010 con 0x7fceec0650e0 2022-08-10T17:55:21.942 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.938+0000 7fcefeffd700 1 -- 172.21.15.150:0/1864803313 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf10154010 con 0x7fceec0650e0 2022-08-10T17:55:21.944 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 msgr2=0x7fceec067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 0x7fceec067590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009a50 tx=0x7fcf000090e0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 msgr2=0x7fcf100bffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:21.945 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7d0 tx=0x7fcf0800cae0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 shutdown_connections 2022-08-10T17:55:21.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf100c9380 0x7fcf100bffa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fceec0650e0 0x7fceec067590 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.946 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcf100b09e0 0x7fcf101525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 --2- 172.21.15.150:0/1864803313 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcf100c2110 0x7fcf100bfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:21.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 >> 172.21.15.150:0/1864803313 conn(0x7fcf1006fae0 msgr2=0x7fcf1006feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:21.947 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 shutdown_connections 2022-08-10T17:55:21.948 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:21.940+0000 7fcf14f3c700 1 -- 172.21.15.150:0/1864803313 wait complete. 2022-08-10T17:55:21.948 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 3 to deep-scrub 2022-08-10T17:55:21.956 INFO:tasks.ceph:Scrubbing osd.4 2022-08-10T17:55:21.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:22.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 Processor -- start 2022-08-10T17:55:22.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 -- start start 2022-08-10T17:55:22.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe96c150d50 0x7fe96c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c0cda40 0x7fe96c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0c4750 con 0x7fe96c0c8770 2022-08-10T17:55:22.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0c81b0 con 0x7fe96c150d50 2022-08-10T17:55:22.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.081+0000 7fe971ce8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0c8490 con 0x7fe96c0cda40 2022-08-10T17:55:22.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe96c150d50 0x7fe96c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe96c150d50 0x7fe96c0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45566/0 (socket says 172.21.15.150:45566) 2022-08-10T17:55:22.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 -- 172.21.15.150:0/3087369655 learned_addr learned my addr 172.21.15.150:0/3087369655 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96affd700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c0cda40 0x7fe96c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 -- 172.21.15.150:0/3087369655 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c0cda40 msgr2=0x7fe96c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c0cda40 0x7fe96c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 -- 172.21.15.150:0/3087369655 >> v1:172.21.15.197:6789/0 conn(0x7fe96c0c8770 legacy=0x7fe96c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 -- 172.21.15.150:0/3087369655 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0ccc80 con 0x7fe96c150d50 2022-08-10T17:55:22.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96b7fe700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c150d50 0x7fe96c0c4210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe95c006fd0 tx=0x7fe95c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2a61828a2654bd server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96a7fc700 1 -- 172.21.15.150:0/3087369655 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c004230 con 0x7fe96c150d50 2022-08-10T17:55:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96a7fc700 1 -- 172.21.15.150:0/3087369655 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c004390 con 0x7fe96c150d50 2022-08-10T17:55:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.082+0000 7fe96a7fc700 1 -- 172.21.15.150:0/3087369655 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011830 con 0x7fe96c150d50 2022-08-10T17:55:22.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 -- 172.21.15.150:0/3087369655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c150d50 msgr2=0x7fe96c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c150d50 0x7fe96c0c4210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe95c006fd0 tx=0x7fe95c009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:22.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 -- 172.21.15.150:0/3087369655 shutdown_connections 2022-08-10T17:55:22.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c150d50 0x7fe96c0c4210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 --2- 172.21.15.150:0/3087369655 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c0cda40 0x7fe96c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 -- 172.21.15.150:0/3087369655 >> 172.21.15.150:0/3087369655 conn(0x7fe96c071370 msgr2=0x7fe96c071740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 -- 172.21.15.150:0/3087369655 shutdown_connections 2022-08-10T17:55:22.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.083+0000 7fe971ce8700 1 -- 172.21.15.150:0/3087369655 wait complete. 2022-08-10T17:55:22.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.084+0000 7fe971ce8700 1 Processor -- start 2022-08-10T17:55:22.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.084+0000 7fe971ce8700 1 -- start start 2022-08-10T17:55:22.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe96c0c8770 0x7fe96c14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 0x7fe96c1e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c1ed130 0x7fe96c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c155be0 con 0x7fe96c0cda40 2022-08-10T17:55:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1ec440 con 0x7fe96c0c8770 2022-08-10T17:55:22.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe971ce8700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1ecca0 con 0x7fe96c1ed130 2022-08-10T17:55:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 0x7fe96c1e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 0x7fe96c1e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45574/0 (socket says 172.21.15.150:45574) 2022-08-10T17:55:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 -- 172.21.15.150:0/2937353140 learned_addr learned my addr 172.21.15.150:0/2937353140 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96b7fe700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe96c0c8770 0x7fe96c14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96bfff700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c1ed130 0x7fe96c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 -- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c1ed130 msgr2=0x7fe96c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe96c1ed130 0x7fe96c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 -- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe96c0c8770 msgr2=0x7fe96c14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe96c0c8770 0x7fe96c14a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0093e0 con 0x7fe96c0cda40 2022-08-10T17:55:22.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.085+0000 7fe96affd700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 0x7fe96c1e2fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe96000e870 tx=0x7fe96000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960009400 con 0x7fe96c0cda40 2022-08-10T17:55:22.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960013680 con 0x7fe96c0cda40 2022-08-10T17:55:22.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c157520 con 0x7fe96c0cda40 2022-08-10T17:55:22.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960013a30 con 0x7fe96c0cda40 2022-08-10T17:55:22.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c1ec650 con 0x7fe96c0cda40 2022-08-10T17:55:22.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.086+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe96c072890 con 0x7fe96c0cda40 2022-08-10T17:55:22.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.087+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe960019030 con 0x7fe96c0cda40 2022-08-10T17:55:22.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.087+0000 7fe953fff700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe94c0650e0 0x7fe94c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.087+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe960082120 con 0x7fe96c0cda40 2022-08-10T17:55:22.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe953fff700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fe94c06eeb0 0x7fe94c071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe96b7fe700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe94c0650e0 0x7fe94c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe94c0719d0 con 0x7fe94c06eeb0 2022-08-10T17:55:22.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe960082580 con 0x7fe96c0cda40 2022-08-10T17:55:22.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe96bfff700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fe94c06eeb0 0x7fe94c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe96b7fe700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe94c0650e0 0x7fe94c067590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe96c08b0b0 tx=0x7fe95c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.088+0000 7fe96bfff700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fe94c06eeb0 0x7fe94c071300 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.089+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== osd.4 v2:172.21.15.197:6800/98109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fe94c0719d0 con 0x7fe94c06eeb0 2022-08-10T17:55:22.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 --> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe96c1ecde0 con 0x7fe94c06eeb0 2022-08-10T17:55:22.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe953fff700 1 -- 172.21.15.150:0/2937353140 <== osd.4 v2:172.21.15.197:6800/98109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe96c1ecde0 con 0x7fe94c06eeb0 2022-08-10T17:55:22.111 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:22.111 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:22.112 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:22.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fe94c06eeb0 msgr2=0x7fe94c071300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6800/98109,v1:172.21.15.197:6801/98109] conn(0x7fe94c06eeb0 0x7fe94c071300 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe94c0650e0 msgr2=0x7fe94c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe94c0650e0 0x7fe94c067590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe96c08b0b0 tx=0x7fe95c008030 comp rx=0 tx=0).stop 2022-08-10T17:55:22.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 msgr2=0x7fe96c1e2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 --2- 172.21.15.150:0/2937353140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe96c0cda40 0x7fe96c1e2fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe96000e870 tx=0x7fe96000eb80 comp rx=0 tx=0).stop 2022-08-10T17:55:22.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe96bfff700 1 -- 172.21.15.150:0/2937353140 reap_dead start 2022-08-10T17:55:22.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 shutdown_connections 2022-08-10T17:55:22.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.103+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 >> 172.21.15.150:0/2937353140 conn(0x7fe96c071370 msgr2=0x7fe96c1522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.104+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 shutdown_connections 2022-08-10T17:55:22.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.104+0000 7fe971ce8700 1 -- 172.21.15.150:0/2937353140 wait complete. 2022-08-10T17:55:22.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2022-08-10T17:55:22.242 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.239+0000 7f6b8dc49700 1 Processor -- start 2022-08-10T17:55:22.243 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.239+0000 7f6b8dc49700 1 -- start start 2022-08-10T17:55:22.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b8814ed30 0x7f6b880c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.245 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 0x7f6b880c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c5570 0x7f6b880c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880c36f0 con 0x7f6b8814ed30 2022-08-10T17:55:22.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8806ca30 con 0x7f6b8806b640 2022-08-10T17:55:22.246 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b8dc49700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8814f100 con 0x7f6b880c5570 2022-08-10T17:55:22.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b8814ed30 0x7f6b880c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b8814ed30 0x7f6b880c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45582/0 (socket says 172.21.15.150:45582) 2022-08-10T17:55:22.247 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 -- 172.21.15.150:0/3565374502 learned_addr learned my addr 172.21.15.150:0/3565374502 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b86ffd700 1 --2- 172.21.15.150:0/3565374502 >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 0x7f6b880c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b87fff700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c5570 0x7f6b880c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.248 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 -- 172.21.15.150:0/3565374502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c5570 msgr2=0x7f6b880c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c5570 0x7f6b880c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 -- 172.21.15.150:0/3565374502 >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 msgr2=0x7f6b880c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3565374502 >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 0x7f6b880c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.249 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b877fe700 1 -- 172.21.15.150:0/3565374502 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8806a450 con 0x7f6b8814ed30 2022-08-10T17:55:22.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.240+0000 7f6b86ffd700 1 --2- 172.21.15.150:0/3565374502 >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 0x7f6b880c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b880c20f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b88072570 tx=0x7f6b78009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9a509c5bdf2792 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b867fc700 1 -- 172.21.15.150:0/3565374502 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78004230 con 0x7f6b8814ed30 2022-08-10T17:55:22.250 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b867fc700 1 -- 172.21.15.150:0/3565374502 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78004390 con 0x7f6b8814ed30 2022-08-10T17:55:22.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b867fc700 1 -- 172.21.15.150:0/3565374502 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011850 con 0x7f6b8814ed30 2022-08-10T17:55:22.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3565374502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 msgr2=0x7f6b880c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b880c20f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b88072570 tx=0x7f6b78009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:22.251 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3565374502 shutdown_connections 2022-08-10T17:55:22.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c5570 0x7f6b880c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3565374502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b880c20f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.252 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3565374502 >> v2:172.21.15.197:3300/0 conn(0x7f6b8806b640 0x7f6b880c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3565374502 >> 172.21.15.150:0/3565374502 conn(0x7f6b8806e1f0 msgr2=0x7f6b8806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3565374502 shutdown_connections 2022-08-10T17:55:22.253 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.241+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3565374502 wait complete. 2022-08-10T17:55:22.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.243+0000 7f6b8dc49700 1 Processor -- start 2022-08-10T17:55:22.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.243+0000 7f6b8dc49700 1 -- start start 2022-08-10T17:55:22.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 0x7f6b88149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.257 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c8d70 0x7f6b88140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881ea3c0 con 0x7f6b8814ed30 2022-08-10T17:55:22.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881eb800 con 0x7f6b880c5570 2022-08-10T17:55:22.258 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.244+0000 7f6b8dc49700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881ee7f0 con 0x7f6b880c8d70 2022-08-10T17:55:22.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45588/0 (socket says 172.21.15.150:45588) 2022-08-10T17:55:22.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 -- 172.21.15.150:0/3760655397 learned_addr learned my addr 172.21.15.150:0/3760655397 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 0x7f6b88149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b87fff700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c8d70 0x7f6b88140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 -- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c8d70 msgr2=0x7f6b88140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c8d70 0x7f6b88140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 -- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 msgr2=0x7f6b88149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 0x7f6b88149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 -- 172.21.15.150:0/3760655397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c009310 con 0x7f6b8814ed30 2022-08-10T17:55:22.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 0x7f6b88149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b86ffd700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00e890 tx=0x7f6b7c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0095f0 con 0x7f6b8814ed30 2022-08-10T17:55:22.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c013680 con 0x7f6b8814ed30 2022-08-10T17:55:22.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780093e0 con 0x7f6b8814ed30 2022-08-10T17:55:22.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c013a30 con 0x7f6b8814ed30 2022-08-10T17:55:22.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.245+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b881ea8b0 con 0x7f6b8814ed30 2022-08-10T17:55:22.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.246+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b881eb360 con 0x7f6b8814ed30 2022-08-10T17:55:22.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.247+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f6b7c023070 con 0x7f6b8814ed30 2022-08-10T17:55:22.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.247+0000 7f6b6ffff700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 0x7f6b68067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.247+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f6b7c082370 con 0x7f6b8814ed30 2022-08-10T17:55:22.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.247+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 0x7f6b68067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.248+0000 7f6b877fe700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 0x7f6b68067560 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6b780096d0 tx=0x7f6b78008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.251+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f6b7c050350 con 0x7f6b8814ed30 2022-08-10T17:55:22.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.449+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b88072890 con 0x7f6b680650b0 2022-08-10T17:55:22.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.450+0000 7f6b6ffff700 1 -- 172.21.15.150:0/3760655397 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b88072890 con 0x7f6b680650b0 2022-08-10T17:55:22.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 msgr2=0x7f6b68067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 0x7f6b68067560 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6b780096d0 tx=0x7f6b78008030 comp rx=0 tx=0).stop 2022-08-10T17:55:22.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 msgr2=0x7f6b881ee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00e890 tx=0x7f6b7c00eba0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 shutdown_connections 2022-08-10T17:55:22.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f6b680650b0 0x7f6b68067560 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f6b880c8d70 0x7f6b88140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f6b880c5570 0x7f6b88149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 --2- 172.21.15.150:0/3760655397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b8814ed30 0x7f6b881ee2b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 >> 172.21.15.150:0/3760655397 conn(0x7f6b8806e1f0 msgr2=0x7f6b8814b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 shutdown_connections 2022-08-10T17:55:22.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.452+0000 7f6b8dc49700 1 -- 172.21.15.150:0/3760655397 wait complete. 2022-08-10T17:55:22.461 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 4 to deep-scrub 2022-08-10T17:55:22.468 INFO:tasks.ceph:Scrubbing osd.5 2022-08-10T17:55:22.469 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:22.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.590+0000 7f8405023700 1 Processor -- start 2022-08-10T17:55:22.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.590+0000 7f8405023700 1 -- start start 2022-08-10T17:55:22.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f8405023700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f840006ffd0 0x7f840006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f8405023700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f84000c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f8405023700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8400154790 con 0x7f84001543c0 2022-08-10T17:55:22.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f8405023700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840006f110 con 0x7f840006ffd0 2022-08-10T17:55:22.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f8405023700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c4c80 con 0x7f840006f9d0 2022-08-10T17:55:22.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f83fe59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f840006ffd0 0x7f840006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f83fe59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f840006ffd0 0x7f840006f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45596/0 (socket says 172.21.15.150:45596) 2022-08-10T17:55:22.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f83fed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f84001543c0 0x7f840006ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58274/0 (socket says 172.21.15.150:58274) 2022-08-10T17:55:22.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f83fe59c700 1 -- 172.21.15.150:0/1189938544 learned_addr learned my addr 172.21.15.150:0/1189938544 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.591+0000 7f83ff59e700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f84000c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fe59c700 1 -- 172.21.15.150:0/1189938544 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 msgr2=0x7f84000c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fe59c700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f84000c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fe59c700 1 -- 172.21.15.150:0/1189938544 >> v1:172.21.15.150:6789/0 conn(0x7f84001543c0 legacy=0x7f840006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.612 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fdd9b700 1 -- 172.21.15.150:0/1189938544 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830798997 0 0) 0x7f8400154790 con 0x7f84001543c0 2022-08-10T17:55:22.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fe59c700 1 -- 172.21.15.150:0/1189938544 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000c9cf0 con 0x7f840006ffd0 2022-08-10T17:55:22.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fe59c700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f840006f490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83f4006fd0 tx=0x7f83f4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a38174b0823e24a server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fdd9b700 1 -- 172.21.15.150:0/1189938544 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4004230 con 0x7f840006ffd0 2022-08-10T17:55:22.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fdd9b700 1 -- 172.21.15.150:0/1189938544 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4004390 con 0x7f840006ffd0 2022-08-10T17:55:22.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f83fdd9b700 1 -- 172.21.15.150:0/1189938544 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4011830 con 0x7f840006ffd0 2022-08-10T17:55:22.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 -- 172.21.15.150:0/1189938544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 msgr2=0x7f840006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f840006f490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83f4006fd0 tx=0x7f83f4009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:22.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 -- 172.21.15.150:0/1189938544 shutdown_connections 2022-08-10T17:55:22.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f84000c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 --2- 172.21.15.150:0/1189938544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f840006f490 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.592+0000 7f8405023700 1 -- 172.21.15.150:0/1189938544 >> 172.21.15.150:0/1189938544 conn(0x7f8400068110 msgr2=0x7f8400068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.593+0000 7f8405023700 1 -- 172.21.15.150:0/1189938544 shutdown_connections 2022-08-10T17:55:22.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.593+0000 7f8405023700 1 -- 172.21.15.150:0/1189938544 wait complete. 2022-08-10T17:55:22.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.595+0000 7f8405023700 1 Processor -- start 2022-08-10T17:55:22.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.595+0000 7f8405023700 1 -- start start 2022-08-10T17:55:22.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f840014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f84001e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f84001543c0 0x7f84001e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400157c90 con 0x7f840006ffd0 2022-08-10T17:55:22.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c3720 con 0x7f84001543c0 2022-08-10T17:55:22.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f8405023700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c3ca0 con 0x7f840006f9d0 2022-08-10T17:55:22.618 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f84001e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f84001e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45602/0 (socket says 172.21.15.150:45602) 2022-08-10T17:55:22.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 -- 172.21.15.150:0/2476869238 learned_addr learned my addr 172.21.15.150:0/2476869238 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fed9d700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f840014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83ff59e700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f84001543c0 0x7f84001e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 -- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 msgr2=0x7f840014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f840014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 -- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f84001543c0 msgr2=0x7f84001e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f84001543c0 0x7f84001e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40093e0 con 0x7f840006ffd0 2022-08-10T17:55:22.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83ff59e700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f84001543c0 0x7f84001e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fed9d700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f840006f9d0 0x7f840014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.596+0000 7f83fe59c700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f84001e8040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83f4000c00 tx=0x7f83f40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4011ca0 con 0x7f840006ffd0 2022-08-10T17:55:22.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f401f070 con 0x7f840006ffd0 2022-08-10T17:55:22.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84001df4d0 con 0x7f840006ffd0 2022-08-10T17:55:22.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003520 con 0x7f840006ffd0 2022-08-10T17:55:22.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000c3930 con 0x7f840006ffd0 2022-08-10T17:55:22.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.597+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84001df9f0 con 0x7f840006ffd0 2022-08-10T17:55:22.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.598+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f83f402a020 con 0x7f840006ffd0 2022-08-10T17:55:22.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.598+0000 7f83e77fe700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83e00650b0 0x7f83e0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.623 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f83f4083b90 con 0x7f840006ffd0 2022-08-10T17:55:22.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83fed9d700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83e00650b0 0x7f83e0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83e77fe700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f83e006ee80 0x7f83e00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83e00719a0 con 0x7f83e006ee80 2022-08-10T17:55:22.624 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83f4083f00 con 0x7f840006ffd0 2022-08-10T17:55:22.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83ff59e700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f83e006ee80 0x7f83e00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83fed9d700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83e00650b0 0x7f83e0067560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000f60 tx=0x7f83f0007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.599+0000 7f83ff59e700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f83e006ee80 0x7f83e00712d0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.625 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.600+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== osd.5 v2:172.21.15.197:6808/98110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f83e00719a0 con 0x7f83e006ee80 2022-08-10T17:55:22.626 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.614+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 --> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84000c3ac0 con 0x7f83e006ee80 2022-08-10T17:55:22.627 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f83e77fe700 1 -- 172.21.15.150:0/2476869238 <== osd.5 v2:172.21.15.197:6808/98110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84000c3ac0 con 0x7f83e006ee80 2022-08-10T17:55:22.627 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:22.627 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:22.628 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:22.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f83e006ee80 msgr2=0x7f83e00712d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6808/98110,v1:172.21.15.197:6809/98110] conn(0x7f83e006ee80 0x7f83e00712d0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83e00650b0 msgr2=0x7f83e0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f83e00650b0 0x7f83e0067560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000f60 tx=0x7f83f0007c60 comp rx=0 tx=0).stop 2022-08-10T17:55:22.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 msgr2=0x7f84001e8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 --2- 172.21.15.150:0/2476869238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840006ffd0 0x7f84001e8040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83f4000c00 tx=0x7f83f40045d0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f83ff59e700 1 -- 172.21.15.150:0/2476869238 reap_dead start 2022-08-10T17:55:22.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 shutdown_connections 2022-08-10T17:55:22.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 >> 172.21.15.150:0/2476869238 conn(0x7f8400068110 msgr2=0x7f8400152230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 shutdown_connections 2022-08-10T17:55:22.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.615+0000 7f8405023700 1 -- 172.21.15.150:0/2476869238 wait complete. 2022-08-10T17:55:22.633 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2022-08-10T17:55:22.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.751+0000 7eff70d3e700 1 Processor -- start 2022-08-10T17:55:22.755 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.751+0000 7eff70d3e700 1 -- start start 2022-08-10T17:55:22.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff6c1544d0 0x7eff6c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 0x7eff6c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.758 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 0x7eff6c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c06a050 con 0x7eff6c1544d0 2022-08-10T17:55:22.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0c6220 con 0x7eff6c06eff0 2022-08-10T17:55:22.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff70d3e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0c4420 con 0x7eff6c06ea90 2022-08-10T17:55:22.759 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff6c1544d0 0x7eff6c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff6c1544d0 0x7eff6c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45610/0 (socket says 172.21.15.150:45610) 2022-08-10T17:55:22.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 -- 172.21.15.150:0/972104740 learned_addr learned my addr 172.21.15.150:0/972104740 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff69d9b700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 0x7eff6c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6ad9d700 1 --2- 172.21.15.150:0/972104740 >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 0x7eff6c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.760 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 -- 172.21.15.150:0/972104740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 msgr2=0x7eff6c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 0x7eff6c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 -- 172.21.15.150:0/972104740 >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 msgr2=0x7eff6c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:22.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 --2- 172.21.15.150:0/972104740 >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 0x7eff6c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.761 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.752+0000 7eff6a59c700 1 -- 172.21.15.150:0/972104740 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0c4700 con 0x7eff6c1544d0 2022-08-10T17:55:22.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff69d9b700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 0x7eff6c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff6ad9d700 1 --2- 172.21.15.150:0/972104740 >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 0x7eff6c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff6a59c700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c1544d0 0x7eff6c071370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0c7690 tx=0x7eff5c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7ea62c77a83ef9 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.762 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff6959a700 1 -- 172.21.15.150:0/972104740 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004230 con 0x7eff6c1544d0 2022-08-10T17:55:22.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff6959a700 1 -- 172.21.15.150:0/972104740 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c004390 con 0x7eff6c1544d0 2022-08-10T17:55:22.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff6959a700 1 -- 172.21.15.150:0/972104740 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011850 con 0x7eff6c1544d0 2022-08-10T17:55:22.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 -- 172.21.15.150:0/972104740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c1544d0 msgr2=0x7eff6c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.763 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c1544d0 0x7eff6c071370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0c7690 tx=0x7eff5c009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:22.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 -- 172.21.15.150:0/972104740 shutdown_connections 2022-08-10T17:55:22.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 --2- 172.21.15.150:0/972104740 >> v2:172.21.15.197:3300/0 conn(0x7eff6c06eff0 0x7eff6c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c1544d0 0x7eff6c071370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 --2- 172.21.15.150:0/972104740 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c06ea90 0x7eff6c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 -- 172.21.15.150:0/972104740 >> 172.21.15.150:0/972104740 conn(0x7eff6c068110 msgr2=0x7eff6c068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 -- 172.21.15.150:0/972104740 shutdown_connections 2022-08-10T17:55:22.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.753+0000 7eff70d3e700 1 -- 172.21.15.150:0/972104740 wait complete. 2022-08-10T17:55:22.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.755+0000 7eff70d3e700 1 Processor -- start 2022-08-10T17:55:22.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.755+0000 7eff70d3e700 1 -- start start 2022-08-10T17:55:22.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 0x7eff6c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 0x7eff6c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0ca280 con 0x7eff6c06eff0 2022-08-10T17:55:22.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1ed360 con 0x7eff6c06ea90 2022-08-10T17:55:22.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff70d3e700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1ecdf0 con 0x7eff6c1544d0 2022-08-10T17:55:22.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff69d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff69d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45618/0 (socket says 172.21.15.150:45618) 2022-08-10T17:55:22.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff69d9b700 1 -- 172.21.15.150:0/3691450916 learned_addr learned my addr 172.21.15.150:0/3691450916 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:22.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff6a59c700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 0x7eff6c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.756+0000 7eff6ad9d700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 0x7eff6c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 -- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 msgr2=0x7eff6c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 0x7eff6c0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 -- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 msgr2=0x7eff6c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 0x7eff6c155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 -- 172.21.15.150:0/3691450916 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009310 con 0x7eff6c06eff0 2022-08-10T17:55:22.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff6a59c700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 0x7eff6c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff6ad9d700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 0x7eff6c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff69d9b700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e7f0 tx=0x7eff6000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60009550 con 0x7eff6c06eff0 2022-08-10T17:55:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60013680 con 0x7eff6c06eff0 2022-08-10T17:55:22.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff64009a70 con 0x7eff6c06eff0 2022-08-10T17:55:22.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60013a30 con 0x7eff6c06eff0 2022-08-10T17:55:22.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.757+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0093e0 con 0x7eff6c06eff0 2022-08-10T17:55:22.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.758+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7eff60023070 con 0x7eff6c06eff0 2022-08-10T17:55:22.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.759+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c0ca430 con 0x7eff6c06eff0 2022-08-10T17:55:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.759+0000 7eff5affd700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 0x7eff48067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.759+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7eff600822a0 con 0x7eff6c06eff0 2022-08-10T17:55:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.759+0000 7eff6a59c700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 0x7eff48067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:22.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.759+0000 7eff6a59c700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 0x7eff48067590 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009fd0 tx=0x7eff5c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:22.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.767+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7eff6c0ca430 con 0x7eff6c06eff0 2022-08-10T17:55:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.952+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7eff6c0ca430 con 0x7eff480650e0 2022-08-10T17:55:22.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.952+0000 7eff5affd700 1 -- 172.21.15.150:0/3691450916 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff6c0ca430 con 0x7eff480650e0 2022-08-10T17:55:22.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 msgr2=0x7eff48067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 0x7eff48067590 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009fd0 tx=0x7eff5c008030 comp rx=0 tx=0).stop 2022-08-10T17:55:22.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 msgr2=0x7eff6c155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:22.959 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e7f0 tx=0x7eff6000eb00 comp rx=0 tx=0).stop 2022-08-10T17:55:22.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 shutdown_connections 2022-08-10T17:55:22.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7eff480650e0 0x7eff48067590 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7eff6c1544d0 0x7eff6c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.960 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7eff6c06ea90 0x7eff6c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 --2- 172.21.15.150:0/3691450916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff6c06eff0 0x7eff6c155cf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:22.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 >> 172.21.15.150:0/3691450916 conn(0x7eff6c068110 msgr2=0x7eff6c06fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:22.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.954+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 shutdown_connections 2022-08-10T17:55:22.961 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:22.955+0000 7eff70d3e700 1 -- 172.21.15.150:0/3691450916 wait complete. 2022-08-10T17:55:22.962 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 5 to deep-scrub 2022-08-10T17:55:22.970 INFO:tasks.ceph:Scrubbing osd.6 2022-08-10T17:55:22.971 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:23.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.093+0000 7f7d7beb7700 1 Processor -- start 2022-08-10T17:55:23.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d7beb7700 1 -- start start 2022-08-10T17:55:23.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d7beb7700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7d74150d50 0x7f7d740c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d7beb7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7415abb0 con 0x7f7d740cda40 2022-08-10T17:55:23.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d7beb7700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740c4750 con 0x7f7d740c8770 2022-08-10T17:55:23.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d7beb7700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740c81b0 con 0x7f7d74150d50 2022-08-10T17:55:23.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.094+0000 7f7d79452700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7d740cda40 0x7f7d74159d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58306/0 (socket says 172.21.15.150:58306) 2022-08-10T17:55:23.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79452700 1 -- 172.21.15.150:0/2895662405 learned_addr learned my addr 172.21.15.150:0/2895662405 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:23.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2895662405 >> v2:172.21.15.197:3300/0 conn(0x7f7d74150d50 0x7f7d740c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971502393 0 0) 0x7f7d7415abb0 con 0x7f7d740cda40 2022-08-10T17:55:23.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003430 con 0x7f7d740cda40 2022-08-10T17:55:23.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144543066 0 0) 0x7f7d740c4750 con 0x7f7d740c8770 2022-08-10T17:55:23.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d7415abb0 con 0x7f7d740c8770 2022-08-10T17:55:23.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79c53700 1 -- 172.21.15.150:0/2895662405 >> v1:172.21.15.197:6789/0 conn(0x7f7d740c8770 legacy=0x7f7d7415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79c53700 1 -- 172.21.15.150:0/2895662405 >> v1:172.21.15.150:6789/0 conn(0x7f7d740cda40 legacy=0x7f7d74159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79c53700 1 -- 172.21.15.150:0/2895662405 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740c8490 con 0x7f7d74150d50 2022-08-10T17:55:23.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2895662405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d740c4210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d700096b0 tx=0x7f7d700099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0cc042f4120eae5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700107b0 con 0x7f7d74150d50 2022-08-10T17:55:23.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70010910 con 0x7f7d74150d50 2022-08-10T17:55:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.095+0000 7f7d78c51700 1 -- 172.21.15.150:0/2895662405 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70010cc0 con 0x7f7d74150d50 2022-08-10T17:55:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2895662405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 msgr2=0x7f7d740c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 --2- 172.21.15.150:0/2895662405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d740c4210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d700096b0 tx=0x7f7d700099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2895662405 shutdown_connections 2022-08-10T17:55:23.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 --2- 172.21.15.150:0/2895662405 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d740c4210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2895662405 >> 172.21.15.150:0/2895662405 conn(0x7f7d74071370 msgr2=0x7f7d74071740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2895662405 shutdown_connections 2022-08-10T17:55:23.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.096+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2895662405 wait complete. 2022-08-10T17:55:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.097+0000 7f7d7beb7700 1 Processor -- start 2022-08-10T17:55:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.097+0000 7f7d7beb7700 1 -- start start 2022-08-10T17:55:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7d740c8770 0x7f7d740c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 0x7f7d740c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d741ec080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c25f0 con 0x7f7d740cda40 2022-08-10T17:55:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c3780 con 0x7f7d74150d50 2022-08-10T17:55:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7beb7700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c3a60 con 0x7f7d740c8770 2022-08-10T17:55:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 0x7f7d740c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 0x7f7d740c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45632/0 (socket says 172.21.15.150:45632) 2022-08-10T17:55:23.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 -- 172.21.15.150:0/2022965193 learned_addr learned my addr 172.21.15.150:0/2022965193 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7d740c8770 0x7f7d740c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7a454700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d741ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 -- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7d740c8770 msgr2=0x7f7d740c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7d740c8770 0x7f7d740c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.116 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 -- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 msgr2=0x7f7d741ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d741ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.117 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70009310 con 0x7f7d740cda40 2022-08-10T17:55:23.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7d740c8770 0x7f7d740c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:23.118 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d7a454700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7d74150d50 0x7f7d741ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:55:23.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d79452700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 0x7f7d740c9980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c400 tx=0x7f7d6400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.098+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640072d0 con 0x7f7d740cda40 2022-08-10T17:55:23.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.099+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d64007450 con 0x7f7d740cda40 2022-08-10T17:55:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.099+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d740c1c50 con 0x7f7d740cda40 2022-08-10T17:55:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.099+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640057c0 con 0x7f7d740cda40 2022-08-10T17:55:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.099+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d740c2210 con 0x7f7d740cda40 2022-08-10T17:55:23.120 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.099+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d740c23d0 con 0x7f7d740cda40 2022-08-10T17:55:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.100+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7d64019030 con 0x7f7d740cda40 2022-08-10T17:55:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d627fc700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7d540650b0 0x7f7d54067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7d64081500 con 0x7f7d740cda40 2022-08-10T17:55:23.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7d540650b0 0x7f7d54067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d627fc700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f7d5406ee00 0x7f7d54071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d54071920 con 0x7f7d5406ee00 2022-08-10T17:55:23.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d64083bd0 con 0x7f7d740cda40 2022-08-10T17:55:23.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d7a454700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f7d5406ee00 0x7f7d54071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d79c53700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7d540650b0 0x7f7d54067560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7d700090b0 tx=0x7f7d70008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.101+0000 7f7d7a454700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f7d5406ee00 0x7f7d54071250 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.102+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== osd.6 v2:172.21.15.197:6824/98136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7f7d54071920 con 0x7f7d5406ee00 2022-08-10T17:55:23.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.116+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 --> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7d740c2730 con 0x7f7d5406ee00 2022-08-10T17:55:23.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.116+0000 7f7d627fc700 1 -- 172.21.15.150:0/2022965193 <== osd.6 v2:172.21.15.197:6824/98136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7d740c2730 con 0x7f7d5406ee00 2022-08-10T17:55:23.125 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:23.125 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:23.125 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:23.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f7d5406ee00 msgr2=0x7f7d54071250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6824/98136,v1:172.21.15.197:6825/98136] conn(0x7f7d5406ee00 0x7f7d54071250 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7d540650b0 msgr2=0x7f7d54067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f7d540650b0 0x7f7d54067560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7d700090b0 tx=0x7f7d70008030 comp rx=0 tx=0).stop 2022-08-10T17:55:23.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 msgr2=0x7f7d740c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 --2- 172.21.15.150:0/2022965193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d740cda40 0x7f7d740c9980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c400 tx=0x7f7d6400c710 comp rx=0 tx=0).stop 2022-08-10T17:55:23.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7a454700 1 -- 172.21.15.150:0/2022965193 reap_dead start 2022-08-10T17:55:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 shutdown_connections 2022-08-10T17:55:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 >> 172.21.15.150:0/2022965193 conn(0x7f7d74071370 msgr2=0x7f7d740c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 shutdown_connections 2022-08-10T17:55:23.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.117+0000 7f7d7beb7700 1 -- 172.21.15.150:0/2022965193 wait complete. 2022-08-10T17:55:23.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2022-08-10T17:55:23.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.252+0000 7f17511da700 1 Processor -- start 2022-08-10T17:55:23.256 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.252+0000 7f17511da700 1 -- start start 2022-08-10T17:55:23.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f174c1540f0 0x7f174c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f174c0bd4b0 0x7f174c068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.259 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0c5270 con 0x7f174c1540f0 2022-08-10T17:55:23.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0c6100 con 0x7f174c0bd4b0 2022-08-10T17:55:23.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f17511da700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c5e00 con 0x7f174c1544c0 2022-08-10T17:55:23.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f174c1540f0 0x7f174c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.260 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f174c1540f0 0x7f174c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45640/0 (socket says 172.21.15.150:45640) 2022-08-10T17:55:23.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 -- 172.21.15.150:0/1298891806 learned_addr learned my addr 172.21.15.150:0/1298891806 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:23.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174b59e700 1 --2- 172.21.15.150:0/1298891806 >> v2:172.21.15.197:3300/0 conn(0x7f174c0bd4b0 0x7f174c068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174a59c700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 -- 172.21.15.150:0/1298891806 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 msgr2=0x7f174c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:23.261 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 -- 172.21.15.150:0/1298891806 >> v2:172.21.15.197:3300/0 conn(0x7f174c0bd4b0 msgr2=0x7f174c068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:55:23.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 --2- 172.21.15.150:0/1298891806 >> v2:172.21.15.197:3300/0 conn(0x7f174c0bd4b0 0x7f174c068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 -- 172.21.15.150:0/1298891806 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c06eb00 con 0x7f174c1540f0 2022-08-10T17:55:23.262 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.253+0000 7f174ad9d700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c1540f0 0x7f174c071370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f174c0c6d90 tx=0x7f1740009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b6b1f097de3d77 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f1749d9b700 1 -- 172.21.15.150:0/1298891806 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740004230 con 0x7f174c1540f0 2022-08-10T17:55:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f1749d9b700 1 -- 172.21.15.150:0/1298891806 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740004390 con 0x7f174c1540f0 2022-08-10T17:55:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f1749d9b700 1 -- 172.21.15.150:0/1298891806 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011850 con 0x7f174c1540f0 2022-08-10T17:55:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 -- 172.21.15.150:0/1298891806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c1540f0 msgr2=0x7f174c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.263 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c1540f0 0x7f174c071370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f174c0c6d90 tx=0x7f1740009a60 comp rx=0 tx=0).stop 2022-08-10T17:55:23.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 -- 172.21.15.150:0/1298891806 shutdown_connections 2022-08-10T17:55:23.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 --2- 172.21.15.150:0/1298891806 >> v2:172.21.15.197:3300/0 conn(0x7f174c0bd4b0 0x7f174c068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c1540f0 0x7f174c071370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 --2- 172.21.15.150:0/1298891806 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 -- 172.21.15.150:0/1298891806 >> 172.21.15.150:0/1298891806 conn(0x7f174c06d0d0 msgr2=0x7f174c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 -- 172.21.15.150:0/1298891806 shutdown_connections 2022-08-10T17:55:23.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.254+0000 7f17511da700 1 -- 172.21.15.150:0/1298891806 wait complete. 2022-08-10T17:55:23.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 Processor -- start 2022-08-10T17:55:23.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 -- start start 2022-08-10T17:55:23.268 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c1ebe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f174c0afb10 0x7f174c1ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1efa70 con 0x7f174c0bd4b0 2022-08-10T17:55:23.269 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1f0030 con 0x7f174c0afb10 2022-08-10T17:55:23.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.256+0000 7f17511da700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c150610 con 0x7f174c1544c0 2022-08-10T17:55:23.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45646/0 (socket says 172.21.15.150:45646) 2022-08-10T17:55:23.270 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 -- 172.21.15.150:0/2271840026 learned_addr learned my addr 172.21.15.150:0/2271840026 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:23.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174a59c700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c1ebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174b59e700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f174c0afb10 0x7f174c1ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 -- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 msgr2=0x7f174c1ebe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c1ebe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 -- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f174c0afb10 msgr2=0x7f174c1ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f174c0afb10 0x7f174c1ec3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 -- 172.21.15.150:0/2271840026 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400093e0 con 0x7f174c0bd4b0 2022-08-10T17:55:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f174ad9d700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1740009aa0 tx=0x7f17400045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011e70 con 0x7f174c0bd4b0 2022-08-10T17:55:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174001f070 con 0x7f174c0bd4b0 2022-08-10T17:55:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c1508b0 con 0x7f174c0bd4b0 2022-08-10T17:55:23.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740003720 con 0x7f174c0bd4b0 2022-08-10T17:55:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.257+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c150150 con 0x7f174c0bd4b0 2022-08-10T17:55:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.258+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c150370 con 0x7f174c0bd4b0 2022-08-10T17:55:23.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.259+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f1740017020 con 0x7f174c0bd4b0 2022-08-10T17:55:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.259+0000 7f17337fe700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 0x7f172c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.259+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f1740021070 con 0x7f174c0bd4b0 2022-08-10T17:55:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.259+0000 7f174a59c700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 0x7f172c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.260+0000 7f174a59c700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 0x7f172c067560 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f174c0c8ff0 tx=0x7f173c0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.263+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f1740051860 con 0x7f174c0bd4b0 2022-08-10T17:55:23.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.448+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f174c1ebd00 con 0x7f172c0650b0 2022-08-10T17:55:23.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.448+0000 7f17337fe700 1 -- 172.21.15.150:0/2271840026 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f174c1ebd00 con 0x7f172c0650b0 2022-08-10T17:55:23.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 msgr2=0x7f172c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 0x7f172c067560 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f174c0c8ff0 tx=0x7f173c0090e0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 msgr2=0x7f174c0c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1740009aa0 tx=0x7f17400045d0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 shutdown_connections 2022-08-10T17:55:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f174c0afb10 0x7f174c1ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f174c0bd4b0 0x7f174c0c8440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f172c0650b0 0x7f172c067560 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 --2- 172.21.15.150:0/2271840026 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f174c1544c0 0x7f174c1ebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 >> 172.21.15.150:0/2271840026 conn(0x7f174c06d0d0 msgr2=0x7f174c152b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 shutdown_connections 2022-08-10T17:55:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.450+0000 7f17511da700 1 -- 172.21.15.150:0/2271840026 wait complete. 2022-08-10T17:55:23.457 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 6 to deep-scrub 2022-08-10T17:55:23.466 INFO:tasks.ceph:Scrubbing osd.7 2022-08-10T17:55:23.466 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2022-08-10T17:55:23.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.588+0000 7fe498df5700 1 Processor -- start 2022-08-10T17:55:23.592 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.588+0000 7fe498df5700 1 -- start start 2022-08-10T17:55:23.598 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe498df5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe49406f380 0x7fe4940bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe498df5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49406f130 con 0x7fe4940c6760 2022-08-10T17:55:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe498df5700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940ca6d0 con 0x7fe4940c6b30 2022-08-10T17:55:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe498df5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940c4a80 con 0x7fe49406f380 2022-08-10T17:55:23.599 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe491d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe49406f380 0x7fe4940bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe49259c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe4940c6760 0x7fe4940c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58334/0 (socket says 172.21.15.150:58334) 2022-08-10T17:55:23.600 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe491d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe49406f380 0x7fe4940bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45656/0 (socket says 172.21.15.150:45656) 2022-08-10T17:55:23.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.589+0000 7fe49259c700 1 -- 172.21.15.150:0/209482423 learned_addr learned my addr 172.21.15.150:0/209482423 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:23.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe491d9b700 1 -- 172.21.15.150:0/209482423 >> v1:172.21.15.197:6789/0 conn(0x7fe4940c6b30 legacy=0x7fe494153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe491d9b700 1 -- 172.21.15.150:0/209482423 >> v1:172.21.15.150:6789/0 conn(0x7fe4940c6760 legacy=0x7fe4940c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.601 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe491d9b700 1 -- 172.21.15.150:0/209482423 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940ca990 con 0x7fe49406f380 2022-08-10T17:55:23.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe49159a700 1 -- 172.21.15.150:0/209482423 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276760151 0 0) 0x7fe49406f130 con 0x7fe4940c6760 2022-08-10T17:55:23.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe491d9b700 1 --2- 172.21.15.150:0/209482423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe4940bd460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4840096b0 tx=0x7fe4840099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b9c0a0b3457326 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe49159a700 1 -- 172.21.15.150:0/209482423 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484011830 con 0x7fe49406f380 2022-08-10T17:55:23.602 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe49159a700 1 -- 172.21.15.150:0/209482423 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484011990 con 0x7fe49406f380 2022-08-10T17:55:23.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.590+0000 7fe49159a700 1 -- 172.21.15.150:0/209482423 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484011d40 con 0x7fe49406f380 2022-08-10T17:55:23.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 -- 172.21.15.150:0/209482423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 msgr2=0x7fe4940bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 --2- 172.21.15.150:0/209482423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe4940bd460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4840096b0 tx=0x7fe4840099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.603 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 -- 172.21.15.150:0/209482423 shutdown_connections 2022-08-10T17:55:23.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 --2- 172.21.15.150:0/209482423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe4940bd460 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 -- 172.21.15.150:0/209482423 >> 172.21.15.150:0/209482423 conn(0x7fe494068110 msgr2=0x7fe494068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 -- 172.21.15.150:0/209482423 shutdown_connections 2022-08-10T17:55:23.604 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.591+0000 7fe498df5700 1 -- 172.21.15.150:0/209482423 wait complete. 2022-08-10T17:55:23.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.592+0000 7fe498df5700 1 Processor -- start 2022-08-10T17:55:23.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.592+0000 7fe498df5700 1 -- start start 2022-08-10T17:55:23.605 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe494157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4940c6760 0x7fe494159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4940c6b30 0x7fe4940c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494158a50 con 0x7fe49406f380 2022-08-10T17:55:23.606 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c9690 con 0x7fe4940c6760 2022-08-10T17:55:23.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe494151170 con 0x7fe4940c6b30 2022-08-10T17:55:23.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe494157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe494157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45660/0 (socket says 172.21.15.150:45660) 2022-08-10T17:55:23.607 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 -- 172.21.15.150:0/3699218802 learned_addr learned my addr 172.21.15.150:0/3699218802 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:23.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe491d9b700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4940c6760 0x7fe494159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe492d9d700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4940c6b30 0x7fe4940c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 -- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4940c6b30 msgr2=0x7fe4940c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.608 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fe4940c6b30 0x7fe4940c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 -- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4940c6760 msgr2=0x7fe494159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fe4940c6760 0x7fe494159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009310 con 0x7fe49406f380 2022-08-10T17:55:23.609 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe49259c700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe494157c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c440 tx=0x7fe48800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880072d0 con 0x7fe49406f380 2022-08-10T17:55:23.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488007430 con 0x7fe49406f380 2022-08-10T17:55:23.610 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.593+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940c9be0 con 0x7fe49406f380 2022-08-10T17:55:23.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.594+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488004930 con 0x7fe49406f380 2022-08-10T17:55:23.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.594+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941586e0 con 0x7fe49406f380 2022-08-10T17:55:23.611 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.594+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe494072890 con 0x7fe49406f380 2022-08-10T17:55:23.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.595+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fe48801a020 con 0x7fe49406f380 2022-08-10T17:55:23.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe482ffd700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe4700650b0 0x7fe470067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.613 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fe488081d30 con 0x7fe49406f380 2022-08-10T17:55:23.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe491d9b700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe4700650b0 0x7fe470067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe482ffd700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7fe47006ee00 0x7fe470071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.614 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe470071920 con 0x7fe47006ee00 2022-08-10T17:55:23.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe488084310 con 0x7fe49406f380 2022-08-10T17:55:23.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe492d9d700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7fe47006ee00 0x7fe470071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe491d9b700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe4700650b0 0x7fe470067560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe4840090b0 tx=0x7fe48401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.615 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.596+0000 7fe492d9d700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7fe47006ee00 0x7fe470071250 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.597+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== osd.7 v2:172.21.15.197:6816/98111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24493 (crc 0 0 0) 0x7fe470071920 con 0x7fe47006ee00 2022-08-10T17:55:23.616 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.611+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 --> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe494158b90 con 0x7fe47006ee00 2022-08-10T17:55:23.617 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe482ffd700 1 -- 172.21.15.150:0/3699218802 <== osd.7 v2:172.21.15.197:6816/98111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe48c001a30 con 0x7fe47006ee00 2022-08-10T17:55:23.617 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2022-08-10T17:55:23.617 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-08-10T17:55:23.618 INFO:teuthology.orchestra.run.smithi150.stdout:} 2022-08-10T17:55:23.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7fe47006ee00 msgr2=0x7fe470071250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.619 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6816/98111,v1:172.21.15.197:6817/98111] conn(0x7fe47006ee00 0x7fe470071250 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe4700650b0 msgr2=0x7fe470067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fe4700650b0 0x7fe470067560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe4840090b0 tx=0x7fe48401c040 comp rx=0 tx=0).stop 2022-08-10T17:55:23.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 msgr2=0x7fe494157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 --2- 172.21.15.150:0/3699218802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe49406f380 0x7fe494157c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c440 tx=0x7fe48800c750 comp rx=0 tx=0).stop 2022-08-10T17:55:23.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe492d9d700 1 -- 172.21.15.150:0/3699218802 reap_dead start 2022-08-10T17:55:23.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 shutdown_connections 2022-08-10T17:55:23.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 >> 172.21.15.150:0/3699218802 conn(0x7fe494068110 msgr2=0x7fe494071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 shutdown_connections 2022-08-10T17:55:23.622 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.612+0000 7fe498df5700 1 -- 172.21.15.150:0/3699218802 wait complete. 2022-08-10T17:55:23.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2022-08-10T17:55:23.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.753+0000 7faabc687700 1 Processor -- start 2022-08-10T17:55:23.757 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.753+0000 7faabc687700 1 -- start start 2022-08-10T17:55:23.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faabc687700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faab4158170 0x7faab40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faabc687700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab40c1f40 con 0x7faab4151290 2022-08-10T17:55:23.764 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faabc687700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab40c2220 con 0x7faab4068bf0 2022-08-10T17:55:23.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faabc687700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab40c7d90 con 0x7faab4158170 2022-08-10T17:55:23.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faab9c22700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faab4158170 0x7faab40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faaba423700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7faab4151290 0x7faab4157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58350/0 (socket says 172.21.15.150:58350) 2022-08-10T17:55:23.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.754+0000 7faaba423700 1 -- 172.21.15.150:0/3599595632 learned_addr learned my addr 172.21.15.150:0/3599595632 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:23.765 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9c22700 1 -- 172.21.15.150:0/3599595632 >> v1:172.21.15.197:6789/0 conn(0x7faab4068bf0 legacy=0x7faab40c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9c22700 1 -- 172.21.15.150:0/3599595632 >> v1:172.21.15.150:6789/0 conn(0x7faab4151290 legacy=0x7faab4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9c22700 1 -- 172.21.15.150:0/3599595632 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40c2500 con 0x7faab4158170 2022-08-10T17:55:23.766 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9c22700 1 --2- 172.21.15.150:0/3599595632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c7850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faaa40096b0 tx=0x7faaa40099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19108720b3ed4de7 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9421700 1 -- 172.21.15.150:0/3599595632 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011830 con 0x7faab4158170 2022-08-10T17:55:23.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9421700 1 -- 172.21.15.150:0/3599595632 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4011990 con 0x7faab4158170 2022-08-10T17:55:23.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faab9421700 1 -- 172.21.15.150:0/3599595632 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011d40 con 0x7faab4158170 2022-08-10T17:55:23.767 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faabc687700 1 -- 172.21.15.150:0/3599595632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 msgr2=0x7faab40c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.755+0000 7faabc687700 1 --2- 172.21.15.150:0/3599595632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c7850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faaa40096b0 tx=0x7faaa40099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.756+0000 7faabc687700 1 -- 172.21.15.150:0/3599595632 shutdown_connections 2022-08-10T17:55:23.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.756+0000 7faabc687700 1 --2- 172.21.15.150:0/3599595632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c7850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.768 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.756+0000 7faabc687700 1 -- 172.21.15.150:0/3599595632 >> 172.21.15.150:0/3599595632 conn(0x7faab406f880 msgr2=0x7faab406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.756+0000 7faabc687700 1 -- 172.21.15.150:0/3599595632 shutdown_connections 2022-08-10T17:55:23.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.756+0000 7faabc687700 1 -- 172.21.15.150:0/3599595632 wait complete. 2022-08-10T17:55:23.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 Processor -- start 2022-08-10T17:55:23.769 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 -- start start 2022-08-10T17:55:23.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faab4068bf0 0x7faab40c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faab4151290 0x7faab40c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.770 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab40cafd0 con 0x7faab4158170 2022-08-10T17:55:23.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab414fde0 con 0x7faab4068bf0 2022-08-10T17:55:23.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.757+0000 7faabc687700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab41ed730 con 0x7faab4151290 2022-08-10T17:55:23.771 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45680/0 (socket says 172.21.15.150:45680) 2022-08-10T17:55:23.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 -- 172.21.15.150:0/2051092620 learned_addr learned my addr 172.21.15.150:0/2051092620 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:23.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faaba423700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faab4068bf0 0x7faab40c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.772 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faab9c22700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faab4151290 0x7faab40c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 -- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faab4151290 msgr2=0x7faab40c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faab4151290 0x7faab40c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 -- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faab4068bf0 msgr2=0x7faab40c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.773 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faab4068bf0 0x7faab40c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 -- 172.21.15.150:0/2051092620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4009310 con 0x7faab4158170 2022-08-10T17:55:23.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabac24700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c730 tx=0x7faaac00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac003a80 con 0x7faab4158170 2022-08-10T17:55:23.774 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac003c00 con 0x7faab4158170 2022-08-10T17:55:23.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0050d0 con 0x7faab4158170 2022-08-10T17:55:23.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab414f860 con 0x7faab4158170 2022-08-10T17:55:23.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.758+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab41ed1a0 con 0x7faab4158170 2022-08-10T17:55:23.775 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.759+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab40cb110 con 0x7faab4158170 2022-08-10T17:55:23.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.760+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7faaac019030 con 0x7faab4158170 2022-08-10T17:55:23.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.760+0000 7faaa2ffd700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 0x7faa94067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:23.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.760+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7faaac081600 con 0x7faab4158170 2022-08-10T17:55:23.776 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.760+0000 7faaba423700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 0x7faa94067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:23.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.761+0000 7faaba423700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 0x7faa94067590 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faab00010e0 tx=0x7faab0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:23.777 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.764+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7faab40cb110 con 0x7faab4158170 2022-08-10T17:55:23.951 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.947+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7faab40cb110 con 0x7faa940650e0 2022-08-10T17:55:23.952 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.948+0000 7faaa2ffd700 1 -- 172.21.15.150:0/2051092620 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faab40cb110 con 0x7faa940650e0 2022-08-10T17:55:23.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 msgr2=0x7faa94067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.954 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 0x7faa94067590 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faab00010e0 tx=0x7faab0009040 comp rx=0 tx=0).stop 2022-08-10T17:55:23.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 msgr2=0x7faab40c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:23.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c730 tx=0x7faaac00ca40 comp rx=0 tx=0).stop 2022-08-10T17:55:23.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 shutdown_connections 2022-08-10T17:55:23.955 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab4158170 0x7faab40c6180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7faab4068bf0 0x7faab40c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7faa940650e0 0x7faa94067590 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 --2- 172.21.15.150:0/2051092620 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7faab4151290 0x7faab40c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:23.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 >> 172.21.15.150:0/2051092620 conn(0x7faab406f880 msgr2=0x7faab4140430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:23.956 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 shutdown_connections 2022-08-10T17:55:23.957 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:23.950+0000 7faabc687700 1 -- 172.21.15.150:0/2051092620 wait complete. 2022-08-10T17:55:23.957 INFO:teuthology.orchestra.run.smithi150.stderr:instructed osd(s) 7 to deep-scrub 2022-08-10T17:55:23.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:55:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.085+0000 7fcff9957700 1 Processor -- start 2022-08-10T17:55:24.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.085+0000 7fcff9957700 1 -- start start 2022-08-10T17:55:24.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff9957700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcff4158170 0x7fcff40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:24.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff9957700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff40c1f40 con 0x7fcff4151290 2022-08-10T17:55:24.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff9957700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff40c2220 con 0x7fcff4068bf0 2022-08-10T17:55:24.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff9957700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff40c7d90 con 0x7fcff4158170 2022-08-10T17:55:24.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcff4158170 0x7fcff40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:24.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcff4151290 0x7fcff4157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58364/0 (socket says 172.21.15.150:58364) 2022-08-10T17:55:24.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcff4158170 0x7fcff40c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45686/0 (socket says 172.21.15.150:45686) 2022-08-10T17:55:24.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff2ffd700 1 -- 172.21.15.150:0/1597168243 learned_addr learned my addr 172.21.15.150:0/1597168243 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:24.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 -- 172.21.15.150:0/1597168243 >> v1:172.21.15.197:6789/0 conn(0x7fcff4068bf0 legacy=0x7fcff40c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 -- 172.21.15.150:0/1597168243 >> v1:172.21.15.150:6789/0 conn(0x7fcff4151290 legacy=0x7fcff4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff1ffb700 1 -- 172.21.15.150:0/1597168243 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486915020 0 0) 0x7fcff40c1f40 con 0x7fcff4151290 2022-08-10T17:55:24.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 -- 172.21.15.150:0/1597168243 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40c2500 con 0x7fcff4158170 2022-08-10T17:55:24.102 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.086+0000 7fcff27fc700 1 --2- 172.21.15.150:0/1597168243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4158170 0x7fcff40c7850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80096b0 tx=0x7fcfe80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c9610320ddd29 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:24.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff1ffb700 1 -- 172.21.15.150:0/1597168243 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011830 con 0x7fcff4158170 2022-08-10T17:55:24.103 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff1ffb700 1 -- 172.21.15.150:0/1597168243 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8011990 con 0x7fcff4158170 2022-08-10T17:55:24.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff1ffb700 1 -- 172.21.15.150:0/1597168243 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011d40 con 0x7fcff4158170 2022-08-10T17:55:24.104 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 -- 172.21.15.150:0/1597168243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4158170 msgr2=0x7fcff40c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 --2- 172.21.15.150:0/1597168243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4158170 0x7fcff40c7850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80096b0 tx=0x7fcfe80099c0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 -- 172.21.15.150:0/1597168243 shutdown_connections 2022-08-10T17:55:24.105 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 --2- 172.21.15.150:0/1597168243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4158170 0x7fcff40c7850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 -- 172.21.15.150:0/1597168243 >> 172.21.15.150:0/1597168243 conn(0x7fcff406f880 msgr2=0x7fcff406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:24.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 -- 172.21.15.150:0/1597168243 shutdown_connections 2022-08-10T17:55:24.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.087+0000 7fcff9957700 1 -- 172.21.15.150:0/1597168243 wait complete. 2022-08-10T17:55:24.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.088+0000 7fcff9957700 1 Processor -- start 2022-08-10T17:55:24.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 -- start start 2022-08-10T17:55:24.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:24.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 0x7fcff4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcff4158170 0x7fcff413f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff41eca40 con 0x7fcff4068bf0 2022-08-10T17:55:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff41ed990 con 0x7fcff4151290 2022-08-10T17:55:24.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff9957700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff415a1b0 con 0x7fcff4158170 2022-08-10T17:55:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff2ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff27fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 0x7fcff4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff2ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45690/0 (socket says 172.21.15.150:45690) 2022-08-10T17:55:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff27fc700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 0x7fcff4148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:56284/0 (socket says 172.21.15.150:56284) 2022-08-10T17:55:24.109 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff37fe700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcff4158170 0x7fcff413f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:24.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.089+0000 7fcff2ffd700 1 -- 172.21.15.150:0/2734209716 learned_addr learned my addr 172.21.15.150:0/2734209716 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:24.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 -- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcff4158170 msgr2=0x7fcff413f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.110 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcff4158170 0x7fcff413f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 -- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 msgr2=0x7fcff4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 0x7fcff4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 -- 172.21.15.150:0/2734209716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8009310 con 0x7fcff4068bf0 2022-08-10T17:55:24.111 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff2ffd700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c390 tx=0x7fcfe400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:24.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40072d0 con 0x7fcff4068bf0 2022-08-10T17:55:24.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4007450 con 0x7fcff4068bf0 2022-08-10T17:55:24.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40058f0 con 0x7fcff4068bf0 2022-08-10T17:55:24.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff415a490 con 0x7fcff4068bf0 2022-08-10T17:55:24.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.090+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff41ecc50 con 0x7fcff4068bf0 2022-08-10T17:55:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.091+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff415a9b0 con 0x7fcff4068bf0 2022-08-10T17:55:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.092+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcfe4019030 con 0x7fcff4068bf0 2022-08-10T17:55:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.092+0000 7fcfdbfff700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 0x7fcfd4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:24.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.092+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fcfe40812e0 con 0x7fcff4068bf0 2022-08-10T17:55:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.092+0000 7fcff27fc700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 0x7fcfd4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:24.114 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.093+0000 7fcff27fc700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 0x7fcfd4067590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80090b0 tx=0x7fcfe801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:24.115 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.096+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcff415a9b0 con 0x7fcff4068bf0 2022-08-10T17:55:24.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.278+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcff415a9b0 con 0x7fcfd40650e0 2022-08-10T17:55:24.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.288+0000 7fcfdbfff700 1 -- 172.21.15.150:0/2734209716 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389853 (secure 0 0 0) 0x7fcff415a9b0 con 0x7fcfd40650e0 2022-08-10T17:55:24.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 msgr2=0x7fcfd4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 0x7fcfd4067590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80090b0 tx=0x7fcfe801c040 comp rx=0 tx=0).stop 2022-08-10T17:55:24.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 msgr2=0x7fcff41ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:24.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c390 tx=0x7fcfe400c6a0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 shutdown_connections 2022-08-10T17:55:24.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcfd40650e0 0x7fcfd4067590 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcff4158170 0x7fcff413f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcff4068bf0 0x7fcff41ed450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 --2- 172.21.15.150:0/2734209716 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcff4151290 0x7fcff4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:24.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.292+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 >> 172.21.15.150:0/2734209716 conn(0x7fcff406f880 msgr2=0x7fcff4158650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:24.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.293+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 shutdown_connections 2022-08-10T17:55:24.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:24.293+0000 7fcff9957700 1 -- 172.21.15.150:0/2734209716 wait complete. 2022-08-10T17:55:24.303 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:55:24.311 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2022-08-10T17:55:23.798746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152550,"ondisk_log_size":152550,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261360,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4238784,"kb_avail":750713360,"statfs":{"total":773094113280,"available":768730480640,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340514816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,62,40,119],"upper_bound":256},"perf_stat":{"commit_latency_ms":151,"apply_latency_ms":151,"commit_latency_ns":151000000,"apply_latency_ns":151000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":639,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.118282"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.531304+0000","last_change":"2022-08-10T17:35:37.408224+0000","last_active":"2022-08-10T17:55:16.531304+0000","last_peered":"2022-08-10T17:55:16.531304+0000","last_clean":"2022-08-10T17:55:16.531304+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:16.531304+0000","last_undegraded":"2022-08-10T17:55:16.531304+0000","last_fullsized":"2022-08-10T17:55:16.531304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.544593+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:55:16.544593+0000","last_peered":"2022-08-10T17:55:16.544593+0000","last_clean":"2022-08-10T17:55:16.544593+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:16.544593+0000","last_undegraded":"2022-08-10T17:55:16.544593+0000","last_fullsized":"2022-08-10T17:55:16.544593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:48:01.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548419+0000","last_change":"2022-08-10T17:35:37.409302+0000","last_active":"2022-08-10T17:55:16.548419+0000","last_peered":"2022-08-10T17:55:16.548419+0000","last_clean":"2022-08-10T17:55:16.548419+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:16.548419+0000","last_undegraded":"2022-08-10T17:55:16.548419+0000","last_fullsized":"2022-08-10T17:55:16.548419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:04:22.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547841+0000","last_change":"2022-08-10T17:35:37.414236+0000","last_active":"2022-08-10T17:55:16.547841+0000","last_peered":"2022-08-10T17:55:16.547841+0000","last_clean":"2022-08-10T17:55:16.547841+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:16.547841+0000","last_undegraded":"2022-08-10T17:55:16.547841+0000","last_fullsized":"2022-08-10T17:55:16.547841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:07:54.621552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.541917+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:55:16.541917+0000","last_peered":"2022-08-10T17:55:16.541917+0000","last_clean":"2022-08-10T17:55:16.541917+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:16.541917+0000","last_undegraded":"2022-08-10T17:55:16.541917+0000","last_fullsized":"2022-08-10T17:55:16.541917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:27:44.463327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.543374+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:55:16.543374+0000","last_peered":"2022-08-10T17:55:16.543374+0000","last_clean":"2022-08-10T17:55:16.543374+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:55:16.543374+0000","last_undegraded":"2022-08-10T17:55:16.543374+0000","last_fullsized":"2022-08-10T17:55:16.543374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:27:59.338957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549244+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:55:16.549244+0000","last_peered":"2022-08-10T17:55:16.549244+0000","last_clean":"2022-08-10T17:55:16.549244+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:55:16.549244+0000","last_undegraded":"2022-08-10T17:55:16.549244+0000","last_fullsized":"2022-08-10T17:55:16.549244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:47:39.028735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.543712+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:55:16.543712+0000","last_peered":"2022-08-10T17:55:16.543712+0000","last_clean":"2022-08-10T17:55:16.543712+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:16.543712+0000","last_undegraded":"2022-08-10T17:55:16.543712+0000","last_fullsized":"2022-08-10T17:55:16.543712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:43:09.927704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.541845+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:55:16.541845+0000","last_peered":"2022-08-10T17:55:16.541845+0000","last_clean":"2022-08-10T17:55:16.541845+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:16.541845+0000","last_undegraded":"2022-08-10T17:55:16.541845+0000","last_fullsized":"2022-08-10T17:55:16.541845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:32:24.167421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.544799+0000","last_change":"2022-08-10T17:35:37.411661+0000","last_active":"2022-08-10T17:55:16.544799+0000","last_peered":"2022-08-10T17:55:16.544799+0000","last_clean":"2022-08-10T17:55:16.544799+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:16.544799+0000","last_undegraded":"2022-08-10T17:55:16.544799+0000","last_fullsized":"2022-08-10T17:55:16.544799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:28.284649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549318+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:55:16.549318+0000","last_peered":"2022-08-10T17:55:16.549318+0000","last_clean":"2022-08-10T17:55:16.549318+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:16.549318+0000","last_undegraded":"2022-08-10T17:55:16.549318+0000","last_fullsized":"2022-08-10T17:55:16.549318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:12:50.792948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527961+0000","last_change":"2022-08-10T17:35:37.410665+0000","last_active":"2022-08-10T17:55:16.527961+0000","last_peered":"2022-08-10T17:55:16.527961+0000","last_clean":"2022-08-10T17:55:16.527961+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:16.527961+0000","last_undegraded":"2022-08-10T17:55:16.527961+0000","last_fullsized":"2022-08-10T17:55:16.527961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.531220+0000","last_change":"2022-08-10T17:35:37.406195+0000","last_active":"2022-08-10T17:55:16.531220+0000","last_peered":"2022-08-10T17:55:16.531220+0000","last_clean":"2022-08-10T17:55:16.531220+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:16.531220+0000","last_undegraded":"2022-08-10T17:55:16.531220+0000","last_fullsized":"2022-08-10T17:55:16.531220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.518585+0000","last_change":"2022-08-10T17:35:37.409763+0000","last_active":"2022-08-10T17:55:16.518585+0000","last_peered":"2022-08-10T17:55:16.518585+0000","last_clean":"2022-08-10T17:55:16.518585+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:16.518585+0000","last_undegraded":"2022-08-10T17:55:16.518585+0000","last_fullsized":"2022-08-10T17:55:16.518585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:37.602882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549328+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:55:16.549328+0000","last_peered":"2022-08-10T17:55:16.549328+0000","last_clean":"2022-08-10T17:55:16.549328+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:55:16.549328+0000","last_undegraded":"2022-08-10T17:55:16.549328+0000","last_fullsized":"2022-08-10T17:55:16.549328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:05:16.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.543595+0000","last_change":"2022-08-10T17:35:37.411141+0000","last_active":"2022-08-10T17:55:16.543595+0000","last_peered":"2022-08-10T17:55:16.543595+0000","last_clean":"2022-08-10T17:55:16.543595+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:16.543595+0000","last_undegraded":"2022-08-10T17:55:16.543595+0000","last_fullsized":"2022-08-10T17:55:16.543595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:29.253473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.541653+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:55:16.541653+0000","last_peered":"2022-08-10T17:55:16.541653+0000","last_clean":"2022-08-10T17:55:16.541653+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:16.541653+0000","last_undegraded":"2022-08-10T17:55:16.541653+0000","last_fullsized":"2022-08-10T17:55:16.541653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:31:28.367399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527818+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:55:16.527818+0000","last_peered":"2022-08-10T17:55:16.527818+0000","last_clean":"2022-08-10T17:55:16.527818+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:16.527818+0000","last_undegraded":"2022-08-10T17:55:16.527818+0000","last_fullsized":"2022-08-10T17:55:16.527818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:45:22.348955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535043+0000","last_change":"2022-08-10T17:35:37.417686+0000","last_active":"2022-08-10T17:55:16.535043+0000","last_peered":"2022-08-10T17:55:16.535043+0000","last_clean":"2022-08-10T17:55:16.535043+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:16.535043+0000","last_undegraded":"2022-08-10T17:55:16.535043+0000","last_fullsized":"2022-08-10T17:55:16.535043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536049+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:55:16.536049+0000","last_peered":"2022-08-10T17:55:16.536049+0000","last_clean":"2022-08-10T17:55:16.536049+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:55:16.536049+0000","last_undegraded":"2022-08-10T17:55:16.536049+0000","last_fullsized":"2022-08-10T17:55:16.536049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:44:48.232233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535492+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:55:16.535492+0000","last_peered":"2022-08-10T17:55:16.535492+0000","last_clean":"2022-08-10T17:55:16.535492+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:55:16.535492+0000","last_undegraded":"2022-08-10T17:55:16.535492+0000","last_fullsized":"2022-08-10T17:55:16.535492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:46:11.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550882+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:55:16.550882+0000","last_peered":"2022-08-10T17:55:16.550882+0000","last_clean":"2022-08-10T17:55:16.550882+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:16.550882+0000","last_undegraded":"2022-08-10T17:55:16.550882+0000","last_fullsized":"2022-08-10T17:55:16.550882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:34:48.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547359+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:55:16.547359+0000","last_peered":"2022-08-10T17:55:16.547359+0000","last_clean":"2022-08-10T17:55:16.547359+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:16.547359+0000","last_undegraded":"2022-08-10T17:55:16.547359+0000","last_fullsized":"2022-08-10T17:55:16.547359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533494+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:55:16.533494+0000","last_peered":"2022-08-10T17:55:16.533494+0000","last_clean":"2022-08-10T17:55:16.533494+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:55:16.533494+0000","last_undegraded":"2022-08-10T17:55:16.533494+0000","last_fullsized":"2022-08-10T17:55:16.533494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:09:53.965504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.529411+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:55:16.529411+0000","last_peered":"2022-08-10T17:55:16.529411+0000","last_clean":"2022-08-10T17:55:16.529411+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:16.529411+0000","last_undegraded":"2022-08-10T17:55:16.529411+0000","last_fullsized":"2022-08-10T17:55:16.529411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.542397+0000","last_change":"2022-08-10T17:35:37.410167+0000","last_active":"2022-08-10T17:55:16.542397+0000","last_peered":"2022-08-10T17:55:16.542397+0000","last_clean":"2022-08-10T17:55:16.542397+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:16.542397+0000","last_undegraded":"2022-08-10T17:55:16.542397+0000","last_fullsized":"2022-08-10T17:55:16.542397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.526322+0000","last_change":"2022-08-10T17:35:37.410002+0000","last_active":"2022-08-10T17:55:16.526322+0000","last_peered":"2022-08-10T17:55:16.526322+0000","last_clean":"2022-08-10T17:55:16.526322+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:16.526322+0000","last_undegraded":"2022-08-10T17:55:16.526322+0000","last_fullsized":"2022-08-10T17:55:16.526322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:07:47.486627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4457,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.234292+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.234292+0000","last_peered":"2022-08-10T17:54:42.234292+0000","last_clean":"2022-08-10T17:54:42.234292+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.234292+0000","last_undegraded":"2022-08-10T17:54:42.234292+0000","last_fullsized":"2022-08-10T17:54:42.234292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:31.036262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.118864+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.118864+0000","last_peered":"2022-08-10T17:54:42.118864+0000","last_clean":"2022-08-10T17:54:42.118864+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.118864+0000","last_undegraded":"2022-08-10T17:54:42.118864+0000","last_fullsized":"2022-08-10T17:54:42.118864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:29:30.784442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.553465+0000","last_change":"2022-08-10T17:35:37.417871+0000","last_active":"2022-08-10T17:55:16.553465+0000","last_peered":"2022-08-10T17:55:16.553465+0000","last_clean":"2022-08-10T17:55:16.553465+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:16.553465+0000","last_undegraded":"2022-08-10T17:55:16.553465+0000","last_fullsized":"2022-08-10T17:55:16.553465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4707,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.914053+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:54:42.914053+0000","last_peered":"2022-08-10T17:54:42.914053+0000","last_clean":"2022-08-10T17:54:42.914053+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:54:42.914053+0000","last_undegraded":"2022-08-10T17:54:42.914053+0000","last_fullsized":"2022-08-10T17:54:42.914053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:45:32.163440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085177+0000","last_change":"2022-08-10T17:35:37.026279+0000","last_active":"2022-08-10T17:54:43.085177+0000","last_peered":"2022-08-10T17:54:43.085177+0000","last_clean":"2022-08-10T17:54:43.085177+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:54:43.085177+0000","last_undegraded":"2022-08-10T17:54:43.085177+0000","last_fullsized":"2022-08-10T17:54:43.085177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.542049+0000","last_change":"2022-08-10T17:35:37.413449+0000","last_active":"2022-08-10T17:55:16.542049+0000","last_peered":"2022-08-10T17:55:16.542049+0000","last_clean":"2022-08-10T17:55:16.542049+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:16.542049+0000","last_undegraded":"2022-08-10T17:55:16.542049+0000","last_fullsized":"2022-08-10T17:55:16.542049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:46:31.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4367,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.875031+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:42.875031+0000","last_peered":"2022-08-10T17:54:42.875031+0000","last_clean":"2022-08-10T17:54:42.875031+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:42.875031+0000","last_undegraded":"2022-08-10T17:54:42.875031+0000","last_fullsized":"2022-08-10T17:54:42.875031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:43:03.342385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.858771+0000","last_change":"2022-08-10T17:35:37.024820+0000","last_active":"2022-08-10T17:37:58.858771+0000","last_peered":"2022-08-10T17:37:58.858771+0000","last_clean":"2022-08-10T17:37:58.858771+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:37:58.858771+0000","last_undegraded":"2022-08-10T17:37:58.858771+0000","last_fullsized":"2022-08-10T17:37:58.858771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545814+0000","last_change":"2022-08-10T17:35:37.412783+0000","last_active":"2022-08-10T17:55:16.545814+0000","last_peered":"2022-08-10T17:55:16.545814+0000","last_clean":"2022-08-10T17:55:16.545814+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:16.545814+0000","last_undegraded":"2022-08-10T17:55:16.545814+0000","last_fullsized":"2022-08-10T17:55:16.545814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:41.032197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.013544+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:54:43.013544+0000","last_peered":"2022-08-10T17:54:43.013544+0000","last_clean":"2022-08-10T17:54:43.013544+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:54:43.013544+0000","last_undegraded":"2022-08-10T17:54:43.013544+0000","last_fullsized":"2022-08-10T17:54:43.013544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:07.120761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'63","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709246+0000","last_change":"2022-08-10T17:35:37.025891+0000","last_active":"2022-08-10T17:54:42.709246+0000","last_peered":"2022-08-10T17:54:42.709246+0000","last_clean":"2022-08-10T17:54:42.709246+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:54:42.709246+0000","last_undegraded":"2022-08-10T17:54:42.709246+0000","last_fullsized":"2022-08-10T17:54:42.709246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:52.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549999+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:55:16.549999+0000","last_peered":"2022-08-10T17:55:16.549999+0000","last_clean":"2022-08-10T17:55:16.549999+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:55:16.549999+0000","last_undegraded":"2022-08-10T17:55:16.549999+0000","last_fullsized":"2022-08-10T17:55:16.549999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4171,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.978723+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:42.978723+0000","last_peered":"2022-08-10T17:54:42.978723+0000","last_clean":"2022-08-10T17:54:42.978723+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:42.978723+0000","last_undegraded":"2022-08-10T17:54:42.978723+0000","last_fullsized":"2022-08-10T17:54:42.978723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:39.312712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:37:58.859567+0000","last_change":"2022-08-10T17:35:37.023241+0000","last_active":"2022-08-10T17:37:58.859567+0000","last_peered":"2022-08-10T17:37:58.859567+0000","last_clean":"2022-08-10T17:37:58.859567+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:37:58.859567+0000","last_undegraded":"2022-08-10T17:37:58.859567+0000","last_fullsized":"2022-08-10T17:37:58.859567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:25:06.370123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535384+0000","last_change":"2022-08-10T17:35:37.414180+0000","last_active":"2022-08-10T17:55:16.535384+0000","last_peered":"2022-08-10T17:55:16.535384+0000","last_clean":"2022-08-10T17:55:16.535384+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:16.535384+0000","last_undegraded":"2022-08-10T17:55:16.535384+0000","last_fullsized":"2022-08-10T17:55:16.535384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5939,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.038487+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:43.038487+0000","last_peered":"2022-08-10T17:54:43.038487+0000","last_clean":"2022-08-10T17:54:43.038487+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:43.038487+0000","last_undegraded":"2022-08-10T17:54:43.038487+0000","last_fullsized":"2022-08-10T17:54:43.038487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'21","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.397147+0000","last_change":"2022-08-10T17:35:37.025466+0000","last_active":"2022-08-10T17:54:43.397147+0000","last_peered":"2022-08-10T17:54:43.397147+0000","last_clean":"2022-08-10T17:54:43.397147+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:54:43.397147+0000","last_undegraded":"2022-08-10T17:54:43.397147+0000","last_fullsized":"2022-08-10T17:54:43.397147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:22:46.943820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548200+0000","last_change":"2022-08-10T17:35:37.417786+0000","last_active":"2022-08-10T17:55:16.548200+0000","last_peered":"2022-08-10T17:55:16.548200+0000","last_clean":"2022-08-10T17:55:16.548200+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:16.548200+0000","last_undegraded":"2022-08-10T17:55:16.548200+0000","last_fullsized":"2022-08-10T17:55:16.548200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4199,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.983753+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:54:42.983753+0000","last_peered":"2022-08-10T17:54:42.983753+0000","last_clean":"2022-08-10T17:54:42.983753+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:54:42.983753+0000","last_undegraded":"2022-08-10T17:54:42.983753+0000","last_fullsized":"2022-08-10T17:54:42.983753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'306","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.862001+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:54:42.862001+0000","last_peered":"2022-08-10T17:54:42.862001+0000","last_clean":"2022-08-10T17:54:42.862001+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:54:42.862001+0000","last_undegraded":"2022-08-10T17:54:42.862001+0000","last_fullsized":"2022-08-10T17:54:42.862001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:06.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536407+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:55:16.536407+0000","last_peered":"2022-08-10T17:55:16.536407+0000","last_clean":"2022-08-10T17:55:16.536407+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:55:16.536407+0000","last_undegraded":"2022-08-10T17:55:16.536407+0000","last_fullsized":"2022-08-10T17:55:16.536407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:12.626254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5817,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.411690+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.411690+0000","last_peered":"2022-08-10T17:54:42.411690+0000","last_clean":"2022-08-10T17:54:42.411690+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.411690+0000","last_undegraded":"2022-08-10T17:54:42.411690+0000","last_fullsized":"2022-08-10T17:54:42.411690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:05.631607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:38:04.887295+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:38:04.887295+0000","last_peered":"2022-08-10T17:38:04.887295+0000","last_clean":"2022-08-10T17:38:04.887295+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:38:04.887295+0000","last_undegraded":"2022-08-10T17:38:04.887295+0000","last_fullsized":"2022-08-10T17:38:04.887295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:59:30.159835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549994+0000","last_change":"2022-08-10T17:35:37.417756+0000","last_active":"2022-08-10T17:55:16.549994+0000","last_peered":"2022-08-10T17:55:16.549994+0000","last_clean":"2022-08-10T17:55:16.549994+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:16.549994+0000","last_undegraded":"2022-08-10T17:55:16.549994+0000","last_fullsized":"2022-08-10T17:55:16.549994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4272,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.474553+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:54:42.474553+0000","last_peered":"2022-08-10T17:54:42.474553+0000","last_clean":"2022-08-10T17:54:42.474553+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:54:42.474553+0000","last_undegraded":"2022-08-10T17:54:42.474553+0000","last_fullsized":"2022-08-10T17:54:42.474553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794257+0000","last_change":"2022-08-10T17:35:37.025742+0000","last_active":"2022-08-10T17:54:42.794257+0000","last_peered":"2022-08-10T17:54:42.794257+0000","last_clean":"2022-08-10T17:54:42.794257+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:54:42.794257+0000","last_undegraded":"2022-08-10T17:54:42.794257+0000","last_fullsized":"2022-08-10T17:54:42.794257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:08:02.846044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.526492+0000","last_change":"2022-08-10T17:35:37.413388+0000","last_active":"2022-08-10T17:55:16.526492+0000","last_peered":"2022-08-10T17:55:16.526492+0000","last_clean":"2022-08-10T17:55:16.526492+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:16.526492+0000","last_undegraded":"2022-08-10T17:55:16.526492+0000","last_fullsized":"2022-08-10T17:55:16.526492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:55.630056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.526055+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:54:42.526055+0000","last_peered":"2022-08-10T17:54:42.526055+0000","last_clean":"2022-08-10T17:54:42.526055+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:54:42.526055+0000","last_undegraded":"2022-08-10T17:54:42.526055+0000","last_fullsized":"2022-08-10T17:54:42.526055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'302","reported_seq":318,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.686364+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:54:42.686364+0000","last_peered":"2022-08-10T17:54:42.686364+0000","last_clean":"2022-08-10T17:54:42.686364+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:54:42.686364+0000","last_undegraded":"2022-08-10T17:54:42.686364+0000","last_fullsized":"2022-08-10T17:54:42.686364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:53:13.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.541311+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:55:16.541311+0000","last_peered":"2022-08-10T17:55:16.541311+0000","last_clean":"2022-08-10T17:55:16.541311+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:55:16.541311+0000","last_undegraded":"2022-08-10T17:55:16.541311+0000","last_fullsized":"2022-08-10T17:55:16.541311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:55.662077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4919,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.775714+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:54:42.775714+0000","last_peered":"2022-08-10T17:54:42.775714+0000","last_clean":"2022-08-10T17:54:42.775714+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:54:42.775714+0000","last_undegraded":"2022-08-10T17:54:42.775714+0000","last_fullsized":"2022-08-10T17:54:42.775714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:03:05.369181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.794349+0000","last_change":"2022-08-10T17:35:37.029198+0000","last_active":"2022-08-10T17:54:42.794349+0000","last_peered":"2022-08-10T17:54:42.794349+0000","last_clean":"2022-08-10T17:54:42.794349+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:54:42.794349+0000","last_undegraded":"2022-08-10T17:54:42.794349+0000","last_fullsized":"2022-08-10T17:54:42.794349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:50:39.468113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527661+0000","last_change":"2022-08-10T17:35:37.412283+0000","last_active":"2022-08-10T17:55:16.527661+0000","last_peered":"2022-08-10T17:55:16.527661+0000","last_clean":"2022-08-10T17:55:16.527661+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:16.527661+0000","last_undegraded":"2022-08-10T17:55:16.527661+0000","last_fullsized":"2022-08-10T17:55:16.527661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5306,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.823506+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.823506+0000","last_peered":"2022-08-10T17:54:42.823506+0000","last_clean":"2022-08-10T17:54:42.823506+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.823506+0000","last_undegraded":"2022-08-10T17:54:42.823506+0000","last_fullsized":"2022-08-10T17:54:42.823506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:24:56.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'45","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:19.999725+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:54:19.999725+0000","last_peered":"2022-08-10T17:54:19.999725+0000","last_clean":"2022-08-10T17:54:19.999725+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:54:19.999725+0000","last_undegraded":"2022-08-10T17:54:19.999725+0000","last_fullsized":"2022-08-10T17:54:19.999725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:32.248015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527956+0000","last_change":"2022-08-10T17:35:37.409985+0000","last_active":"2022-08-10T17:55:16.527956+0000","last_peered":"2022-08-10T17:55:16.527956+0000","last_clean":"2022-08-10T17:55:16.527956+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:16.527956+0000","last_undegraded":"2022-08-10T17:55:16.527956+0000","last_fullsized":"2022-08-10T17:55:16.527956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:22:24.235140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4367,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.042831+0000","last_change":"2022-08-10T17:35:41.444115+0000","last_active":"2022-08-10T17:54:43.042831+0000","last_peered":"2022-08-10T17:54:43.042831+0000","last_clean":"2022-08-10T17:54:43.042831+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:54:43.042831+0000","last_undegraded":"2022-08-10T17:54:43.042831+0000","last_fullsized":"2022-08-10T17:54:43.042831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.527905+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:39:02.527905+0000","last_peered":"2022-08-10T17:39:02.527905+0000","last_clean":"2022-08-10T17:39:02.527905+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:39:02.527905+0000","last_undegraded":"2022-08-10T17:39:02.527905+0000","last_fullsized":"2022-08-10T17:39:02.527905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:58:22.922578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546197+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:55:16.546197+0000","last_peered":"2022-08-10T17:55:16.546197+0000","last_clean":"2022-08-10T17:55:16.546197+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:55:16.546197+0000","last_undegraded":"2022-08-10T17:55:16.546197+0000","last_fullsized":"2022-08-10T17:55:16.546197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:19:20.384934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4695,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.886773+0000","last_change":"2022-08-10T17:35:41.445300+0000","last_active":"2022-08-10T17:54:42.886773+0000","last_peered":"2022-08-10T17:54:42.886773+0000","last_clean":"2022-08-10T17:54:42.886773+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:54:42.886773+0000","last_undegraded":"2022-08-10T17:54:42.886773+0000","last_fullsized":"2022-08-10T17:54:42.886773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:41.849623+0000","last_change":"2022-08-10T17:35:37.022784+0000","last_active":"2022-08-10T17:39:41.849623+0000","last_peered":"2022-08-10T17:39:41.849623+0000","last_clean":"2022-08-10T17:39:41.849623+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:39:41.849623+0000","last_undegraded":"2022-08-10T17:39:41.849623+0000","last_fullsized":"2022-08-10T17:39:41.849623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:27:29.221802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.545652+0000","last_change":"2022-08-10T17:35:37.416201+0000","last_active":"2022-08-10T17:55:16.545652+0000","last_peered":"2022-08-10T17:55:16.545652+0000","last_clean":"2022-08-10T17:55:16.545652+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:16.545652+0000","last_undegraded":"2022-08-10T17:55:16.545652+0000","last_fullsized":"2022-08-10T17:55:16.545652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:19:54.510248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3819,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.019206+0000","last_change":"2022-08-10T17:35:41.433348+0000","last_active":"2022-08-10T17:54:43.019206+0000","last_peered":"2022-08-10T17:54:43.019206+0000","last_clean":"2022-08-10T17:54:43.019206+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:54:43.019206+0000","last_undegraded":"2022-08-10T17:54:43.019206+0000","last_fullsized":"2022-08-10T17:54:43.019206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.919068+0000","last_change":"2022-08-10T17:35:37.023820+0000","last_active":"2022-08-10T17:39:18.919068+0000","last_peered":"2022-08-10T17:39:18.919068+0000","last_clean":"2022-08-10T17:39:18.919068+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:39:18.919068+0000","last_undegraded":"2022-08-10T17:39:18.919068+0000","last_fullsized":"2022-08-10T17:39:18.919068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:45:28.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550074+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:55:16.550074+0000","last_peered":"2022-08-10T17:55:16.550074+0000","last_clean":"2022-08-10T17:55:16.550074+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:55:16.550074+0000","last_undegraded":"2022-08-10T17:55:16.550074+0000","last_fullsized":"2022-08-10T17:55:16.550074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:06:18.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3293,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.260780+0000","last_change":"2022-08-10T17:35:41.430601+0000","last_active":"2022-08-10T17:54:42.260780+0000","last_peered":"2022-08-10T17:54:42.260780+0000","last_clean":"2022-08-10T17:54:42.260780+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:54:42.260780+0000","last_undegraded":"2022-08-10T17:54:42.260780+0000","last_fullsized":"2022-08-10T17:54:42.260780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'333","reported_seq":350,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.382634+0000","last_change":"2022-08-10T17:35:37.027397+0000","last_active":"2022-08-10T17:55:17.382634+0000","last_peered":"2022-08-10T17:55:17.382634+0000","last_clean":"2022-08-10T17:55:17.382634+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:17.382634+0000","last_undegraded":"2022-08-10T17:55:17.382634+0000","last_fullsized":"2022-08-10T17:55:17.382634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534948+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:55:16.534948+0000","last_peered":"2022-08-10T17:55:16.534948+0000","last_clean":"2022-08-10T17:55:16.534948+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:16.534948+0000","last_undegraded":"2022-08-10T17:55:16.534948+0000","last_fullsized":"2022-08-10T17:55:16.534948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:52:45.166623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5061,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.072410+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:54:43.072410+0000","last_peered":"2022-08-10T17:54:43.072410+0000","last_clean":"2022-08-10T17:54:43.072410+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:54:43.072410+0000","last_undegraded":"2022-08-10T17:54:43.072410+0000","last_fullsized":"2022-08-10T17:54:43.072410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'55","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.387180+0000","last_change":"2022-08-10T17:35:37.028439+0000","last_active":"2022-08-10T17:54:42.387180+0000","last_peered":"2022-08-10T17:54:42.387180+0000","last_clean":"2022-08-10T17:54:42.387180+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:54:42.387180+0000","last_undegraded":"2022-08-10T17:54:42.387180+0000","last_fullsized":"2022-08-10T17:54:42.387180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:41:13.524388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.529373+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:55:16.529373+0000","last_peered":"2022-08-10T17:55:16.529373+0000","last_clean":"2022-08-10T17:55:16.529373+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:16.529373+0000","last_undegraded":"2022-08-10T17:55:16.529373+0000","last_fullsized":"2022-08-10T17:55:16.529373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:53:57.814728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6353,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.572490+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.572490+0000","last_peered":"2022-08-10T17:54:42.572490+0000","last_clean":"2022-08-10T17:54:42.572490+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.572490+0000","last_undegraded":"2022-08-10T17:54:42.572490+0000","last_fullsized":"2022-08-10T17:54:42.572490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:39:13.074894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:23.787138+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:23.787138+0000","last_peered":"2022-08-10T17:54:23.787138+0000","last_clean":"2022-08-10T17:54:23.787138+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:23.787138+0000","last_undegraded":"2022-08-10T17:54:23.787138+0000","last_fullsized":"2022-08-10T17:54:23.787138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:24:20.203992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533839+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:55:16.533839+0000","last_peered":"2022-08-10T17:55:16.533839+0000","last_clean":"2022-08-10T17:55:16.533839+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:55:16.533839+0000","last_undegraded":"2022-08-10T17:55:16.533839+0000","last_fullsized":"2022-08-10T17:55:16.533839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:17:49.648686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6045,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709336+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:42.709336+0000","last_peered":"2022-08-10T17:54:42.709336+0000","last_clean":"2022-08-10T17:54:42.709336+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:42.709336+0000","last_undegraded":"2022-08-10T17:54:42.709336+0000","last_fullsized":"2022-08-10T17:54:42.709336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:34:42.108902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.083514+0000","last_change":"2022-08-10T17:35:37.019987+0000","last_active":"2022-08-10T17:54:43.083514+0000","last_peered":"2022-08-10T17:54:43.083514+0000","last_clean":"2022-08-10T17:54:43.083514+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:54:43.083514+0000","last_undegraded":"2022-08-10T17:54:43.083514+0000","last_fullsized":"2022-08-10T17:54:43.083514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548068+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:55:16.548068+0000","last_peered":"2022-08-10T17:55:16.548068+0000","last_clean":"2022-08-10T17:55:16.548068+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:16.548068+0000","last_undegraded":"2022-08-10T17:55:16.548068+0000","last_fullsized":"2022-08-10T17:55:16.548068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4544,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.330973+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.330973+0000","last_peered":"2022-08-10T17:54:42.330973+0000","last_clean":"2022-08-10T17:54:42.330973+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.330973+0000","last_undegraded":"2022-08-10T17:54:42.330973+0000","last_fullsized":"2022-08-10T17:54:42.330973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:32:43.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.840772+0000","last_change":"2022-08-10T17:35:37.023620+0000","last_active":"2022-08-10T17:54:42.840772+0000","last_peered":"2022-08-10T17:54:42.840772+0000","last_clean":"2022-08-10T17:54:42.840772+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:54:42.840772+0000","last_undegraded":"2022-08-10T17:54:42.840772+0000","last_fullsized":"2022-08-10T17:54:42.840772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:10:05.009815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.517721+0000","last_change":"2022-08-10T17:35:37.414476+0000","last_active":"2022-08-10T17:55:16.517721+0000","last_peered":"2022-08-10T17:55:16.517721+0000","last_clean":"2022-08-10T17:55:16.517721+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:16.517721+0000","last_undegraded":"2022-08-10T17:55:16.517721+0000","last_fullsized":"2022-08-10T17:55:16.517721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4359,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.960673+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:42.960673+0000","last_peered":"2022-08-10T17:54:42.960673+0000","last_clean":"2022-08-10T17:54:42.960673+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:42.960673+0000","last_undegraded":"2022-08-10T17:54:42.960673+0000","last_fullsized":"2022-08-10T17:54:42.960673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:42:58.412230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673817+0000","last_change":"2022-08-10T17:35:31.995206+0000","last_active":"2022-08-10T17:36:17.673817+0000","last_peered":"2022-08-10T17:36:17.673817+0000","last_clean":"2022-08-10T17:36:17.673817+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:36:17.673817+0000","last_undegraded":"2022-08-10T17:36:17.673817+0000","last_fullsized":"2022-08-10T17:36:17.673817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:03:54.922060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:24.660704+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:24.660704+0000","last_peered":"2022-08-10T17:54:24.660704+0000","last_clean":"2022-08-10T17:54:24.660704+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:24.660704+0000","last_undegraded":"2022-08-10T17:54:24.660704+0000","last_fullsized":"2022-08-10T17:54:24.660704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:00:52.609477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.309023+0000","last_change":"2022-08-10T17:35:37.414491+0000","last_active":"2022-08-10T17:55:17.309023+0000","last_peered":"2022-08-10T17:55:17.309023+0000","last_clean":"2022-08-10T17:55:17.309023+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:17.309023+0000","last_undegraded":"2022-08-10T17:55:17.309023+0000","last_fullsized":"2022-08-10T17:55:17.309023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4660,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.889667+0000","last_change":"2022-08-10T17:35:41.437068+0000","last_active":"2022-08-10T17:54:42.889667+0000","last_peered":"2022-08-10T17:54:42.889667+0000","last_clean":"2022-08-10T17:54:42.889667+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:54:42.889667+0000","last_undegraded":"2022-08-10T17:54:42.889667+0000","last_fullsized":"2022-08-10T17:54:42.889667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.676409+0000","last_change":"2022-08-10T17:35:31.987034+0000","last_active":"2022-08-10T17:36:18.676409+0000","last_peered":"2022-08-10T17:36:18.676409+0000","last_clean":"2022-08-10T17:36:18.676409+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:36:18.676409+0000","last_undegraded":"2022-08-10T17:36:18.676409+0000","last_fullsized":"2022-08-10T17:36:18.676409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.818216+0000","last_change":"2022-08-10T17:35:37.021027+0000","last_active":"2022-08-10T17:54:42.818216+0000","last_peered":"2022-08-10T17:54:42.818216+0000","last_clean":"2022-08-10T17:54:42.818216+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:54:42.818216+0000","last_undegraded":"2022-08-10T17:54:42.818216+0000","last_fullsized":"2022-08-10T17:54:42.818216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546660+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:55:16.546660+0000","last_peered":"2022-08-10T17:55:16.546660+0000","last_clean":"2022-08-10T17:55:16.546660+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:16.546660+0000","last_undegraded":"2022-08-10T17:55:16.546660+0000","last_fullsized":"2022-08-10T17:55:16.546660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4786,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.967437+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:42.967437+0000","last_peered":"2022-08-10T17:54:42.967437+0000","last_clean":"2022-08-10T17:54:42.967437+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:42.967437+0000","last_undegraded":"2022-08-10T17:54:42.967437+0000","last_fullsized":"2022-08-10T17:54:42.967437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:25:56.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.673889+0000","last_change":"2022-08-10T17:35:31.995628+0000","last_active":"2022-08-10T17:36:17.673889+0000","last_peered":"2022-08-10T17:36:17.673889+0000","last_clean":"2022-08-10T17:36:17.673889+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:36:17.673889+0000","last_undegraded":"2022-08-10T17:36:17.673889+0000","last_fullsized":"2022-08-10T17:36:17.673889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:11:49.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690109+0000","last_change":"2022-08-10T17:35:29.539042+0000","last_active":"2022-08-10T17:36:17.690109+0000","last_peered":"2022-08-10T17:36:17.690109+0000","last_clean":"2022-08-10T17:36:17.690109+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:36:17.690109+0000","last_undegraded":"2022-08-10T17:36:17.690109+0000","last_fullsized":"2022-08-10T17:36:17.690109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:27.938973+0000","last_clean_scrub_stamp":"2022-08-10T17:35:27.938973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:17:52.761362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:12.574952+0000","last_change":"2022-08-10T17:35:37.023361+0000","last_active":"2022-08-10T17:39:12.574952+0000","last_peered":"2022-08-10T17:39:12.574952+0000","last_clean":"2022-08-10T17:39:12.574952+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:39:12.574952+0000","last_undegraded":"2022-08-10T17:39:12.574952+0000","last_fullsized":"2022-08-10T17:39:12.574952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527672+0000","last_change":"2022-08-10T17:35:37.417450+0000","last_active":"2022-08-10T17:55:16.527672+0000","last_peered":"2022-08-10T17:55:16.527672+0000","last_clean":"2022-08-10T17:55:16.527672+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:16.527672+0000","last_undegraded":"2022-08-10T17:55:16.527672+0000","last_fullsized":"2022-08-10T17:55:16.527672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:15:22.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.882397+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.882397+0000","last_peered":"2022-08-10T17:54:42.882397+0000","last_clean":"2022-08-10T17:54:42.882397+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.882397+0000","last_undegraded":"2022-08-10T17:54:42.882397+0000","last_fullsized":"2022-08-10T17:54:42.882397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:11:16.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690309+0000","last_change":"2022-08-10T17:35:31.995168+0000","last_active":"2022-08-10T17:36:17.690309+0000","last_peered":"2022-08-10T17:36:17.690309+0000","last_clean":"2022-08-10T17:36:17.690309+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:36:17.690309+0000","last_undegraded":"2022-08-10T17:36:17.690309+0000","last_fullsized":"2022-08-10T17:36:17.690309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:56:04.281120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'82","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.092311+0000","last_change":"2022-08-10T17:35:37.032738+0000","last_active":"2022-08-10T17:54:43.092311+0000","last_peered":"2022-08-10T17:54:43.092311+0000","last_clean":"2022-08-10T17:54:43.092311+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:54:43.092311+0000","last_undegraded":"2022-08-10T17:54:43.092311+0000","last_fullsized":"2022-08-10T17:54:43.092311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:04:52.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550728+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:55:16.550728+0000","last_peered":"2022-08-10T17:55:16.550728+0000","last_clean":"2022-08-10T17:55:16.550728+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:16.550728+0000","last_undegraded":"2022-08-10T17:55:16.550728+0000","last_fullsized":"2022-08-10T17:55:16.550728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:12:30.480800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5875,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.568847+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:54:42.568847+0000","last_peered":"2022-08-10T17:54:42.568847+0000","last_clean":"2022-08-10T17:54:42.568847+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:54:42.568847+0000","last_undegraded":"2022-08-10T17:54:42.568847+0000","last_fullsized":"2022-08-10T17:54:42.568847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:45:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690969+0000","last_change":"2022-08-10T17:35:32.322042+0000","last_active":"2022-08-10T17:36:17.690969+0000","last_peered":"2022-08-10T17:36:17.690969+0000","last_clean":"2022-08-10T17:36:17.690969+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:36:17.690969+0000","last_undegraded":"2022-08-10T17:36:17.690969+0000","last_fullsized":"2022-08-10T17:36:17.690969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:51:41.398614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.678451+0000","last_change":"2022-08-10T17:35:37.022232+0000","last_active":"2022-08-10T17:36:18.678451+0000","last_peered":"2022-08-10T17:36:18.678451+0000","last_clean":"2022-08-10T17:36:18.678451+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:36:18.678451+0000","last_undegraded":"2022-08-10T17:36:18.678451+0000","last_fullsized":"2022-08-10T17:36:18.678451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.552916+0000","last_change":"2022-08-10T17:35:37.415402+0000","last_active":"2022-08-10T17:55:16.552916+0000","last_peered":"2022-08-10T17:55:16.552916+0000","last_clean":"2022-08-10T17:55:16.552916+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:16.552916+0000","last_undegraded":"2022-08-10T17:55:16.552916+0000","last_fullsized":"2022-08-10T17:55:16.552916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:49.849995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2959,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.508415+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.508415+0000","last_peered":"2022-08-10T17:54:42.508415+0000","last_clean":"2022-08-10T17:54:42.508415+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.508415+0000","last_undegraded":"2022-08-10T17:54:42.508415+0000","last_fullsized":"2022-08-10T17:54:42.508415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:15:30.777786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.097669+0000","last_change":"2022-08-10T17:35:37.023262+0000","last_active":"2022-08-10T17:54:43.097669+0000","last_peered":"2022-08-10T17:54:43.097669+0000","last_clean":"2022-08-10T17:54:43.097669+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:54:43.097669+0000","last_undegraded":"2022-08-10T17:54:43.097669+0000","last_fullsized":"2022-08-10T17:54:43.097669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:18.678416+0000","last_change":"2022-08-10T17:35:31.994871+0000","last_active":"2022-08-10T17:36:18.678416+0000","last_peered":"2022-08-10T17:36:18.678416+0000","last_clean":"2022-08-10T17:36:18.678416+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:36:18.678416+0000","last_undegraded":"2022-08-10T17:36:18.678416+0000","last_fullsized":"2022-08-10T17:36:18.678416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.526850+0000","last_change":"2022-08-10T17:35:37.413768+0000","last_active":"2022-08-10T17:55:16.526850+0000","last_peered":"2022-08-10T17:55:16.526850+0000","last_clean":"2022-08-10T17:55:16.526850+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:16.526850+0000","last_undegraded":"2022-08-10T17:55:16.526850+0000","last_fullsized":"2022-08-10T17:55:16.526850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4330,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.054834+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.054834+0000","last_peered":"2022-08-10T17:54:43.054834+0000","last_clean":"2022-08-10T17:54:43.054834+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.054834+0000","last_undegraded":"2022-08-10T17:54:43.054834+0000","last_fullsized":"2022-08-10T17:54:43.054834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-08-10T17:36:17.690512+0000","last_change":"2022-08-10T17:35:31.994567+0000","last_active":"2022-08-10T17:36:17.690512+0000","last_peered":"2022-08-10T17:36:17.690512+0000","last_clean":"2022-08-10T17:36:17.690512+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:36:17.690512+0000","last_undegraded":"2022-08-10T17:36:17.690512+0000","last_fullsized":"2022-08-10T17:36:17.690512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:30.960019+0000","last_clean_scrub_stamp":"2022-08-10T17:35:30.960019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:27:33.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'72","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.092274+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:54:43.092274+0000","last_peered":"2022-08-10T17:54:43.092274+0000","last_clean":"2022-08-10T17:54:43.092274+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:54:43.092274+0000","last_undegraded":"2022-08-10T17:54:43.092274+0000","last_fullsized":"2022-08-10T17:54:43.092274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:10:44.078171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.524501+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:55:16.524501+0000","last_peered":"2022-08-10T17:55:16.524501+0000","last_clean":"2022-08-10T17:55:16.524501+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:55:16.524501+0000","last_undegraded":"2022-08-10T17:55:16.524501+0000","last_fullsized":"2022-08-10T17:55:16.524501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:30.543084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4824,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.730541+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:54:42.730541+0000","last_peered":"2022-08-10T17:54:42.730541+0000","last_clean":"2022-08-10T17:54:42.730541+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:54:42.730541+0000","last_undegraded":"2022-08-10T17:54:42.730541+0000","last_fullsized":"2022-08-10T17:54:42.730541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1831","reported_seq":1846,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.438762+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:55:16.438762+0000","last_peered":"2022-08-10T17:55:16.438762+0000","last_clean":"2022-08-10T17:55:16.438762+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:16.438762+0000","last_undegraded":"2022-08-10T17:55:16.438762+0000","last_fullsized":"2022-08-10T17:55:16.438762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:13:12.788804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549427+0000","last_change":"2022-08-10T17:35:37.417733+0000","last_active":"2022-08-10T17:55:16.549427+0000","last_peered":"2022-08-10T17:55:16.549427+0000","last_clean":"2022-08-10T17:55:16.549427+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:16.549427+0000","last_undegraded":"2022-08-10T17:55:16.549427+0000","last_fullsized":"2022-08-10T17:55:16.549427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4542,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.578670+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.578670+0000","last_peered":"2022-08-10T17:54:42.578670+0000","last_clean":"2022-08-10T17:54:42.578670+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.578670+0000","last_undegraded":"2022-08-10T17:54:42.578670+0000","last_fullsized":"2022-08-10T17:54:42.578670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:31:22.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:36:19.057640+0000","last_change":"2022-08-10T17:35:37.028955+0000","last_active":"2022-08-10T17:36:19.057640+0000","last_peered":"2022-08-10T17:36:19.057640+0000","last_clean":"2022-08-10T17:36:19.057640+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:36:19.057640+0000","last_undegraded":"2022-08-10T17:36:19.057640+0000","last_fullsized":"2022-08-10T17:36:19.057640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:51:17.824165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536094+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:55:16.536094+0000","last_peered":"2022-08-10T17:55:16.536094+0000","last_clean":"2022-08-10T17:55:16.536094+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:55:16.536094+0000","last_undegraded":"2022-08-10T17:55:16.536094+0000","last_fullsized":"2022-08-10T17:55:16.536094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:20.137196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3894,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.753421+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:54:42.753421+0000","last_peered":"2022-08-10T17:54:42.753421+0000","last_clean":"2022-08-10T17:54:42.753421+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:54:42.753421+0000","last_undegraded":"2022-08-10T17:54:42.753421+0000","last_fullsized":"2022-08-10T17:54:42.753421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:57:23.021394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'9","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:18.730686+0000","last_change":"2022-08-10T17:35:37.030519+0000","last_active":"2022-08-10T17:39:18.730686+0000","last_peered":"2022-08-10T17:39:18.730686+0000","last_clean":"2022-08-10T17:39:18.730686+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:39:18.730686+0000","last_undegraded":"2022-08-10T17:39:18.730686+0000","last_fullsized":"2022-08-10T17:39:18.730686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:05.364089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535629+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:55:16.535629+0000","last_peered":"2022-08-10T17:55:16.535629+0000","last_clean":"2022-08-10T17:55:16.535629+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:55:16.535629+0000","last_undegraded":"2022-08-10T17:55:16.535629+0000","last_fullsized":"2022-08-10T17:55:16.535629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:08.609368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4423,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.557967+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.557967+0000","last_peered":"2022-08-10T17:54:42.557967+0000","last_clean":"2022-08-10T17:54:42.557967+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.557967+0000","last_undegraded":"2022-08-10T17:54:42.557967+0000","last_fullsized":"2022-08-10T17:54:42.557967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:56:00.998960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.828842+0000","last_change":"2022-08-10T17:35:37.016400+0000","last_active":"2022-08-10T17:54:42.828842+0000","last_peered":"2022-08-10T17:54:42.828842+0000","last_clean":"2022-08-10T17:54:42.828842+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:54:42.828842+0000","last_undegraded":"2022-08-10T17:54:42.828842+0000","last_fullsized":"2022-08-10T17:54:42.828842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.539660+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:55:16.539660+0000","last_peered":"2022-08-10T17:55:16.539660+0000","last_clean":"2022-08-10T17:55:16.539660+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:16.539660+0000","last_undegraded":"2022-08-10T17:55:16.539660+0000","last_fullsized":"2022-08-10T17:55:16.539660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5521,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.756733+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:54:42.756733+0000","last_peered":"2022-08-10T17:54:42.756733+0000","last_clean":"2022-08-10T17:54:42.756733+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:54:42.756733+0000","last_undegraded":"2022-08-10T17:54:42.756733+0000","last_fullsized":"2022-08-10T17:54:42.756733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'12","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.709261+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:54:42.709261+0000","last_peered":"2022-08-10T17:54:42.709261+0000","last_clean":"2022-08-10T17:54:42.709261+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:54:42.709261+0000","last_undegraded":"2022-08-10T17:54:42.709261+0000","last_fullsized":"2022-08-10T17:54:42.709261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:21:58.494209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534274+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:55:16.534274+0000","last_peered":"2022-08-10T17:55:16.534274+0000","last_clean":"2022-08-10T17:55:16.534274+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:55:16.534274+0000","last_undegraded":"2022-08-10T17:55:16.534274+0000","last_fullsized":"2022-08-10T17:55:16.534274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:19:34.992127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527655+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:55:16.527655+0000","last_peered":"2022-08-10T17:55:16.527655+0000","last_clean":"2022-08-10T17:55:16.527655+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:16.527655+0000","last_undegraded":"2022-08-10T17:55:16.527655+0000","last_fullsized":"2022-08-10T17:55:16.527655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:30:50.580505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.323409+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:55:17.323409+0000","last_peered":"2022-08-10T17:55:17.323409+0000","last_clean":"2022-08-10T17:55:17.323409+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:17.323409+0000","last_undegraded":"2022-08-10T17:55:17.323409+0000","last_fullsized":"2022-08-10T17:55:17.323409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535273+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:55:16.535273+0000","last_peered":"2022-08-10T17:55:16.535273+0000","last_clean":"2022-08-10T17:55:16.535273+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:55:16.535273+0000","last_undegraded":"2022-08-10T17:55:16.535273+0000","last_fullsized":"2022-08-10T17:55:16.535273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:17:24.255017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527231+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:55:16.527231+0000","last_peered":"2022-08-10T17:55:16.527231+0000","last_clean":"2022-08-10T17:55:16.527231+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:16.527231+0000","last_undegraded":"2022-08-10T17:55:16.527231+0000","last_fullsized":"2022-08-10T17:55:16.527231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.542778+0000","last_change":"2022-08-10T17:35:37.414891+0000","last_active":"2022-08-10T17:55:16.542778+0000","last_peered":"2022-08-10T17:55:16.542778+0000","last_clean":"2022-08-10T17:55:16.542778+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:16.542778+0000","last_undegraded":"2022-08-10T17:55:16.542778+0000","last_fullsized":"2022-08-10T17:55:16.542778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3245,"ondisk_log_size":3245,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575090,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478132,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475136,"kb_avail":93893708,"statfs":{"total":96636764160,"available":96147156992,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486539264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.31}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.379}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.38500000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.36399999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.29899999999999999},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.34000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504068,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503744,"kb_avail":93867772,"statfs":{"total":96636764160,"available":96120598528,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515833856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.7009999999999996,"5min":10.398,"15min":11.797000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":38.445,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":4.4139999999999997,"5min":10.430999999999999,"15min":12.347},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":29.300999999999998,"5min":129.767,"15min":129.767},"last":0.35299999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.2009999999999996,"5min":11.039999999999999,"15min":13.378},"min":{"1min":0.34899999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":25.206,"5min":114.83,"15min":318.94299999999998},"last":0.373},{"interface":"front","average":{"1min":4.4109999999999996,"5min":11.000999999999999,"15min":11.98},"min":{"1min":0.33600000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":21.338999999999999,"5min":114.842,"15min":119.708},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.407,"5min":1.405,"15min":4.6799999999999997},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.224},"max":{"1min":16.099,"5min":17.885999999999999,"15min":107.033},"last":0.30499999999999999},{"interface":"front","average":{"1min":3.9049999999999998,"5min":1.4019999999999999,"15min":5.0629999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":16.277999999999999,"5min":17.895,"15min":107.062},"last":0.41899999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.3210000000000002,"5min":1.0029999999999999,"15min":2.9049999999999998},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.254},"max":{"1min":16.376999999999999,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.437},{"interface":"front","average":{"1min":3.3799999999999999,"5min":1.0840000000000001,"15min":3.1459999999999999},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":16.331,"5min":16.331,"15min":96.870000000000005},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.8500000000000001,"5min":3.0350000000000001,"15min":6.7670000000000003},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.183},"max":{"1min":22.443000000000001,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":3.419,"5min":3.004,"15min":6.7670000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":22.484999999999999,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.379}]},{"osd":5,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":2.4569999999999999,"5min":6.5010000000000003,"15min":8.2929999999999993},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":16.129999999999999,"5min":79.944999999999993,"15min":100.741},"last":0.34599999999999997},{"interface":"front","average":{"1min":4.9290000000000003,"5min":7.0510000000000002,"15min":8.3940000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":38.378999999999998,"5min":80.159000000000006,"15min":100.715},"last":0.36099999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":1.238,"15min":4.101},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":15.968999999999999,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.7769999999999999,"5min":0.873,"15min":3.597},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":10.551,"5min":10.551,"15min":59.384},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621376,"kb_avail":93750132,"statfs":{"total":96636764160,"available":96000135168,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636289024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.373},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.39200000000000002},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.28899999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.624}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.628}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.59599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603984,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596288,"kb_avail":93767856,"statfs":{"total":96636764160,"available":96018284544,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610598912},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,62,40,119],"upper_bound":256},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.0060000000000002,"5min":10.24,"15min":11.976000000000001},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":23.757000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.40500000000000003},{"interface":"front","average":{"1min":8.7750000000000004,"5min":11.038,"15min":12.311},"min":{"1min":0.28899999999999998,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":59.381999999999998,"5min":93.111999999999995,"15min":111.506},"last":0.41499999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2560000000000002,"5min":1.367,"15min":6.3049999999999997},"min":{"1min":0.23999999999999999,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":21.789000000000001,"5min":21.789000000000001,"15min":130.566},"last":0.35599999999999998},{"interface":"front","average":{"1min":4.4429999999999996,"5min":1.905,"15min":6.4100000000000001},"min":{"1min":0.26400000000000001,"5min":0.252,"15min":0.222},"max":{"1min":21.855,"5min":50.625,"15min":130.63300000000001},"last":2.5910000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.2249999999999996,"5min":1.462,"15min":4.431},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":22.013000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.253},{"interface":"front","average":{"1min":5.3639999999999999,"5min":2.028,"15min":4.6799999999999997},"min":{"1min":0.318,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":33.039000000000001,"5min":50.686999999999998,"15min":111.377},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.9939999999999998,"5min":2.089,"15min":7.2450000000000001},"min":{"1min":0.30299999999999999,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":21.960999999999999,"5min":39.814999999999998,"15min":127.629},"last":0.57699999999999996},{"interface":"front","average":{"1min":6.6210000000000004,"5min":2.9220000000000002,"15min":7.468},"min":{"1min":0.374,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":32.966000000000001,"5min":50.734000000000002,"15min":127.497},"last":2.5209999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":6.6760000000000002,"5min":5.4100000000000001,"15min":8.3859999999999992},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":44.777999999999999,"5min":88.512,"15min":127.77500000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":7.5039999999999996,"5min":5.6230000000000002,"15min":8.8490000000000002},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":44.838000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.7080000000000002,"5min":1.9259999999999999,"15min":4.7610000000000001},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":22.035,"5min":50.664000000000001,"15min":114.8},"last":0.34799999999999998},{"interface":"front","average":{"1min":5.8470000000000004,"5min":2.149,"15min":5.0810000000000004},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":21.940000000000001,"5min":50.767000000000003,"15min":114.77800000000001},"last":2.5590000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2969999999999997,"5min":1.823,"15min":3.4199999999999999},"min":{"1min":0.35899999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":21.975000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":6.3529999999999998,"5min":2.3100000000000001,"15min":4.0389999999999997},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":21.917999999999999,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.51000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575089,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.40699999999999997},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.40000000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":11.993,"15min":15.167},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":37.323,"5min":150.911,"15min":433.41199999999998},"last":0.308},{"interface":"front","average":{"1min":5.6980000000000004,"5min":12.128,"15min":13.394},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":37.259999999999998,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:55:19 2022","interfaces":[{"interface":"back","average":{"1min":4.0640000000000001,"5min":1.1779999999999999,"15min":4.0529999999999999},"min":{"1min":0.29499999999999998,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":250.44200000000001},"last":0.371},{"interface":"front","average":{"1min":3.8090000000000002,"5min":1.1739999999999999,"15min":2.956},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":19.399000000000001,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.435}]},{"osd":4,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":3.48,"15min":7.9800000000000004},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":30.893000000000001,"5min":47.207999999999998,"15min":114.259},"last":0.45600000000000002},{"interface":"front","average":{"1min":4.4050000000000002,"5min":3.3700000000000001,"15min":8.2829999999999995},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":30.867999999999999,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":2.2109999999999999,"5min":4.1440000000000001,"15min":7.8929999999999998},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":9.0790000000000006,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":2.976,"5min":4.2249999999999996,"15min":8.1769999999999996},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":19.873000000000001,"5min":63.508000000000003,"15min":100.22},"last":0.42899999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":1.2350000000000001,"15min":3.774},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":19.789999999999999,"5min":19.789999999999999,"15min":83.046000000000006},"last":0.47499999999999998},{"interface":"front","average":{"1min":4.2530000000000001,"5min":1.4470000000000001,"15min":3.4809999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":28.131,"5min":28.131,"15min":60.445},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":1.4490000000000001,"15min":4.3289999999999997},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.904000000000003,"5min":34.904000000000003,"15min":94.753},"last":0.45300000000000001},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.405,"15min":4.7729999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":19.922999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.38300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575089,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473880,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":471936,"kb_avail":93897960,"statfs":{"total":96636764160,"available":96151511040,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483262464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.255},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.39200000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.28499999999999998},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.35699999999999998},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.33000000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.435},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.45700000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.50600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575090,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559924,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551296,"kb_avail":93811916,"statfs":{"total":96636764160,"available":96063401984,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564527104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.36199999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.38500000000000001},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.379},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.44}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.40100000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.433}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575088,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547216,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546880,"kb_avail":93824624,"statfs":{"total":96636764160,"available":96076414976,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560005120},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.35899999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.435},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:55:24.324 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.325 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.325 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.325 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.326 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.326 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.326 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.327 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.327 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.327 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.328 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.328 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.328 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.329 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.329 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.329 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.330 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.330 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.330 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.331 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.331 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.331 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.332 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.332 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.332 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.333 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.333 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.333 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.334 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.334 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.334 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.335 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.335 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.335 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.336 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.336 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.336 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.337 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.337 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.337 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.338 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.338 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.338 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.339 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.339 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.339 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.340 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.340 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.340 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.341 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.341 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.341 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.342 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.342 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.342 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.343 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.343 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.343 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.344 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.344 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.344 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.345 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.345 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.345 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.346 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.346 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.346 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.347 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.347 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.347 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.348 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.348 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.348 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.349 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.349 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.349 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.350 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.350 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.350 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.351 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.351 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.351 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.352 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.352 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.352 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.353 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.353 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.353 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.354 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.354 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.354 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.355 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.355 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.355 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.356 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.356 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.356 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.357 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2022-08-10T17:35:27.938973+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=27, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.357 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.358 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.358 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.358 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.359 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.359 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.359 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.360 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.360 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.360 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.361 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.361 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.361 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.362 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.362 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.362 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2022-08-10T17:35:30.960019+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=30, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.363 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.363 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.363 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.364 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.364 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.364 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.365 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.365 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.365 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.366 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.366 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.366 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.367 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.367 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.367 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.368 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.368 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.368 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.369 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.369 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.369 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.370 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:24.370 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-08-10T17:55:44.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:55:44.505 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.502+0000 7fb62d53b700 1 Processor -- start 2022-08-10T17:55:44.506 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.502+0000 7fb62d53b700 1 -- start start 2022-08-10T17:55:44.508 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb62d53b700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fb62815a570 0x7fb6280c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:44.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb62d53b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280c4dc0 con 0x7fb628150af0 2022-08-10T17:55:44.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb62d53b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280c5940 con 0x7fb62806c860 2022-08-10T17:55:44.509 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb62d53b700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280c9fc0 con 0x7fb62815a570 2022-08-10T17:55:44.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb626ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb628150af0 0x7fb628159e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58398/0 (socket says 172.21.15.150:58398) 2022-08-10T17:55:44.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb626ffd700 1 -- 172.21.15.150:0/3553311042 learned_addr learned my addr 172.21.15.150:0/3553311042 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:55:44.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb6277fe700 1 --2- 172.21.15.150:0/3553311042 >> v2:172.21.15.197:3300/0 conn(0x7fb62815a570 0x7fb6280c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:44.510 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb625ffb700 1 -- 172.21.15.150:0/3553311042 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966724455 0 0) 0x7fb6280c4dc0 con 0x7fb628150af0 2022-08-10T17:55:44.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb625ffb700 1 -- 172.21.15.150:0/3553311042 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb614003430 con 0x7fb628150af0 2022-08-10T17:55:44.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb6277fe700 1 -- 172.21.15.150:0/3553311042 >> v1:172.21.15.197:6789/0 conn(0x7fb62806c860 legacy=0x7fb6280c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb6277fe700 1 -- 172.21.15.150:0/3553311042 >> v1:172.21.15.150:6789/0 conn(0x7fb628150af0 legacy=0x7fb628159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.511 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb6277fe700 1 -- 172.21.15.150:0/3553311042 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62806f9a0 con 0x7fb62815a570 2022-08-10T17:55:44.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.503+0000 7fb6277fe700 1 --2- 172.21.15.150:0/3553311042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb62815a570 0x7fb6280c45d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb620009d90 tx=0x7fb62000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7817bd0cdcd8d6e server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:44.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb625ffb700 1 -- 172.21.15.150:0/3553311042 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000e070 con 0x7fb62815a570 2022-08-10T17:55:44.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb625ffb700 1 -- 172.21.15.150:0/3553311042 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62000bb20 con 0x7fb62815a570 2022-08-10T17:55:44.512 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb625ffb700 1 -- 172.21.15.150:0/3553311042 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620012430 con 0x7fb62815a570 2022-08-10T17:55:44.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 -- 172.21.15.150:0/3553311042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb62815a570 msgr2=0x7fb6280c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3553311042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb62815a570 0x7fb6280c45d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb620009d90 tx=0x7fb62000b330 comp rx=0 tx=0).stop 2022-08-10T17:55:44.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 -- 172.21.15.150:0/3553311042 shutdown_connections 2022-08-10T17:55:44.513 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3553311042 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb62815a570 0x7fb6280c45d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 -- 172.21.15.150:0/3553311042 >> 172.21.15.150:0/3553311042 conn(0x7fb6280c92f0 msgr2=0x7fb6280c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:44.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 -- 172.21.15.150:0/3553311042 shutdown_connections 2022-08-10T17:55:44.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.504+0000 7fb62d53b700 1 -- 172.21.15.150:0/3553311042 wait complete. 2022-08-10T17:55:44.514 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.505+0000 7fb62d53b700 1 Processor -- start 2022-08-10T17:55:44.515 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.505+0000 7fb62d53b700 1 -- start start 2022-08-10T17:55:44.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb62806c860 0x7fb6281efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:44.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb628150af0 0x7fb6280baec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:44.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:44.518 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280bef90 con 0x7fb62815a570 2022-08-10T17:55:44.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280bfe50 con 0x7fb628150af0 2022-08-10T17:55:44.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb62d53b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280bd260 con 0x7fb62806c860 2022-08-10T17:55:44.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:44.519 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb626ffd700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb62806c860 0x7fb6281efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:44.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45726/0 (socket says 172.21.15.150:45726) 2022-08-10T17:55:44.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 -- 172.21.15.150:0/3709043475 learned_addr learned my addr 172.21.15.150:0/3709043475 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:55:44.520 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6267fc700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb628150af0 0x7fb6280baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:44.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 -- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb62806c860 msgr2=0x7fb6281efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb62806c860 0x7fb6281efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 -- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb628150af0 msgr2=0x7fb6280baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.521 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb628150af0 0x7fb6280baec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.506+0000 7fb6277fe700 1 -- 172.21.15.150:0/3709043475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620009a70 con 0x7fb62815a570 2022-08-10T17:55:44.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb6277fe700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb62000b370 tx=0x7fb620004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:44.522 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620004450 con 0x7fb62815a570 2022-08-10T17:55:44.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620020070 con 0x7fb62815a570 2022-08-10T17:55:44.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200047f0 con 0x7fb62815a570 2022-08-10T17:55:44.523 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6280c7bf0 con 0x7fb62815a570 2022-08-10T17:55:44.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.507+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6280c8170 con 0x7fb62815a570 2022-08-10T17:55:44.524 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.508+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62806e290 con 0x7fb62815a570 2022-08-10T17:55:44.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.508+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb6200125e0 con 0x7fb62815a570 2022-08-10T17:55:44.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.508+0000 7fb60f7fe700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 0x7fb608067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:55:44.525 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.509+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb620022070 con 0x7fb62815a570 2022-08-10T17:55:44.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.509+0000 7fb626ffd700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 0x7fb608067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:55:44.526 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.509+0000 7fb626ffd700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 0x7fb608067560 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6180011e0 tx=0x7fb618007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:55:44.527 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.513+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb6200525b0 con 0x7fb62815a570 2022-08-10T17:55:44.697 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.694+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb628072890 con 0x7fb6080650b0 2022-08-10T17:55:44.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.705+0000 7fb60f7fe700 1 -- 172.21.15.150:0/3709043475 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390217 (secure 0 0 0) 0x7fb628072890 con 0x7fb6080650b0 2022-08-10T17:55:44.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:55:44.720 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 msgr2=0x7fb608067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 0x7fb608067560 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6180011e0 tx=0x7fb618007c40 comp rx=0 tx=0).stop 2022-08-10T17:55:44.721 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 msgr2=0x7fb6280bb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:55:44.722 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb62000b370 tx=0x7fb620004950 comp rx=0 tx=0).stop 2022-08-10T17:55:44.723 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 shutdown_connections 2022-08-10T17:55:44.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62815a570 0x7fb6280bb400 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb6080650b0 0x7fb608067560 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb62806c860 0x7fb6281efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.724 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 --2- 172.21.15.150:0/3709043475 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb628150af0 0x7fb6280baec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:55:44.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 >> 172.21.15.150:0/3709043475 conn(0x7fb6280c92f0 msgr2=0x7fb62814f100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:55:44.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 shutdown_connections 2022-08-10T17:55:44.725 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:55:44.708+0000 7fb62d53b700 1 -- 172.21.15.150:0/3709043475 wait complete. 2022-08-10T17:55:44.725 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:55:44.727 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":631,"stamp":"2022-08-10T17:55:43.803396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152584,"ondisk_log_size":152584,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261552,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4238976,"kb_avail":750713168,"statfs":{"total":773094113280,"available":768730284032,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340711424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":64,"apply_latency_ms":64,"commit_latency_ns":64000000,"apply_latency_ns":64000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002644"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.671542+0000","last_change":"2022-08-10T17:55:23.671511+0000","last_active":"2022-08-10T17:55:23.671542+0000","last_peered":"2022-08-10T17:55:23.671542+0000","last_clean":"2022-08-10T17:55:23.671542+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:23.671542+0000","last_undegraded":"2022-08-10T17:55:23.671542+0000","last_fullsized":"2022-08-10T17:55:23.671542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.671406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:28:06.994122+0000","scrub_duration":0.037043489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.544642+0000","last_change":"2022-08-10T17:35:37.413048+0000","last_active":"2022-08-10T17:55:16.544642+0000","last_peered":"2022-08-10T17:55:16.544642+0000","last_clean":"2022-08-10T17:55:16.544642+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:16.544642+0000","last_undegraded":"2022-08-10T17:55:16.544642+0000","last_fullsized":"2022-08-10T17:55:16.544642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.749547+0000","last_change":"2022-08-10T17:55:24.749527+0000","last_active":"2022-08-10T17:55:24.749547+0000","last_peered":"2022-08-10T17:55:24.749547+0000","last_clean":"2022-08-10T17:55:24.749547+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:24.749547+0000","last_undegraded":"2022-08-10T17:55:24.749547+0000","last_fullsized":"2022-08-10T17:55:24.749547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.749427+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:12.518032+0000","scrub_duration":0.0088304560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.879719+0000","last_change":"2022-08-10T17:55:34.879699+0000","last_active":"2022-08-10T17:55:34.879719+0000","last_peered":"2022-08-10T17:55:34.879719+0000","last_clean":"2022-08-10T17:55:34.879719+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:34.879719+0000","last_undegraded":"2022-08-10T17:55:34.879719+0000","last_fullsized":"2022-08-10T17:55:34.879719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.879618+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:21.211782+0000","scrub_duration":0.003479551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.542166+0000","last_change":"2022-08-10T17:35:37.419235+0000","last_active":"2022-08-10T17:55:16.542166+0000","last_peered":"2022-08-10T17:55:16.542166+0000","last_clean":"2022-08-10T17:55:16.542166+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:16.542166+0000","last_undegraded":"2022-08-10T17:55:16.542166+0000","last_fullsized":"2022-08-10T17:55:16.542166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547605+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:55:16.547605+0000","last_peered":"2022-08-10T17:55:16.547605+0000","last_clean":"2022-08-10T17:55:16.547605+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:55:16.547605+0000","last_undegraded":"2022-08-10T17:55:16.547605+0000","last_fullsized":"2022-08-10T17:55:16.547605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549480+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:55:16.549480+0000","last_peered":"2022-08-10T17:55:16.549480+0000","last_clean":"2022-08-10T17:55:16.549480+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:55:16.549480+0000","last_undegraded":"2022-08-10T17:55:16.549480+0000","last_fullsized":"2022-08-10T17:55:16.549480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.543774+0000","last_change":"2022-08-10T17:35:37.412161+0000","last_active":"2022-08-10T17:55:16.543774+0000","last_peered":"2022-08-10T17:55:16.543774+0000","last_clean":"2022-08-10T17:55:16.543774+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:16.543774+0000","last_undegraded":"2022-08-10T17:55:16.543774+0000","last_fullsized":"2022-08-10T17:55:16.543774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.542042+0000","last_change":"2022-08-10T17:35:37.416193+0000","last_active":"2022-08-10T17:55:16.542042+0000","last_peered":"2022-08-10T17:55:16.542042+0000","last_clean":"2022-08-10T17:55:16.542042+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:16.542042+0000","last_undegraded":"2022-08-10T17:55:16.542042+0000","last_fullsized":"2022-08-10T17:55:16.542042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.092605+0000","last_change":"2022-08-10T17:55:24.092585+0000","last_active":"2022-08-10T17:55:24.092605+0000","last_peered":"2022-08-10T17:55:24.092605+0000","last_clean":"2022-08-10T17:55:24.092605+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:24.092605+0000","last_undegraded":"2022-08-10T17:55:24.092605+0000","last_fullsized":"2022-08-10T17:55:24.092605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.092509+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:43:12.935816+0000","scrub_duration":0.0044268040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549380+0000","last_change":"2022-08-10T17:35:37.411157+0000","last_active":"2022-08-10T17:55:16.549380+0000","last_peered":"2022-08-10T17:55:16.549380+0000","last_clean":"2022-08-10T17:55:16.549380+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:16.549380+0000","last_undegraded":"2022-08-10T17:55:16.549380+0000","last_fullsized":"2022-08-10T17:55:16.549380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.587361+0000","last_change":"2022-08-10T17:55:27.587324+0000","last_active":"2022-08-10T17:55:27.587361+0000","last_peered":"2022-08-10T17:55:27.587361+0000","last_clean":"2022-08-10T17:55:27.587361+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:27.587361+0000","last_undegraded":"2022-08-10T17:55:27.587361+0000","last_fullsized":"2022-08-10T17:55:27.587361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.587177+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:18:28.369001+0000","scrub_duration":0.003490515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.597924+0000","last_change":"2022-08-10T17:55:28.597885+0000","last_active":"2022-08-10T17:55:28.597924+0000","last_peered":"2022-08-10T17:55:28.597924+0000","last_clean":"2022-08-10T17:55:28.597924+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:28.597924+0000","last_undegraded":"2022-08-10T17:55:28.597924+0000","last_fullsized":"2022-08-10T17:55:28.597924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.597685+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:50:51.165553+0000","scrub_duration":0.016393403000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.084201+0000","last_change":"2022-08-10T17:55:25.084163+0000","last_active":"2022-08-10T17:55:25.084201+0000","last_peered":"2022-08-10T17:55:25.084201+0000","last_clean":"2022-08-10T17:55:25.084201+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:25.084201+0000","last_undegraded":"2022-08-10T17:55:25.084201+0000","last_fullsized":"2022-08-10T17:55:25.084201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.084023+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:58:36.715764+0000","scrub_duration":0.0035396899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549404+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:55:16.549404+0000","last_peered":"2022-08-10T17:55:16.549404+0000","last_clean":"2022-08-10T17:55:16.549404+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:55:16.549404+0000","last_undegraded":"2022-08-10T17:55:16.549404+0000","last_fullsized":"2022-08-10T17:55:16.549404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.746364+0000","last_change":"2022-08-10T17:55:32.746346+0000","last_active":"2022-08-10T17:55:32.746364+0000","last_peered":"2022-08-10T17:55:32.746364+0000","last_clean":"2022-08-10T17:55:32.746364+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:32.746364+0000","last_undegraded":"2022-08-10T17:55:32.746364+0000","last_fullsized":"2022-08-10T17:55:32.746364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.746268+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:15.017040+0000","scrub_duration":0.0035363500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.541942+0000","last_change":"2022-08-10T17:35:37.415061+0000","last_active":"2022-08-10T17:55:16.541942+0000","last_peered":"2022-08-10T17:55:16.541942+0000","last_clean":"2022-08-10T17:55:16.541942+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:16.541942+0000","last_undegraded":"2022-08-10T17:55:16.541942+0000","last_fullsized":"2022-08-10T17:55:16.541942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527883+0000","last_change":"2022-08-10T17:35:37.408639+0000","last_active":"2022-08-10T17:55:16.527883+0000","last_peered":"2022-08-10T17:55:16.527883+0000","last_clean":"2022-08-10T17:55:16.527883+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:16.527883+0000","last_undegraded":"2022-08-10T17:55:16.527883+0000","last_fullsized":"2022-08-10T17:55:16.527883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.602705+0000","last_change":"2022-08-10T17:55:25.602683+0000","last_active":"2022-08-10T17:55:25.602705+0000","last_peered":"2022-08-10T17:55:25.602705+0000","last_clean":"2022-08-10T17:55:25.602705+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:25.602705+0000","last_undegraded":"2022-08-10T17:55:25.602705+0000","last_fullsized":"2022-08-10T17:55:25.602705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.602593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:49:36.908209+0000","scrub_duration":0.015965635999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536111+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:55:16.536111+0000","last_peered":"2022-08-10T17:55:16.536111+0000","last_clean":"2022-08-10T17:55:16.536111+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:55:16.536111+0000","last_undegraded":"2022-08-10T17:55:16.536111+0000","last_fullsized":"2022-08-10T17:55:16.536111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535583+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:55:16.535583+0000","last_peered":"2022-08-10T17:55:16.535583+0000","last_clean":"2022-08-10T17:55:16.535583+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:55:16.535583+0000","last_undegraded":"2022-08-10T17:55:16.535583+0000","last_fullsized":"2022-08-10T17:55:16.535583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550974+0000","last_change":"2022-08-10T17:35:37.411814+0000","last_active":"2022-08-10T17:55:16.550974+0000","last_peered":"2022-08-10T17:55:16.550974+0000","last_clean":"2022-08-10T17:55:16.550974+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:16.550974+0000","last_undegraded":"2022-08-10T17:55:16.550974+0000","last_fullsized":"2022-08-10T17:55:16.550974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547359+0000","last_change":"2022-08-10T17:35:37.408321+0000","last_active":"2022-08-10T17:55:16.547359+0000","last_peered":"2022-08-10T17:55:16.547359+0000","last_clean":"2022-08-10T17:55:16.547359+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:16.547359+0000","last_undegraded":"2022-08-10T17:55:16.547359+0000","last_fullsized":"2022-08-10T17:55:16.547359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533588+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:55:16.533588+0000","last_peered":"2022-08-10T17:55:16.533588+0000","last_clean":"2022-08-10T17:55:16.533588+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:55:16.533588+0000","last_undegraded":"2022-08-10T17:55:16.533588+0000","last_fullsized":"2022-08-10T17:55:16.533588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.529411+0000","last_change":"2022-08-10T17:35:37.416832+0000","last_active":"2022-08-10T17:55:16.529411+0000","last_peered":"2022-08-10T17:55:16.529411+0000","last_clean":"2022-08-10T17:55:16.529411+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:16.529411+0000","last_undegraded":"2022-08-10T17:55:16.529411+0000","last_fullsized":"2022-08-10T17:55:16.529411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.335430+0000","last_change":"2022-08-10T17:55:36.335408+0000","last_active":"2022-08-10T17:55:36.335430+0000","last_peered":"2022-08-10T17:55:36.335430+0000","last_clean":"2022-08-10T17:55:36.335430+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:36.335430+0000","last_undegraded":"2022-08-10T17:55:36.335430+0000","last_fullsized":"2022-08-10T17:55:36.335430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.335326+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:02:07.956826+0000","scrub_duration":0.0034800230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.147493+0000","last_change":"2022-08-10T17:55:38.147458+0000","last_active":"2022-08-10T17:55:38.147493+0000","last_peered":"2022-08-10T17:55:38.147493+0000","last_clean":"2022-08-10T17:55:38.147493+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:38.147493+0000","last_undegraded":"2022-08-10T17:55:38.147493+0000","last_fullsized":"2022-08-10T17:55:38.147493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.147290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:17:04.733650+0000","scrub_duration":0.021995639000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4458,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.460453+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.460453+0000","last_peered":"2022-08-10T17:54:42.460453+0000","last_clean":"2022-08-10T17:54:42.460453+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.460453+0000","last_undegraded":"2022-08-10T17:54:42.460453+0000","last_fullsized":"2022-08-10T17:54:42.460453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.795261+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.795261+0000","last_peered":"2022-08-10T17:54:42.795261+0000","last_clean":"2022-08-10T17:54:42.795261+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.795261+0000","last_undegraded":"2022-08-10T17:54:42.795261+0000","last_fullsized":"2022-08-10T17:54:42.795261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.330599+0000","last_change":"2022-08-10T17:55:23.330567+0000","last_active":"2022-08-10T17:55:23.330599+0000","last_peered":"2022-08-10T17:55:23.330599+0000","last_clean":"2022-08-10T17:55:23.330599+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:23.330599+0000","last_undegraded":"2022-08-10T17:55:23.330599+0000","last_fullsized":"2022-08-10T17:55:23.330599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.330462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:10:32.984049+0000","scrub_duration":0.024365404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4708,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.058463+0000","last_change":"2022-08-10T17:35:41.436899+0000","last_active":"2022-08-10T17:54:43.058463+0000","last_peered":"2022-08-10T17:54:43.058463+0000","last_clean":"2022-08-10T17:54:43.058463+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:54:43.058463+0000","last_undegraded":"2022-08-10T17:54:43.058463+0000","last_fullsized":"2022-08-10T17:54:43.058463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'14","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.422498+0000","last_change":"2022-08-10T17:55:33.422452+0000","last_active":"2022-08-10T17:55:33.422498+0000","last_peered":"2022-08-10T17:55:33.422498+0000","last_clean":"2022-08-10T17:55:33.422498+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:55:33.422498+0000","last_undegraded":"2022-08-10T17:55:33.422498+0000","last_fullsized":"2022-08-10T17:55:33.422498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.422315+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:27.773536+0000","scrub_duration":0.019140213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.009599+0000","last_change":"2022-08-10T17:55:27.009577+0000","last_active":"2022-08-10T17:55:27.009599+0000","last_peered":"2022-08-10T17:55:27.009599+0000","last_clean":"2022-08-10T17:55:27.009599+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:27.009599+0000","last_undegraded":"2022-08-10T17:55:27.009599+0000","last_fullsized":"2022-08-10T17:55:27.009599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.009500+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:15:21.317429+0000","scrub_duration":0.0035028260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4368,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.032149+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:43.032149+0000","last_peered":"2022-08-10T17:54:43.032149+0000","last_clean":"2022-08-10T17:54:43.032149+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:43.032149+0000","last_undegraded":"2022-08-10T17:54:43.032149+0000","last_fullsized":"2022-08-10T17:54:43.032149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.272824+0000","last_change":"2022-08-10T17:55:34.272805+0000","last_active":"2022-08-10T17:55:34.272824+0000","last_peered":"2022-08-10T17:55:34.272824+0000","last_clean":"2022-08-10T17:55:34.272824+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:55:34.272824+0000","last_undegraded":"2022-08-10T17:55:34.272824+0000","last_fullsized":"2022-08-10T17:55:34.272824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.272714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:36.483574+0000","scrub_duration":0.0034525319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.957655+0000","last_change":"2022-08-10T17:55:29.957632+0000","last_active":"2022-08-10T17:55:29.957655+0000","last_peered":"2022-08-10T17:55:29.957655+0000","last_clean":"2022-08-10T17:55:29.957655+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:29.957655+0000","last_undegraded":"2022-08-10T17:55:29.957655+0000","last_fullsized":"2022-08-10T17:55:29.957655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.957536+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:43:07.254608+0000","scrub_duration":0.062576358999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3603,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.056451+0000","last_change":"2022-08-10T17:35:41.436347+0000","last_active":"2022-08-10T17:54:43.056451+0000","last_peered":"2022-08-10T17:54:43.056451+0000","last_clean":"2022-08-10T17:54:43.056451+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:54:43.056451+0000","last_undegraded":"2022-08-10T17:54:43.056451+0000","last_fullsized":"2022-08-10T17:54:43.056451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'64","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.093868+0000","last_change":"2022-08-10T17:55:35.093847+0000","last_active":"2022-08-10T17:55:35.093868+0000","last_peered":"2022-08-10T17:55:35.093868+0000","last_clean":"2022-08-10T17:55:35.093868+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:55:35.093868+0000","last_undegraded":"2022-08-10T17:55:35.093868+0000","last_fullsized":"2022-08-10T17:55:35.093868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.093760+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:13:33.865196+0000","scrub_duration":0.016913436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549999+0000","last_change":"2022-08-10T17:35:37.415343+0000","last_active":"2022-08-10T17:55:16.549999+0000","last_peered":"2022-08-10T17:55:16.549999+0000","last_clean":"2022-08-10T17:55:16.549999+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:55:16.549999+0000","last_undegraded":"2022-08-10T17:55:16.549999+0000","last_fullsized":"2022-08-10T17:55:16.549999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4172,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.007366+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:43.007366+0000","last_peered":"2022-08-10T17:54:43.007366+0000","last_clean":"2022-08-10T17:54:43.007366+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:43.007366+0000","last_undegraded":"2022-08-10T17:54:43.007366+0000","last_fullsized":"2022-08-10T17:54:43.007366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.119148+0000","last_change":"2022-08-10T17:55:32.119128+0000","last_active":"2022-08-10T17:55:32.119148+0000","last_peered":"2022-08-10T17:55:32.119148+0000","last_clean":"2022-08-10T17:55:32.119148+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:55:32.119148+0000","last_undegraded":"2022-08-10T17:55:32.119148+0000","last_fullsized":"2022-08-10T17:55:32.119148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.119046+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:52:27.377502+0000","scrub_duration":0.015219678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.405585+0000","last_change":"2022-08-10T17:55:30.405562+0000","last_active":"2022-08-10T17:55:30.405585+0000","last_peered":"2022-08-10T17:55:30.405585+0000","last_clean":"2022-08-10T17:55:30.405585+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:30.405585+0000","last_undegraded":"2022-08-10T17:55:30.405585+0000","last_fullsized":"2022-08-10T17:55:30.405585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.405460+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:57:23.895561+0000","scrub_duration":0.024012329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5939,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.038487+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:43.038487+0000","last_peered":"2022-08-10T17:54:43.038487+0000","last_clean":"2022-08-10T17:54:43.038487+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:43.038487+0000","last_undegraded":"2022-08-10T17:54:43.038487+0000","last_fullsized":"2022-08-10T17:54:43.038487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'24","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.079797+0000","last_change":"2022-08-10T17:55:27.079775+0000","last_active":"2022-08-10T17:55:27.079797+0000","last_peered":"2022-08-10T17:55:27.079797+0000","last_clean":"2022-08-10T17:55:27.079797+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:55:27.079797+0000","last_undegraded":"2022-08-10T17:55:27.079797+0000","last_fullsized":"2022-08-10T17:55:27.079797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.079689+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:16:30.544031+0000","scrub_duration":0.026671822000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.370196+0000","last_change":"2022-08-10T17:55:42.370175+0000","last_active":"2022-08-10T17:55:42.370196+0000","last_peered":"2022-08-10T17:55:42.370196+0000","last_clean":"2022-08-10T17:55:42.370196+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:42.370196+0000","last_undegraded":"2022-08-10T17:55:42.370196+0000","last_fullsized":"2022-08-10T17:55:42.370196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.370067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:10.161792+0000","scrub_duration":0.020699707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4199,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.983753+0000","last_change":"2022-08-10T17:35:41.438153+0000","last_active":"2022-08-10T17:54:42.983753+0000","last_peered":"2022-08-10T17:54:42.983753+0000","last_clean":"2022-08-10T17:54:42.983753+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:54:42.983753+0000","last_undegraded":"2022-08-10T17:54:42.983753+0000","last_fullsized":"2022-08-10T17:54:42.983753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'306","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.430409+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:55:16.430409+0000","last_peered":"2022-08-10T17:55:16.430409+0000","last_clean":"2022-08-10T17:55:16.430409+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:55:16.430409+0000","last_undegraded":"2022-08-10T17:55:16.430409+0000","last_fullsized":"2022-08-10T17:55:16.430409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536458+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:55:16.536458+0000","last_peered":"2022-08-10T17:55:16.536458+0000","last_clean":"2022-08-10T17:55:16.536458+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:55:16.536458+0000","last_undegraded":"2022-08-10T17:55:16.536458+0000","last_fullsized":"2022-08-10T17:55:16.536458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5818,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.547448+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.547448+0000","last_peered":"2022-08-10T17:54:42.547448+0000","last_clean":"2022-08-10T17:54:42.547448+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.547448+0000","last_undegraded":"2022-08-10T17:54:42.547448+0000","last_fullsized":"2022-08-10T17:54:42.547448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:39:02.589977+0000","last_change":"2022-08-10T17:35:37.030613+0000","last_active":"2022-08-10T17:39:02.589977+0000","last_peered":"2022-08-10T17:39:02.589977+0000","last_clean":"2022-08-10T17:39:02.589977+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:39:02.589977+0000","last_undegraded":"2022-08-10T17:39:02.589977+0000","last_fullsized":"2022-08-10T17:39:02.589977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.358355+0000","last_change":"2022-08-10T17:55:25.358323+0000","last_active":"2022-08-10T17:55:25.358355+0000","last_peered":"2022-08-10T17:55:25.358355+0000","last_clean":"2022-08-10T17:55:25.358355+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:25.358355+0000","last_undegraded":"2022-08-10T17:55:25.358355+0000","last_fullsized":"2022-08-10T17:55:25.358355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.358222+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:32:47.761238+0000","scrub_duration":0.024137542000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4272,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.474553+0000","last_change":"2022-08-10T17:35:41.438430+0000","last_active":"2022-08-10T17:54:42.474553+0000","last_peered":"2022-08-10T17:54:42.474553+0000","last_clean":"2022-08-10T17:54:42.474553+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:54:42.474553+0000","last_undegraded":"2022-08-10T17:54:42.474553+0000","last_fullsized":"2022-08-10T17:54:42.474553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.061351+0000","last_change":"2022-08-10T17:55:38.061316+0000","last_active":"2022-08-10T17:55:38.061351+0000","last_peered":"2022-08-10T17:55:38.061351+0000","last_clean":"2022-08-10T17:55:38.061351+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:55:38.061351+0000","last_undegraded":"2022-08-10T17:55:38.061351+0000","last_fullsized":"2022-08-10T17:55:38.061351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.061144+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:50.451261+0000","scrub_duration":0.016751453999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.108842+0000","last_change":"2022-08-10T17:55:26.108788+0000","last_active":"2022-08-10T17:55:26.108842+0000","last_peered":"2022-08-10T17:55:26.108842+0000","last_clean":"2022-08-10T17:55:26.108842+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:26.108842+0000","last_undegraded":"2022-08-10T17:55:26.108842+0000","last_fullsized":"2022-08-10T17:55:26.108842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.108605+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:10:35.922613+0000","scrub_duration":0.021195411000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.526055+0000","last_change":"2022-08-10T17:35:41.442443+0000","last_active":"2022-08-10T17:54:42.526055+0000","last_peered":"2022-08-10T17:54:42.526055+0000","last_clean":"2022-08-10T17:54:42.526055+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:54:42.526055+0000","last_undegraded":"2022-08-10T17:54:42.526055+0000","last_fullsized":"2022-08-10T17:54:42.526055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'302","reported_seq":319,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.464842+0000","last_change":"2022-08-10T17:35:37.030760+0000","last_active":"2022-08-10T17:55:16.464842+0000","last_peered":"2022-08-10T17:55:16.464842+0000","last_clean":"2022-08-10T17:55:16.464842+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:55:16.464842+0000","last_undegraded":"2022-08-10T17:55:16.464842+0000","last_fullsized":"2022-08-10T17:55:16.464842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.367413+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:55:17.367413+0000","last_peered":"2022-08-10T17:55:17.367413+0000","last_clean":"2022-08-10T17:55:17.367413+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:55:17.367413+0000","last_undegraded":"2022-08-10T17:55:17.367413+0000","last_fullsized":"2022-08-10T17:55:17.367413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4920,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.889535+0000","last_change":"2022-08-10T17:35:41.433555+0000","last_active":"2022-08-10T17:54:42.889535+0000","last_peered":"2022-08-10T17:54:42.889535+0000","last_clean":"2022-08-10T17:54:42.889535+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:54:42.889535+0000","last_undegraded":"2022-08-10T17:54:42.889535+0000","last_fullsized":"2022-08-10T17:54:42.889535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.924288+0000","last_change":"2022-08-10T17:55:24.924251+0000","last_active":"2022-08-10T17:55:24.924288+0000","last_peered":"2022-08-10T17:55:24.924288+0000","last_clean":"2022-08-10T17:55:24.924288+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:55:24.924288+0000","last_undegraded":"2022-08-10T17:55:24.924288+0000","last_fullsized":"2022-08-10T17:55:24.924288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.924118+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:55:21.923386+0000","scrub_duration":0.021377028999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.408869+0000","last_change":"2022-08-10T17:55:27.408845+0000","last_active":"2022-08-10T17:55:27.408869+0000","last_peered":"2022-08-10T17:55:27.408869+0000","last_clean":"2022-08-10T17:55:27.408869+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:27.408869+0000","last_undegraded":"2022-08-10T17:55:27.408869+0000","last_fullsized":"2022-08-10T17:55:27.408869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.408747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:14:38.533949+0000","scrub_duration":0.040517141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.879530+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.879530+0000","last_peered":"2022-08-10T17:54:42.879530+0000","last_clean":"2022-08-10T17:54:42.879530+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.879530+0000","last_undegraded":"2022-08-10T17:54:42.879530+0000","last_fullsized":"2022-08-10T17:54:42.879530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'45","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:25.064155+0000","last_change":"2022-08-10T17:35:37.030972+0000","last_active":"2022-08-10T17:54:25.064155+0000","last_peered":"2022-08-10T17:54:25.064155+0000","last_clean":"2022-08-10T17:54:25.064155+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:54:25.064155+0000","last_undegraded":"2022-08-10T17:54:25.064155+0000","last_fullsized":"2022-08-10T17:54:25.064155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.160168+0000","last_change":"2022-08-10T17:55:37.160149+0000","last_active":"2022-08-10T17:55:37.160168+0000","last_peered":"2022-08-10T17:55:37.160168+0000","last_clean":"2022-08-10T17:55:37.160168+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:37.160168+0000","last_undegraded":"2022-08-10T17:55:37.160168+0000","last_fullsized":"2022-08-10T17:55:37.160168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.160075+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:27:20.436089+0000","scrub_duration":0.0034772340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.648371+0000","last_change":"2022-08-10T17:55:30.648315+0000","last_active":"2022-08-10T17:55:30.648371+0000","last_peered":"2022-08-10T17:55:30.648371+0000","last_clean":"2022-08-10T17:55:30.648371+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:55:30.648371+0000","last_undegraded":"2022-08-10T17:55:30.648371+0000","last_fullsized":"2022-08-10T17:55:30.648371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4353","last_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_deep_scrub":"29'4353","last_deep_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.648133+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:10.184933+0000","scrub_duration":0.067302737000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:23.625366+0000","last_change":"2022-08-10T17:35:37.030959+0000","last_active":"2022-08-10T17:54:23.625366+0000","last_peered":"2022-08-10T17:54:23.625366+0000","last_clean":"2022-08-10T17:54:23.625366+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:54:23.625366+0000","last_undegraded":"2022-08-10T17:54:23.625366+0000","last_fullsized":"2022-08-10T17:54:23.625366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546276+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:55:16.546276+0000","last_peered":"2022-08-10T17:55:16.546276+0000","last_clean":"2022-08-10T17:55:16.546276+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:55:16.546276+0000","last_undegraded":"2022-08-10T17:55:16.546276+0000","last_fullsized":"2022-08-10T17:55:16.546276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4709,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.577615+0000","last_change":"2022-08-10T17:55:33.577580+0000","last_active":"2022-08-10T17:55:33.577615+0000","last_peered":"2022-08-10T17:55:33.577615+0000","last_clean":"2022-08-10T17:55:33.577615+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:55:33.577615+0000","last_undegraded":"2022-08-10T17:55:33.577615+0000","last_fullsized":"2022-08-10T17:55:33.577615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4681","last_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_deep_scrub":"29'4681","last_deep_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.577468+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:50:41.930237+0000","scrub_duration":0.053293471000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:40.114580+0000","last_change":"2022-08-10T17:55:40.114552+0000","last_active":"2022-08-10T17:55:40.114580+0000","last_peered":"2022-08-10T17:55:40.114580+0000","last_clean":"2022-08-10T17:55:40.114580+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:55:40.114580+0000","last_undegraded":"2022-08-10T17:55:40.114580+0000","last_fullsized":"2022-08-10T17:55:40.114580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:40.114468+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:53:37.748882+0000","scrub_duration":0.013616628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.818264+0000","last_change":"2022-08-10T17:55:39.818234+0000","last_active":"2022-08-10T17:55:39.818264+0000","last_peered":"2022-08-10T17:55:39.818264+0000","last_clean":"2022-08-10T17:55:39.818264+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:39.818264+0000","last_undegraded":"2022-08-10T17:55:39.818264+0000","last_fullsized":"2022-08-10T17:55:39.818264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.818135+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:31:58.229281+0000","scrub_duration":0.027795573000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3833,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.499543+0000","last_change":"2022-08-10T17:55:38.499484+0000","last_active":"2022-08-10T17:55:38.499543+0000","last_peered":"2022-08-10T17:55:38.499543+0000","last_clean":"2022-08-10T17:55:38.499543+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:55:38.499543+0000","last_undegraded":"2022-08-10T17:55:38.499543+0000","last_fullsized":"2022-08-10T17:55:38.499543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3805","last_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_deep_scrub":"29'3805","last_deep_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.499317+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:59:44.072729+0000","scrub_duration":0.056492191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.078050+0000","last_change":"2022-08-10T17:55:30.078020+0000","last_active":"2022-08-10T17:55:30.078050+0000","last_peered":"2022-08-10T17:55:30.078050+0000","last_clean":"2022-08-10T17:55:30.078050+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:55:30.078050+0000","last_undegraded":"2022-08-10T17:55:30.078050+0000","last_fullsized":"2022-08-10T17:55:30.078050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.077894+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:33.679903+0000","scrub_duration":0.022499880999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550177+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:55:16.550177+0000","last_peered":"2022-08-10T17:55:16.550177+0000","last_clean":"2022-08-10T17:55:16.550177+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:55:16.550177+0000","last_undegraded":"2022-08-10T17:55:16.550177+0000","last_fullsized":"2022-08-10T17:55:16.550177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.617813+0000","last_change":"2022-08-10T17:55:32.617770+0000","last_active":"2022-08-10T17:55:32.617813+0000","last_peered":"2022-08-10T17:55:32.617813+0000","last_clean":"2022-08-10T17:55:32.617813+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:55:32.617813+0000","last_undegraded":"2022-08-10T17:55:32.617813+0000","last_fullsized":"2022-08-10T17:55:32.617813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3279","last_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_deep_scrub":"29'3279","last_deep_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.617666+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:55:16.394063+0000","scrub_duration":0.060262404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'335","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.385035+0000","last_change":"2022-08-10T17:55:39.385014+0000","last_active":"2022-08-10T17:55:39.385035+0000","last_peered":"2022-08-10T17:55:39.385035+0000","last_clean":"2022-08-10T17:55:39.385035+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:39.385035+0000","last_undegraded":"2022-08-10T17:55:39.385035+0000","last_fullsized":"2022-08-10T17:55:39.385035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'335","last_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_deep_scrub":"29'335","last_deep_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.384919+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:34:51.492681+0000","scrub_duration":0.038040591999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535913+0000","last_change":"2022-08-10T17:35:37.408634+0000","last_active":"2022-08-10T17:55:16.535913+0000","last_peered":"2022-08-10T17:55:16.535913+0000","last_clean":"2022-08-10T17:55:16.535913+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:16.535913+0000","last_undegraded":"2022-08-10T17:55:16.535913+0000","last_fullsized":"2022-08-10T17:55:16.535913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5061,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.072410+0000","last_change":"2022-08-10T17:35:41.445942+0000","last_active":"2022-08-10T17:54:43.072410+0000","last_peered":"2022-08-10T17:54:43.072410+0000","last_clean":"2022-08-10T17:54:43.072410+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:54:43.072410+0000","last_undegraded":"2022-08-10T17:54:43.072410+0000","last_fullsized":"2022-08-10T17:54:43.072410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'56","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.906120+0000","last_change":"2022-08-10T17:55:26.906097+0000","last_active":"2022-08-10T17:55:26.906120+0000","last_peered":"2022-08-10T17:55:26.906120+0000","last_clean":"2022-08-10T17:55:26.906120+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:55:26.906120+0000","last_undegraded":"2022-08-10T17:55:26.906120+0000","last_fullsized":"2022-08-10T17:55:26.906120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.906012+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:01.182562+0000","scrub_duration":0.014215698000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.529463+0000","last_change":"2022-08-10T17:35:37.408755+0000","last_active":"2022-08-10T17:55:16.529463+0000","last_peered":"2022-08-10T17:55:16.529463+0000","last_clean":"2022-08-10T17:55:16.529463+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:16.529463+0000","last_undegraded":"2022-08-10T17:55:16.529463+0000","last_fullsized":"2022-08-10T17:55:16.529463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6354,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.786059+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.786059+0000","last_peered":"2022-08-10T17:54:42.786059+0000","last_clean":"2022-08-10T17:54:42.786059+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.786059+0000","last_undegraded":"2022-08-10T17:54:42.786059+0000","last_fullsized":"2022-08-10T17:54:42.786059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:34.914684+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:34.914684+0000","last_peered":"2022-08-10T17:54:34.914684+0000","last_clean":"2022-08-10T17:54:34.914684+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:34.914684+0000","last_undegraded":"2022-08-10T17:54:34.914684+0000","last_fullsized":"2022-08-10T17:54:34.914684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533946+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:55:16.533946+0000","last_peered":"2022-08-10T17:55:16.533946+0000","last_clean":"2022-08-10T17:55:16.533946+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:55:16.533946+0000","last_undegraded":"2022-08-10T17:55:16.533946+0000","last_fullsized":"2022-08-10T17:55:16.533946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6046,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.055091+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:43.055091+0000","last_peered":"2022-08-10T17:54:43.055091+0000","last_clean":"2022-08-10T17:54:43.055091+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:43.055091+0000","last_undegraded":"2022-08-10T17:54:43.055091+0000","last_fullsized":"2022-08-10T17:54:43.055091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.378188+0000","last_change":"2022-08-10T17:55:32.378165+0000","last_active":"2022-08-10T17:55:32.378188+0000","last_peered":"2022-08-10T17:55:32.378188+0000","last_clean":"2022-08-10T17:55:32.378188+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:55:32.378188+0000","last_undegraded":"2022-08-10T17:55:32.378188+0000","last_fullsized":"2022-08-10T17:55:32.378188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.378072+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:37:51.551862+0000","scrub_duration":0.025084980999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548068+0000","last_change":"2022-08-10T17:36:19.058896+0000","last_active":"2022-08-10T17:55:16.548068+0000","last_peered":"2022-08-10T17:55:16.548068+0000","last_clean":"2022-08-10T17:55:16.548068+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:16.548068+0000","last_undegraded":"2022-08-10T17:55:16.548068+0000","last_fullsized":"2022-08-10T17:55:16.548068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4545,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.644522+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.644522+0000","last_peered":"2022-08-10T17:54:42.644522+0000","last_clean":"2022-08-10T17:54:42.644522+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.644522+0000","last_undegraded":"2022-08-10T17:54:42.644522+0000","last_fullsized":"2022-08-10T17:54:42.644522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.144294+0000","last_change":"2022-08-10T17:55:36.144271+0000","last_active":"2022-08-10T17:55:36.144294+0000","last_peered":"2022-08-10T17:55:36.144294+0000","last_clean":"2022-08-10T17:55:36.144294+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:55:36.144294+0000","last_undegraded":"2022-08-10T17:55:36.144294+0000","last_fullsized":"2022-08-10T17:55:36.144294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.144187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:21:38.195327+0000","scrub_duration":0.028929255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.367621+0000","last_change":"2022-08-10T17:55:38.367599+0000","last_active":"2022-08-10T17:55:38.367621+0000","last_peered":"2022-08-10T17:55:38.367621+0000","last_clean":"2022-08-10T17:55:38.367621+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:38.367621+0000","last_undegraded":"2022-08-10T17:55:38.367621+0000","last_fullsized":"2022-08-10T17:55:38.367621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.367524+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:16:32.842509+0000","scrub_duration":0.0035067779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4360,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.077342+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:43.077342+0000","last_peered":"2022-08-10T17:54:43.077342+0000","last_clean":"2022-08-10T17:54:43.077342+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:43.077342+0000","last_undegraded":"2022-08-10T17:54:43.077342+0000","last_fullsized":"2022-08-10T17:54:43.077342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.070691+0000","last_change":"2022-08-10T17:55:29.070663+0000","last_active":"2022-08-10T17:55:29.070691+0000","last_peered":"2022-08-10T17:55:29.070691+0000","last_clean":"2022-08-10T17:55:29.070691+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:55:29.070691+0000","last_undegraded":"2022-08-10T17:55:29.070691+0000","last_fullsized":"2022-08-10T17:55:29.070691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.070546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:28:30.391516+0000","scrub_duration":0.0035289599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.658541+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:43.658541+0000","last_peered":"2022-08-10T17:54:43.658541+0000","last_clean":"2022-08-10T17:54:43.658541+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:43.658541+0000","last_undegraded":"2022-08-10T17:54:43.658541+0000","last_fullsized":"2022-08-10T17:54:43.658541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.348594+0000","last_change":"2022-08-10T17:55:37.348571+0000","last_active":"2022-08-10T17:55:37.348594+0000","last_peered":"2022-08-10T17:55:37.348594+0000","last_clean":"2022-08-10T17:55:37.348594+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:37.348594+0000","last_undegraded":"2022-08-10T17:55:37.348594+0000","last_fullsized":"2022-08-10T17:55:37.348594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.348475+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:32:44.196786+0000","scrub_duration":0.0035728499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.563629+0000","last_change":"2022-08-10T17:55:36.563579+0000","last_active":"2022-08-10T17:55:36.563629+0000","last_peered":"2022-08-10T17:55:36.563629+0000","last_clean":"2022-08-10T17:55:36.563629+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:55:36.563629+0000","last_undegraded":"2022-08-10T17:55:36.563629+0000","last_fullsized":"2022-08-10T17:55:36.563629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4646","last_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_deep_scrub":"29'4646","last_deep_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.563473+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:09:00.188963+0000","scrub_duration":0.061717941999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.626811+0000","last_change":"2022-08-10T17:55:22.626781+0000","last_active":"2022-08-10T17:55:22.626811+0000","last_peered":"2022-08-10T17:55:22.626811+0000","last_clean":"2022-08-10T17:55:22.626811+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:55:22.626811+0000","last_undegraded":"2022-08-10T17:55:22.626811+0000","last_fullsized":"2022-08-10T17:55:22.626811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.626653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:34.446413+0000","scrub_duration":0.0035853080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.396141+0000","last_change":"2022-08-10T17:55:26.396110+0000","last_active":"2022-08-10T17:55:26.396141+0000","last_peered":"2022-08-10T17:55:26.396141+0000","last_clean":"2022-08-10T17:55:26.396141+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:55:26.396141+0000","last_undegraded":"2022-08-10T17:55:26.396141+0000","last_fullsized":"2022-08-10T17:55:26.396141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.396028+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:22:41.188174+0000","scrub_duration":0.016673178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546660+0000","last_change":"2022-08-10T17:35:37.414084+0000","last_active":"2022-08-10T17:55:16.546660+0000","last_peered":"2022-08-10T17:55:16.546660+0000","last_clean":"2022-08-10T17:55:16.546660+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:16.546660+0000","last_undegraded":"2022-08-10T17:55:16.546660+0000","last_fullsized":"2022-08-10T17:55:16.546660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4787,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085068+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:43.085068+0000","last_peered":"2022-08-10T17:54:43.085068+0000","last_clean":"2022-08-10T17:54:43.085068+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:43.085068+0000","last_undegraded":"2022-08-10T17:54:43.085068+0000","last_fullsized":"2022-08-10T17:54:43.085068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.086112+0000","last_change":"2022-08-10T17:55:27.086083+0000","last_active":"2022-08-10T17:55:27.086112+0000","last_peered":"2022-08-10T17:55:27.086112+0000","last_clean":"2022-08-10T17:55:27.086112+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:55:27.086112+0000","last_undegraded":"2022-08-10T17:55:27.086112+0000","last_fullsized":"2022-08-10T17:55:27.086112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.085971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:11:51.139836+0000","scrub_duration":0.003529314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.998931+0000","last_change":"2022-08-10T17:55:28.998908+0000","last_active":"2022-08-10T17:55:28.998931+0000","last_peered":"2022-08-10T17:55:28.998931+0000","last_clean":"2022-08-10T17:55:28.998931+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:55:28.998931+0000","last_undegraded":"2022-08-10T17:55:28.998931+0000","last_fullsized":"2022-08-10T17:55:28.998931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.998804+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:40:46.133786+0000","scrub_duration":0.020972382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.369120+0000","last_change":"2022-08-10T17:55:31.369098+0000","last_active":"2022-08-10T17:55:31.369120+0000","last_peered":"2022-08-10T17:55:31.369120+0000","last_clean":"2022-08-10T17:55:31.369120+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:55:31.369120+0000","last_undegraded":"2022-08-10T17:55:31.369120+0000","last_fullsized":"2022-08-10T17:55:31.369120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.369017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:19.456252+0000","scrub_duration":0.0034799219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.902416+0000","last_change":"2022-08-10T17:55:31.902390+0000","last_active":"2022-08-10T17:55:31.902416+0000","last_peered":"2022-08-10T17:55:31.902416+0000","last_clean":"2022-08-10T17:55:31.902416+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:31.902416+0000","last_undegraded":"2022-08-10T17:55:31.902416+0000","last_fullsized":"2022-08-10T17:55:31.902416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.902294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:04.476448+0000","scrub_duration":0.027996058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3420,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.969697+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.969697+0000","last_peered":"2022-08-10T17:54:42.969697+0000","last_clean":"2022-08-10T17:54:42.969697+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.969697+0000","last_undegraded":"2022-08-10T17:54:42.969697+0000","last_fullsized":"2022-08-10T17:54:42.969697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.966787+0000","last_change":"2022-08-10T17:55:29.966768+0000","last_active":"2022-08-10T17:55:29.966787+0000","last_peered":"2022-08-10T17:55:29.966787+0000","last_clean":"2022-08-10T17:55:29.966787+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:55:29.966787+0000","last_undegraded":"2022-08-10T17:55:29.966787+0000","last_fullsized":"2022-08-10T17:55:29.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.966669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:30:37.613565+0000","scrub_duration":0.0037818109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'84","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.063945+0000","last_change":"2022-08-10T17:55:34.063912+0000","last_active":"2022-08-10T17:55:34.063945+0000","last_peered":"2022-08-10T17:55:34.063945+0000","last_clean":"2022-08-10T17:55:34.063945+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:55:34.063945+0000","last_undegraded":"2022-08-10T17:55:34.063945+0000","last_fullsized":"2022-08-10T17:55:34.063945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'84","last_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_deep_scrub":"29'84","last_deep_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.063817+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:21:24.542508+0000","scrub_duration":0.019597560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550787+0000","last_change":"2022-08-10T17:35:37.411175+0000","last_active":"2022-08-10T17:55:16.550787+0000","last_peered":"2022-08-10T17:55:16.550787+0000","last_clean":"2022-08-10T17:55:16.550787+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:16.550787+0000","last_undegraded":"2022-08-10T17:55:16.550787+0000","last_fullsized":"2022-08-10T17:55:16.550787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5876,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.675919+0000","last_change":"2022-08-10T17:35:41.442200+0000","last_active":"2022-08-10T17:54:42.675919+0000","last_peered":"2022-08-10T17:54:42.675919+0000","last_clean":"2022-08-10T17:54:42.675919+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:54:42.675919+0000","last_undegraded":"2022-08-10T17:54:42.675919+0000","last_fullsized":"2022-08-10T17:54:42.675919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.069569+0000","last_change":"2022-08-10T17:55:37.069551+0000","last_active":"2022-08-10T17:55:37.069569+0000","last_peered":"2022-08-10T17:55:37.069569+0000","last_clean":"2022-08-10T17:55:37.069569+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:55:37.069569+0000","last_undegraded":"2022-08-10T17:55:37.069569+0000","last_fullsized":"2022-08-10T17:55:37.069569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.069477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:41.886326+0000","scrub_duration":0.0035232359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.399676+0000","last_change":"2022-08-10T17:55:34.399655+0000","last_active":"2022-08-10T17:55:34.399676+0000","last_peered":"2022-08-10T17:55:34.399676+0000","last_clean":"2022-08-10T17:55:34.399676+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:55:34.399676+0000","last_undegraded":"2022-08-10T17:55:34.399676+0000","last_fullsized":"2022-08-10T17:55:34.399676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.399577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:44:22.781395+0000","scrub_duration":0.0034960490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.071382+0000","last_change":"2022-08-10T17:55:33.071345+0000","last_active":"2022-08-10T17:55:33.071382+0000","last_peered":"2022-08-10T17:55:33.071382+0000","last_clean":"2022-08-10T17:55:33.071382+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:33.071382+0000","last_undegraded":"2022-08-10T17:55:33.071382+0000","last_fullsized":"2022-08-10T17:55:33.071382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.071183+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:40:33.068733+0000","scrub_duration":0.0095831489999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2960,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922891+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.922891+0000","last_peered":"2022-08-10T17:54:42.922891+0000","last_clean":"2022-08-10T17:54:42.922891+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.922891+0000","last_undegraded":"2022-08-10T17:54:42.922891+0000","last_fullsized":"2022-08-10T17:54:42.922891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.316191+0000","last_change":"2022-08-10T17:55:37.316154+0000","last_active":"2022-08-10T17:55:37.316191+0000","last_peered":"2022-08-10T17:55:37.316191+0000","last_clean":"2022-08-10T17:55:37.316191+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:55:37.316191+0000","last_undegraded":"2022-08-10T17:55:37.316191+0000","last_fullsized":"2022-08-10T17:55:37.316191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.316067+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:40:23.614188+0000","scrub_duration":0.016809653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.301522+0000","last_change":"2022-08-10T17:55:24.301501+0000","last_active":"2022-08-10T17:55:24.301522+0000","last_peered":"2022-08-10T17:55:24.301522+0000","last_clean":"2022-08-10T17:55:24.301522+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:55:24.301522+0000","last_undegraded":"2022-08-10T17:55:24.301522+0000","last_fullsized":"2022-08-10T17:55:24.301522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.301417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:33:53.898237+0000","scrub_duration":0.0034981370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.337456+0000","last_change":"2022-08-10T17:55:41.337433+0000","last_active":"2022-08-10T17:55:41.337456+0000","last_peered":"2022-08-10T17:55:41.337456+0000","last_clean":"2022-08-10T17:55:41.337456+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:41.337456+0000","last_undegraded":"2022-08-10T17:55:41.337456+0000","last_fullsized":"2022-08-10T17:55:41.337456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.337357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:41:32.970167+0000","scrub_duration":0.0035830240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4330,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.054834+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.054834+0000","last_peered":"2022-08-10T17:54:43.054834+0000","last_clean":"2022-08-10T17:54:43.054834+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.054834+0000","last_undegraded":"2022-08-10T17:54:43.054834+0000","last_fullsized":"2022-08-10T17:54:43.054834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.899289+0000","last_change":"2022-08-10T17:55:23.899252+0000","last_active":"2022-08-10T17:55:23.899289+0000","last_peered":"2022-08-10T17:55:23.899289+0000","last_clean":"2022-08-10T17:55:23.899289+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:55:23.899289+0000","last_undegraded":"2022-08-10T17:55:23.899289+0000","last_fullsized":"2022-08-10T17:55:23.899289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.899118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:10:44.169251+0000","scrub_duration":0.0035038819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'72","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:18.491717+0000","last_change":"2022-08-10T17:35:37.028432+0000","last_active":"2022-08-10T17:55:18.491717+0000","last_peered":"2022-08-10T17:55:18.491717+0000","last_clean":"2022-08-10T17:55:18.491717+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:55:18.491717+0000","last_undegraded":"2022-08-10T17:55:18.491717+0000","last_fullsized":"2022-08-10T17:55:18.491717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548524+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:55:16.548524+0000","last_peered":"2022-08-10T17:55:16.548524+0000","last_clean":"2022-08-10T17:55:16.548524+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:55:16.548524+0000","last_undegraded":"2022-08-10T17:55:16.548524+0000","last_fullsized":"2022-08-10T17:55:16.548524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4824,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.730541+0000","last_change":"2022-08-10T17:35:41.439738+0000","last_active":"2022-08-10T17:54:42.730541+0000","last_peered":"2022-08-10T17:54:42.730541+0000","last_clean":"2022-08-10T17:54:42.730541+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:54:42.730541+0000","last_undegraded":"2022-08-10T17:54:42.730541+0000","last_fullsized":"2022-08-10T17:54:42.730541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1831","reported_seq":1847,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.397133+0000","last_change":"2022-08-10T17:35:37.032752+0000","last_active":"2022-08-10T17:55:17.397133+0000","last_peered":"2022-08-10T17:55:17.397133+0000","last_clean":"2022-08-10T17:55:17.397133+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:17.397133+0000","last_undegraded":"2022-08-10T17:55:17.397133+0000","last_fullsized":"2022-08-10T17:55:17.397133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.601728+0000","last_change":"2022-08-10T17:55:24.601691+0000","last_active":"2022-08-10T17:55:24.601728+0000","last_peered":"2022-08-10T17:55:24.601728+0000","last_clean":"2022-08-10T17:55:24.601728+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:24.601728+0000","last_undegraded":"2022-08-10T17:55:24.601728+0000","last_fullsized":"2022-08-10T17:55:24.601728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.601546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:48:03.331213+0000","scrub_duration":0.0034631699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4543,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.925064+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.925064+0000","last_peered":"2022-08-10T17:54:42.925064+0000","last_clean":"2022-08-10T17:54:42.925064+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.925064+0000","last_undegraded":"2022-08-10T17:54:42.925064+0000","last_fullsized":"2022-08-10T17:54:42.925064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.131177+0000","last_change":"2022-08-10T17:55:35.131146+0000","last_active":"2022-08-10T17:55:35.131177+0000","last_peered":"2022-08-10T17:55:35.131177+0000","last_clean":"2022-08-10T17:55:35.131177+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:55:35.131177+0000","last_undegraded":"2022-08-10T17:55:35.131177+0000","last_fullsized":"2022-08-10T17:55:35.131177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.131014+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:12:57.212526+0000","scrub_duration":0.028963988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536361+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:55:16.536361+0000","last_peered":"2022-08-10T17:55:16.536361+0000","last_clean":"2022-08-10T17:55:16.536361+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:55:16.536361+0000","last_undegraded":"2022-08-10T17:55:16.536361+0000","last_fullsized":"2022-08-10T17:55:16.536361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3895,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.073009+0000","last_change":"2022-08-10T17:35:41.438482+0000","last_active":"2022-08-10T17:54:43.073009+0000","last_peered":"2022-08-10T17:54:43.073009+0000","last_clean":"2022-08-10T17:54:43.073009+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:54:43.073009+0000","last_undegraded":"2022-08-10T17:54:43.073009+0000","last_fullsized":"2022-08-10T17:54:43.073009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.117089+0000","last_change":"2022-08-10T17:55:34.117062+0000","last_active":"2022-08-10T17:55:34.117089+0000","last_peered":"2022-08-10T17:55:34.117089+0000","last_clean":"2022-08-10T17:55:34.117089+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:55:34.117089+0000","last_undegraded":"2022-08-10T17:55:34.117089+0000","last_fullsized":"2022-08-10T17:55:34.117089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.116969+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:43:17.054491+0000","scrub_duration":0.029066613000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535698+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:55:16.535698+0000","last_peered":"2022-08-10T17:55:16.535698+0000","last_clean":"2022-08-10T17:55:16.535698+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:55:16.535698+0000","last_undegraded":"2022-08-10T17:55:16.535698+0000","last_fullsized":"2022-08-10T17:55:16.535698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4424,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.639532+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.639532+0000","last_peered":"2022-08-10T17:54:42.639532+0000","last_clean":"2022-08-10T17:54:42.639532+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.639532+0000","last_undegraded":"2022-08-10T17:54:42.639532+0000","last_fullsized":"2022-08-10T17:54:42.639532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.320131+0000","last_change":"2022-08-10T17:55:33.320112+0000","last_active":"2022-08-10T17:55:33.320131+0000","last_peered":"2022-08-10T17:55:33.320131+0000","last_clean":"2022-08-10T17:55:33.320131+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:55:33.320131+0000","last_undegraded":"2022-08-10T17:55:33.320131+0000","last_fullsized":"2022-08-10T17:55:33.320131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.320028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:04.115098+0000","scrub_duration":0.0034705809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.539660+0000","last_change":"2022-08-10T17:35:37.403658+0000","last_active":"2022-08-10T17:55:16.539660+0000","last_peered":"2022-08-10T17:55:16.539660+0000","last_clean":"2022-08-10T17:55:16.539660+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:16.539660+0000","last_undegraded":"2022-08-10T17:55:16.539660+0000","last_fullsized":"2022-08-10T17:55:16.539660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5521,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.756733+0000","last_change":"2022-08-10T17:35:41.434830+0000","last_active":"2022-08-10T17:54:42.756733+0000","last_peered":"2022-08-10T17:54:42.756733+0000","last_clean":"2022-08-10T17:54:42.756733+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:54:42.756733+0000","last_undegraded":"2022-08-10T17:54:42.756733+0000","last_fullsized":"2022-08-10T17:54:42.756733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'12","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.808297+0000","last_change":"2022-08-10T17:35:37.025750+0000","last_active":"2022-08-10T17:54:42.808297+0000","last_peered":"2022-08-10T17:54:42.808297+0000","last_clean":"2022-08-10T17:54:42.808297+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:54:42.808297+0000","last_undegraded":"2022-08-10T17:54:42.808297+0000","last_fullsized":"2022-08-10T17:54:42.808297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534380+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:55:16.534380+0000","last_peered":"2022-08-10T17:55:16.534380+0000","last_clean":"2022-08-10T17:55:16.534380+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:55:16.534380+0000","last_undegraded":"2022-08-10T17:55:16.534380+0000","last_fullsized":"2022-08-10T17:55:16.534380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.529280+0000","last_change":"2022-08-10T17:35:37.412003+0000","last_active":"2022-08-10T17:55:16.529280+0000","last_peered":"2022-08-10T17:55:16.529280+0000","last_clean":"2022-08-10T17:55:16.529280+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:16.529280+0000","last_undegraded":"2022-08-10T17:55:16.529280+0000","last_fullsized":"2022-08-10T17:55:16.529280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.323409+0000","last_change":"2022-08-10T17:35:37.415812+0000","last_active":"2022-08-10T17:55:17.323409+0000","last_peered":"2022-08-10T17:55:17.323409+0000","last_clean":"2022-08-10T17:55:17.323409+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:17.323409+0000","last_undegraded":"2022-08-10T17:55:17.323409+0000","last_fullsized":"2022-08-10T17:55:17.323409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535365+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:55:16.535365+0000","last_peered":"2022-08-10T17:55:16.535365+0000","last_clean":"2022-08-10T17:55:16.535365+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:55:16.535365+0000","last_undegraded":"2022-08-10T17:55:16.535365+0000","last_fullsized":"2022-08-10T17:55:16.535365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.527231+0000","last_change":"2022-08-10T17:35:37.417942+0000","last_active":"2022-08-10T17:55:16.527231+0000","last_peered":"2022-08-10T17:55:16.527231+0000","last_clean":"2022-08-10T17:55:16.527231+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:16.527231+0000","last_undegraded":"2022-08-10T17:55:16.527231+0000","last_fullsized":"2022-08-10T17:55:16.527231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.336472+0000","last_change":"2022-08-10T17:55:39.336435+0000","last_active":"2022-08-10T17:55:39.336472+0000","last_peered":"2022-08-10T17:55:39.336472+0000","last_clean":"2022-08-10T17:55:39.336472+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:39.336472+0000","last_undegraded":"2022-08-10T17:55:39.336472+0000","last_fullsized":"2022-08-10T17:55:39.336472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.336296+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:42:50.195666+0000","scrub_duration":0.003602035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3277,"ondisk_log_size":3277,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575094,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478196,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475200,"kb_avail":93893644,"statfs":{"total":96636764160,"available":96147091456,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486604800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.435}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.33900000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.26600000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.32600000000000001},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.38900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575094,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503808,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515899392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.7009999999999996,"5min":10.398,"15min":11.797000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":38.445,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.309},{"interface":"front","average":{"1min":4.4139999999999997,"5min":10.430999999999999,"15min":12.347},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":29.300999999999998,"5min":129.767,"15min":129.767},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.2009999999999996,"5min":11.039999999999999,"15min":13.378},"min":{"1min":0.34899999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":25.206,"5min":114.83,"15min":318.94299999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":4.4109999999999996,"5min":11.000999999999999,"15min":11.98},"min":{"1min":0.33600000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":21.338999999999999,"5min":114.842,"15min":119.708},"last":0.56399999999999995}]},{"osd":2,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.407,"5min":1.405,"15min":4.6799999999999997},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.224},"max":{"1min":16.099,"5min":17.885999999999999,"15min":107.033},"last":0.55000000000000004},{"interface":"front","average":{"1min":3.9049999999999998,"5min":1.4019999999999999,"15min":5.0629999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":16.277999999999999,"5min":17.895,"15min":107.062},"last":0.42499999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.3210000000000002,"5min":1.0029999999999999,"15min":2.9049999999999998},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.254},"max":{"1min":16.376999999999999,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.35999999999999999},{"interface":"front","average":{"1min":3.3799999999999999,"5min":1.0840000000000001,"15min":3.1459999999999999},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":16.331,"5min":16.331,"15min":96.870000000000005},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.8500000000000001,"5min":3.0350000000000001,"15min":6.7670000000000003},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.183},"max":{"1min":22.443000000000001,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":3.419,"5min":3.004,"15min":6.7670000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":22.484999999999999,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":2.4569999999999999,"5min":6.5010000000000003,"15min":8.2929999999999993},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":16.129999999999999,"5min":79.944999999999993,"15min":100.741},"last":0.65300000000000002},{"interface":"front","average":{"1min":4.9290000000000003,"5min":7.0510000000000002,"15min":8.3940000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":38.378999999999998,"5min":80.159000000000006,"15min":100.715},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":1.238,"15min":4.101},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":15.968999999999999,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":1.7769999999999999,"5min":0.873,"15min":3.597},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":10.551,"5min":10.551,"15min":59.384},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575092,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621376,"kb_avail":93750132,"statfs":{"total":96636764160,"available":96000135168,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636289024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.30099999999999999},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.33100000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.434}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.45300000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575091,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603984,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596288,"kb_avail":93767856,"statfs":{"total":96636764160,"available":96018284544,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610598912},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.0060000000000002,"5min":10.24,"15min":11.976000000000001},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":23.757000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.45000000000000001},{"interface":"front","average":{"1min":8.7750000000000004,"5min":11.038,"15min":12.311},"min":{"1min":0.28899999999999998,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":59.381999999999998,"5min":93.111999999999995,"15min":111.506},"last":0.32600000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2560000000000002,"5min":1.367,"15min":6.3049999999999997},"min":{"1min":0.23999999999999999,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":21.789000000000001,"5min":21.789000000000001,"15min":130.566},"last":0.42699999999999999},{"interface":"front","average":{"1min":4.4429999999999996,"5min":1.905,"15min":6.4100000000000001},"min":{"1min":0.26400000000000001,"5min":0.252,"15min":0.222},"max":{"1min":21.855,"5min":50.625,"15min":130.63300000000001},"last":0.28399999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.2249999999999996,"5min":1.462,"15min":4.431},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":22.013000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.36099999999999999},{"interface":"front","average":{"1min":5.3639999999999999,"5min":2.028,"15min":4.6799999999999997},"min":{"1min":0.318,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":33.039000000000001,"5min":50.686999999999998,"15min":111.377},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.9939999999999998,"5min":2.089,"15min":7.2450000000000001},"min":{"1min":0.30299999999999999,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":21.960999999999999,"5min":39.814999999999998,"15min":127.629},"last":0.33300000000000002},{"interface":"front","average":{"1min":6.6210000000000004,"5min":2.9220000000000002,"15min":7.468},"min":{"1min":0.374,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":32.966000000000001,"5min":50.734000000000002,"15min":127.497},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":6.6760000000000002,"5min":5.4100000000000001,"15min":8.3859999999999992},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":44.777999999999999,"5min":88.512,"15min":127.77500000000001},"last":0.373},{"interface":"front","average":{"1min":7.5039999999999996,"5min":5.6230000000000002,"15min":8.8490000000000002},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":44.838000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.40200000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.7080000000000002,"5min":1.9259999999999999,"15min":4.7610000000000001},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":22.035,"5min":50.664000000000001,"15min":114.8},"last":0.41399999999999998},{"interface":"front","average":{"1min":5.8470000000000004,"5min":2.149,"15min":5.0810000000000004},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":21.940000000000001,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.502}]},{"osd":7,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2969999999999997,"5min":1.823,"15min":3.4199999999999999},"min":{"1min":0.35899999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":21.975000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":6.3529999999999998,"5min":2.3100000000000001,"15min":4.0389999999999997},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":21.917999999999999,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.436}]}]},{"osd":2,"up_from":13,"seq":55834575093,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.25700000000000001},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":11.993,"15min":15.167},"min":{"1min":0.22600000000000001,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":37.323,"5min":150.911,"15min":433.41199999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":5.6980000000000004,"5min":12.128,"15min":13.394},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":37.259999999999998,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:55:19 2022","interfaces":[{"interface":"back","average":{"1min":4.0640000000000001,"5min":1.1779999999999999,"15min":4.0529999999999999},"min":{"1min":0.29499999999999998,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":250.44200000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":3.8090000000000002,"5min":1.1739999999999999,"15min":2.956},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":19.399000000000001,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":3.48,"15min":7.9800000000000004},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":30.893000000000001,"5min":47.207999999999998,"15min":114.259},"last":0.71699999999999997},{"interface":"front","average":{"1min":4.4050000000000002,"5min":3.3700000000000001,"15min":8.2829999999999995},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":30.867999999999999,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":2.2109999999999999,"5min":4.1440000000000001,"15min":7.8929999999999998},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":9.0790000000000006,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":2.976,"5min":4.2249999999999996,"15min":8.1769999999999996},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":19.873000000000001,"5min":63.508000000000003,"15min":100.22},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":1.2350000000000001,"15min":3.774},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":19.789999999999999,"5min":19.789999999999999,"15min":83.046000000000006},"last":0.52700000000000002},{"interface":"front","average":{"1min":4.2530000000000001,"5min":1.4470000000000001,"15min":3.4809999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":28.131,"5min":28.131,"15min":60.445},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed Aug 10 17:54:58 2022","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":1.4490000000000001,"15min":4.3289999999999997},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.904000000000003,"5min":34.904000000000003,"15min":94.753},"last":0.70499999999999996},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.405,"15min":4.7729999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":19.922999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.60499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575093,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473880,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":471936,"kb_avail":93897960,"statfs":{"total":96636764160,"available":96151511040,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483262464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.28100000000000003},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.24199999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.39900000000000002},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.316}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.44}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.442}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.46200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575094,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559924,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551296,"kb_avail":93811916,"statfs":{"total":96636764160,"available":96063401984,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564527104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.31},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.371}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.436},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.40799999999999997}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575092,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546944,"kb_avail":93824560,"statfs":{"total":96636764160,"available":96076349440,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560070656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.376},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.35699999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.46100000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.436},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:55:44.737 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.737 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.737 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.738 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.738 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.739 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.739 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.739 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.740 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.740 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.741 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.741 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.741 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.742 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.742 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.742 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.743 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.743 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.744 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.744 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.744 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.745 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.745 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.746 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.746 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.746 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.747 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.747 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.747 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.748 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.748 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.749 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.749 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.749 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.750 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.750 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.751 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.751 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.752 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.752 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.752 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.753 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.753 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.753 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.754 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.755 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.755 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.756 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.756 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.757 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.757 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.757 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.758 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.758 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.759 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.759 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.759 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.760 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.760 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.761 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.761 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.761 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.762 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.762 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.763 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.763 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.763 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.764 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.764 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.765 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.765 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.766 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.766 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.766 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:55:44.767 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-08-10T17:56:04.771 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:56:04.894 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 Processor -- start 2022-08-10T17:56:04.895 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 -- start start 2022-08-10T17:56:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb34c070240 0x7fb34c0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.901 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157490 0x7fb34c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0c3020 con 0x7fb34c157060 2022-08-10T17:56:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c156930 con 0x7fb34c070240 2022-08-10T17:56:04.902 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.891+0000 7fb35345b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c156bd0 con 0x7fb34c157490 2022-08-10T17:56:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb34c070240 0x7fb34c0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3509f6700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb34c157060 0x7fb34c0cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58428/0 (socket says 172.21.15.150:58428) 2022-08-10T17:56:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3509f6700 1 -- 172.21.15.150:0/3634665725 learned_addr learned my addr 172.21.15.150:0/3634665725 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:56:04.903 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3519f8700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157490 0x7fb34c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 -- 172.21.15.150:0/3634665725 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157490 msgr2=0x7fb34c0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:56:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157490 0x7fb34c0691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 -- 172.21.15.150:0/3634665725 >> v1:172.21.15.150:6789/0 conn(0x7fb34c157060 legacy=0x7fb34c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:04.904 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb33bfff700 1 -- 172.21.15.150:0/3634665725 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013771815 0 0) 0x7fb34c0c3020 con 0x7fb34c157060 2022-08-10T17:56:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 -- 172.21.15.150:0/3634665725 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c06f770 con 0x7fb34c070240 2022-08-10T17:56:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb3511f7700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c1730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3480096b0 tx=0x7fb3480099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407ea64973b4b4da server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:04.905 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb33bfff700 1 -- 172.21.15.150:0/3634665725 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480107b0 con 0x7fb34c070240 2022-08-10T17:56:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb33bfff700 1 -- 172.21.15.150:0/3634665725 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348010910 con 0x7fb34c070240 2022-08-10T17:56:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.892+0000 7fb33bfff700 1 -- 172.21.15.150:0/3634665725 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348010cc0 con 0x7fb34c070240 2022-08-10T17:56:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 -- 172.21.15.150:0/3634665725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 msgr2=0x7fb34c0c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c1730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3480096b0 tx=0x7fb3480099c0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.906 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 -- 172.21.15.150:0/3634665725 shutdown_connections 2022-08-10T17:56:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157490 0x7fb34c0691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 --2- 172.21.15.150:0/3634665725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c1730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.907 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 -- 172.21.15.150:0/3634665725 >> 172.21.15.150:0/3634665725 conn(0x7fb34c071e40 msgr2=0x7fb34c0cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 -- 172.21.15.150:0/3634665725 shutdown_connections 2022-08-10T17:56:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.893+0000 7fb35345b700 1 -- 172.21.15.150:0/3634665725 wait complete. 2022-08-10T17:56:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.894+0000 7fb35345b700 1 Processor -- start 2022-08-10T17:56:04.908 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.894+0000 7fb35345b700 1 -- start start 2022-08-10T17:56:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157060 0x7fb34c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34c157490 0x7fb34c0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.909 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c56d0 con 0x7fb34c070240 2022-08-10T17:56:04.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c42d0 con 0x7fb34c157490 2022-08-10T17:56:04.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb35345b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c4570 con 0x7fb34c157060 2022-08-10T17:56:04.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb3511f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.910 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb3511f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45754/0 (socket says 172.21.15.150:45754) 2022-08-10T17:56:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb3511f7700 1 -- 172.21.15.150:0/2453725927 learned_addr learned my addr 172.21.15.150:0/2453725927 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:56:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb3509f6700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157060 0x7fb34c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.895+0000 7fb3519f8700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34c157490 0x7fb34c0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.911 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 -- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157060 msgr2=0x7fb34c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157060 0x7fb34c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 -- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34c157490 msgr2=0x7fb34c0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34c157490 0x7fb34c0c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:04.912 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 -- 172.21.15.150:0/2453725927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348009310 con 0x7fb34c070240 2022-08-10T17:56:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb3511f7700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb348013040 tx=0x7fb3480045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348010a80 con 0x7fb34c070240 2022-08-10T17:56:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348010be0 con 0x7fb34c070240 2022-08-10T17:56:04.913 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348004270 con 0x7fb34c070240 2022-08-10T17:56:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c159040 con 0x7fb34c070240 2022-08-10T17:56:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.896+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0c5b40 con 0x7fb34c070240 2022-08-10T17:56:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.897+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c072890 con 0x7fb34c070240 2022-08-10T17:56:04.914 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.898+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fb34800f070 con 0x7fb34c070240 2022-08-10T17:56:04.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.898+0000 7fb339ffb700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 0x7fb32c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:04.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.898+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7fb348021030 con 0x7fb34c070240 2022-08-10T17:56:04.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.899+0000 7fb3509f6700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 0x7fb32c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:04.916 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.899+0000 7fb3509f6700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 0x7fb32c067590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:04.917 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:04.906+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fb3480516e0 con 0x7fb34c070240 2022-08-10T17:56:05.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.082+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb34c0cc8c0 con 0x7fb32c0650e0 2022-08-10T17:56:05.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.093+0000 7fb339ffb700 1 -- 172.21.15.150:0/2453725927 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392231 (secure 0 0 0) 0x7fb34c0cc8c0 con 0x7fb32c0650e0 2022-08-10T17:56:05.102 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:56:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 msgr2=0x7fb32c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 0x7fb32c067590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c007c60 comp rx=0 tx=0).stop 2022-08-10T17:56:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 msgr2=0x7fb34c0c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:05.106 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb348013040 tx=0x7fb3480045d0 comp rx=0 tx=0).stop 2022-08-10T17:56:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 shutdown_connections 2022-08-10T17:56:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fb34c157490 0x7fb34c0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c070240 0x7fb34c0c5190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fb32c0650e0 0x7fb32c067590 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:05.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 --2- 172.21.15.150:0/2453725927 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fb34c157060 0x7fb34c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:05.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 >> 172.21.15.150:0/2453725927 conn(0x7fb34c071e40 msgr2=0x7fb34c0691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:05.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 shutdown_connections 2022-08-10T17:56:05.108 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:05.097+0000 7fb35345b700 1 -- 172.21.15.150:0/2453725927 wait complete. 2022-08-10T17:56:05.109 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:56:05.113 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":641,"stamp":"2022-08-10T17:56:03.807873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152601,"ondisk_log_size":152601,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261744,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4239168,"kb_avail":750712976,"statfs":{"total":773094113280,"available":768730087424,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340908032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002558"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.671542+0000","last_change":"2022-08-10T17:55:23.671511+0000","last_active":"2022-08-10T17:55:23.671542+0000","last_peered":"2022-08-10T17:55:23.671542+0000","last_clean":"2022-08-10T17:55:23.671542+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:23.671542+0000","last_undegraded":"2022-08-10T17:55:23.671542+0000","last_fullsized":"2022-08-10T17:55:23.671542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.671406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:28:06.994122+0000","scrub_duration":0.037043489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.118511+0000","last_change":"2022-08-10T17:55:48.118489+0000","last_active":"2022-08-10T17:55:48.118511+0000","last_peered":"2022-08-10T17:55:48.118511+0000","last_clean":"2022-08-10T17:55:48.118511+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:48.118511+0000","last_undegraded":"2022-08-10T17:55:48.118511+0000","last_fullsized":"2022-08-10T17:55:48.118511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.118410+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:55:58.751362+0000","scrub_duration":0.003595076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.749547+0000","last_change":"2022-08-10T17:55:24.749527+0000","last_active":"2022-08-10T17:55:24.749547+0000","last_peered":"2022-08-10T17:55:24.749547+0000","last_clean":"2022-08-10T17:55:24.749547+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:24.749547+0000","last_undegraded":"2022-08-10T17:55:24.749547+0000","last_fullsized":"2022-08-10T17:55:24.749547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.749427+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:12.518032+0000","scrub_duration":0.0088304560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.879719+0000","last_change":"2022-08-10T17:55:34.879699+0000","last_active":"2022-08-10T17:55:34.879719+0000","last_peered":"2022-08-10T17:55:34.879719+0000","last_clean":"2022-08-10T17:55:34.879719+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:34.879719+0000","last_undegraded":"2022-08-10T17:55:34.879719+0000","last_fullsized":"2022-08-10T17:55:34.879719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.879618+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:21.211782+0000","scrub_duration":0.003479551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.970758+0000","last_change":"2022-08-10T17:55:54.970725+0000","last_active":"2022-08-10T17:55:54.970758+0000","last_peered":"2022-08-10T17:55:54.970758+0000","last_clean":"2022-08-10T17:55:54.970758+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:54.970758+0000","last_undegraded":"2022-08-10T17:55:54.970758+0000","last_fullsized":"2022-08-10T17:55:54.970758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.970624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:58.527187+0000","scrub_duration":0.018586465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547605+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:55:16.547605+0000","last_peered":"2022-08-10T17:55:16.547605+0000","last_clean":"2022-08-10T17:55:16.547605+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:55:16.547605+0000","last_undegraded":"2022-08-10T17:55:16.547605+0000","last_fullsized":"2022-08-10T17:55:16.547605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549480+0000","last_change":"2022-08-10T17:35:37.414381+0000","last_active":"2022-08-10T17:55:16.549480+0000","last_peered":"2022-08-10T17:55:16.549480+0000","last_clean":"2022-08-10T17:55:16.549480+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:55:16.549480+0000","last_undegraded":"2022-08-10T17:55:16.549480+0000","last_fullsized":"2022-08-10T17:55:16.549480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.038721+0000","last_change":"2022-08-10T17:55:50.038689+0000","last_active":"2022-08-10T17:55:50.038721+0000","last_peered":"2022-08-10T17:55:50.038721+0000","last_clean":"2022-08-10T17:55:50.038721+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:50.038721+0000","last_undegraded":"2022-08-10T17:55:50.038721+0000","last_fullsized":"2022-08-10T17:55:50.038721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.038567+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:25:22.148321+0000","scrub_duration":0.0034662680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.017798+0000","last_change":"2022-08-10T17:55:56.017766+0000","last_active":"2022-08-10T17:55:56.017798+0000","last_peered":"2022-08-10T17:55:56.017798+0000","last_clean":"2022-08-10T17:55:56.017798+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:56.017798+0000","last_undegraded":"2022-08-10T17:55:56.017798+0000","last_fullsized":"2022-08-10T17:55:56.017798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.017619+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:34.560662+0000","scrub_duration":0.0309912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.092605+0000","last_change":"2022-08-10T17:55:24.092585+0000","last_active":"2022-08-10T17:55:24.092605+0000","last_peered":"2022-08-10T17:55:24.092605+0000","last_clean":"2022-08-10T17:55:24.092605+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:24.092605+0000","last_undegraded":"2022-08-10T17:55:24.092605+0000","last_fullsized":"2022-08-10T17:55:24.092605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.092509+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:43:12.935816+0000","scrub_duration":0.0044268040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.848285+0000","last_change":"2022-08-10T17:55:50.848264+0000","last_active":"2022-08-10T17:55:50.848285+0000","last_peered":"2022-08-10T17:55:50.848285+0000","last_clean":"2022-08-10T17:55:50.848285+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:50.848285+0000","last_undegraded":"2022-08-10T17:55:50.848285+0000","last_fullsized":"2022-08-10T17:55:50.848285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.848186+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:27:36.860710+0000","scrub_duration":0.0034554989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.587361+0000","last_change":"2022-08-10T17:55:27.587324+0000","last_active":"2022-08-10T17:55:27.587361+0000","last_peered":"2022-08-10T17:55:27.587361+0000","last_clean":"2022-08-10T17:55:27.587361+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:27.587361+0000","last_undegraded":"2022-08-10T17:55:27.587361+0000","last_fullsized":"2022-08-10T17:55:27.587361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.587177+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:18:28.369001+0000","scrub_duration":0.003490515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.597924+0000","last_change":"2022-08-10T17:55:28.597885+0000","last_active":"2022-08-10T17:55:28.597924+0000","last_peered":"2022-08-10T17:55:28.597924+0000","last_clean":"2022-08-10T17:55:28.597924+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:28.597924+0000","last_undegraded":"2022-08-10T17:55:28.597924+0000","last_fullsized":"2022-08-10T17:55:28.597924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.597685+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:50:51.165553+0000","scrub_duration":0.016393403000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.084201+0000","last_change":"2022-08-10T17:55:25.084163+0000","last_active":"2022-08-10T17:55:25.084201+0000","last_peered":"2022-08-10T17:55:25.084201+0000","last_clean":"2022-08-10T17:55:25.084201+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:25.084201+0000","last_undegraded":"2022-08-10T17:55:25.084201+0000","last_fullsized":"2022-08-10T17:55:25.084201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.084023+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:58:36.715764+0000","scrub_duration":0.0035396899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.549404+0000","last_change":"2022-08-10T17:35:37.421628+0000","last_active":"2022-08-10T17:55:16.549404+0000","last_peered":"2022-08-10T17:55:16.549404+0000","last_clean":"2022-08-10T17:55:16.549404+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:55:16.549404+0000","last_undegraded":"2022-08-10T17:55:16.549404+0000","last_fullsized":"2022-08-10T17:55:16.549404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.746364+0000","last_change":"2022-08-10T17:55:32.746346+0000","last_active":"2022-08-10T17:55:32.746364+0000","last_peered":"2022-08-10T17:55:32.746364+0000","last_clean":"2022-08-10T17:55:32.746364+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:32.746364+0000","last_undegraded":"2022-08-10T17:55:32.746364+0000","last_fullsized":"2022-08-10T17:55:32.746364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.746268+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:15.017040+0000","scrub_duration":0.0035363500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.956491+0000","last_change":"2022-08-10T17:55:53.956469+0000","last_active":"2022-08-10T17:55:53.956491+0000","last_peered":"2022-08-10T17:55:53.956491+0000","last_clean":"2022-08-10T17:55:53.956491+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:53.956491+0000","last_undegraded":"2022-08-10T17:55:53.956491+0000","last_fullsized":"2022-08-10T17:55:53.956491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.956366+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:02:03.066925+0000","scrub_duration":0.034545389000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.834163+0000","last_change":"2022-08-10T17:55:44.834143+0000","last_active":"2022-08-10T17:55:44.834163+0000","last_peered":"2022-08-10T17:55:44.834163+0000","last_clean":"2022-08-10T17:55:44.834163+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:44.834163+0000","last_undegraded":"2022-08-10T17:55:44.834163+0000","last_fullsized":"2022-08-10T17:55:44.834163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.834059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:17.359055+0000","scrub_duration":0.0034759230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.602705+0000","last_change":"2022-08-10T17:55:25.602683+0000","last_active":"2022-08-10T17:55:25.602705+0000","last_peered":"2022-08-10T17:55:25.602705+0000","last_clean":"2022-08-10T17:55:25.602705+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:25.602705+0000","last_undegraded":"2022-08-10T17:55:25.602705+0000","last_fullsized":"2022-08-10T17:55:25.602705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.602593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:49:36.908209+0000","scrub_duration":0.015965635999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536111+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:55:16.536111+0000","last_peered":"2022-08-10T17:55:16.536111+0000","last_clean":"2022-08-10T17:55:16.536111+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:55:16.536111+0000","last_undegraded":"2022-08-10T17:55:16.536111+0000","last_fullsized":"2022-08-10T17:55:16.536111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535583+0000","last_change":"2022-08-10T17:35:37.418837+0000","last_active":"2022-08-10T17:55:16.535583+0000","last_peered":"2022-08-10T17:55:16.535583+0000","last_clean":"2022-08-10T17:55:16.535583+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:55:16.535583+0000","last_undegraded":"2022-08-10T17:55:16.535583+0000","last_fullsized":"2022-08-10T17:55:16.535583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.964336+0000","last_change":"2022-08-10T17:55:49.964314+0000","last_active":"2022-08-10T17:55:49.964336+0000","last_peered":"2022-08-10T17:55:49.964336+0000","last_clean":"2022-08-10T17:55:49.964336+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:49.964336+0000","last_undegraded":"2022-08-10T17:55:49.964336+0000","last_fullsized":"2022-08-10T17:55:49.964336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.964237+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:13:15.202875+0000","scrub_duration":0.0034506480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.369947+0000","last_change":"2022-08-10T17:55:57.369922+0000","last_active":"2022-08-10T17:55:57.369947+0000","last_peered":"2022-08-10T17:55:57.369947+0000","last_clean":"2022-08-10T17:55:57.369947+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:57.369947+0000","last_undegraded":"2022-08-10T17:55:57.369947+0000","last_fullsized":"2022-08-10T17:55:57.369947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.369823+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:11:25.548675+0000","scrub_duration":0.023686576000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533588+0000","last_change":"2022-08-10T17:35:37.414417+0000","last_active":"2022-08-10T17:55:16.533588+0000","last_peered":"2022-08-10T17:55:16.533588+0000","last_clean":"2022-08-10T17:55:16.533588+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:55:16.533588+0000","last_undegraded":"2022-08-10T17:55:16.533588+0000","last_fullsized":"2022-08-10T17:55:16.533588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:45.411773+0000","last_change":"2022-08-10T17:55:45.411749+0000","last_active":"2022-08-10T17:55:45.411773+0000","last_peered":"2022-08-10T17:55:45.411773+0000","last_clean":"2022-08-10T17:55:45.411773+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:45.411773+0000","last_undegraded":"2022-08-10T17:55:45.411773+0000","last_fullsized":"2022-08-10T17:55:45.411773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_clean_scrub_stamp":"2022-08-10T17:55:45.411650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:19:32.370100+0000","scrub_duration":0.046072038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.335430+0000","last_change":"2022-08-10T17:55:36.335408+0000","last_active":"2022-08-10T17:55:36.335430+0000","last_peered":"2022-08-10T17:55:36.335430+0000","last_clean":"2022-08-10T17:55:36.335430+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:36.335430+0000","last_undegraded":"2022-08-10T17:55:36.335430+0000","last_fullsized":"2022-08-10T17:55:36.335430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.335326+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:02:07.956826+0000","scrub_duration":0.0034800230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.147493+0000","last_change":"2022-08-10T17:55:38.147458+0000","last_active":"2022-08-10T17:55:38.147493+0000","last_peered":"2022-08-10T17:55:38.147493+0000","last_clean":"2022-08-10T17:55:38.147493+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:38.147493+0000","last_undegraded":"2022-08-10T17:55:38.147493+0000","last_fullsized":"2022-08-10T17:55:38.147493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.147290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:17:04.733650+0000","scrub_duration":0.021995639000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4458,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.460453+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.460453+0000","last_peered":"2022-08-10T17:54:42.460453+0000","last_clean":"2022-08-10T17:54:42.460453+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.460453+0000","last_undegraded":"2022-08-10T17:54:42.460453+0000","last_fullsized":"2022-08-10T17:54:42.460453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.795261+0000","last_change":"2022-08-10T17:35:37.030101+0000","last_active":"2022-08-10T17:54:42.795261+0000","last_peered":"2022-08-10T17:54:42.795261+0000","last_clean":"2022-08-10T17:54:42.795261+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:54:42.795261+0000","last_undegraded":"2022-08-10T17:54:42.795261+0000","last_fullsized":"2022-08-10T17:54:42.795261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.330599+0000","last_change":"2022-08-10T17:55:23.330567+0000","last_active":"2022-08-10T17:55:23.330599+0000","last_peered":"2022-08-10T17:55:23.330599+0000","last_clean":"2022-08-10T17:55:23.330599+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:23.330599+0000","last_undegraded":"2022-08-10T17:55:23.330599+0000","last_fullsized":"2022-08-10T17:55:23.330599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.330462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:10:32.984049+0000","scrub_duration":0.024365404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4722,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.922506+0000","last_change":"2022-08-10T17:55:50.922445+0000","last_active":"2022-08-10T17:55:50.922506+0000","last_peered":"2022-08-10T17:55:50.922506+0000","last_clean":"2022-08-10T17:55:50.922506+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:55:50.922506+0000","last_undegraded":"2022-08-10T17:55:50.922506+0000","last_fullsized":"2022-08-10T17:55:50.922506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4694","last_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_deep_scrub":"29'4694","last_deep_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.922264+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:24:16.270656+0000","scrub_duration":0.059697769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'14","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.422498+0000","last_change":"2022-08-10T17:55:33.422452+0000","last_active":"2022-08-10T17:55:33.422498+0000","last_peered":"2022-08-10T17:55:33.422498+0000","last_clean":"2022-08-10T17:55:33.422498+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:55:33.422498+0000","last_undegraded":"2022-08-10T17:55:33.422498+0000","last_fullsized":"2022-08-10T17:55:33.422498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.422315+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:27.773536+0000","scrub_duration":0.019140213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.009599+0000","last_change":"2022-08-10T17:55:27.009577+0000","last_active":"2022-08-10T17:55:27.009599+0000","last_peered":"2022-08-10T17:55:27.009599+0000","last_clean":"2022-08-10T17:55:27.009599+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:27.009599+0000","last_undegraded":"2022-08-10T17:55:27.009599+0000","last_fullsized":"2022-08-10T17:55:27.009599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.009500+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:15:21.317429+0000","scrub_duration":0.0035028260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4368,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.032149+0000","last_change":"2022-08-10T17:35:41.436688+0000","last_active":"2022-08-10T17:54:43.032149+0000","last_peered":"2022-08-10T17:54:43.032149+0000","last_clean":"2022-08-10T17:54:43.032149+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:54:43.032149+0000","last_undegraded":"2022-08-10T17:54:43.032149+0000","last_fullsized":"2022-08-10T17:54:43.032149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.272824+0000","last_change":"2022-08-10T17:55:34.272805+0000","last_active":"2022-08-10T17:55:34.272824+0000","last_peered":"2022-08-10T17:55:34.272824+0000","last_clean":"2022-08-10T17:55:34.272824+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:55:34.272824+0000","last_undegraded":"2022-08-10T17:55:34.272824+0000","last_fullsized":"2022-08-10T17:55:34.272824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.272714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:36.483574+0000","scrub_duration":0.0034525319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.957655+0000","last_change":"2022-08-10T17:55:29.957632+0000","last_active":"2022-08-10T17:55:29.957655+0000","last_peered":"2022-08-10T17:55:29.957655+0000","last_clean":"2022-08-10T17:55:29.957655+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:29.957655+0000","last_undegraded":"2022-08-10T17:55:29.957655+0000","last_fullsized":"2022-08-10T17:55:29.957655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.957536+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:43:07.254608+0000","scrub_duration":0.062576358999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3617,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.969865+0000","last_change":"2022-08-10T17:55:48.969826+0000","last_active":"2022-08-10T17:55:48.969865+0000","last_peered":"2022-08-10T17:55:48.969865+0000","last_clean":"2022-08-10T17:55:48.969865+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:55:48.969865+0000","last_undegraded":"2022-08-10T17:55:48.969865+0000","last_fullsized":"2022-08-10T17:55:48.969865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3589","last_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_deep_scrub":"29'3589","last_deep_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.969722+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:16.418208+0000","scrub_duration":0.065700320000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'64","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.093868+0000","last_change":"2022-08-10T17:55:35.093847+0000","last_active":"2022-08-10T17:55:35.093868+0000","last_peered":"2022-08-10T17:55:35.093868+0000","last_clean":"2022-08-10T17:55:35.093868+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:55:35.093868+0000","last_undegraded":"2022-08-10T17:55:35.093868+0000","last_fullsized":"2022-08-10T17:55:35.093868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.093760+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:13:33.865196+0000","scrub_duration":0.016913436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.391530+0000","last_change":"2022-08-10T17:55:49.391530+0000","last_active":"2022-08-10T17:55:49.391530+0000","last_peered":"2022-08-10T17:55:49.391530+0000","last_clean":"2022-08-10T17:55:49.391530+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:55:49.391530+0000","last_undegraded":"2022-08-10T17:55:49.391530+0000","last_fullsized":"2022-08-10T17:55:49.391530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4172,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.007366+0000","last_change":"2022-08-10T17:35:41.443437+0000","last_active":"2022-08-10T17:54:43.007366+0000","last_peered":"2022-08-10T17:54:43.007366+0000","last_clean":"2022-08-10T17:54:43.007366+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:54:43.007366+0000","last_undegraded":"2022-08-10T17:54:43.007366+0000","last_fullsized":"2022-08-10T17:54:43.007366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.119148+0000","last_change":"2022-08-10T17:55:32.119128+0000","last_active":"2022-08-10T17:55:32.119148+0000","last_peered":"2022-08-10T17:55:32.119148+0000","last_clean":"2022-08-10T17:55:32.119148+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:55:32.119148+0000","last_undegraded":"2022-08-10T17:55:32.119148+0000","last_fullsized":"2022-08-10T17:55:32.119148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.119046+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:52:27.377502+0000","scrub_duration":0.015219678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.405585+0000","last_change":"2022-08-10T17:55:30.405562+0000","last_active":"2022-08-10T17:55:30.405585+0000","last_peered":"2022-08-10T17:55:30.405585+0000","last_clean":"2022-08-10T17:55:30.405585+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:30.405585+0000","last_undegraded":"2022-08-10T17:55:30.405585+0000","last_fullsized":"2022-08-10T17:55:30.405585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.405460+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:57:23.895561+0000","scrub_duration":0.024012329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5939,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.038487+0000","last_change":"2022-08-10T17:35:41.438694+0000","last_active":"2022-08-10T17:54:43.038487+0000","last_peered":"2022-08-10T17:54:43.038487+0000","last_clean":"2022-08-10T17:54:43.038487+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:54:43.038487+0000","last_undegraded":"2022-08-10T17:54:43.038487+0000","last_fullsized":"2022-08-10T17:54:43.038487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'24","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.079797+0000","last_change":"2022-08-10T17:55:27.079775+0000","last_active":"2022-08-10T17:55:27.079797+0000","last_peered":"2022-08-10T17:55:27.079797+0000","last_clean":"2022-08-10T17:55:27.079797+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:55:27.079797+0000","last_undegraded":"2022-08-10T17:55:27.079797+0000","last_fullsized":"2022-08-10T17:55:27.079797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.079689+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:16:30.544031+0000","scrub_duration":0.026671822000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.370196+0000","last_change":"2022-08-10T17:55:42.370175+0000","last_active":"2022-08-10T17:55:42.370196+0000","last_peered":"2022-08-10T17:55:42.370196+0000","last_clean":"2022-08-10T17:55:42.370196+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:42.370196+0000","last_undegraded":"2022-08-10T17:55:42.370196+0000","last_fullsized":"2022-08-10T17:55:42.370196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.370067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:10.161792+0000","scrub_duration":0.020699707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4213,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:51.434262+0000","last_change":"2022-08-10T17:55:51.434220+0000","last_active":"2022-08-10T17:55:51.434262+0000","last_peered":"2022-08-10T17:55:51.434262+0000","last_clean":"2022-08-10T17:55:51.434262+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:55:51.434262+0000","last_undegraded":"2022-08-10T17:55:51.434262+0000","last_fullsized":"2022-08-10T17:55:51.434262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4185","last_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_deep_scrub":"29'4185","last_deep_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:51.434118+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:56:18.697580+0000","scrub_duration":0.064411632999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'306","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.430409+0000","last_change":"2022-08-10T17:35:37.028400+0000","last_active":"2022-08-10T17:55:16.430409+0000","last_peered":"2022-08-10T17:55:16.430409+0000","last_clean":"2022-08-10T17:55:16.430409+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:55:16.430409+0000","last_undegraded":"2022-08-10T17:55:16.430409+0000","last_fullsized":"2022-08-10T17:55:16.430409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536458+0000","last_change":"2022-08-10T17:35:37.417572+0000","last_active":"2022-08-10T17:55:16.536458+0000","last_peered":"2022-08-10T17:55:16.536458+0000","last_clean":"2022-08-10T17:55:16.536458+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:55:16.536458+0000","last_undegraded":"2022-08-10T17:55:16.536458+0000","last_fullsized":"2022-08-10T17:55:16.536458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5818,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.547448+0000","last_change":"2022-08-10T17:35:41.439892+0000","last_active":"2022-08-10T17:54:42.547448+0000","last_peered":"2022-08-10T17:54:42.547448+0000","last_clean":"2022-08-10T17:54:42.547448+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:54:42.547448+0000","last_undegraded":"2022-08-10T17:54:42.547448+0000","last_fullsized":"2022-08-10T17:54:42.547448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:52.153823+0000","last_change":"2022-08-10T17:55:52.153800+0000","last_active":"2022-08-10T17:55:52.153823+0000","last_peered":"2022-08-10T17:55:52.153823+0000","last_clean":"2022-08-10T17:55:52.153823+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:55:52.153823+0000","last_undegraded":"2022-08-10T17:55:52.153823+0000","last_fullsized":"2022-08-10T17:55:52.153823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_clean_scrub_stamp":"2022-08-10T17:55:52.153704+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:54:56.375867+0000","scrub_duration":0.019208741000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.358355+0000","last_change":"2022-08-10T17:55:25.358323+0000","last_active":"2022-08-10T17:55:25.358355+0000","last_peered":"2022-08-10T17:55:25.358355+0000","last_clean":"2022-08-10T17:55:25.358355+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:25.358355+0000","last_undegraded":"2022-08-10T17:55:25.358355+0000","last_fullsized":"2022-08-10T17:55:25.358355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.358222+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:32:47.761238+0000","scrub_duration":0.024137542000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4286,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:00.464274+0000","last_change":"2022-08-10T17:56:00.464222+0000","last_active":"2022-08-10T17:56:00.464274+0000","last_peered":"2022-08-10T17:56:00.464274+0000","last_clean":"2022-08-10T17:56:00.464274+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:56:00.464274+0000","last_undegraded":"2022-08-10T17:56:00.464274+0000","last_fullsized":"2022-08-10T17:56:00.464274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4258","last_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_deep_scrub":"29'4258","last_deep_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_clean_scrub_stamp":"2022-08-10T17:56:00.464107+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:55:24.422676+0000","scrub_duration":0.051924405999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.061351+0000","last_change":"2022-08-10T17:55:38.061316+0000","last_active":"2022-08-10T17:55:38.061351+0000","last_peered":"2022-08-10T17:55:38.061351+0000","last_clean":"2022-08-10T17:55:38.061351+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:55:38.061351+0000","last_undegraded":"2022-08-10T17:55:38.061351+0000","last_fullsized":"2022-08-10T17:55:38.061351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.061144+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:50.451261+0000","scrub_duration":0.016751453999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.108842+0000","last_change":"2022-08-10T17:55:26.108788+0000","last_active":"2022-08-10T17:55:26.108842+0000","last_peered":"2022-08-10T17:55:26.108842+0000","last_clean":"2022-08-10T17:55:26.108842+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:26.108842+0000","last_undegraded":"2022-08-10T17:55:26.108842+0000","last_fullsized":"2022-08-10T17:55:26.108842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.108605+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:10:35.922613+0000","scrub_duration":0.021195411000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4395,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:58.442683+0000","last_change":"2022-08-10T17:55:58.442647+0000","last_active":"2022-08-10T17:55:58.442683+0000","last_peered":"2022-08-10T17:55:58.442683+0000","last_clean":"2022-08-10T17:55:58.442683+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:55:58.442683+0000","last_undegraded":"2022-08-10T17:55:58.442683+0000","last_fullsized":"2022-08-10T17:55:58.442683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4367","last_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_deep_scrub":"29'4367","last_deep_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_clean_scrub_stamp":"2022-08-10T17:55:58.442543+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:41:05.524327+0000","scrub_duration":0.060906218999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'304","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.097085+0000","last_change":"2022-08-10T17:55:49.097051+0000","last_active":"2022-08-10T17:55:49.097085+0000","last_peered":"2022-08-10T17:55:49.097085+0000","last_clean":"2022-08-10T17:55:49.097085+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:55:49.097085+0000","last_undegraded":"2022-08-10T17:55:49.097085+0000","last_fullsized":"2022-08-10T17:55:49.097085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'304","last_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_deep_scrub":"29'304","last_deep_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.096942+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:12:27.209788+0000","scrub_duration":0.031557822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:17.367413+0000","last_change":"2022-08-10T17:35:37.415495+0000","last_active":"2022-08-10T17:55:17.367413+0000","last_peered":"2022-08-10T17:55:17.367413+0000","last_clean":"2022-08-10T17:55:17.367413+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:55:17.367413+0000","last_undegraded":"2022-08-10T17:55:17.367413+0000","last_fullsized":"2022-08-10T17:55:17.367413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4934,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.103904+0000","last_change":"2022-08-10T17:55:57.103864+0000","last_active":"2022-08-10T17:55:57.103904+0000","last_peered":"2022-08-10T17:55:57.103904+0000","last_clean":"2022-08-10T17:55:57.103904+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:55:57.103904+0000","last_undegraded":"2022-08-10T17:55:57.103904+0000","last_fullsized":"2022-08-10T17:55:57.103904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4906","last_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_deep_scrub":"29'4906","last_deep_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.103765+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:30:44.540506+0000","scrub_duration":0.064568445000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.924288+0000","last_change":"2022-08-10T17:55:24.924251+0000","last_active":"2022-08-10T17:55:24.924288+0000","last_peered":"2022-08-10T17:55:24.924288+0000","last_clean":"2022-08-10T17:55:24.924288+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:55:24.924288+0000","last_undegraded":"2022-08-10T17:55:24.924288+0000","last_fullsized":"2022-08-10T17:55:24.924288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.924118+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:55:21.923386+0000","scrub_duration":0.021377028999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.408869+0000","last_change":"2022-08-10T17:55:27.408845+0000","last_active":"2022-08-10T17:55:27.408869+0000","last_peered":"2022-08-10T17:55:27.408869+0000","last_clean":"2022-08-10T17:55:27.408869+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:27.408869+0000","last_undegraded":"2022-08-10T17:55:27.408869+0000","last_fullsized":"2022-08-10T17:55:27.408869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.408747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:14:38.533949+0000","scrub_duration":0.040517141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.879530+0000","last_change":"2022-08-10T17:35:41.437234+0000","last_active":"2022-08-10T17:54:42.879530+0000","last_peered":"2022-08-10T17:54:42.879530+0000","last_clean":"2022-08-10T17:54:42.879530+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:54:42.879530+0000","last_undegraded":"2022-08-10T17:54:42.879530+0000","last_fullsized":"2022-08-10T17:54:42.879530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.225847+0000","last_change":"2022-08-10T17:55:56.225825+0000","last_active":"2022-08-10T17:55:56.225847+0000","last_peered":"2022-08-10T17:55:56.225847+0000","last_clean":"2022-08-10T17:55:56.225847+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:55:56.225847+0000","last_undegraded":"2022-08-10T17:55:56.225847+0000","last_fullsized":"2022-08-10T17:55:56.225847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.225734+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:48.013865+0000","scrub_duration":0.032000617000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.160168+0000","last_change":"2022-08-10T17:55:37.160149+0000","last_active":"2022-08-10T17:55:37.160168+0000","last_peered":"2022-08-10T17:55:37.160168+0000","last_clean":"2022-08-10T17:55:37.160168+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:37.160168+0000","last_undegraded":"2022-08-10T17:55:37.160168+0000","last_fullsized":"2022-08-10T17:55:37.160168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.160075+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:27:20.436089+0000","scrub_duration":0.0034772340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.648371+0000","last_change":"2022-08-10T17:55:30.648315+0000","last_active":"2022-08-10T17:55:30.648371+0000","last_peered":"2022-08-10T17:55:30.648371+0000","last_clean":"2022-08-10T17:55:30.648371+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:55:30.648371+0000","last_undegraded":"2022-08-10T17:55:30.648371+0000","last_fullsized":"2022-08-10T17:55:30.648371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4353","last_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_deep_scrub":"29'4353","last_deep_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.648133+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:10.184933+0000","scrub_duration":0.067302737000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.138559+0000","last_change":"2022-08-10T17:55:43.138538+0000","last_active":"2022-08-10T17:55:43.138559+0000","last_peered":"2022-08-10T17:55:43.138559+0000","last_clean":"2022-08-10T17:55:43.138559+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:55:43.138559+0000","last_undegraded":"2022-08-10T17:55:43.138559+0000","last_fullsized":"2022-08-10T17:55:43.138559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.138462+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:40.531685+0000","scrub_duration":0.013263829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546276+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:55:16.546276+0000","last_peered":"2022-08-10T17:55:16.546276+0000","last_clean":"2022-08-10T17:55:16.546276+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:55:16.546276+0000","last_undegraded":"2022-08-10T17:55:16.546276+0000","last_fullsized":"2022-08-10T17:55:16.546276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4709,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.577615+0000","last_change":"2022-08-10T17:55:33.577580+0000","last_active":"2022-08-10T17:55:33.577615+0000","last_peered":"2022-08-10T17:55:33.577615+0000","last_clean":"2022-08-10T17:55:33.577615+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:55:33.577615+0000","last_undegraded":"2022-08-10T17:55:33.577615+0000","last_fullsized":"2022-08-10T17:55:33.577615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4681","last_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_deep_scrub":"29'4681","last_deep_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.577468+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:50:41.930237+0000","scrub_duration":0.053293471000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:40.114580+0000","last_change":"2022-08-10T17:55:40.114552+0000","last_active":"2022-08-10T17:55:40.114580+0000","last_peered":"2022-08-10T17:55:40.114580+0000","last_clean":"2022-08-10T17:55:40.114580+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:55:40.114580+0000","last_undegraded":"2022-08-10T17:55:40.114580+0000","last_fullsized":"2022-08-10T17:55:40.114580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:40.114468+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:53:37.748882+0000","scrub_duration":0.013616628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.818264+0000","last_change":"2022-08-10T17:55:39.818234+0000","last_active":"2022-08-10T17:55:39.818264+0000","last_peered":"2022-08-10T17:55:39.818264+0000","last_clean":"2022-08-10T17:55:39.818264+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:39.818264+0000","last_undegraded":"2022-08-10T17:55:39.818264+0000","last_fullsized":"2022-08-10T17:55:39.818264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.818135+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:31:58.229281+0000","scrub_duration":0.027795573000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3833,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.499543+0000","last_change":"2022-08-10T17:55:38.499484+0000","last_active":"2022-08-10T17:55:38.499543+0000","last_peered":"2022-08-10T17:55:38.499543+0000","last_clean":"2022-08-10T17:55:38.499543+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:55:38.499543+0000","last_undegraded":"2022-08-10T17:55:38.499543+0000","last_fullsized":"2022-08-10T17:55:38.499543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3805","last_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_deep_scrub":"29'3805","last_deep_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.499317+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:59:44.072729+0000","scrub_duration":0.056492191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.078050+0000","last_change":"2022-08-10T17:55:30.078020+0000","last_active":"2022-08-10T17:55:30.078050+0000","last_peered":"2022-08-10T17:55:30.078050+0000","last_clean":"2022-08-10T17:55:30.078050+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:55:30.078050+0000","last_undegraded":"2022-08-10T17:55:30.078050+0000","last_fullsized":"2022-08-10T17:55:30.078050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.077894+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:33.679903+0000","scrub_duration":0.022499880999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.550177+0000","last_change":"2022-08-10T17:35:37.410324+0000","last_active":"2022-08-10T17:55:16.550177+0000","last_peered":"2022-08-10T17:55:16.550177+0000","last_clean":"2022-08-10T17:55:16.550177+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:55:16.550177+0000","last_undegraded":"2022-08-10T17:55:16.550177+0000","last_fullsized":"2022-08-10T17:55:16.550177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.617813+0000","last_change":"2022-08-10T17:55:32.617770+0000","last_active":"2022-08-10T17:55:32.617813+0000","last_peered":"2022-08-10T17:55:32.617813+0000","last_clean":"2022-08-10T17:55:32.617813+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:55:32.617813+0000","last_undegraded":"2022-08-10T17:55:32.617813+0000","last_fullsized":"2022-08-10T17:55:32.617813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3279","last_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_deep_scrub":"29'3279","last_deep_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.617666+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:55:16.394063+0000","scrub_duration":0.060262404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'335","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.385035+0000","last_change":"2022-08-10T17:55:39.385014+0000","last_active":"2022-08-10T17:55:39.385035+0000","last_peered":"2022-08-10T17:55:39.385035+0000","last_clean":"2022-08-10T17:55:39.385035+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:39.385035+0000","last_undegraded":"2022-08-10T17:55:39.385035+0000","last_fullsized":"2022-08-10T17:55:39.385035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'335","last_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_deep_scrub":"29'335","last_deep_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.384919+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:34:51.492681+0000","scrub_duration":0.038040591999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.819713+0000","last_change":"2022-08-10T17:55:48.819683+0000","last_active":"2022-08-10T17:55:48.819713+0000","last_peered":"2022-08-10T17:55:48.819713+0000","last_clean":"2022-08-10T17:55:48.819713+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:48.819713+0000","last_undegraded":"2022-08-10T17:55:48.819713+0000","last_fullsized":"2022-08-10T17:55:48.819713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.819544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:07:54.609189+0000","scrub_duration":0.014561592999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5075,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.420110+0000","last_change":"2022-08-10T17:55:54.420077+0000","last_active":"2022-08-10T17:55:54.420110+0000","last_peered":"2022-08-10T17:55:54.420110+0000","last_clean":"2022-08-10T17:55:54.420110+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:55:54.420110+0000","last_undegraded":"2022-08-10T17:55:54.420110+0000","last_fullsized":"2022-08-10T17:55:54.420110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5047","last_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_deep_scrub":"29'5047","last_deep_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.419972+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:37:40.479531+0000","scrub_duration":0.067399972000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'56","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.906120+0000","last_change":"2022-08-10T17:55:26.906097+0000","last_active":"2022-08-10T17:55:26.906120+0000","last_peered":"2022-08-10T17:55:26.906120+0000","last_clean":"2022-08-10T17:55:26.906120+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:55:26.906120+0000","last_undegraded":"2022-08-10T17:55:26.906120+0000","last_fullsized":"2022-08-10T17:55:26.906120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.906012+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:01.182562+0000","scrub_duration":0.014215698000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.925293+0000","last_change":"2022-08-10T17:55:55.925273+0000","last_active":"2022-08-10T17:55:55.925293+0000","last_peered":"2022-08-10T17:55:55.925293+0000","last_clean":"2022-08-10T17:55:55.925293+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:55.925293+0000","last_undegraded":"2022-08-10T17:55:55.925293+0000","last_fullsized":"2022-08-10T17:55:55.925293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.925196+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:07.952289+0000","scrub_duration":0.0034809820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6354,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.786059+0000","last_change":"2022-08-10T17:35:41.433844+0000","last_active":"2022-08-10T17:54:42.786059+0000","last_peered":"2022-08-10T17:54:42.786059+0000","last_clean":"2022-08-10T17:54:42.786059+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:54:42.786059+0000","last_undegraded":"2022-08-10T17:54:42.786059+0000","last_fullsized":"2022-08-10T17:54:42.786059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'7","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:34.914684+0000","last_change":"2022-08-10T17:35:37.025796+0000","last_active":"2022-08-10T17:54:34.914684+0000","last_peered":"2022-08-10T17:54:34.914684+0000","last_clean":"2022-08-10T17:54:34.914684+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:54:34.914684+0000","last_undegraded":"2022-08-10T17:54:34.914684+0000","last_fullsized":"2022-08-10T17:54:34.914684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.533946+0000","last_change":"2022-08-10T17:35:37.416720+0000","last_active":"2022-08-10T17:55:16.533946+0000","last_peered":"2022-08-10T17:55:16.533946+0000","last_clean":"2022-08-10T17:55:16.533946+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:55:16.533946+0000","last_undegraded":"2022-08-10T17:55:16.533946+0000","last_fullsized":"2022-08-10T17:55:16.533946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6046,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.055091+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:43.055091+0000","last_peered":"2022-08-10T17:54:43.055091+0000","last_clean":"2022-08-10T17:54:43.055091+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:43.055091+0000","last_undegraded":"2022-08-10T17:54:43.055091+0000","last_fullsized":"2022-08-10T17:54:43.055091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.378188+0000","last_change":"2022-08-10T17:55:32.378165+0000","last_active":"2022-08-10T17:55:32.378188+0000","last_peered":"2022-08-10T17:55:32.378188+0000","last_clean":"2022-08-10T17:55:32.378188+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:55:32.378188+0000","last_undegraded":"2022-08-10T17:55:32.378188+0000","last_fullsized":"2022-08-10T17:55:32.378188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.378072+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:37:51.551862+0000","scrub_duration":0.025084980999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.387732+0000","last_change":"2022-08-10T17:55:44.387701+0000","last_active":"2022-08-10T17:55:44.387732+0000","last_peered":"2022-08-10T17:55:44.387732+0000","last_clean":"2022-08-10T17:55:44.387732+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:44.387732+0000","last_undegraded":"2022-08-10T17:55:44.387732+0000","last_fullsized":"2022-08-10T17:55:44.387732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.387600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:07:54.771605+0000","scrub_duration":0.016116917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4545,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.644522+0000","last_change":"2022-08-10T17:35:41.437298+0000","last_active":"2022-08-10T17:54:42.644522+0000","last_peered":"2022-08-10T17:54:42.644522+0000","last_clean":"2022-08-10T17:54:42.644522+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:54:42.644522+0000","last_undegraded":"2022-08-10T17:54:42.644522+0000","last_fullsized":"2022-08-10T17:54:42.644522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.144294+0000","last_change":"2022-08-10T17:55:36.144271+0000","last_active":"2022-08-10T17:55:36.144294+0000","last_peered":"2022-08-10T17:55:36.144294+0000","last_clean":"2022-08-10T17:55:36.144294+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:55:36.144294+0000","last_undegraded":"2022-08-10T17:55:36.144294+0000","last_fullsized":"2022-08-10T17:55:36.144294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.144187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:21:38.195327+0000","scrub_duration":0.028929255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.367621+0000","last_change":"2022-08-10T17:55:38.367599+0000","last_active":"2022-08-10T17:55:38.367621+0000","last_peered":"2022-08-10T17:55:38.367621+0000","last_clean":"2022-08-10T17:55:38.367621+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:38.367621+0000","last_undegraded":"2022-08-10T17:55:38.367621+0000","last_fullsized":"2022-08-10T17:55:38.367621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.367524+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:16:32.842509+0000","scrub_duration":0.0035067779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4360,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.077342+0000","last_change":"2022-08-10T17:35:41.437242+0000","last_active":"2022-08-10T17:54:43.077342+0000","last_peered":"2022-08-10T17:54:43.077342+0000","last_clean":"2022-08-10T17:54:43.077342+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:54:43.077342+0000","last_undegraded":"2022-08-10T17:54:43.077342+0000","last_fullsized":"2022-08-10T17:54:43.077342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.070691+0000","last_change":"2022-08-10T17:55:29.070663+0000","last_active":"2022-08-10T17:55:29.070691+0000","last_peered":"2022-08-10T17:55:29.070691+0000","last_clean":"2022-08-10T17:55:29.070691+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:55:29.070691+0000","last_undegraded":"2022-08-10T17:55:29.070691+0000","last_fullsized":"2022-08-10T17:55:29.070691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.070546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:28:30.391516+0000","scrub_duration":0.0035289599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.658541+0000","last_change":"2022-08-10T17:35:37.028001+0000","last_active":"2022-08-10T17:54:43.658541+0000","last_peered":"2022-08-10T17:54:43.658541+0000","last_clean":"2022-08-10T17:54:43.658541+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:54:43.658541+0000","last_undegraded":"2022-08-10T17:54:43.658541+0000","last_fullsized":"2022-08-10T17:54:43.658541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:35.987103+0000","last_clean_scrub_stamp":"2022-08-10T17:35:35.987103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.348594+0000","last_change":"2022-08-10T17:55:37.348571+0000","last_active":"2022-08-10T17:55:37.348594+0000","last_peered":"2022-08-10T17:55:37.348594+0000","last_clean":"2022-08-10T17:55:37.348594+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:37.348594+0000","last_undegraded":"2022-08-10T17:55:37.348594+0000","last_fullsized":"2022-08-10T17:55:37.348594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.348475+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:32:44.196786+0000","scrub_duration":0.0035728499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.563629+0000","last_change":"2022-08-10T17:55:36.563579+0000","last_active":"2022-08-10T17:55:36.563629+0000","last_peered":"2022-08-10T17:55:36.563629+0000","last_clean":"2022-08-10T17:55:36.563629+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:55:36.563629+0000","last_undegraded":"2022-08-10T17:55:36.563629+0000","last_fullsized":"2022-08-10T17:55:36.563629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4646","last_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_deep_scrub":"29'4646","last_deep_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.563473+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:09:00.188963+0000","scrub_duration":0.061717941999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.626811+0000","last_change":"2022-08-10T17:55:22.626781+0000","last_active":"2022-08-10T17:55:22.626811+0000","last_peered":"2022-08-10T17:55:22.626811+0000","last_clean":"2022-08-10T17:55:22.626811+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:55:22.626811+0000","last_undegraded":"2022-08-10T17:55:22.626811+0000","last_fullsized":"2022-08-10T17:55:22.626811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.626653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:34.446413+0000","scrub_duration":0.0035853080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.396141+0000","last_change":"2022-08-10T17:55:26.396110+0000","last_active":"2022-08-10T17:55:26.396141+0000","last_peered":"2022-08-10T17:55:26.396141+0000","last_clean":"2022-08-10T17:55:26.396141+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:55:26.396141+0000","last_undegraded":"2022-08-10T17:55:26.396141+0000","last_fullsized":"2022-08-10T17:55:26.396141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.396028+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:22:41.188174+0000","scrub_duration":0.016673178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.382444+0000","last_change":"2022-08-10T17:55:43.382417+0000","last_active":"2022-08-10T17:55:43.382444+0000","last_peered":"2022-08-10T17:55:43.382444+0000","last_clean":"2022-08-10T17:55:43.382444+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:43.382444+0000","last_undegraded":"2022-08-10T17:55:43.382444+0000","last_fullsized":"2022-08-10T17:55:43.382444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.382310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:35:24.953748+0000","scrub_duration":0.042344012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4787,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085068+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:43.085068+0000","last_peered":"2022-08-10T17:54:43.085068+0000","last_clean":"2022-08-10T17:54:43.085068+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:43.085068+0000","last_undegraded":"2022-08-10T17:54:43.085068+0000","last_fullsized":"2022-08-10T17:54:43.085068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.086112+0000","last_change":"2022-08-10T17:55:27.086083+0000","last_active":"2022-08-10T17:55:27.086112+0000","last_peered":"2022-08-10T17:55:27.086112+0000","last_clean":"2022-08-10T17:55:27.086112+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:55:27.086112+0000","last_undegraded":"2022-08-10T17:55:27.086112+0000","last_fullsized":"2022-08-10T17:55:27.086112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.085971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:11:51.139836+0000","scrub_duration":0.003529314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.998931+0000","last_change":"2022-08-10T17:55:28.998908+0000","last_active":"2022-08-10T17:55:28.998931+0000","last_peered":"2022-08-10T17:55:28.998931+0000","last_clean":"2022-08-10T17:55:28.998931+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:55:28.998931+0000","last_undegraded":"2022-08-10T17:55:28.998931+0000","last_fullsized":"2022-08-10T17:55:28.998931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.998804+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:40:46.133786+0000","scrub_duration":0.020972382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.369120+0000","last_change":"2022-08-10T17:55:31.369098+0000","last_active":"2022-08-10T17:55:31.369120+0000","last_peered":"2022-08-10T17:55:31.369120+0000","last_clean":"2022-08-10T17:55:31.369120+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:55:31.369120+0000","last_undegraded":"2022-08-10T17:55:31.369120+0000","last_fullsized":"2022-08-10T17:55:31.369120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.369017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:19.456252+0000","scrub_duration":0.0034799219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.902416+0000","last_change":"2022-08-10T17:55:31.902390+0000","last_active":"2022-08-10T17:55:31.902416+0000","last_peered":"2022-08-10T17:55:31.902416+0000","last_clean":"2022-08-10T17:55:31.902416+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:31.902416+0000","last_undegraded":"2022-08-10T17:55:31.902416+0000","last_fullsized":"2022-08-10T17:55:31.902416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.902294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:04.476448+0000","scrub_duration":0.027996058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3420,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.969697+0000","last_change":"2022-08-10T17:35:41.442386+0000","last_active":"2022-08-10T17:54:42.969697+0000","last_peered":"2022-08-10T17:54:42.969697+0000","last_clean":"2022-08-10T17:54:42.969697+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:54:42.969697+0000","last_undegraded":"2022-08-10T17:54:42.969697+0000","last_fullsized":"2022-08-10T17:54:42.969697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.966787+0000","last_change":"2022-08-10T17:55:29.966768+0000","last_active":"2022-08-10T17:55:29.966787+0000","last_peered":"2022-08-10T17:55:29.966787+0000","last_clean":"2022-08-10T17:55:29.966787+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:55:29.966787+0000","last_undegraded":"2022-08-10T17:55:29.966787+0000","last_fullsized":"2022-08-10T17:55:29.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.966669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:30:37.613565+0000","scrub_duration":0.0037818109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'84","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.063945+0000","last_change":"2022-08-10T17:55:34.063912+0000","last_active":"2022-08-10T17:55:34.063945+0000","last_peered":"2022-08-10T17:55:34.063945+0000","last_clean":"2022-08-10T17:55:34.063945+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:55:34.063945+0000","last_undegraded":"2022-08-10T17:55:34.063945+0000","last_fullsized":"2022-08-10T17:55:34.063945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'84","last_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_deep_scrub":"29'84","last_deep_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.063817+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:21:24.542508+0000","scrub_duration":0.019597560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.989697+0000","last_change":"2022-08-10T17:55:50.989676+0000","last_active":"2022-08-10T17:55:50.989697+0000","last_peered":"2022-08-10T17:55:50.989697+0000","last_clean":"2022-08-10T17:55:50.989697+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:50.989697+0000","last_undegraded":"2022-08-10T17:55:50.989697+0000","last_fullsized":"2022-08-10T17:55:50.989697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.989601+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:29:39.434990+0000","scrub_duration":0.0035003970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5890,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.906460+0000","last_change":"2022-08-10T17:55:43.906421+0000","last_active":"2022-08-10T17:55:43.906460+0000","last_peered":"2022-08-10T17:55:43.906460+0000","last_clean":"2022-08-10T17:55:43.906460+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:55:43.906460+0000","last_undegraded":"2022-08-10T17:55:43.906460+0000","last_fullsized":"2022-08-10T17:55:43.906460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5862","last_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_deep_scrub":"29'5862","last_deep_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.906317+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:26:06.441129+0000","scrub_duration":0.075268903999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.069569+0000","last_change":"2022-08-10T17:55:37.069551+0000","last_active":"2022-08-10T17:55:37.069569+0000","last_peered":"2022-08-10T17:55:37.069569+0000","last_clean":"2022-08-10T17:55:37.069569+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:55:37.069569+0000","last_undegraded":"2022-08-10T17:55:37.069569+0000","last_fullsized":"2022-08-10T17:55:37.069569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.069477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:41.886326+0000","scrub_duration":0.0035232359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.399676+0000","last_change":"2022-08-10T17:55:34.399655+0000","last_active":"2022-08-10T17:55:34.399676+0000","last_peered":"2022-08-10T17:55:34.399676+0000","last_clean":"2022-08-10T17:55:34.399676+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:55:34.399676+0000","last_undegraded":"2022-08-10T17:55:34.399676+0000","last_fullsized":"2022-08-10T17:55:34.399676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.399577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:44:22.781395+0000","scrub_duration":0.0034960490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.071382+0000","last_change":"2022-08-10T17:55:33.071345+0000","last_active":"2022-08-10T17:55:33.071382+0000","last_peered":"2022-08-10T17:55:33.071382+0000","last_clean":"2022-08-10T17:55:33.071382+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:33.071382+0000","last_undegraded":"2022-08-10T17:55:33.071382+0000","last_fullsized":"2022-08-10T17:55:33.071382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.071183+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:40:33.068733+0000","scrub_duration":0.0095831489999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2960,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922891+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.922891+0000","last_peered":"2022-08-10T17:54:42.922891+0000","last_clean":"2022-08-10T17:54:42.922891+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.922891+0000","last_undegraded":"2022-08-10T17:54:42.922891+0000","last_fullsized":"2022-08-10T17:54:42.922891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.316191+0000","last_change":"2022-08-10T17:55:37.316154+0000","last_active":"2022-08-10T17:55:37.316191+0000","last_peered":"2022-08-10T17:55:37.316191+0000","last_clean":"2022-08-10T17:55:37.316191+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:55:37.316191+0000","last_undegraded":"2022-08-10T17:55:37.316191+0000","last_fullsized":"2022-08-10T17:55:37.316191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.316067+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:40:23.614188+0000","scrub_duration":0.016809653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.301522+0000","last_change":"2022-08-10T17:55:24.301501+0000","last_active":"2022-08-10T17:55:24.301522+0000","last_peered":"2022-08-10T17:55:24.301522+0000","last_clean":"2022-08-10T17:55:24.301522+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:55:24.301522+0000","last_undegraded":"2022-08-10T17:55:24.301522+0000","last_fullsized":"2022-08-10T17:55:24.301522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.301417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:33:53.898237+0000","scrub_duration":0.0034981370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.337456+0000","last_change":"2022-08-10T17:55:41.337433+0000","last_active":"2022-08-10T17:55:41.337456+0000","last_peered":"2022-08-10T17:55:41.337456+0000","last_clean":"2022-08-10T17:55:41.337456+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:41.337456+0000","last_undegraded":"2022-08-10T17:55:41.337456+0000","last_fullsized":"2022-08-10T17:55:41.337456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.337357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:41:32.970167+0000","scrub_duration":0.0035830240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4330,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.054834+0000","last_change":"2022-08-10T17:35:41.443999+0000","last_active":"2022-08-10T17:54:43.054834+0000","last_peered":"2022-08-10T17:54:43.054834+0000","last_clean":"2022-08-10T17:54:43.054834+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:54:43.054834+0000","last_undegraded":"2022-08-10T17:54:43.054834+0000","last_fullsized":"2022-08-10T17:54:43.054834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.899289+0000","last_change":"2022-08-10T17:55:23.899252+0000","last_active":"2022-08-10T17:55:23.899289+0000","last_peered":"2022-08-10T17:55:23.899289+0000","last_clean":"2022-08-10T17:55:23.899289+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:55:23.899289+0000","last_undegraded":"2022-08-10T17:55:23.899289+0000","last_fullsized":"2022-08-10T17:55:23.899289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.899118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:10:44.169251+0000","scrub_duration":0.0035038819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'73","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.041014+0000","last_change":"2022-08-10T17:55:41.040993+0000","last_active":"2022-08-10T17:55:41.041014+0000","last_peered":"2022-08-10T17:55:41.041014+0000","last_clean":"2022-08-10T17:55:41.041014+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:55:41.041014+0000","last_undegraded":"2022-08-10T17:55:41.041014+0000","last_fullsized":"2022-08-10T17:55:41.041014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.040907+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:49:13.722929+0000","scrub_duration":0.024350785999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.548524+0000","last_change":"2022-08-10T17:35:37.405726+0000","last_active":"2022-08-10T17:55:16.548524+0000","last_peered":"2022-08-10T17:55:16.548524+0000","last_clean":"2022-08-10T17:55:16.548524+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:55:16.548524+0000","last_undegraded":"2022-08-10T17:55:16.548524+0000","last_fullsized":"2022-08-10T17:55:16.548524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4838,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.416166+0000","last_change":"2022-08-10T17:55:53.416111+0000","last_active":"2022-08-10T17:55:53.416166+0000","last_peered":"2022-08-10T17:55:53.416166+0000","last_clean":"2022-08-10T17:55:53.416166+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:55:53.416166+0000","last_undegraded":"2022-08-10T17:55:53.416166+0000","last_fullsized":"2022-08-10T17:55:53.416166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4810","last_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_deep_scrub":"29'4810","last_deep_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.416011+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:10.405949+0000","scrub_duration":0.05286983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1834","reported_seq":1864,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:47.965716+0000","last_change":"2022-08-10T17:55:47.965696+0000","last_active":"2022-08-10T17:55:47.965716+0000","last_peered":"2022-08-10T17:55:47.965716+0000","last_clean":"2022-08-10T17:55:47.965716+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:47.965716+0000","last_undegraded":"2022-08-10T17:55:47.965716+0000","last_fullsized":"2022-08-10T17:55:47.965716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1834","last_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_deep_scrub":"29'1834","last_deep_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_clean_scrub_stamp":"2022-08-10T17:55:47.965611+0000","objects_scrubbed":3,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:45.463809+0000","scrub_duration":0.038525047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.601728+0000","last_change":"2022-08-10T17:55:24.601691+0000","last_active":"2022-08-10T17:55:24.601728+0000","last_peered":"2022-08-10T17:55:24.601728+0000","last_clean":"2022-08-10T17:55:24.601728+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:24.601728+0000","last_undegraded":"2022-08-10T17:55:24.601728+0000","last_fullsized":"2022-08-10T17:55:24.601728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.601546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:48:03.331213+0000","scrub_duration":0.0034631699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4543,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.925064+0000","last_change":"2022-08-10T17:35:41.438251+0000","last_active":"2022-08-10T17:54:42.925064+0000","last_peered":"2022-08-10T17:54:42.925064+0000","last_clean":"2022-08-10T17:54:42.925064+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:54:42.925064+0000","last_undegraded":"2022-08-10T17:54:42.925064+0000","last_fullsized":"2022-08-10T17:54:42.925064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.131177+0000","last_change":"2022-08-10T17:55:35.131146+0000","last_active":"2022-08-10T17:55:35.131177+0000","last_peered":"2022-08-10T17:55:35.131177+0000","last_clean":"2022-08-10T17:55:35.131177+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:55:35.131177+0000","last_undegraded":"2022-08-10T17:55:35.131177+0000","last_fullsized":"2022-08-10T17:55:35.131177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.131014+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:12:57.212526+0000","scrub_duration":0.028963988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536361+0000","last_change":"2022-08-10T17:35:37.407875+0000","last_active":"2022-08-10T17:55:16.536361+0000","last_peered":"2022-08-10T17:55:16.536361+0000","last_clean":"2022-08-10T17:55:16.536361+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:55:16.536361+0000","last_undegraded":"2022-08-10T17:55:16.536361+0000","last_fullsized":"2022-08-10T17:55:16.536361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3909,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.144536+0000","last_change":"2022-08-10T17:55:54.144477+0000","last_active":"2022-08-10T17:55:54.144536+0000","last_peered":"2022-08-10T17:55:54.144536+0000","last_clean":"2022-08-10T17:55:54.144536+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:55:54.144536+0000","last_undegraded":"2022-08-10T17:55:54.144536+0000","last_fullsized":"2022-08-10T17:55:54.144536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3881","last_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_deep_scrub":"29'3881","last_deep_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.144322+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:34.319790+0000","scrub_duration":0.066230998999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.117089+0000","last_change":"2022-08-10T17:55:34.117062+0000","last_active":"2022-08-10T17:55:34.117089+0000","last_peered":"2022-08-10T17:55:34.117089+0000","last_clean":"2022-08-10T17:55:34.117089+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:55:34.117089+0000","last_undegraded":"2022-08-10T17:55:34.117089+0000","last_fullsized":"2022-08-10T17:55:34.117089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.116969+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:43:17.054491+0000","scrub_duration":0.029066613000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535698+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:55:16.535698+0000","last_peered":"2022-08-10T17:55:16.535698+0000","last_clean":"2022-08-10T17:55:16.535698+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:55:16.535698+0000","last_undegraded":"2022-08-10T17:55:16.535698+0000","last_fullsized":"2022-08-10T17:55:16.535698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4424,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.639532+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.639532+0000","last_peered":"2022-08-10T17:54:42.639532+0000","last_clean":"2022-08-10T17:54:42.639532+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.639532+0000","last_undegraded":"2022-08-10T17:54:42.639532+0000","last_fullsized":"2022-08-10T17:54:42.639532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.320131+0000","last_change":"2022-08-10T17:55:33.320112+0000","last_active":"2022-08-10T17:55:33.320131+0000","last_peered":"2022-08-10T17:55:33.320131+0000","last_clean":"2022-08-10T17:55:33.320131+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:55:33.320131+0000","last_undegraded":"2022-08-10T17:55:33.320131+0000","last_fullsized":"2022-08-10T17:55:33.320131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.320028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:04.115098+0000","scrub_duration":0.0034705809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.392253+0000","last_change":"2022-08-10T17:55:50.392218+0000","last_active":"2022-08-10T17:55:50.392253+0000","last_peered":"2022-08-10T17:55:50.392253+0000","last_clean":"2022-08-10T17:55:50.392253+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:50.392253+0000","last_undegraded":"2022-08-10T17:55:50.392253+0000","last_fullsized":"2022-08-10T17:55:50.392253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.392108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:07.042516+0000","scrub_duration":0.026038200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5535,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.445165+0000","last_change":"2022-08-10T17:55:49.445116+0000","last_active":"2022-08-10T17:55:49.445165+0000","last_peered":"2022-08-10T17:55:49.445165+0000","last_clean":"2022-08-10T17:55:49.445165+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:55:49.445165+0000","last_undegraded":"2022-08-10T17:55:49.445165+0000","last_fullsized":"2022-08-10T17:55:49.445165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5507","last_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_deep_scrub":"29'5507","last_deep_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.445013+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:23:49.478670+0000","scrub_duration":0.071917088000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.971860+0000","last_change":"2022-08-10T17:55:42.971824+0000","last_active":"2022-08-10T17:55:42.971860+0000","last_peered":"2022-08-10T17:55:42.971860+0000","last_clean":"2022-08-10T17:55:42.971860+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:55:42.971860+0000","last_undegraded":"2022-08-10T17:55:42.971860+0000","last_fullsized":"2022-08-10T17:55:42.971860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.971742+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:21:05.087309+0000","scrub_duration":0.019130503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.534380+0000","last_change":"2022-08-10T17:35:37.413707+0000","last_active":"2022-08-10T17:55:16.534380+0000","last_peered":"2022-08-10T17:55:16.534380+0000","last_clean":"2022-08-10T17:55:16.534380+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:55:16.534380+0000","last_undegraded":"2022-08-10T17:55:16.534380+0000","last_fullsized":"2022-08-10T17:55:16.534380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.797625+0000","last_change":"2022-08-10T17:55:42.797602+0000","last_active":"2022-08-10T17:55:42.797625+0000","last_peered":"2022-08-10T17:55:42.797625+0000","last_clean":"2022-08-10T17:55:42.797625+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:42.797625+0000","last_undegraded":"2022-08-10T17:55:42.797625+0000","last_fullsized":"2022-08-10T17:55:42.797625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.797520+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:36.624748+0000","scrub_duration":0.0035868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.426634+0000","last_change":"2022-08-10T17:55:55.426610+0000","last_active":"2022-08-10T17:55:55.426634+0000","last_peered":"2022-08-10T17:55:55.426634+0000","last_clean":"2022-08-10T17:55:55.426634+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:55.426634+0000","last_undegraded":"2022-08-10T17:55:55.426634+0000","last_fullsized":"2022-08-10T17:55:55.426634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.426506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:30:26.689886+0000","scrub_duration":0.023987992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535365+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:55:16.535365+0000","last_peered":"2022-08-10T17:55:16.535365+0000","last_clean":"2022-08-10T17:55:16.535365+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:55:16.535365+0000","last_undegraded":"2022-08-10T17:55:16.535365+0000","last_fullsized":"2022-08-10T17:55:16.535365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.495214+0000","last_change":"2022-08-10T17:55:53.495189+0000","last_active":"2022-08-10T17:55:53.495214+0000","last_peered":"2022-08-10T17:55:53.495214+0000","last_clean":"2022-08-10T17:55:53.495214+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:53.495214+0000","last_undegraded":"2022-08-10T17:55:53.495214+0000","last_fullsized":"2022-08-10T17:55:53.495214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.495082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:02.429575+0000","scrub_duration":0.031547311000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.336472+0000","last_change":"2022-08-10T17:55:39.336435+0000","last_active":"2022-08-10T17:55:39.336472+0000","last_peered":"2022-08-10T17:55:39.336472+0000","last_clean":"2022-08-10T17:55:39.336472+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:39.336472+0000","last_undegraded":"2022-08-10T17:55:39.336472+0000","last_fullsized":"2022-08-10T17:55:39.336472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.336296+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:42:50.195666+0000","scrub_duration":0.003602035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3294,"ondisk_log_size":3294,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575098,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478196,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475200,"kb_avail":93893644,"statfs":{"total":96636764160,"available":96147091456,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486604800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":14.324,"15min":13.169},"min":{"1min":0.318,"5min":0.20599999999999999,"15min":0.193},"max":{"1min":14.875,"5min":111.864,"15min":140.46000000000001},"last":0.374},{"interface":"front","average":{"1min":1.877,"5min":14.297000000000001,"15min":13.265000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":8.2089999999999996,"5min":112.184,"15min":140.48099999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.5059999999999998,"5min":9.1479999999999997,"15min":10.211},"min":{"1min":0.316,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":19.739999999999998,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":3.5329999999999999,"5min":9.1609999999999996,"15min":10.135},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.215},"max":{"1min":19.771999999999998,"5min":70.302999999999997,"15min":78.843000000000004},"last":0.38}]},{"osd":2,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":2.0409999999999999,"15min":3.8929999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":8.4779999999999998,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1509999999999998,"15min":3.6819999999999999},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":8.093,"5min":43.933,"15min":60.771999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:55:05 2022","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":0.76100000000000001,"15min":4.3620000000000001},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.20499999999999999},"max":{"1min":13.641999999999999,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":2.1859999999999999,"5min":0.84699999999999998,"15min":4.1459999999999999},"min":{"1min":0.30199999999999999,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":14.845000000000001,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.433}]},{"osd":4,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.069,"5min":1.242,"15min":5.6609999999999996},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.218},"max":{"1min":16.939,"5min":16.939,"15min":81.718999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4810000000000001,"5min":0.94099999999999995,"15min":5.6420000000000003},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":16.827000000000002,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":3.7890000000000001,"5min":4.8789999999999996,"15min":9.0410000000000004},"min":{"1min":0.308,"5min":0.251,"15min":0.215},"max":{"1min":21.684000000000001,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.308},{"interface":"front","average":{"1min":3.0990000000000002,"5min":4.8109999999999999,"15min":8.9600000000000009},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":14.672000000000001,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.35999999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:55:00 2022","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":0.77500000000000002,"15min":3.161},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.247},"max":{"1min":9.0060000000000002,"5min":10.731999999999999,"15min":72.474999999999994},"last":0.316},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.0089999999999999,"15min":3.1499999999999999},"min":{"1min":0.32000000000000001,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":20.064,"5min":20.064,"15min":72.403999999999996},"last":0.32600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575098,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503808,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515899392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.7009999999999996,"5min":10.398,"15min":11.797000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":38.445,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":4.4139999999999997,"5min":10.430999999999999,"15min":12.347},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":29.300999999999998,"5min":129.767,"15min":129.767},"last":0.317}]},{"osd":1,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":4.2009999999999996,"5min":11.039999999999999,"15min":13.378},"min":{"1min":0.34899999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":25.206,"5min":114.83,"15min":318.94299999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":4.4109999999999996,"5min":11.000999999999999,"15min":11.98},"min":{"1min":0.33600000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":21.338999999999999,"5min":114.842,"15min":119.708},"last":0.434}]},{"osd":2,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.407,"5min":1.405,"15min":4.6799999999999997},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.224},"max":{"1min":16.099,"5min":17.885999999999999,"15min":107.033},"last":0.374},{"interface":"front","average":{"1min":3.9049999999999998,"5min":1.4019999999999999,"15min":5.0629999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":16.277999999999999,"5min":17.895,"15min":107.062},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.3210000000000002,"5min":1.0029999999999999,"15min":2.9049999999999998},"min":{"1min":0.33500000000000002,"5min":0.255,"15min":0.254},"max":{"1min":16.376999999999999,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":3.3799999999999999,"5min":1.0840000000000001,"15min":3.1459999999999999},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":16.331,"5min":16.331,"15min":96.870000000000005},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.8500000000000001,"5min":3.0350000000000001,"15min":6.7670000000000003},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.183},"max":{"1min":22.443000000000001,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":3.419,"5min":3.004,"15min":6.7670000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":22.484999999999999,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.443}]},{"osd":5,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":2.4569999999999999,"5min":6.5010000000000003,"15min":8.2929999999999993},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":16.129999999999999,"5min":79.944999999999993,"15min":100.741},"last":0.39200000000000002},{"interface":"front","average":{"1min":4.9290000000000003,"5min":7.0510000000000002,"15min":8.3940000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":38.378999999999998,"5min":80.159000000000006,"15min":100.715},"last":0.40100000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:12 2022","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":1.238,"15min":4.101},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":15.968999999999999,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":0.873,"15min":3.597},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":10.551,"5min":10.551,"15min":59.384},"last":0.47099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575096,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621772,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621440,"kb_avail":93750068,"statfs":{"total":96636764160,"available":96000069632,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636354560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.3719999999999999,"5min":12.138999999999999,"15min":12.065},"min":{"1min":0.216,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":28.741,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.311},{"interface":"front","average":{"1min":5.1559999999999997,"5min":11.811999999999999,"15min":11.930999999999999},"min":{"1min":0.193,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":30.305,"5min":116.699,"15min":116.699},"last":0.38200000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.2220000000000004,"5min":1.712,"15min":5.5129999999999999},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":28.670000000000002,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":4.5259999999999998,"5min":1.5489999999999999,"15min":5.1189999999999998},"min":{"1min":0.252,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":28.707000000000001,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":1.363,"15min":3.5499999999999998},"min":{"1min":0.309,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":16.419,"5min":25.152000000000001,"15min":87.884},"last":0.372},{"interface":"front","average":{"1min":8.9550000000000001,"5min":2.4609999999999999,"15min":3.7050000000000001},"min":{"1min":0.245,"5min":0.20000000000000001,"15min":0.16600000000000001},"max":{"1min":36.569000000000003,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.317}]},{"osd":4,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":4.6909999999999998,"5min":2.927,"15min":8.4130000000000003},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":19.536999999999999,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":4.0800000000000001,"5min":3.153,"15min":8.5269999999999992},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":19.713999999999999,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.40300000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":6.8940000000000001,"5min":4.3079999999999998,"15min":9.0820000000000007},"min":{"1min":0.35899999999999999,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":35.956000000000003,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":5.8140000000000001,"5min":4.1509999999999998,"15min":9.2829999999999995},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":28.789000000000001,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.435}]},{"osd":6,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":5.3799999999999999,"5min":1.6739999999999999,"15min":4.6559999999999997},"min":{"1min":0.438,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":30.183,"5min":30.183,"15min":115.45999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":5.4109999999999996,"5min":1.728,"15min":4.3040000000000003},"min":{"1min":0.45300000000000001,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":30.236000000000001,"5min":30.236000000000001,"15min":115.346},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":1.4510000000000001,"15min":3.206},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":12.015000000000001,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.496},{"interface":"front","average":{"1min":3.145,"5min":1.181,"15min":3.1600000000000001},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29499999999999998},"max":{"1min":11.885,"5min":11.885,"15min":58.526000000000003},"last":0.45000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575095,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604048,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596352,"kb_avail":93767792,"statfs":{"total":96636764160,"available":96018219008,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610664448},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.0060000000000002,"5min":10.24,"15min":11.976000000000001},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":23.757000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.33100000000000002},{"interface":"front","average":{"1min":8.7750000000000004,"5min":11.038,"15min":12.311},"min":{"1min":0.28899999999999998,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":59.381999999999998,"5min":93.111999999999995,"15min":111.506},"last":0.35399999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2560000000000002,"5min":1.367,"15min":6.3049999999999997},"min":{"1min":0.23999999999999999,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":21.789000000000001,"5min":21.789000000000001,"15min":130.566},"last":0.27100000000000002},{"interface":"front","average":{"1min":4.4429999999999996,"5min":1.905,"15min":6.4100000000000001},"min":{"1min":0.26400000000000001,"5min":0.252,"15min":0.222},"max":{"1min":21.855,"5min":50.625,"15min":130.63300000000001},"last":0.312}]},{"osd":3,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":5.2249999999999996,"5min":1.462,"15min":4.431},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":22.013000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.28399999999999997},{"interface":"front","average":{"1min":5.3639999999999999,"5min":2.028,"15min":4.6799999999999997},"min":{"1min":0.318,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":33.039000000000001,"5min":50.686999999999998,"15min":111.377},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.9939999999999998,"5min":2.089,"15min":7.2450000000000001},"min":{"1min":0.30299999999999999,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":21.960999999999999,"5min":39.814999999999998,"15min":127.629},"last":0.375},{"interface":"front","average":{"1min":6.6210000000000004,"5min":2.9220000000000002,"15min":7.468},"min":{"1min":0.374,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":32.966000000000001,"5min":50.734000000000002,"15min":127.497},"last":0.38300000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":6.6760000000000002,"5min":5.4100000000000001,"15min":8.3859999999999992},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":44.777999999999999,"5min":88.512,"15min":127.77500000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":7.5039999999999996,"5min":5.6230000000000002,"15min":8.8490000000000002},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":44.838000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.7080000000000002,"5min":1.9259999999999999,"15min":4.7610000000000001},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":22.035,"5min":50.664000000000001,"15min":114.8},"last":0.47099999999999997},{"interface":"front","average":{"1min":5.8470000000000004,"5min":2.149,"15min":5.0810000000000004},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":21.940000000000001,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:55:14 2022","interfaces":[{"interface":"back","average":{"1min":4.2969999999999997,"5min":1.823,"15min":3.4199999999999999},"min":{"1min":0.35899999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":21.975000000000001,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":6.3529999999999998,"5min":2.3100000000000001,"15min":4.0389999999999997},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":21.917999999999999,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575097,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:07 2022","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":16.533999999999999,"15min":15.516999999999999},"min":{"1min":0.19600000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":19.425000000000001,"5min":117.869,"15min":117.869},"last":0.28000000000000003},{"interface":"front","average":{"1min":3.262,"5min":16.48,"15min":16.539000000000001},"min":{"1min":0.22500000000000001,"5min":0.218,"15min":0.19500000000000001},"max":{"1min":19.829000000000001,"5min":117.889,"15min":117.889},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":8.7029999999999994,"15min":12.433999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.185},"max":{"1min":0.38100000000000001,"5min":150.911,"15min":150.911},"last":0.249},{"interface":"front","average":{"1min":0.35299999999999998,"5min":8.8629999999999995,"15min":12.443},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":0.53000000000000003,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.316}]},{"osd":3,"last update":"Wed Aug 10 17:55:19 2022","interfaces":[{"interface":"back","average":{"1min":4.0640000000000001,"5min":1.1779999999999999,"15min":4.0529999999999999},"min":{"1min":0.29499999999999998,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":21.376000000000001,"5min":21.376000000000001,"15min":250.44200000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":3.8090000000000002,"5min":1.1739999999999999,"15min":2.956},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":19.399000000000001,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.29799999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":2.851,"15min":7.4329999999999998},"min":{"1min":0.373,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":0.71699999999999997,"5min":47.207999999999998,"15min":114.259},"last":0.373},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.7519999999999998,"15min":7.6630000000000003},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71099999999999997,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.379}]},{"osd":5,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":2.887,"15min":7.3529999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":0.72999999999999998,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.433,"5min":3.0209999999999999,"15min":7.3540000000000001},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":63.508000000000003,"15min":100.22},"last":0.35399999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.1200000000000001,"15min":2.7989999999999999},"min":{"1min":0.378,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":19.789999999999999,"15min":60.429000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3029999999999999,"15min":2.9609999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":0.58699999999999997,"5min":28.131,"15min":60.445},"last":0.45800000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":1.355,"15min":3.5139999999999998},"min":{"1min":0.34899999999999998,"5min":0.33000000000000002,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":34.904000000000003,"15min":94.753},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":1.2889999999999999,"15min":3.7010000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":0.60499999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.441}]}]},{"osd":3,"up_from":13,"seq":55834575097,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473944,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":472000,"kb_avail":93897896,"statfs":{"total":96636764160,"available":96151445504,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483328000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.9849999999999999,"5min":13.090999999999999,"15min":13.042999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":34.683,"5min":117.169,"15min":121.15900000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":4.0389999999999997,"5min":13.147,"15min":13.339},"min":{"1min":0.254,"5min":0.254,"15min":0.19},"max":{"1min":34.703000000000003,"5min":117.199,"15min":117.199},"last":0.40300000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":4.6219999999999999,"15min":11.151},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":36.978999999999999,"5min":56.604999999999997,"15min":135.714},"last":0.36299999999999999},{"interface":"front","average":{"1min":3.5609999999999999,"5min":4.4299999999999997,"15min":11.989000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.183},"max":{"1min":21.518000000000001,"5min":57.014000000000003,"15min":235.90000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.1480000000000001,"15min":5},"min":{"1min":0.24299999999999999,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":28.228000000000002,"5min":87.492000000000004,"15min":231.173},"last":0.39300000000000002},{"interface":"front","average":{"1min":3.6160000000000001,"5min":2.1899999999999999,"15min":3.9180000000000001},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":26.055,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.441}]},{"osd":4,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":4.7809999999999997,"5min":3.472,"15min":5.726},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":34.555,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.434},{"interface":"front","average":{"1min":1.9950000000000001,"5min":2.919,"15min":5.806},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.26600000000000001},"max":{"1min":10.161,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":3.8769999999999998,"5min":4.258,"15min":6.0359999999999996},"min":{"1min":0.38400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":34.831000000000003,"5min":56.850999999999999,"15min":70.989000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":4.71,"5min":4.5250000000000004,"15min":6.8120000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":24.341999999999999,"5min":56.832999999999998,"15min":121.116},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":2.6309999999999998,"5min":1.216,"15min":4.5199999999999996},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30099999999999999},"max":{"1min":9.9450000000000003,"5min":9.9450000000000003,"15min":121.01900000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":5.8630000000000004,"5min":1.718,"15min":3.6230000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.29899999999999999},"max":{"1min":34.656999999999996,"5min":34.656999999999996,"15min":51.738},"last":0.46200000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:55:11 2022","interfaces":[{"interface":"back","average":{"1min":5.2519999999999998,"5min":1.611,"15min":3.8599999999999999},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":3.681,"5min":1.3420000000000001,"15min":3.5739999999999998},"min":{"1min":0.42499999999999999,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":21.422000000000001,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575098,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559924,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551296,"kb_avail":93811916,"statfs":{"total":96636764160,"available":96063401984,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564527104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.2489999999999997,"5min":11.276999999999999,"15min":12.975},"min":{"1min":0.31900000000000001,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":39.643000000000001,"5min":101.88,"15min":403.31900000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":6.7619999999999996,"5min":11.635,"15min":11.677},"min":{"1min":0.378,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":41.718000000000004,"5min":101.867,"15min":136.142},"last":0.28199999999999997}]},{"osd":1,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":9.1120000000000001,"15min":12.148},"min":{"1min":0.33000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":24.210999999999999,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.8180000000000001,"5min":8.9149999999999991,"15min":11.866},"min":{"1min":0.32400000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":21.460999999999999,"5min":146.45699999999999,"15min":220.07499999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.875,"15min":4.984},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":33.960999999999999,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.36699999999999999},{"interface":"front","average":{"1min":2.5979999999999999,"5min":1.9399999999999999,"15min":4.1959999999999997},"min":{"1min":0.38800000000000001,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":33.981999999999999,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.8799999999999999,"5min":1.6899999999999999,"15min":4.1219999999999999},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.24099999999999999},"max":{"1min":30.765000000000001,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":5.6719999999999997,"5min":1.7270000000000001,"15min":3.9830000000000001},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.25800000000000001},"max":{"1min":29.956,"5min":29.956,"15min":63.167999999999999},"last":0.439}]},{"osd":5,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":5.4580000000000002,"5min":3.6709999999999998,"15min":9.0389999999999997},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.219},"max":{"1min":34.140000000000001,"5min":73.430000000000007,"15min":84.778999999999996},"last":0.502},{"interface":"front","average":{"1min":5.0990000000000002,"5min":3.9049999999999998,"15min":9.1509999999999998},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":34.174999999999997,"5min":73.760999999999996,"15min":84.762},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":4.1120000000000001,"5min":1.2549999999999999,"15min":4.7690000000000001},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":30.805,"5min":30.805,"15min":83.144000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.831,"5min":0.879,"15min":5.2629999999999999},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":21.940999999999999,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.38400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:55:02 2022","interfaces":[{"interface":"back","average":{"1min":3.5720000000000001,"5min":1.234,"15min":2.8610000000000002},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.252},"max":{"1min":23.818000000000001,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":2.0179999999999998,"5min":0.96299999999999997,"15min":3.4860000000000002},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":10.853999999999999,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.44800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575096,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546944,"kb_avail":93824560,"statfs":{"total":96636764160,"available":96076349440,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560070656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":11.928000000000001,"15min":12.19},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":15.35,"5min":102.663,"15min":112.441},"last":0.35499999999999998},{"interface":"front","average":{"1min":2.3690000000000002,"5min":13.552,"15min":13.564},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":25.853999999999999,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":3.3130000000000002,"5min":9.9049999999999994,"15min":12.113},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":26.355,"5min":106.054,"15min":431.26499999999999},"last":0.439},{"interface":"front","average":{"1min":5.4000000000000004,"5min":10.154,"15min":11.496},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":52.944000000000003,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":2.113,"15min":4.7110000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":9.4830000000000005,"5min":56.621000000000002,"15min":112.09099999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.363,"15min":4.891},"min":{"1min":0.38100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":26.026,"5min":56.652999999999999,"15min":112.91200000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":4.6790000000000003,"5min":2.5259999999999998,"15min":4.4619999999999997},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":41.634999999999998,"5min":56.588999999999999,"15min":139.75299999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":4.5970000000000004,"5min":2.4929999999999999,"15min":5.2880000000000003},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":46.216999999999999,"5min":56.710999999999999,"15min":181.535},"last":0.36499999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.7589999999999999,"15min":7.7610000000000001},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":25.922999999999998,"5min":56.540999999999997,"15min":88.391000000000005},"last":0.29999999999999999},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.8479999999999999,"15min":7.5709999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":26.094000000000001,"5min":56.683999999999997,"15min":88.344999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.4239999999999999,"15min":3.5760000000000001},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.222},"max":{"1min":15.548,"5min":56.786999999999999,"15min":68.132999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.587,"15min":3.456},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":15.49,"5min":56.734999999999999,"15min":67.926000000000002},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:55:09 2022","interfaces":[{"interface":"back","average":{"1min":2.0750000000000002,"5min":1.4139999999999999,"15min":3.9580000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":25.954999999999998,"5min":56.612000000000002,"15min":65.207999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2509999999999999,"15min":4.0209999999999999},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":7.2000000000000002,"5min":56.719999999999999,"15min":65.260999999999996},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:56:05.122 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.123 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.123 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.124 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.124 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.125 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.125 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.125 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.126 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.126 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.126 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.127 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.127 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.128 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.128 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.128 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.129 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.129 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.130 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.130 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.130 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.131 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.131 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.132 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.132 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.132 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2022-08-10T17:35:35.987103+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=35, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.133 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.133 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.134 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.134 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.134 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.135 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.135 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.136 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.136 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.136 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.137 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:05.137 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-08-10T17:56:25.139 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:56:25.264 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.260+0000 7f7996c95700 1 Processor -- start 2022-08-10T17:56:25.265 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 -- start start 2022-08-10T17:56:25.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 0x7f79900c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7990068bf0 0x7f79900c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79900c1f40 con 0x7f7990158170 2022-08-10T17:56:25.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900c7d90 con 0x7f7990068bf0 2022-08-10T17:56:25.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7996c95700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900c2220 con 0x7f7990151290 2022-08-10T17:56:25.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f7995232700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7990068bf0 0x7f79900c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f798ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7990158170 0x7f7990157780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58464/0 (socket says 172.21.15.150:58464) 2022-08-10T17:56:25.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.261+0000 7f798ffff700 1 -- 172.21.15.150:0/675112753 learned_addr learned my addr 172.21.15.150:0/675112753 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:56:25.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7994a31700 1 --2- 172.21.15.150:0/675112753 >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 0x7f79900c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f798f7fe700 1 -- 172.21.15.150:0/675112753 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787976272 0 0) 0x7f79900c1f40 con 0x7f7990158170 2022-08-10T17:56:25.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f798f7fe700 1 -- 172.21.15.150:0/675112753 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7970003430 con 0x7f7990158170 2022-08-10T17:56:25.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7995232700 1 -- 172.21.15.150:0/675112753 >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 msgr2=0x7f79900c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:56:25.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7995232700 1 --2- 172.21.15.150:0/675112753 >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 0x7f79900c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7995232700 1 -- 172.21.15.150:0/675112753 >> v1:172.21.15.150:6789/0 conn(0x7f7990158170 legacy=0x7f7990157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7995232700 1 -- 172.21.15.150:0/675112753 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900c2500 con 0x7f7990068bf0 2022-08-10T17:56:25.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7994a31700 1 --2- 172.21.15.150:0/675112753 >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 0x7f79900c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:56:25.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f7995232700 1 --2- 172.21.15.150:0/675112753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c2910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79900cdeb0 tx=0x7f7980009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dfde3aed71a6b server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:25.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f798f7fe700 1 -- 172.21.15.150:0/675112753 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79800107b0 con 0x7f7990068bf0 2022-08-10T17:56:25.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f798f7fe700 1 -- 172.21.15.150:0/675112753 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7980010910 con 0x7f7990068bf0 2022-08-10T17:56:25.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.262+0000 7f798f7fe700 1 -- 172.21.15.150:0/675112753 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980010cc0 con 0x7f7990068bf0 2022-08-10T17:56:25.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 -- 172.21.15.150:0/675112753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 msgr2=0x7f79900c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 --2- 172.21.15.150:0/675112753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c2910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79900cdeb0 tx=0x7f7980009990 comp rx=0 tx=0).stop 2022-08-10T17:56:25.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 -- 172.21.15.150:0/675112753 shutdown_connections 2022-08-10T17:56:25.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 --2- 172.21.15.150:0/675112753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c2910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 --2- 172.21.15.150:0/675112753 >> v2:172.21.15.197:3300/0 conn(0x7f7990151290 0x7f79900c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 -- 172.21.15.150:0/675112753 >> 172.21.15.150:0/675112753 conn(0x7f799006f880 msgr2=0x7f799006fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:25.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 -- 172.21.15.150:0/675112753 shutdown_connections 2022-08-10T17:56:25.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.263+0000 7f7996c95700 1 -- 172.21.15.150:0/675112753 wait complete. 2022-08-10T17:56:25.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.264+0000 7f7996c95700 1 Processor -- start 2022-08-10T17:56:25.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.264+0000 7f7996c95700 1 -- start start 2022-08-10T17:56:25.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.280 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7990151290 0x7f79900c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7990158170 0x7f79900c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79900c5090 con 0x7f7990068bf0 2022-08-10T17:56:25.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799014d490 con 0x7f7990158170 2022-08-10T17:56:25.281 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79901f06a0 con 0x7f7990151290 2022-08-10T17:56:25.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45786/0 (socket says 172.21.15.150:45786) 2022-08-10T17:56:25.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 -- 172.21.15.150:0/3730888284 learned_addr learned my addr 172.21.15.150:0/3730888284 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:56:25.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7995232700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7990158170 0x7f79900c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f798ffff700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7990151290 0x7f79900c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 -- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7990151290 msgr2=0x7f79900c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7990151290 0x7f79900c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 -- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7990158170 msgr2=0x7f79900c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7990158170 0x7f79900c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 -- 172.21.15.150:0/3730888284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988009a70 con 0x7f7990068bf0 2022-08-10T17:56:25.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7994a31700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f798800ebb0 tx=0x7f798800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:25.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800ca80 con 0x7f7990068bf0 2022-08-10T17:56:25.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800f040 con 0x7f7990068bf0 2022-08-10T17:56:25.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800ce00 con 0x7f7990068bf0 2022-08-10T17:56:25.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980009310 con 0x7f7990068bf0 2022-08-10T17:56:25.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.265+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79901efd70 con 0x7f7990068bf0 2022-08-10T17:56:25.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.266+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7990071e10 con 0x7f7990068bf0 2022-08-10T17:56:25.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.267+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f7988024070 con 0x7f7990068bf0 2022-08-10T17:56:25.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.267+0000 7f798d7fa700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 0x7f7974067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:25.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.267+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f7988082bd0 con 0x7f7990068bf0 2022-08-10T17:56:25.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.267+0000 7f798ffff700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 0x7f7974067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:25.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.268+0000 7f798ffff700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 0x7f7974067560 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7990068970 tx=0x7f7978007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:25.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.271+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f7988050bb0 con 0x7f7990068bf0 2022-08-10T17:56:25.451 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.447+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7990072890 con 0x7f79740650b0 2022-08-10T17:56:25.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.458+0000 7f798d7fa700 1 -- 172.21.15.150:0/3730888284 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394566 (secure 0 0 0) 0x7f7990072890 con 0x7f79740650b0 2022-08-10T17:56:25.468 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:56:25.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 msgr2=0x7f7974067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 0x7f7974067560 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7990068970 tx=0x7f7978007c40 comp rx=0 tx=0).stop 2022-08-10T17:56:25.473 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 msgr2=0x7f79900c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:25.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f798800ebb0 tx=0x7f798800eec0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 shutdown_connections 2022-08-10T17:56:25.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f7990158170 0x7f79900c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.474 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7990068bf0 0x7f79900c60e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f79740650b0 0x7f7974067560 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 --2- 172.21.15.150:0/3730888284 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f7990151290 0x7f79900c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:25.475 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 >> 172.21.15.150:0/3730888284 conn(0x7f799006f880 msgr2=0x7f799014fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:25.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 shutdown_connections 2022-08-10T17:56:25.476 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:25.462+0000 7f7996c95700 1 -- 172.21.15.150:0/3730888284 wait complete. 2022-08-10T17:56:25.476 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:56:25.478 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":651,"stamp":"2022-08-10T17:56:23.812482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152613,"ondisk_log_size":152613,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261808,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4239232,"kb_avail":750712912,"statfs":{"total":773094113280,"available":768730021888,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340973568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002713"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.671542+0000","last_change":"2022-08-10T17:55:23.671511+0000","last_active":"2022-08-10T17:55:23.671542+0000","last_peered":"2022-08-10T17:55:23.671542+0000","last_clean":"2022-08-10T17:55:23.671542+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:23.671542+0000","last_undegraded":"2022-08-10T17:55:23.671542+0000","last_fullsized":"2022-08-10T17:55:23.671542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.671406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:28:06.994122+0000","scrub_duration":0.037043489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.118511+0000","last_change":"2022-08-10T17:55:48.118489+0000","last_active":"2022-08-10T17:55:48.118511+0000","last_peered":"2022-08-10T17:55:48.118511+0000","last_clean":"2022-08-10T17:55:48.118511+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:48.118511+0000","last_undegraded":"2022-08-10T17:55:48.118511+0000","last_fullsized":"2022-08-10T17:55:48.118511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.118410+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:55:58.751362+0000","scrub_duration":0.003595076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.749547+0000","last_change":"2022-08-10T17:55:24.749527+0000","last_active":"2022-08-10T17:55:24.749547+0000","last_peered":"2022-08-10T17:55:24.749547+0000","last_clean":"2022-08-10T17:55:24.749547+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:24.749547+0000","last_undegraded":"2022-08-10T17:55:24.749547+0000","last_fullsized":"2022-08-10T17:55:24.749547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.749427+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:12.518032+0000","scrub_duration":0.0088304560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.879719+0000","last_change":"2022-08-10T17:55:34.879699+0000","last_active":"2022-08-10T17:55:34.879719+0000","last_peered":"2022-08-10T17:55:34.879719+0000","last_clean":"2022-08-10T17:55:34.879719+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:34.879719+0000","last_undegraded":"2022-08-10T17:55:34.879719+0000","last_fullsized":"2022-08-10T17:55:34.879719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.879618+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:21.211782+0000","scrub_duration":0.003479551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.970758+0000","last_change":"2022-08-10T17:55:54.970725+0000","last_active":"2022-08-10T17:55:54.970758+0000","last_peered":"2022-08-10T17:55:54.970758+0000","last_clean":"2022-08-10T17:55:54.970758+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:54.970758+0000","last_undegraded":"2022-08-10T17:55:54.970758+0000","last_fullsized":"2022-08-10T17:55:54.970758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.970624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:58.527187+0000","scrub_duration":0.018586465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.547605+0000","last_change":"2022-08-10T17:35:37.410107+0000","last_active":"2022-08-10T17:55:16.547605+0000","last_peered":"2022-08-10T17:55:16.547605+0000","last_clean":"2022-08-10T17:55:16.547605+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:55:16.547605+0000","last_undegraded":"2022-08-10T17:55:16.547605+0000","last_fullsized":"2022-08-10T17:55:16.547605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.331223+0000","last_change":"2022-08-10T17:56:13.331186+0000","last_active":"2022-08-10T17:56:13.331223+0000","last_peered":"2022-08-10T17:56:13.331223+0000","last_clean":"2022-08-10T17:56:13.331223+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:56:13.331223+0000","last_undegraded":"2022-08-10T17:56:13.331223+0000","last_fullsized":"2022-08-10T17:56:13.331223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.331081+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:01:12.389751+0000","scrub_duration":0.039103919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.038721+0000","last_change":"2022-08-10T17:55:50.038689+0000","last_active":"2022-08-10T17:55:50.038721+0000","last_peered":"2022-08-10T17:55:50.038721+0000","last_clean":"2022-08-10T17:55:50.038721+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:50.038721+0000","last_undegraded":"2022-08-10T17:55:50.038721+0000","last_fullsized":"2022-08-10T17:55:50.038721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.038567+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:25:22.148321+0000","scrub_duration":0.0034662680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.017798+0000","last_change":"2022-08-10T17:55:56.017766+0000","last_active":"2022-08-10T17:55:56.017798+0000","last_peered":"2022-08-10T17:55:56.017798+0000","last_clean":"2022-08-10T17:55:56.017798+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:56.017798+0000","last_undegraded":"2022-08-10T17:55:56.017798+0000","last_fullsized":"2022-08-10T17:55:56.017798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.017619+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:34.560662+0000","scrub_duration":0.0309912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.092605+0000","last_change":"2022-08-10T17:55:24.092585+0000","last_active":"2022-08-10T17:55:24.092605+0000","last_peered":"2022-08-10T17:55:24.092605+0000","last_clean":"2022-08-10T17:55:24.092605+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:24.092605+0000","last_undegraded":"2022-08-10T17:55:24.092605+0000","last_fullsized":"2022-08-10T17:55:24.092605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.092509+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:43:12.935816+0000","scrub_duration":0.0044268040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.848285+0000","last_change":"2022-08-10T17:55:50.848264+0000","last_active":"2022-08-10T17:55:50.848285+0000","last_peered":"2022-08-10T17:55:50.848285+0000","last_clean":"2022-08-10T17:55:50.848285+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:50.848285+0000","last_undegraded":"2022-08-10T17:55:50.848285+0000","last_fullsized":"2022-08-10T17:55:50.848285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.848186+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:27:36.860710+0000","scrub_duration":0.0034554989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.587361+0000","last_change":"2022-08-10T17:55:27.587324+0000","last_active":"2022-08-10T17:55:27.587361+0000","last_peered":"2022-08-10T17:55:27.587361+0000","last_clean":"2022-08-10T17:55:27.587361+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:27.587361+0000","last_undegraded":"2022-08-10T17:55:27.587361+0000","last_fullsized":"2022-08-10T17:55:27.587361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.587177+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:18:28.369001+0000","scrub_duration":0.003490515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.597924+0000","last_change":"2022-08-10T17:55:28.597885+0000","last_active":"2022-08-10T17:55:28.597924+0000","last_peered":"2022-08-10T17:55:28.597924+0000","last_clean":"2022-08-10T17:55:28.597924+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:28.597924+0000","last_undegraded":"2022-08-10T17:55:28.597924+0000","last_fullsized":"2022-08-10T17:55:28.597924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.597685+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:50:51.165553+0000","scrub_duration":0.016393403000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.084201+0000","last_change":"2022-08-10T17:55:25.084163+0000","last_active":"2022-08-10T17:55:25.084201+0000","last_peered":"2022-08-10T17:55:25.084201+0000","last_clean":"2022-08-10T17:55:25.084201+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:25.084201+0000","last_undegraded":"2022-08-10T17:55:25.084201+0000","last_fullsized":"2022-08-10T17:55:25.084201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.084023+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:58:36.715764+0000","scrub_duration":0.0035396899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.289003+0000","last_change":"2022-08-10T17:56:09.288973+0000","last_active":"2022-08-10T17:56:09.289003+0000","last_peered":"2022-08-10T17:56:09.289003+0000","last_clean":"2022-08-10T17:56:09.289003+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:56:09.289003+0000","last_undegraded":"2022-08-10T17:56:09.289003+0000","last_fullsized":"2022-08-10T17:56:09.289003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.288839+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:42.321172+0000","scrub_duration":0.0035582019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.746364+0000","last_change":"2022-08-10T17:55:32.746346+0000","last_active":"2022-08-10T17:55:32.746364+0000","last_peered":"2022-08-10T17:55:32.746364+0000","last_clean":"2022-08-10T17:55:32.746364+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:32.746364+0000","last_undegraded":"2022-08-10T17:55:32.746364+0000","last_fullsized":"2022-08-10T17:55:32.746364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.746268+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:15.017040+0000","scrub_duration":0.0035363500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.956491+0000","last_change":"2022-08-10T17:55:53.956469+0000","last_active":"2022-08-10T17:55:53.956491+0000","last_peered":"2022-08-10T17:55:53.956491+0000","last_clean":"2022-08-10T17:55:53.956491+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:53.956491+0000","last_undegraded":"2022-08-10T17:55:53.956491+0000","last_fullsized":"2022-08-10T17:55:53.956491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.956366+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:02:03.066925+0000","scrub_duration":0.034545389000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.834163+0000","last_change":"2022-08-10T17:55:44.834143+0000","last_active":"2022-08-10T17:55:44.834163+0000","last_peered":"2022-08-10T17:55:44.834163+0000","last_clean":"2022-08-10T17:55:44.834163+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:44.834163+0000","last_undegraded":"2022-08-10T17:55:44.834163+0000","last_fullsized":"2022-08-10T17:55:44.834163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.834059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:17.359055+0000","scrub_duration":0.0034759230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.602705+0000","last_change":"2022-08-10T17:55:25.602683+0000","last_active":"2022-08-10T17:55:25.602705+0000","last_peered":"2022-08-10T17:55:25.602705+0000","last_clean":"2022-08-10T17:55:25.602705+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:25.602705+0000","last_undegraded":"2022-08-10T17:55:25.602705+0000","last_fullsized":"2022-08-10T17:55:25.602705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.602593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:49:36.908209+0000","scrub_duration":0.015965635999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.536111+0000","last_change":"2022-08-10T17:35:37.416751+0000","last_active":"2022-08-10T17:55:16.536111+0000","last_peered":"2022-08-10T17:55:16.536111+0000","last_clean":"2022-08-10T17:55:16.536111+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:55:16.536111+0000","last_undegraded":"2022-08-10T17:55:16.536111+0000","last_fullsized":"2022-08-10T17:55:16.536111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:05.358959+0000","last_change":"2022-08-10T17:56:05.358912+0000","last_active":"2022-08-10T17:56:05.358959+0000","last_peered":"2022-08-10T17:56:05.358959+0000","last_clean":"2022-08-10T17:56:05.358959+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:56:05.358959+0000","last_undegraded":"2022-08-10T17:56:05.358959+0000","last_fullsized":"2022-08-10T17:56:05.358959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_clean_scrub_stamp":"2022-08-10T17:56:05.358729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:00:22.195910+0000","scrub_duration":0.051750043000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.964336+0000","last_change":"2022-08-10T17:55:49.964314+0000","last_active":"2022-08-10T17:55:49.964336+0000","last_peered":"2022-08-10T17:55:49.964336+0000","last_clean":"2022-08-10T17:55:49.964336+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:49.964336+0000","last_undegraded":"2022-08-10T17:55:49.964336+0000","last_fullsized":"2022-08-10T17:55:49.964336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.964237+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:13:15.202875+0000","scrub_duration":0.0034506480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.369947+0000","last_change":"2022-08-10T17:55:57.369922+0000","last_active":"2022-08-10T17:55:57.369947+0000","last_peered":"2022-08-10T17:55:57.369947+0000","last_clean":"2022-08-10T17:55:57.369947+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:57.369947+0000","last_undegraded":"2022-08-10T17:55:57.369947+0000","last_fullsized":"2022-08-10T17:55:57.369947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.369823+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:11:25.548675+0000","scrub_duration":0.023686576000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:07.270250+0000","last_change":"2022-08-10T17:56:07.270217+0000","last_active":"2022-08-10T17:56:07.270250+0000","last_peered":"2022-08-10T17:56:07.270250+0000","last_clean":"2022-08-10T17:56:07.270250+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:56:07.270250+0000","last_undegraded":"2022-08-10T17:56:07.270250+0000","last_fullsized":"2022-08-10T17:56:07.270250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_clean_scrub_stamp":"2022-08-10T17:56:07.270085+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:03:30.303765+0000","scrub_duration":0.003542674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:45.411773+0000","last_change":"2022-08-10T17:55:45.411749+0000","last_active":"2022-08-10T17:55:45.411773+0000","last_peered":"2022-08-10T17:55:45.411773+0000","last_clean":"2022-08-10T17:55:45.411773+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:45.411773+0000","last_undegraded":"2022-08-10T17:55:45.411773+0000","last_fullsized":"2022-08-10T17:55:45.411773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_clean_scrub_stamp":"2022-08-10T17:55:45.411650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:19:32.370100+0000","scrub_duration":0.046072038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.335430+0000","last_change":"2022-08-10T17:55:36.335408+0000","last_active":"2022-08-10T17:55:36.335430+0000","last_peered":"2022-08-10T17:55:36.335430+0000","last_clean":"2022-08-10T17:55:36.335430+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:36.335430+0000","last_undegraded":"2022-08-10T17:55:36.335430+0000","last_fullsized":"2022-08-10T17:55:36.335430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.335326+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:02:07.956826+0000","scrub_duration":0.0034800230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.147493+0000","last_change":"2022-08-10T17:55:38.147458+0000","last_active":"2022-08-10T17:55:38.147493+0000","last_peered":"2022-08-10T17:55:38.147493+0000","last_clean":"2022-08-10T17:55:38.147493+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:38.147493+0000","last_undegraded":"2022-08-10T17:55:38.147493+0000","last_fullsized":"2022-08-10T17:55:38.147493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.147290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:17:04.733650+0000","scrub_duration":0.021995639000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4458,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.460453+0000","last_change":"2022-08-10T17:35:41.442479+0000","last_active":"2022-08-10T17:54:42.460453+0000","last_peered":"2022-08-10T17:54:42.460453+0000","last_clean":"2022-08-10T17:54:42.460453+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:54:42.460453+0000","last_undegraded":"2022-08-10T17:54:42.460453+0000","last_fullsized":"2022-08-10T17:54:42.460453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'12","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.916968+0000","last_change":"2022-08-10T17:56:04.916940+0000","last_active":"2022-08-10T17:56:04.916968+0000","last_peered":"2022-08-10T17:56:04.916968+0000","last_clean":"2022-08-10T17:56:04.916968+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:56:04.916968+0000","last_undegraded":"2022-08-10T17:56:04.916968+0000","last_fullsized":"2022-08-10T17:56:04.916968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.916856+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:31:33.074691+0000","scrub_duration":0.028362951000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.330599+0000","last_change":"2022-08-10T17:55:23.330567+0000","last_active":"2022-08-10T17:55:23.330599+0000","last_peered":"2022-08-10T17:55:23.330599+0000","last_clean":"2022-08-10T17:55:23.330599+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:23.330599+0000","last_undegraded":"2022-08-10T17:55:23.330599+0000","last_fullsized":"2022-08-10T17:55:23.330599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.330462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:10:32.984049+0000","scrub_duration":0.024365404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4722,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.922506+0000","last_change":"2022-08-10T17:55:50.922445+0000","last_active":"2022-08-10T17:55:50.922506+0000","last_peered":"2022-08-10T17:55:50.922506+0000","last_clean":"2022-08-10T17:55:50.922506+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:55:50.922506+0000","last_undegraded":"2022-08-10T17:55:50.922506+0000","last_fullsized":"2022-08-10T17:55:50.922506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4694","last_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_deep_scrub":"29'4694","last_deep_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.922264+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:24:16.270656+0000","scrub_duration":0.059697769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'14","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.422498+0000","last_change":"2022-08-10T17:55:33.422452+0000","last_active":"2022-08-10T17:55:33.422498+0000","last_peered":"2022-08-10T17:55:33.422498+0000","last_clean":"2022-08-10T17:55:33.422498+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:55:33.422498+0000","last_undegraded":"2022-08-10T17:55:33.422498+0000","last_fullsized":"2022-08-10T17:55:33.422498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.422315+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:27.773536+0000","scrub_duration":0.019140213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.009599+0000","last_change":"2022-08-10T17:55:27.009577+0000","last_active":"2022-08-10T17:55:27.009599+0000","last_peered":"2022-08-10T17:55:27.009599+0000","last_clean":"2022-08-10T17:55:27.009599+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:27.009599+0000","last_undegraded":"2022-08-10T17:55:27.009599+0000","last_fullsized":"2022-08-10T17:55:27.009599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.009500+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:15:21.317429+0000","scrub_duration":0.0035028260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4382,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.018283+0000","last_change":"2022-08-10T17:56:04.018232+0000","last_active":"2022-08-10T17:56:04.018283+0000","last_peered":"2022-08-10T17:56:04.018283+0000","last_clean":"2022-08-10T17:56:04.018283+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:56:04.018283+0000","last_undegraded":"2022-08-10T17:56:04.018283+0000","last_fullsized":"2022-08-10T17:56:04.018283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4354","last_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_deep_scrub":"29'4354","last_deep_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.018007+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:33:06.740237+0000","scrub_duration":0.053114884000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.272824+0000","last_change":"2022-08-10T17:55:34.272805+0000","last_active":"2022-08-10T17:55:34.272824+0000","last_peered":"2022-08-10T17:55:34.272824+0000","last_clean":"2022-08-10T17:55:34.272824+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:55:34.272824+0000","last_undegraded":"2022-08-10T17:55:34.272824+0000","last_fullsized":"2022-08-10T17:55:34.272824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.272714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:36.483574+0000","scrub_duration":0.0034525319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.957655+0000","last_change":"2022-08-10T17:55:29.957632+0000","last_active":"2022-08-10T17:55:29.957655+0000","last_peered":"2022-08-10T17:55:29.957655+0000","last_clean":"2022-08-10T17:55:29.957655+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:29.957655+0000","last_undegraded":"2022-08-10T17:55:29.957655+0000","last_fullsized":"2022-08-10T17:55:29.957655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.957536+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:43:07.254608+0000","scrub_duration":0.062576358999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3617,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.969865+0000","last_change":"2022-08-10T17:55:48.969826+0000","last_active":"2022-08-10T17:55:48.969865+0000","last_peered":"2022-08-10T17:55:48.969865+0000","last_clean":"2022-08-10T17:55:48.969865+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:55:48.969865+0000","last_undegraded":"2022-08-10T17:55:48.969865+0000","last_fullsized":"2022-08-10T17:55:48.969865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3589","last_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_deep_scrub":"29'3589","last_deep_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.969722+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:16.418208+0000","scrub_duration":0.065700320000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'64","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.093868+0000","last_change":"2022-08-10T17:55:35.093847+0000","last_active":"2022-08-10T17:55:35.093868+0000","last_peered":"2022-08-10T17:55:35.093868+0000","last_clean":"2022-08-10T17:55:35.093868+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:55:35.093868+0000","last_undegraded":"2022-08-10T17:55:35.093868+0000","last_fullsized":"2022-08-10T17:55:35.093868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.093760+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:13:33.865196+0000","scrub_duration":0.016913436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.402892+0000","last_change":"2022-08-10T17:56:14.402871+0000","last_active":"2022-08-10T17:56:14.402892+0000","last_peered":"2022-08-10T17:56:14.402892+0000","last_clean":"2022-08-10T17:56:14.402892+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:56:14.402892+0000","last_undegraded":"2022-08-10T17:56:14.402892+0000","last_fullsized":"2022-08-10T17:56:14.402892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.402390+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:25.065766+0000","scrub_duration":0.0035523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4186,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.393911+0000","last_change":"2022-08-10T17:56:14.393872+0000","last_active":"2022-08-10T17:56:14.393911+0000","last_peered":"2022-08-10T17:56:14.393911+0000","last_clean":"2022-08-10T17:56:14.393911+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:56:14.393911+0000","last_undegraded":"2022-08-10T17:56:14.393911+0000","last_fullsized":"2022-08-10T17:56:14.393911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4158","last_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_deep_scrub":"29'4158","last_deep_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.393769+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:25:17.353898+0000","scrub_duration":0.067364295000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.119148+0000","last_change":"2022-08-10T17:55:32.119128+0000","last_active":"2022-08-10T17:55:32.119148+0000","last_peered":"2022-08-10T17:55:32.119148+0000","last_clean":"2022-08-10T17:55:32.119148+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:55:32.119148+0000","last_undegraded":"2022-08-10T17:55:32.119148+0000","last_fullsized":"2022-08-10T17:55:32.119148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.119046+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:52:27.377502+0000","scrub_duration":0.015219678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.405585+0000","last_change":"2022-08-10T17:55:30.405562+0000","last_active":"2022-08-10T17:55:30.405585+0000","last_peered":"2022-08-10T17:55:30.405585+0000","last_clean":"2022-08-10T17:55:30.405585+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:30.405585+0000","last_undegraded":"2022-08-10T17:55:30.405585+0000","last_fullsized":"2022-08-10T17:55:30.405585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.405460+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:57:23.895561+0000","scrub_duration":0.024012329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5953,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.454025+0000","last_change":"2022-08-10T17:56:06.453970+0000","last_active":"2022-08-10T17:56:06.454025+0000","last_peered":"2022-08-10T17:56:06.454025+0000","last_clean":"2022-08-10T17:56:06.454025+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:56:06.454025+0000","last_undegraded":"2022-08-10T17:56:06.454025+0000","last_fullsized":"2022-08-10T17:56:06.454025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5925","last_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_deep_scrub":"29'5925","last_deep_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.453813+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:04:53.609822+0000","scrub_duration":0.069290974000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'24","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.079797+0000","last_change":"2022-08-10T17:55:27.079775+0000","last_active":"2022-08-10T17:55:27.079797+0000","last_peered":"2022-08-10T17:55:27.079797+0000","last_clean":"2022-08-10T17:55:27.079797+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:55:27.079797+0000","last_undegraded":"2022-08-10T17:55:27.079797+0000","last_fullsized":"2022-08-10T17:55:27.079797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.079689+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:16:30.544031+0000","scrub_duration":0.026671822000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.370196+0000","last_change":"2022-08-10T17:55:42.370175+0000","last_active":"2022-08-10T17:55:42.370196+0000","last_peered":"2022-08-10T17:55:42.370196+0000","last_clean":"2022-08-10T17:55:42.370196+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:42.370196+0000","last_undegraded":"2022-08-10T17:55:42.370196+0000","last_fullsized":"2022-08-10T17:55:42.370196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.370067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:10.161792+0000","scrub_duration":0.020699707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4213,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:51.434262+0000","last_change":"2022-08-10T17:55:51.434220+0000","last_active":"2022-08-10T17:55:51.434262+0000","last_peered":"2022-08-10T17:55:51.434262+0000","last_clean":"2022-08-10T17:55:51.434262+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:55:51.434262+0000","last_undegraded":"2022-08-10T17:55:51.434262+0000","last_fullsized":"2022-08-10T17:55:51.434262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4185","last_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_deep_scrub":"29'4185","last_deep_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:51.434118+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:56:18.697580+0000","scrub_duration":0.064411632999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'311","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.991208+0000","last_change":"2022-08-10T17:56:09.991174+0000","last_active":"2022-08-10T17:56:09.991208+0000","last_peered":"2022-08-10T17:56:09.991208+0000","last_clean":"2022-08-10T17:56:09.991208+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:56:09.991208+0000","last_undegraded":"2022-08-10T17:56:09.991208+0000","last_fullsized":"2022-08-10T17:56:09.991208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'311","last_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_deep_scrub":"29'311","last_deep_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.991082+0000","objects_scrubbed":5,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:28:46.755600+0000","scrub_duration":0.032474404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.015442+0000","last_change":"2022-08-10T17:56:14.015416+0000","last_active":"2022-08-10T17:56:14.015442+0000","last_peered":"2022-08-10T17:56:14.015442+0000","last_clean":"2022-08-10T17:56:14.015442+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:56:14.015442+0000","last_undegraded":"2022-08-10T17:56:14.015442+0000","last_fullsized":"2022-08-10T17:56:14.015442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.015311+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:03:48.477000+0000","scrub_duration":0.027149287000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5832,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.170504+0000","last_change":"2022-08-10T17:56:06.170447+0000","last_active":"2022-08-10T17:56:06.170504+0000","last_peered":"2022-08-10T17:56:06.170504+0000","last_clean":"2022-08-10T17:56:06.170504+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:56:06.170504+0000","last_undegraded":"2022-08-10T17:56:06.170504+0000","last_fullsized":"2022-08-10T17:56:06.170504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5804","last_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_deep_scrub":"29'5804","last_deep_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.170268+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:02:33.838572+0000","scrub_duration":0.064557167999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:52.153823+0000","last_change":"2022-08-10T17:55:52.153800+0000","last_active":"2022-08-10T17:55:52.153823+0000","last_peered":"2022-08-10T17:55:52.153823+0000","last_clean":"2022-08-10T17:55:52.153823+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:55:52.153823+0000","last_undegraded":"2022-08-10T17:55:52.153823+0000","last_fullsized":"2022-08-10T17:55:52.153823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_clean_scrub_stamp":"2022-08-10T17:55:52.153704+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:54:56.375867+0000","scrub_duration":0.019208741000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.358355+0000","last_change":"2022-08-10T17:55:25.358323+0000","last_active":"2022-08-10T17:55:25.358355+0000","last_peered":"2022-08-10T17:55:25.358355+0000","last_clean":"2022-08-10T17:55:25.358355+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:25.358355+0000","last_undegraded":"2022-08-10T17:55:25.358355+0000","last_fullsized":"2022-08-10T17:55:25.358355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.358222+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:32:47.761238+0000","scrub_duration":0.024137542000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4286,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:00.464274+0000","last_change":"2022-08-10T17:56:00.464222+0000","last_active":"2022-08-10T17:56:00.464274+0000","last_peered":"2022-08-10T17:56:00.464274+0000","last_clean":"2022-08-10T17:56:00.464274+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:56:00.464274+0000","last_undegraded":"2022-08-10T17:56:00.464274+0000","last_fullsized":"2022-08-10T17:56:00.464274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4258","last_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_deep_scrub":"29'4258","last_deep_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_clean_scrub_stamp":"2022-08-10T17:56:00.464107+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:55:24.422676+0000","scrub_duration":0.051924405999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.061351+0000","last_change":"2022-08-10T17:55:38.061316+0000","last_active":"2022-08-10T17:55:38.061351+0000","last_peered":"2022-08-10T17:55:38.061351+0000","last_clean":"2022-08-10T17:55:38.061351+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:55:38.061351+0000","last_undegraded":"2022-08-10T17:55:38.061351+0000","last_fullsized":"2022-08-10T17:55:38.061351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.061144+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:50.451261+0000","scrub_duration":0.016751453999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.108842+0000","last_change":"2022-08-10T17:55:26.108788+0000","last_active":"2022-08-10T17:55:26.108842+0000","last_peered":"2022-08-10T17:55:26.108842+0000","last_clean":"2022-08-10T17:55:26.108842+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:26.108842+0000","last_undegraded":"2022-08-10T17:55:26.108842+0000","last_fullsized":"2022-08-10T17:55:26.108842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.108605+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:10:35.922613+0000","scrub_duration":0.021195411000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4395,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:58.442683+0000","last_change":"2022-08-10T17:55:58.442647+0000","last_active":"2022-08-10T17:55:58.442683+0000","last_peered":"2022-08-10T17:55:58.442683+0000","last_clean":"2022-08-10T17:55:58.442683+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:55:58.442683+0000","last_undegraded":"2022-08-10T17:55:58.442683+0000","last_fullsized":"2022-08-10T17:55:58.442683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4367","last_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_deep_scrub":"29'4367","last_deep_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_clean_scrub_stamp":"2022-08-10T17:55:58.442543+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:41:05.524327+0000","scrub_duration":0.060906218999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'304","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.097085+0000","last_change":"2022-08-10T17:55:49.097051+0000","last_active":"2022-08-10T17:55:49.097085+0000","last_peered":"2022-08-10T17:55:49.097085+0000","last_clean":"2022-08-10T17:55:49.097085+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:55:49.097085+0000","last_undegraded":"2022-08-10T17:55:49.097085+0000","last_fullsized":"2022-08-10T17:55:49.097085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'304","last_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_deep_scrub":"29'304","last_deep_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.096942+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:12:27.209788+0000","scrub_duration":0.031557822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.045594+0000","last_change":"2022-08-10T17:56:13.045573+0000","last_active":"2022-08-10T17:56:13.045594+0000","last_peered":"2022-08-10T17:56:13.045594+0000","last_clean":"2022-08-10T17:56:13.045594+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:56:13.045594+0000","last_undegraded":"2022-08-10T17:56:13.045594+0000","last_fullsized":"2022-08-10T17:56:13.045594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.045497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:43:07.934183+0000","scrub_duration":0.0034909870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4934,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.103904+0000","last_change":"2022-08-10T17:55:57.103864+0000","last_active":"2022-08-10T17:55:57.103904+0000","last_peered":"2022-08-10T17:55:57.103904+0000","last_clean":"2022-08-10T17:55:57.103904+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:55:57.103904+0000","last_undegraded":"2022-08-10T17:55:57.103904+0000","last_fullsized":"2022-08-10T17:55:57.103904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4906","last_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_deep_scrub":"29'4906","last_deep_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.103765+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:30:44.540506+0000","scrub_duration":0.064568445000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.924288+0000","last_change":"2022-08-10T17:55:24.924251+0000","last_active":"2022-08-10T17:55:24.924288+0000","last_peered":"2022-08-10T17:55:24.924288+0000","last_clean":"2022-08-10T17:55:24.924288+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:55:24.924288+0000","last_undegraded":"2022-08-10T17:55:24.924288+0000","last_fullsized":"2022-08-10T17:55:24.924288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.924118+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:55:21.923386+0000","scrub_duration":0.021377028999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.408869+0000","last_change":"2022-08-10T17:55:27.408845+0000","last_active":"2022-08-10T17:55:27.408869+0000","last_peered":"2022-08-10T17:55:27.408869+0000","last_clean":"2022-08-10T17:55:27.408869+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:27.408869+0000","last_undegraded":"2022-08-10T17:55:27.408869+0000","last_fullsized":"2022-08-10T17:55:27.408869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.408747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:14:38.533949+0000","scrub_duration":0.040517141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:21.401868+0000","last_change":"2022-08-10T17:56:21.401826+0000","last_active":"2022-08-10T17:56:21.401868+0000","last_peered":"2022-08-10T17:56:21.401868+0000","last_clean":"2022-08-10T17:56:21.401868+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:56:21.401868+0000","last_undegraded":"2022-08-10T17:56:21.401868+0000","last_fullsized":"2022-08-10T17:56:21.401868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5293","last_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_deep_scrub":"29'5293","last_deep_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_clean_scrub_stamp":"2022-08-10T17:56:21.401724+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:57:42.790520+0000","scrub_duration":0.061559711000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.225847+0000","last_change":"2022-08-10T17:55:56.225825+0000","last_active":"2022-08-10T17:55:56.225847+0000","last_peered":"2022-08-10T17:55:56.225847+0000","last_clean":"2022-08-10T17:55:56.225847+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:55:56.225847+0000","last_undegraded":"2022-08-10T17:55:56.225847+0000","last_fullsized":"2022-08-10T17:55:56.225847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.225734+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:48.013865+0000","scrub_duration":0.032000617000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.160168+0000","last_change":"2022-08-10T17:55:37.160149+0000","last_active":"2022-08-10T17:55:37.160168+0000","last_peered":"2022-08-10T17:55:37.160168+0000","last_clean":"2022-08-10T17:55:37.160168+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:37.160168+0000","last_undegraded":"2022-08-10T17:55:37.160168+0000","last_fullsized":"2022-08-10T17:55:37.160168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.160075+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:27:20.436089+0000","scrub_duration":0.0034772340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.648371+0000","last_change":"2022-08-10T17:55:30.648315+0000","last_active":"2022-08-10T17:55:30.648371+0000","last_peered":"2022-08-10T17:55:30.648371+0000","last_clean":"2022-08-10T17:55:30.648371+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:55:30.648371+0000","last_undegraded":"2022-08-10T17:55:30.648371+0000","last_fullsized":"2022-08-10T17:55:30.648371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4353","last_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_deep_scrub":"29'4353","last_deep_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.648133+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:10.184933+0000","scrub_duration":0.067302737000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.138559+0000","last_change":"2022-08-10T17:55:43.138538+0000","last_active":"2022-08-10T17:55:43.138559+0000","last_peered":"2022-08-10T17:55:43.138559+0000","last_clean":"2022-08-10T17:55:43.138559+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:55:43.138559+0000","last_undegraded":"2022-08-10T17:55:43.138559+0000","last_fullsized":"2022-08-10T17:55:43.138559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.138462+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:40.531685+0000","scrub_duration":0.013263829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.546276+0000","last_change":"2022-08-10T17:35:37.411110+0000","last_active":"2022-08-10T17:55:16.546276+0000","last_peered":"2022-08-10T17:55:16.546276+0000","last_clean":"2022-08-10T17:55:16.546276+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:55:16.546276+0000","last_undegraded":"2022-08-10T17:55:16.546276+0000","last_fullsized":"2022-08-10T17:55:16.546276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4709,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.577615+0000","last_change":"2022-08-10T17:55:33.577580+0000","last_active":"2022-08-10T17:55:33.577615+0000","last_peered":"2022-08-10T17:55:33.577615+0000","last_clean":"2022-08-10T17:55:33.577615+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:55:33.577615+0000","last_undegraded":"2022-08-10T17:55:33.577615+0000","last_fullsized":"2022-08-10T17:55:33.577615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4681","last_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_deep_scrub":"29'4681","last_deep_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.577468+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:50:41.930237+0000","scrub_duration":0.053293471000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:40.114580+0000","last_change":"2022-08-10T17:55:40.114552+0000","last_active":"2022-08-10T17:55:40.114580+0000","last_peered":"2022-08-10T17:55:40.114580+0000","last_clean":"2022-08-10T17:55:40.114580+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:55:40.114580+0000","last_undegraded":"2022-08-10T17:55:40.114580+0000","last_fullsized":"2022-08-10T17:55:40.114580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:40.114468+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:53:37.748882+0000","scrub_duration":0.013616628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.818264+0000","last_change":"2022-08-10T17:55:39.818234+0000","last_active":"2022-08-10T17:55:39.818264+0000","last_peered":"2022-08-10T17:55:39.818264+0000","last_clean":"2022-08-10T17:55:39.818264+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:39.818264+0000","last_undegraded":"2022-08-10T17:55:39.818264+0000","last_fullsized":"2022-08-10T17:55:39.818264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.818135+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:31:58.229281+0000","scrub_duration":0.027795573000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3833,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.499543+0000","last_change":"2022-08-10T17:55:38.499484+0000","last_active":"2022-08-10T17:55:38.499543+0000","last_peered":"2022-08-10T17:55:38.499543+0000","last_clean":"2022-08-10T17:55:38.499543+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:55:38.499543+0000","last_undegraded":"2022-08-10T17:55:38.499543+0000","last_fullsized":"2022-08-10T17:55:38.499543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3805","last_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_deep_scrub":"29'3805","last_deep_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.499317+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:59:44.072729+0000","scrub_duration":0.056492191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.078050+0000","last_change":"2022-08-10T17:55:30.078020+0000","last_active":"2022-08-10T17:55:30.078050+0000","last_peered":"2022-08-10T17:55:30.078050+0000","last_clean":"2022-08-10T17:55:30.078050+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:55:30.078050+0000","last_undegraded":"2022-08-10T17:55:30.078050+0000","last_fullsized":"2022-08-10T17:55:30.078050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.077894+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:33.679903+0000","scrub_duration":0.022499880999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.975371+0000","last_change":"2022-08-10T17:56:02.975349+0000","last_active":"2022-08-10T17:56:02.975371+0000","last_peered":"2022-08-10T17:56:02.975371+0000","last_clean":"2022-08-10T17:56:02.975371+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:56:02.975371+0000","last_undegraded":"2022-08-10T17:56:02.975371+0000","last_fullsized":"2022-08-10T17:56:02.975371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.975245+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:34.658380+0000","scrub_duration":0.0086057479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.617813+0000","last_change":"2022-08-10T17:55:32.617770+0000","last_active":"2022-08-10T17:55:32.617813+0000","last_peered":"2022-08-10T17:55:32.617813+0000","last_clean":"2022-08-10T17:55:32.617813+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:55:32.617813+0000","last_undegraded":"2022-08-10T17:55:32.617813+0000","last_fullsized":"2022-08-10T17:55:32.617813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3279","last_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_deep_scrub":"29'3279","last_deep_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.617666+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:55:16.394063+0000","scrub_duration":0.060262404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'335","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.385035+0000","last_change":"2022-08-10T17:55:39.385014+0000","last_active":"2022-08-10T17:55:39.385035+0000","last_peered":"2022-08-10T17:55:39.385035+0000","last_clean":"2022-08-10T17:55:39.385035+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:39.385035+0000","last_undegraded":"2022-08-10T17:55:39.385035+0000","last_fullsized":"2022-08-10T17:55:39.385035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'335","last_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_deep_scrub":"29'335","last_deep_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.384919+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:34:51.492681+0000","scrub_duration":0.038040591999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.819713+0000","last_change":"2022-08-10T17:55:48.819683+0000","last_active":"2022-08-10T17:55:48.819713+0000","last_peered":"2022-08-10T17:55:48.819713+0000","last_clean":"2022-08-10T17:55:48.819713+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:48.819713+0000","last_undegraded":"2022-08-10T17:55:48.819713+0000","last_fullsized":"2022-08-10T17:55:48.819713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.819544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:07:54.609189+0000","scrub_duration":0.014561592999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5075,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.420110+0000","last_change":"2022-08-10T17:55:54.420077+0000","last_active":"2022-08-10T17:55:54.420110+0000","last_peered":"2022-08-10T17:55:54.420110+0000","last_clean":"2022-08-10T17:55:54.420110+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:55:54.420110+0000","last_undegraded":"2022-08-10T17:55:54.420110+0000","last_fullsized":"2022-08-10T17:55:54.420110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5047","last_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_deep_scrub":"29'5047","last_deep_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.419972+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:37:40.479531+0000","scrub_duration":0.067399972000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'56","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.906120+0000","last_change":"2022-08-10T17:55:26.906097+0000","last_active":"2022-08-10T17:55:26.906120+0000","last_peered":"2022-08-10T17:55:26.906120+0000","last_clean":"2022-08-10T17:55:26.906120+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:55:26.906120+0000","last_undegraded":"2022-08-10T17:55:26.906120+0000","last_fullsized":"2022-08-10T17:55:26.906120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.906012+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:01.182562+0000","scrub_duration":0.014215698000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.925293+0000","last_change":"2022-08-10T17:55:55.925273+0000","last_active":"2022-08-10T17:55:55.925293+0000","last_peered":"2022-08-10T17:55:55.925293+0000","last_clean":"2022-08-10T17:55:55.925293+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:55.925293+0000","last_undegraded":"2022-08-10T17:55:55.925293+0000","last_fullsized":"2022-08-10T17:55:55.925293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.925196+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:07.952289+0000","scrub_duration":0.0034809820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6368,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.166064+0000","last_change":"2022-08-10T17:56:02.166028+0000","last_active":"2022-08-10T17:56:02.166064+0000","last_peered":"2022-08-10T17:56:02.166064+0000","last_clean":"2022-08-10T17:56:02.166064+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:56:02.166064+0000","last_undegraded":"2022-08-10T17:56:02.166064+0000","last_fullsized":"2022-08-10T17:56:02.166064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6340","last_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_deep_scrub":"29'6340","last_deep_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.165927+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:20:27.862013+0000","scrub_duration":0.078968956000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:11.948296+0000","last_change":"2022-08-10T17:56:11.948274+0000","last_active":"2022-08-10T17:56:11.948296+0000","last_peered":"2022-08-10T17:56:11.948296+0000","last_clean":"2022-08-10T17:56:11.948296+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:56:11.948296+0000","last_undegraded":"2022-08-10T17:56:11.948296+0000","last_fullsized":"2022-08-10T17:56:11.948296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_clean_scrub_stamp":"2022-08-10T17:56:11.948176+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:26:18.020901+0000","scrub_duration":0.01701418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:03.912780+0000","last_change":"2022-08-10T17:56:03.912759+0000","last_active":"2022-08-10T17:56:03.912780+0000","last_peered":"2022-08-10T17:56:03.912780+0000","last_clean":"2022-08-10T17:56:03.912780+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:56:03.912780+0000","last_undegraded":"2022-08-10T17:56:03.912780+0000","last_fullsized":"2022-08-10T17:56:03.912780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_clean_scrub_stamp":"2022-08-10T17:56:03.912661+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:17.642586+0000","scrub_duration":0.015979535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6046,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.055091+0000","last_change":"2022-08-10T17:35:41.443480+0000","last_active":"2022-08-10T17:54:43.055091+0000","last_peered":"2022-08-10T17:54:43.055091+0000","last_clean":"2022-08-10T17:54:43.055091+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:54:43.055091+0000","last_undegraded":"2022-08-10T17:54:43.055091+0000","last_fullsized":"2022-08-10T17:54:43.055091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.378188+0000","last_change":"2022-08-10T17:55:32.378165+0000","last_active":"2022-08-10T17:55:32.378188+0000","last_peered":"2022-08-10T17:55:32.378188+0000","last_clean":"2022-08-10T17:55:32.378188+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:55:32.378188+0000","last_undegraded":"2022-08-10T17:55:32.378188+0000","last_fullsized":"2022-08-10T17:55:32.378188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.378072+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:37:51.551862+0000","scrub_duration":0.025084980999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.387732+0000","last_change":"2022-08-10T17:55:44.387701+0000","last_active":"2022-08-10T17:55:44.387732+0000","last_peered":"2022-08-10T17:55:44.387732+0000","last_clean":"2022-08-10T17:55:44.387732+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:44.387732+0000","last_undegraded":"2022-08-10T17:55:44.387732+0000","last_fullsized":"2022-08-10T17:55:44.387732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.387600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:07:54.771605+0000","scrub_duration":0.016116917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4559,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.026441+0000","last_change":"2022-08-10T17:56:06.026377+0000","last_active":"2022-08-10T17:56:06.026441+0000","last_peered":"2022-08-10T17:56:06.026441+0000","last_clean":"2022-08-10T17:56:06.026441+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:56:06.026441+0000","last_undegraded":"2022-08-10T17:56:06.026441+0000","last_fullsized":"2022-08-10T17:56:06.026441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4531","last_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_deep_scrub":"29'4531","last_deep_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.026208+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:36.860795+0000","scrub_duration":0.086058169000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.144294+0000","last_change":"2022-08-10T17:55:36.144271+0000","last_active":"2022-08-10T17:55:36.144294+0000","last_peered":"2022-08-10T17:55:36.144294+0000","last_clean":"2022-08-10T17:55:36.144294+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:55:36.144294+0000","last_undegraded":"2022-08-10T17:55:36.144294+0000","last_fullsized":"2022-08-10T17:55:36.144294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.144187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:21:38.195327+0000","scrub_duration":0.028929255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.367621+0000","last_change":"2022-08-10T17:55:38.367599+0000","last_active":"2022-08-10T17:55:38.367621+0000","last_peered":"2022-08-10T17:55:38.367621+0000","last_clean":"2022-08-10T17:55:38.367621+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:38.367621+0000","last_undegraded":"2022-08-10T17:55:38.367621+0000","last_fullsized":"2022-08-10T17:55:38.367621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.367524+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:16:32.842509+0000","scrub_duration":0.0035067779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4374,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.053873+0000","last_change":"2022-08-10T17:56:09.053830+0000","last_active":"2022-08-10T17:56:09.053873+0000","last_peered":"2022-08-10T17:56:09.053873+0000","last_clean":"2022-08-10T17:56:09.053873+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:56:09.053873+0000","last_undegraded":"2022-08-10T17:56:09.053873+0000","last_fullsized":"2022-08-10T17:56:09.053873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4346","last_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_deep_scrub":"29'4346","last_deep_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.053722+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:03.775600+0000","scrub_duration":0.061434124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.070691+0000","last_change":"2022-08-10T17:55:29.070663+0000","last_active":"2022-08-10T17:55:29.070691+0000","last_peered":"2022-08-10T17:55:29.070691+0000","last_clean":"2022-08-10T17:55:29.070691+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:55:29.070691+0000","last_undegraded":"2022-08-10T17:55:29.070691+0000","last_fullsized":"2022-08-10T17:55:29.070691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.070546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:28:30.391516+0000","scrub_duration":0.0035289599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.986802+0000","last_change":"2022-08-10T17:56:10.986777+0000","last_active":"2022-08-10T17:56:10.986802+0000","last_peered":"2022-08-10T17:56:10.986802+0000","last_clean":"2022-08-10T17:56:10.986802+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:56:10.986802+0000","last_undegraded":"2022-08-10T17:56:10.986802+0000","last_fullsized":"2022-08-10T17:56:10.986802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.986680+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:28.661781+0000","scrub_duration":0.019300363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.348594+0000","last_change":"2022-08-10T17:55:37.348571+0000","last_active":"2022-08-10T17:55:37.348594+0000","last_peered":"2022-08-10T17:55:37.348594+0000","last_clean":"2022-08-10T17:55:37.348594+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:37.348594+0000","last_undegraded":"2022-08-10T17:55:37.348594+0000","last_fullsized":"2022-08-10T17:55:37.348594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.348475+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:32:44.196786+0000","scrub_duration":0.0035728499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.563629+0000","last_change":"2022-08-10T17:55:36.563579+0000","last_active":"2022-08-10T17:55:36.563629+0000","last_peered":"2022-08-10T17:55:36.563629+0000","last_clean":"2022-08-10T17:55:36.563629+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:55:36.563629+0000","last_undegraded":"2022-08-10T17:55:36.563629+0000","last_fullsized":"2022-08-10T17:55:36.563629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4646","last_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_deep_scrub":"29'4646","last_deep_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.563473+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:09:00.188963+0000","scrub_duration":0.061717941999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.626811+0000","last_change":"2022-08-10T17:55:22.626781+0000","last_active":"2022-08-10T17:55:22.626811+0000","last_peered":"2022-08-10T17:55:22.626811+0000","last_clean":"2022-08-10T17:55:22.626811+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:55:22.626811+0000","last_undegraded":"2022-08-10T17:55:22.626811+0000","last_fullsized":"2022-08-10T17:55:22.626811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.626653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:34.446413+0000","scrub_duration":0.0035853080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.396141+0000","last_change":"2022-08-10T17:55:26.396110+0000","last_active":"2022-08-10T17:55:26.396141+0000","last_peered":"2022-08-10T17:55:26.396141+0000","last_clean":"2022-08-10T17:55:26.396141+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:55:26.396141+0000","last_undegraded":"2022-08-10T17:55:26.396141+0000","last_fullsized":"2022-08-10T17:55:26.396141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.396028+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:22:41.188174+0000","scrub_duration":0.016673178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.382444+0000","last_change":"2022-08-10T17:55:43.382417+0000","last_active":"2022-08-10T17:55:43.382444+0000","last_peered":"2022-08-10T17:55:43.382444+0000","last_clean":"2022-08-10T17:55:43.382444+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:43.382444+0000","last_undegraded":"2022-08-10T17:55:43.382444+0000","last_fullsized":"2022-08-10T17:55:43.382444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.382310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:35:24.953748+0000","scrub_duration":0.042344012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4787,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:43.085068+0000","last_change":"2022-08-10T17:35:41.436735+0000","last_active":"2022-08-10T17:54:43.085068+0000","last_peered":"2022-08-10T17:54:43.085068+0000","last_clean":"2022-08-10T17:54:43.085068+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:54:43.085068+0000","last_undegraded":"2022-08-10T17:54:43.085068+0000","last_fullsized":"2022-08-10T17:54:43.085068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.086112+0000","last_change":"2022-08-10T17:55:27.086083+0000","last_active":"2022-08-10T17:55:27.086112+0000","last_peered":"2022-08-10T17:55:27.086112+0000","last_clean":"2022-08-10T17:55:27.086112+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:55:27.086112+0000","last_undegraded":"2022-08-10T17:55:27.086112+0000","last_fullsized":"2022-08-10T17:55:27.086112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.085971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:11:51.139836+0000","scrub_duration":0.003529314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.998931+0000","last_change":"2022-08-10T17:55:28.998908+0000","last_active":"2022-08-10T17:55:28.998931+0000","last_peered":"2022-08-10T17:55:28.998931+0000","last_clean":"2022-08-10T17:55:28.998931+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:55:28.998931+0000","last_undegraded":"2022-08-10T17:55:28.998931+0000","last_fullsized":"2022-08-10T17:55:28.998931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.998804+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:40:46.133786+0000","scrub_duration":0.020972382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.369120+0000","last_change":"2022-08-10T17:55:31.369098+0000","last_active":"2022-08-10T17:55:31.369120+0000","last_peered":"2022-08-10T17:55:31.369120+0000","last_clean":"2022-08-10T17:55:31.369120+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:55:31.369120+0000","last_undegraded":"2022-08-10T17:55:31.369120+0000","last_fullsized":"2022-08-10T17:55:31.369120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.369017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:19.456252+0000","scrub_duration":0.0034799219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.902416+0000","last_change":"2022-08-10T17:55:31.902390+0000","last_active":"2022-08-10T17:55:31.902416+0000","last_peered":"2022-08-10T17:55:31.902416+0000","last_clean":"2022-08-10T17:55:31.902416+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:31.902416+0000","last_undegraded":"2022-08-10T17:55:31.902416+0000","last_fullsized":"2022-08-10T17:55:31.902416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.902294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:04.476448+0000","scrub_duration":0.027996058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3434,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:08.203081+0000","last_change":"2022-08-10T17:56:08.203034+0000","last_active":"2022-08-10T17:56:08.203081+0000","last_peered":"2022-08-10T17:56:08.203081+0000","last_clean":"2022-08-10T17:56:08.203081+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:56:08.203081+0000","last_undegraded":"2022-08-10T17:56:08.203081+0000","last_fullsized":"2022-08-10T17:56:08.203081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3406","last_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_deep_scrub":"29'3406","last_deep_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_clean_scrub_stamp":"2022-08-10T17:56:08.202932+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:41:13.192438+0000","scrub_duration":0.091572171999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.966787+0000","last_change":"2022-08-10T17:55:29.966768+0000","last_active":"2022-08-10T17:55:29.966787+0000","last_peered":"2022-08-10T17:55:29.966787+0000","last_clean":"2022-08-10T17:55:29.966787+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:55:29.966787+0000","last_undegraded":"2022-08-10T17:55:29.966787+0000","last_fullsized":"2022-08-10T17:55:29.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.966669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:30:37.613565+0000","scrub_duration":0.0037818109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'84","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.063945+0000","last_change":"2022-08-10T17:55:34.063912+0000","last_active":"2022-08-10T17:55:34.063945+0000","last_peered":"2022-08-10T17:55:34.063945+0000","last_clean":"2022-08-10T17:55:34.063945+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:55:34.063945+0000","last_undegraded":"2022-08-10T17:55:34.063945+0000","last_fullsized":"2022-08-10T17:55:34.063945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'84","last_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_deep_scrub":"29'84","last_deep_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.063817+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:21:24.542508+0000","scrub_duration":0.019597560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.989697+0000","last_change":"2022-08-10T17:55:50.989676+0000","last_active":"2022-08-10T17:55:50.989697+0000","last_peered":"2022-08-10T17:55:50.989697+0000","last_clean":"2022-08-10T17:55:50.989697+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:50.989697+0000","last_undegraded":"2022-08-10T17:55:50.989697+0000","last_fullsized":"2022-08-10T17:55:50.989697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.989601+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:29:39.434990+0000","scrub_duration":0.0035003970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5890,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.906460+0000","last_change":"2022-08-10T17:55:43.906421+0000","last_active":"2022-08-10T17:55:43.906460+0000","last_peered":"2022-08-10T17:55:43.906460+0000","last_clean":"2022-08-10T17:55:43.906460+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:55:43.906460+0000","last_undegraded":"2022-08-10T17:55:43.906460+0000","last_fullsized":"2022-08-10T17:55:43.906460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5862","last_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_deep_scrub":"29'5862","last_deep_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.906317+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:26:06.441129+0000","scrub_duration":0.075268903999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.069569+0000","last_change":"2022-08-10T17:55:37.069551+0000","last_active":"2022-08-10T17:55:37.069569+0000","last_peered":"2022-08-10T17:55:37.069569+0000","last_clean":"2022-08-10T17:55:37.069569+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:55:37.069569+0000","last_undegraded":"2022-08-10T17:55:37.069569+0000","last_fullsized":"2022-08-10T17:55:37.069569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.069477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:41.886326+0000","scrub_duration":0.0035232359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.399676+0000","last_change":"2022-08-10T17:55:34.399655+0000","last_active":"2022-08-10T17:55:34.399676+0000","last_peered":"2022-08-10T17:55:34.399676+0000","last_clean":"2022-08-10T17:55:34.399676+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:55:34.399676+0000","last_undegraded":"2022-08-10T17:55:34.399676+0000","last_fullsized":"2022-08-10T17:55:34.399676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.399577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:44:22.781395+0000","scrub_duration":0.0034960490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.071382+0000","last_change":"2022-08-10T17:55:33.071345+0000","last_active":"2022-08-10T17:55:33.071382+0000","last_peered":"2022-08-10T17:55:33.071382+0000","last_clean":"2022-08-10T17:55:33.071382+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:33.071382+0000","last_undegraded":"2022-08-10T17:55:33.071382+0000","last_fullsized":"2022-08-10T17:55:33.071382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.071183+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:40:33.068733+0000","scrub_duration":0.0095831489999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2960,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922891+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.922891+0000","last_peered":"2022-08-10T17:54:42.922891+0000","last_clean":"2022-08-10T17:54:42.922891+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.922891+0000","last_undegraded":"2022-08-10T17:54:42.922891+0000","last_fullsized":"2022-08-10T17:54:42.922891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.316191+0000","last_change":"2022-08-10T17:55:37.316154+0000","last_active":"2022-08-10T17:55:37.316191+0000","last_peered":"2022-08-10T17:55:37.316191+0000","last_clean":"2022-08-10T17:55:37.316191+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:55:37.316191+0000","last_undegraded":"2022-08-10T17:55:37.316191+0000","last_fullsized":"2022-08-10T17:55:37.316191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.316067+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:40:23.614188+0000","scrub_duration":0.016809653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.301522+0000","last_change":"2022-08-10T17:55:24.301501+0000","last_active":"2022-08-10T17:55:24.301522+0000","last_peered":"2022-08-10T17:55:24.301522+0000","last_clean":"2022-08-10T17:55:24.301522+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:55:24.301522+0000","last_undegraded":"2022-08-10T17:55:24.301522+0000","last_fullsized":"2022-08-10T17:55:24.301522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.301417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:33:53.898237+0000","scrub_duration":0.0034981370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.337456+0000","last_change":"2022-08-10T17:55:41.337433+0000","last_active":"2022-08-10T17:55:41.337456+0000","last_peered":"2022-08-10T17:55:41.337456+0000","last_clean":"2022-08-10T17:55:41.337456+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:41.337456+0000","last_undegraded":"2022-08-10T17:55:41.337456+0000","last_fullsized":"2022-08-10T17:55:41.337456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.337357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:41:32.970167+0000","scrub_duration":0.0035830240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4344,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.513696+0000","last_change":"2022-08-10T17:56:10.513657+0000","last_active":"2022-08-10T17:56:10.513696+0000","last_peered":"2022-08-10T17:56:10.513696+0000","last_clean":"2022-08-10T17:56:10.513696+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:56:10.513696+0000","last_undegraded":"2022-08-10T17:56:10.513696+0000","last_fullsized":"2022-08-10T17:56:10.513696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4316","last_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_deep_scrub":"29'4316","last_deep_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.513552+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:09.761651+0000","scrub_duration":0.084202658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.899289+0000","last_change":"2022-08-10T17:55:23.899252+0000","last_active":"2022-08-10T17:55:23.899289+0000","last_peered":"2022-08-10T17:55:23.899289+0000","last_clean":"2022-08-10T17:55:23.899289+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:55:23.899289+0000","last_undegraded":"2022-08-10T17:55:23.899289+0000","last_fullsized":"2022-08-10T17:55:23.899289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.899118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:10:44.169251+0000","scrub_duration":0.0035038819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'73","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.041014+0000","last_change":"2022-08-10T17:55:41.040993+0000","last_active":"2022-08-10T17:55:41.041014+0000","last_peered":"2022-08-10T17:55:41.041014+0000","last_clean":"2022-08-10T17:55:41.041014+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:55:41.041014+0000","last_undegraded":"2022-08-10T17:55:41.041014+0000","last_fullsized":"2022-08-10T17:55:41.041014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.040907+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:49:13.722929+0000","scrub_duration":0.024350785999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:19.065493+0000","last_change":"2022-08-10T17:56:19.065474+0000","last_active":"2022-08-10T17:56:19.065493+0000","last_peered":"2022-08-10T17:56:19.065493+0000","last_clean":"2022-08-10T17:56:19.065493+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:56:19.065493+0000","last_undegraded":"2022-08-10T17:56:19.065493+0000","last_fullsized":"2022-08-10T17:56:19.065493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_clean_scrub_stamp":"2022-08-10T17:56:19.065397+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:48:02.437895+0000","scrub_duration":0.0035302699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4838,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.416166+0000","last_change":"2022-08-10T17:55:53.416111+0000","last_active":"2022-08-10T17:55:53.416166+0000","last_peered":"2022-08-10T17:55:53.416166+0000","last_clean":"2022-08-10T17:55:53.416166+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:55:53.416166+0000","last_undegraded":"2022-08-10T17:55:53.416166+0000","last_fullsized":"2022-08-10T17:55:53.416166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4810","last_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_deep_scrub":"29'4810","last_deep_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.416011+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:10.405949+0000","scrub_duration":0.05286983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1834","reported_seq":1864,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:47.965716+0000","last_change":"2022-08-10T17:55:47.965696+0000","last_active":"2022-08-10T17:55:47.965716+0000","last_peered":"2022-08-10T17:55:47.965716+0000","last_clean":"2022-08-10T17:55:47.965716+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:47.965716+0000","last_undegraded":"2022-08-10T17:55:47.965716+0000","last_fullsized":"2022-08-10T17:55:47.965716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1834","last_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_deep_scrub":"29'1834","last_deep_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_clean_scrub_stamp":"2022-08-10T17:55:47.965611+0000","objects_scrubbed":3,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:45.463809+0000","scrub_duration":0.038525047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.601728+0000","last_change":"2022-08-10T17:55:24.601691+0000","last_active":"2022-08-10T17:55:24.601728+0000","last_peered":"2022-08-10T17:55:24.601728+0000","last_clean":"2022-08-10T17:55:24.601728+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:24.601728+0000","last_undegraded":"2022-08-10T17:55:24.601728+0000","last_fullsized":"2022-08-10T17:55:24.601728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.601546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:48:03.331213+0000","scrub_duration":0.0034631699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4557,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:16.361916+0000","last_change":"2022-08-10T17:56:16.361878+0000","last_active":"2022-08-10T17:56:16.361916+0000","last_peered":"2022-08-10T17:56:16.361916+0000","last_clean":"2022-08-10T17:56:16.361916+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:56:16.361916+0000","last_undegraded":"2022-08-10T17:56:16.361916+0000","last_fullsized":"2022-08-10T17:56:16.361916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4529","last_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_deep_scrub":"29'4529","last_deep_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:16.361775+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:02:50.074670+0000","scrub_duration":0.063326929000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.131177+0000","last_change":"2022-08-10T17:55:35.131146+0000","last_active":"2022-08-10T17:55:35.131177+0000","last_peered":"2022-08-10T17:55:35.131177+0000","last_clean":"2022-08-10T17:55:35.131177+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:55:35.131177+0000","last_undegraded":"2022-08-10T17:55:35.131177+0000","last_fullsized":"2022-08-10T17:55:35.131177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.131014+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:12:57.212526+0000","scrub_duration":0.028963988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:01.984902+0000","last_change":"2022-08-10T17:56:01.984875+0000","last_active":"2022-08-10T17:56:01.984902+0000","last_peered":"2022-08-10T17:56:01.984902+0000","last_clean":"2022-08-10T17:56:01.984902+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:56:01.984902+0000","last_undegraded":"2022-08-10T17:56:01.984902+0000","last_fullsized":"2022-08-10T17:56:01.984902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:01.984775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:02:21.804010+0000","scrub_duration":0.032020725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3909,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.144536+0000","last_change":"2022-08-10T17:55:54.144477+0000","last_active":"2022-08-10T17:55:54.144536+0000","last_peered":"2022-08-10T17:55:54.144536+0000","last_clean":"2022-08-10T17:55:54.144536+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:55:54.144536+0000","last_undegraded":"2022-08-10T17:55:54.144536+0000","last_fullsized":"2022-08-10T17:55:54.144536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3881","last_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_deep_scrub":"29'3881","last_deep_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.144322+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:34.319790+0000","scrub_duration":0.066230998999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.117089+0000","last_change":"2022-08-10T17:55:34.117062+0000","last_active":"2022-08-10T17:55:34.117089+0000","last_peered":"2022-08-10T17:55:34.117089+0000","last_clean":"2022-08-10T17:55:34.117089+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:55:34.117089+0000","last_undegraded":"2022-08-10T17:55:34.117089+0000","last_fullsized":"2022-08-10T17:55:34.117089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.116969+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:43:17.054491+0000","scrub_duration":0.029066613000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535698+0000","last_change":"2022-08-10T17:35:37.408553+0000","last_active":"2022-08-10T17:55:16.535698+0000","last_peered":"2022-08-10T17:55:16.535698+0000","last_clean":"2022-08-10T17:55:16.535698+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:55:16.535698+0000","last_undegraded":"2022-08-10T17:55:16.535698+0000","last_fullsized":"2022-08-10T17:55:16.535698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4424,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.639532+0000","last_change":"2022-08-10T17:35:41.436322+0000","last_active":"2022-08-10T17:54:42.639532+0000","last_peered":"2022-08-10T17:54:42.639532+0000","last_clean":"2022-08-10T17:54:42.639532+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:54:42.639532+0000","last_undegraded":"2022-08-10T17:54:42.639532+0000","last_fullsized":"2022-08-10T17:54:42.639532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.320131+0000","last_change":"2022-08-10T17:55:33.320112+0000","last_active":"2022-08-10T17:55:33.320131+0000","last_peered":"2022-08-10T17:55:33.320131+0000","last_clean":"2022-08-10T17:55:33.320131+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:55:33.320131+0000","last_undegraded":"2022-08-10T17:55:33.320131+0000","last_fullsized":"2022-08-10T17:55:33.320131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.320028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:04.115098+0000","scrub_duration":0.0034705809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.392253+0000","last_change":"2022-08-10T17:55:50.392218+0000","last_active":"2022-08-10T17:55:50.392253+0000","last_peered":"2022-08-10T17:55:50.392253+0000","last_clean":"2022-08-10T17:55:50.392253+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:50.392253+0000","last_undegraded":"2022-08-10T17:55:50.392253+0000","last_fullsized":"2022-08-10T17:55:50.392253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.392108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:07.042516+0000","scrub_duration":0.026038200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5535,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.445165+0000","last_change":"2022-08-10T17:55:49.445116+0000","last_active":"2022-08-10T17:55:49.445165+0000","last_peered":"2022-08-10T17:55:49.445165+0000","last_clean":"2022-08-10T17:55:49.445165+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:55:49.445165+0000","last_undegraded":"2022-08-10T17:55:49.445165+0000","last_fullsized":"2022-08-10T17:55:49.445165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5507","last_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_deep_scrub":"29'5507","last_deep_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.445013+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:23:49.478670+0000","scrub_duration":0.071917088000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.971860+0000","last_change":"2022-08-10T17:55:42.971824+0000","last_active":"2022-08-10T17:55:42.971860+0000","last_peered":"2022-08-10T17:55:42.971860+0000","last_clean":"2022-08-10T17:55:42.971860+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:55:42.971860+0000","last_undegraded":"2022-08-10T17:55:42.971860+0000","last_fullsized":"2022-08-10T17:55:42.971860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.971742+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:21:05.087309+0000","scrub_duration":0.019130503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:12.965428+0000","last_change":"2022-08-10T17:56:12.965406+0000","last_active":"2022-08-10T17:56:12.965428+0000","last_peered":"2022-08-10T17:56:12.965428+0000","last_clean":"2022-08-10T17:56:12.965428+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:56:12.965428+0000","last_undegraded":"2022-08-10T17:56:12.965428+0000","last_fullsized":"2022-08-10T17:56:12.965428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_clean_scrub_stamp":"2022-08-10T17:56:12.965326+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:31:27.062017+0000","scrub_duration":0.0035956199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.797625+0000","last_change":"2022-08-10T17:55:42.797602+0000","last_active":"2022-08-10T17:55:42.797625+0000","last_peered":"2022-08-10T17:55:42.797625+0000","last_clean":"2022-08-10T17:55:42.797625+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:42.797625+0000","last_undegraded":"2022-08-10T17:55:42.797625+0000","last_fullsized":"2022-08-10T17:55:42.797625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.797520+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:36.624748+0000","scrub_duration":0.0035868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.426634+0000","last_change":"2022-08-10T17:55:55.426610+0000","last_active":"2022-08-10T17:55:55.426634+0000","last_peered":"2022-08-10T17:55:55.426634+0000","last_clean":"2022-08-10T17:55:55.426634+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:55.426634+0000","last_undegraded":"2022-08-10T17:55:55.426634+0000","last_fullsized":"2022-08-10T17:55:55.426634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.426506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:30:26.689886+0000","scrub_duration":0.023987992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:16.535365+0000","last_change":"2022-08-10T17:35:37.416756+0000","last_active":"2022-08-10T17:55:16.535365+0000","last_peered":"2022-08-10T17:55:16.535365+0000","last_clean":"2022-08-10T17:55:16.535365+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:55:16.535365+0000","last_undegraded":"2022-08-10T17:55:16.535365+0000","last_fullsized":"2022-08-10T17:55:16.535365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:36.993769+0000","last_clean_scrub_stamp":"2022-08-10T17:35:36.993769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.495214+0000","last_change":"2022-08-10T17:55:53.495189+0000","last_active":"2022-08-10T17:55:53.495214+0000","last_peered":"2022-08-10T17:55:53.495214+0000","last_clean":"2022-08-10T17:55:53.495214+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:53.495214+0000","last_undegraded":"2022-08-10T17:55:53.495214+0000","last_fullsized":"2022-08-10T17:55:53.495214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.495082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:02.429575+0000","scrub_duration":0.031547311000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.336472+0000","last_change":"2022-08-10T17:55:39.336435+0000","last_active":"2022-08-10T17:55:39.336472+0000","last_peered":"2022-08-10T17:55:39.336472+0000","last_clean":"2022-08-10T17:55:39.336472+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:39.336472+0000","last_undegraded":"2022-08-10T17:55:39.336472+0000","last_fullsized":"2022-08-10T17:55:39.336472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.336296+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:42:50.195666+0000","scrub_duration":0.003602035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3306,"ondisk_log_size":3306,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575102,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478196,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475200,"kb_avail":93893644,"statfs":{"total":96636764160,"available":96147091456,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486604800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":12.699999999999999,"15min":12.686999999999999},"min":{"1min":0.255,"5min":0.222,"15min":0.193},"max":{"1min":0.52700000000000002,"5min":111.864,"15min":140.46000000000001},"last":0.316},{"interface":"front","average":{"1min":0.371,"5min":12.630000000000001,"15min":12.773},"min":{"1min":0.214,"5min":0.214,"15min":0.186},"max":{"1min":0.47899999999999998,"5min":112.184,"15min":140.48099999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":5.3380000000000001,"15min":9.6479999999999997},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.504},{"interface":"front","average":{"1min":0.42599999999999999,"5min":5.3499999999999996,"15min":9.5310000000000006},"min":{"1min":0.32900000000000001,"5min":0.253,"15min":0.215},"max":{"1min":0.59799999999999998,"5min":70.302999999999997,"15min":76.177999999999997},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":1.9650000000000001,"15min":3.1949999999999998},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58599999999999997,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.439,"5min":2.0760000000000001,"15min":3.3199999999999998},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":0.60599999999999998,"5min":43.933,"15min":60.771999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Aug 10 17:56:07 2022","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.76000000000000001,"15min":3.7189999999999999},"min":{"1min":0.33100000000000002,"5min":0.28100000000000003,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.82599999999999996,"15min":3.8929999999999998},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.0920000000000001,"15min":5.1589999999999998},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.218},"max":{"1min":0.55000000000000004,"5min":16.939,"15min":81.718999999999994},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.78800000000000003,"15min":5.3019999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.621,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":4.157,"15min":8.4019999999999992},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":0.52800000000000002,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.37},{"interface":"front","average":{"1min":0.38700000000000001,"5min":4.0529999999999999,"15min":8.4369999999999994},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.434}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.64000000000000001,"15min":2.8140000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.53200000000000003,"5min":9.0060000000000002,"15min":72.474999999999994},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.84099999999999997,"15min":3.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":20.064,"15min":72.403999999999996},"last":0.50800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575102,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503808,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515899392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":9.3140000000000001,"15min":11.616},"min":{"1min":0.28499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.51500000000000001,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":9.3170000000000002,"15min":11.853},"min":{"1min":0.26200000000000001,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":129.767,"15min":129.767},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":7.0030000000000001,"15min":11.9},"min":{"1min":0.29099999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":0.69999999999999996,"5min":114.83,"15min":120.13500000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":6.9550000000000001,"15min":11.571},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":0.56399999999999995,"5min":114.842,"15min":119.708},"last":0.47999999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.343,"15min":4.3499999999999996},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":17.885999999999999,"15min":107.033},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":1.3240000000000001,"15min":4.6289999999999996},"min":{"1min":0.32800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45300000000000001,"5min":17.895,"15min":107.062},"last":0.34599999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":1,"15min":2.6560000000000001},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.438},{"interface":"front","average":{"1min":0.432,"5min":1.0469999999999999,"15min":2.887},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":0.54000000000000004,"5min":16.331,"15min":96.870000000000005},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":2.899,"15min":6.5469999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.183},"max":{"1min":0.48699999999999999,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.44,"5min":2.8500000000000001,"15min":6.5510000000000002},"min":{"1min":0.32300000000000001,"5min":0.28899999999999998,"15min":0.26000000000000001},"max":{"1min":0.58099999999999996,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.30499999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":4.6390000000000002,"15min":7.9610000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":0.65300000000000002,"5min":79.944999999999993,"15min":100.741},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":5.1269999999999998,"15min":8.0600000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":80.159000000000006,"15min":100.715},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":1.212,"15min":3.7719999999999998},"min":{"1min":0.34399999999999997,"5min":0.27100000000000002,"15min":0.23400000000000001},"max":{"1min":0.50700000000000001,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.83599999999999997,"15min":3.3679999999999999},"min":{"1min":0.36899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":10.551,"15min":59.384},"last":0.36499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575100,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621772,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621440,"kb_avail":93750068,"statfs":{"total":96636764160,"available":96000069632,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636354560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":9.8260000000000005,"15min":11.797000000000001},"min":{"1min":0.21199999999999999,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":0.36899999999999999,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28399999999999997,"5min":9.5380000000000003,"15min":11.470000000000001},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":0.38200000000000001,"5min":116.699,"15min":116.699},"last":0.245}]},{"osd":2,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.661,"15min":4.8799999999999999},"min":{"1min":0.25,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.41599999999999998,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.374,"5min":1.5169999999999999,"15min":4.7030000000000003},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":0.52100000000000002,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":1.319,"15min":3.2320000000000002},"min":{"1min":0.30099999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":0.60499999999999998,"5min":25.152000000000001,"15min":87.884},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":2.387,"15min":3.3530000000000002},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.16600000000000001},"max":{"1min":0.51600000000000001,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.311}]},{"osd":4,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":2.6949999999999998,"15min":8.0050000000000008},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":2.919,"15min":8.157},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.28000000000000003},"max":{"1min":0.64500000000000002,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":3.5659999999999998,"15min":8.9169999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":3.3999999999999999,"15min":8.8940000000000001},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.65300000000000002,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":1.5800000000000001,"15min":4.2859999999999996},"min":{"1min":0.373,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":30.183,"15min":115.45999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.496,"5min":1.631,"15min":3.9089999999999998},"min":{"1min":0.40999999999999998,"5min":0.34499999999999997,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":30.236000000000001,"15min":115.346},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.4139999999999999,"15min":2.7429999999999999},"min":{"1min":0.38200000000000001,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":1.141,"15min":2.8740000000000001},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.29499999999999998},"max":{"1min":0.68200000000000005,"5min":11.885,"15min":58.526000000000003},"last":0.58099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575099,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604048,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596352,"kb_avail":93767792,"statfs":{"total":96636764160,"available":96018219008,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610664448},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":8.8580000000000005,"15min":11.233000000000001},"min":{"1min":0.21199999999999999,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":0.45000000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":9.6319999999999997,"15min":11.512},"min":{"1min":0.26800000000000002,"5min":0.21299999999999999,"15min":0.17799999999999999},"max":{"1min":0.51100000000000001,"5min":93.111999999999995,"15min":111.506},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.323,"15min":5.5839999999999996},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":0.52700000000000002,"5min":21.789000000000001,"15min":130.566},"last":0.25},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.881,"15min":5.798},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.222},"max":{"1min":2.5910000000000002,"5min":50.625,"15min":130.63300000000001},"last":0.28999999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":1.385,"15min":3.5369999999999999},"min":{"1min":0.22700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.39600000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.9810000000000001,"15min":3.6880000000000002},"min":{"1min":0.30399999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":50.686999999999998,"15min":111.377},"last":0.33500000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":1.804,"15min":6.6820000000000004},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.57699999999999996,"5min":39.814999999999998,"15min":127.629},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":2.6480000000000001,"15min":7.0259999999999998},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":2.5209999999999999,"5min":50.734000000000002,"15min":127.497},"last":0.378}]},{"osd":5,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":3.7650000000000001,"15min":7.7489999999999997},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":88.512,"15min":127.77500000000001},"last":0.437},{"interface":"front","average":{"1min":0.44500000000000001,"5min":3.9710000000000001,"15min":8.3360000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":1.903,"15min":4.4100000000000001},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":50.664000000000001,"15min":114.8},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":2.1269999999999998,"15min":4.5149999999999997},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":2.5590000000000002,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8049999999999999,"15min":3.0699999999999998},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":2.2690000000000001,"15min":3.298},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575101,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:08 2022","interfaces":[{"interface":"back","average":{"1min":0.27200000000000002,"5min":15.108000000000001,"15min":15.090999999999999},"min":{"1min":0.19900000000000001,"5min":0.18099999999999999,"15min":0.14899999999999999},"max":{"1min":0.40699999999999997,"5min":117.869,"15min":117.869},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.309,"5min":15.01,"15min":15.234},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41899999999999998,"5min":117.889,"15min":117.889},"last":0.29099999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":8.7029999999999994,"15min":12.433999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.185},"max":{"1min":0.38100000000000001,"5min":150.911,"15min":150.911},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":8.8629999999999995,"15min":12.443},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":0.53000000000000003,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:19 2022","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":1.1319999999999999,"15min":2.593},"min":{"1min":0.28399999999999997,"5min":0.22700000000000001,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":21.376000000000001,"15min":95.066999999999993},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.103,"15min":2.4609999999999999},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.48799999999999999,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":2.851,"15min":7.4329999999999998},"min":{"1min":0.373,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":0.71699999999999997,"5min":47.207999999999998,"15min":114.259},"last":0.433},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.7519999999999998,"15min":7.6630000000000003},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71099999999999997,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.34799999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":2.887,"15min":7.3529999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":0.72999999999999998,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.433,"5min":3.0209999999999999,"15min":7.3540000000000001},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":63.508000000000003,"15min":100.22},"last":0.38}]},{"osd":6,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.1200000000000001,"15min":2.7989999999999999},"min":{"1min":0.378,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":19.789999999999999,"15min":60.429000000000002},"last":0.441},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3029999999999999,"15min":2.9609999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":0.58699999999999997,"5min":28.131,"15min":60.445},"last":0.42399999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":1.355,"15min":3.5139999999999998},"min":{"1min":0.34899999999999998,"5min":0.33000000000000002,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":34.904000000000003,"15min":94.753},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":1.2889999999999999,"15min":3.7010000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":0.60499999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575101,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473944,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":472000,"kb_avail":93897896,"statfs":{"total":96636764160,"available":96151445504,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483328000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":10.327,"15min":12.210000000000001},"min":{"1min":0.19400000000000001,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":0.434,"5min":117.169,"15min":117.169},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":10.387,"15min":12.581},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":117.199,"15min":117.199},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":4.3049999999999997,"15min":10.551},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.19400000000000001},"max":{"1min":0.45000000000000001,"5min":56.604999999999997,"15min":135.714},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":4.0940000000000003,"15min":10.529},"min":{"1min":0.23300000000000001,"5min":0.23200000000000001,"15min":0.183},"max":{"1min":0.46600000000000003,"5min":57.014000000000003,"15min":135.65700000000001},"last":0.23300000000000001}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":2.1440000000000001,"15min":3.5649999999999999},"min":{"1min":0.26700000000000002,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":87.492000000000004,"15min":87.492000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":2.169,"15min":3.3100000000000001},"min":{"1min":0.29899999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":2.7570000000000001,"15min":5.2770000000000001},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.433,"5min":2.2599999999999998,"15min":5.2560000000000002},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.66900000000000004,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":2.7040000000000002,"15min":5.6210000000000004},"min":{"1min":0.378,"5min":0.30399999999999999,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":45.448,"15min":70.989000000000004},"last":0.375},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.948,"15min":5.5910000000000002},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":45.462000000000003,"15min":71.114000000000004},"last":0.34000000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":1.0369999999999999,"15min":3.4300000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":9.9450000000000003,"15min":51.773000000000003},"last":0.432},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.675,"15min":3.3530000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":34.656999999999996,"15min":51.738},"last":0.371}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.5609999999999999,"15min":3.3999999999999999},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.64000000000000001,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3140000000000001,"15min":3.2690000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575102,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559988,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551360,"kb_avail":93811852,"statfs":{"total":96636764160,"available":96063336448,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564592640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":8.7799999999999994,"15min":11.246},"min":{"1min":0.28599999999999998,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":0.47299999999999998,"5min":101.88,"15min":136.29300000000001},"last":0.38},{"interface":"front","average":{"1min":0.40899999999999997,"5min":9.1229999999999993,"15min":11.416},"min":{"1min":0.28199999999999997,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":101.867,"15min":136.142},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":7.3230000000000004,"15min":11.394},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.47799999999999998,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.44},{"interface":"front","average":{"1min":0.40400000000000003,"5min":7.1520000000000001,"15min":10.872999999999999},"min":{"1min":0.32100000000000001,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":0.54500000000000004,"5min":146.45699999999999,"15min":146.45699999999999},"last":0.374}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.7390000000000001,"15min":4.4000000000000004},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.792,"15min":3.9990000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":0.66200000000000003,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":1.587,"15min":3.8140000000000001},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.24099999999999999},"max":{"1min":0.48599999999999999,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":1.6299999999999999,"15min":3.5350000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.25800000000000001},"max":{"1min":0.52000000000000002,"5min":29.956,"15min":63.167999999999999},"last":0.33200000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":2.2989999999999999,"15min":8.6020000000000003},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.219},"max":{"1min":0.502,"5min":49.238999999999997,"15min":84.778999999999996},"last":0.318},{"interface":"front","average":{"1min":0.434,"5min":2.2389999999999999,"15min":8.8559999999999999},"min":{"1min":0.32100000000000001,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":0.61599999999999999,"5min":49.283999999999999,"15min":84.762},"last":0.39100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":1.1970000000000001,"15min":4.5780000000000003},"min":{"1min":0.30499999999999999,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.54800000000000004,"5min":30.805,"15min":83.144000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.755,"15min":4.976},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":0.63700000000000001,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.434}]},{"osd":7,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.1379999999999999,"15min":2.5950000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.83299999999999996,"15min":3.1030000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55700000000000005,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.44900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575100,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546944,"kb_avail":93824560,"statfs":{"total":96636764160,"available":96076349440,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560070656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":8.298,"15min":11.548999999999999},"min":{"1min":0.28199999999999997,"5min":0.22900000000000001,"15min":0.192},"max":{"1min":0.51500000000000001,"5min":94.200000000000003,"15min":112.441},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":9.9450000000000003,"15min":12.314},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":6.5839999999999996,"15min":10.292},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":0.46700000000000003,"5min":106.054,"15min":111.13800000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":6.9550000000000001,"15min":10.839},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":0.54800000000000004,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":1.4370000000000001,"15min":4.0359999999999996},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":52.337000000000003,"15min":112.09099999999999},"last":0.441},{"interface":"front","average":{"1min":0.436,"5min":1.736,"15min":4.3150000000000004},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.51500000000000001,"5min":52.393999999999998,"15min":112.91200000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":1.3100000000000001,"15min":3.9049999999999998},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":41.634999999999998,"15min":139.75299999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.3109999999999999,"15min":3.8130000000000002},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.50700000000000001,"5min":46.216999999999999,"15min":110.21599999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":1.083,"15min":7.2679999999999998},"min":{"1min":0.248,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.55000000000000004,"5min":25.922999999999998,"15min":88.391000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.234,"15min":7.3840000000000003},"min":{"1min":0.316,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":0.56499999999999995,"5min":26.094000000000001,"15min":88.344999999999999},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.81599999999999995,"15min":3.052},"min":{"1min":0.248,"5min":0.248,"15min":0.222},"max":{"1min":0.48599999999999999,"5min":15.548,"15min":68.132999999999996},"last":0.433},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.94899999999999995,"15min":3.1429999999999998},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":0.5,"5min":15.49,"15min":67.926000000000002},"last":0.503}]},{"osd":7,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.82199999999999995,"15min":3.7989999999999999},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":25.954999999999998,"15min":65.207999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.64600000000000002,"15min":3.8039999999999998},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":0.58199999999999996,"5min":7.2000000000000002,"15min":65.260999999999996},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:56:25.489 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.489 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.490 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.491 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.492 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.492 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.493 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.494 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.494 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.495 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2022-08-10T17:35:36.993769+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=36, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:25.495 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-08-10T17:56:45.497 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:56:45.620 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.616+0000 7f2b7577b700 1 Processor -- start 2022-08-10T17:56:45.621 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.617+0000 7f2b7577b700 1 -- start start 2022-08-10T17:56:45.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b7577b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b700c3c00 0x7f2b700644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b7577b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b7006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.628 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b7577b700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7006e220 con 0x7f2b70150c60 2022-08-10T17:56:45.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b7577b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b70068930 con 0x7f2b700c3c00 2022-08-10T17:56:45.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b7577b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70068d50 con 0x7f2b70068f50 2022-08-10T17:56:45.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b700c3c00 0x7f2b700644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.629 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b700c3c00 0x7f2b700644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45804/0 (socket says 172.21.15.150:45804) 2022-08-10T17:56:45.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 -- 172.21.15.150:0/1621627661 learned_addr learned my addr 172.21.15.150:0/1621627661 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:56:45.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6f7fe700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b7006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.630 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 -- 172.21.15.150:0/1621627661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 msgr2=0x7f2b7006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:56:45.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b7006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 -- 172.21.15.150:0/1621627661 >> v1:172.21.15.197:6789/0 conn(0x7f2b70150c60 legacy=0x7f2b700c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 -- 172.21.15.150:0/1621627661 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700682b0 con 0x7f2b700c3c00 2022-08-10T17:56:45.631 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6e7fc700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b700c3c00 0x7f2b700644b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009780 tx=0x7f2b64009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a662e5a03419f81c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:45.637 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6dffb700 1 -- 172.21.15.150:0/1621627661 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64004230 con 0x7f2b700c3c00 2022-08-10T17:56:45.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6dffb700 1 -- 172.21.15.150:0/1621627661 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64004390 con 0x7f2b700c3c00 2022-08-10T17:56:45.638 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.618+0000 7f2b6dffb700 1 -- 172.21.15.150:0/1621627661 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64011850 con 0x7f2b700c3c00 2022-08-10T17:56:45.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 -- 172.21.15.150:0/1621627661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b700c3c00 msgr2=0x7f2b700644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.639 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b700c3c00 0x7f2b700644b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009780 tx=0x7f2b64009a90 comp rx=0 tx=0).stop 2022-08-10T17:56:45.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 -- 172.21.15.150:0/1621627661 shutdown_connections 2022-08-10T17:56:45.640 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b7006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1621627661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b700c3c00 0x7f2b700644b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 -- 172.21.15.150:0/1621627661 >> 172.21.15.150:0/1621627661 conn(0x7f2b700c9320 msgr2=0x7f2b700c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:45.641 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 -- 172.21.15.150:0/1621627661 shutdown_connections 2022-08-10T17:56:45.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.619+0000 7f2b7577b700 1 -- 172.21.15.150:0/1621627661 wait complete. 2022-08-10T17:56:45.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.620+0000 7f2b7577b700 1 Processor -- start 2022-08-10T17:56:45.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.620+0000 7f2b7577b700 1 -- start start 2022-08-10T17:56:45.642 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b70155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 0x7f2b701ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70154200 con 0x7f2b70150c60 2022-08-10T17:56:45.643 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70145ae0 con 0x7f2b700c3c00 2022-08-10T17:56:45.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b7577b700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701f0190 con 0x7f2b70068f50 2022-08-10T17:56:45.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45812/0 (socket says 172.21.15.150:45812) 2022-08-10T17:56:45.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 -- 172.21.15.150:0/1630095739 learned_addr learned my addr 172.21.15.150:0/1630095739 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:56:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6effd700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b70155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6e7fc700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 0x7f2b701ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 -- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 msgr2=0x7f2b70155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b70155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 -- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 msgr2=0x7f2b701ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 0x7f2b701ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.646 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6f7fe700 1 -- 172.21.15.150:0/1630095739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640093e0 con 0x7f2b70150c60 2022-08-10T17:56:45.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6effd700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b70155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:56:45.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.621+0000 7f2b6e7fc700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 0x7f2b701ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-08-10T17:56:45.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b6f7fe700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b68007e60 tx=0x7f2b6800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:45.647 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800ede0 con 0x7f2b70150c60 2022-08-10T17:56:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68014420 con 0x7f2b70150c60 2022-08-10T17:56:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b701f0430 con 0x7f2b70150c60 2022-08-10T17:56:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680147d0 con 0x7f2b70150c60 2022-08-10T17:56:45.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.622+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b700c8db0 con 0x7f2b70150c60 2022-08-10T17:56:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.623+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70072890 con 0x7f2b70150c60 2022-08-10T17:56:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.623+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f2b68012050 con 0x7f2b70150c60 2022-08-10T17:56:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.623+0000 7f2b577fe700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 0x7f2b50067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:56:45.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.623+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f2b68082920 con 0x7f2b70150c60 2022-08-10T17:56:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.624+0000 7f2b6effd700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 0x7f2b50067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:56:45.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.624+0000 7f2b6effd700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 0x7f2b50067560 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f60 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:56:45.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.627+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f2b68050900 con 0x7f2b70150c60 2022-08-10T17:56:45.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.810+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b7006e750 con 0x7f2b500650b0 2022-08-10T17:56:45.825 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.821+0000 7f2b577fe700 1 -- 172.21.15.150:0/1630095739 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+395124 (secure 0 0 0) 0x7f2b7006e750 con 0x7f2b500650b0 2022-08-10T17:56:45.832 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:56:45.837 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 msgr2=0x7f2b50067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 0x7f2b50067560 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f60 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2022-08-10T17:56:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 msgr2=0x7f2b701455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:56:45.838 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b68007e60 tx=0x7f2b6800e3c0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 shutdown_connections 2022-08-10T17:56:45.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b70150c60 0x7f2b701455a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f2b500650b0 0x7f2b50067560 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.839 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f2b70068f50 0x7f2b70155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 --2- 172.21.15.150:0/1630095739 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f2b700c3c00 0x7f2b701ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:56:45.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 >> 172.21.15.150:0/1630095739 conn(0x7f2b700c9320 msgr2=0x7f2b7006b620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:56:45.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 shutdown_connections 2022-08-10T17:56:45.840 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:56:45.825+0000 7f2b7577b700 1 -- 172.21.15.150:0/1630095739 wait complete. 2022-08-10T17:56:45.841 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:56:45.842 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":661,"stamp":"2022-08-10T17:56:43.816991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152613,"ondisk_log_size":152613,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261808,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4239232,"kb_avail":750712912,"statfs":{"total":773094113280,"available":768730021888,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340973568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002624"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.671542+0000","last_change":"2022-08-10T17:55:23.671511+0000","last_active":"2022-08-10T17:55:23.671542+0000","last_peered":"2022-08-10T17:55:23.671542+0000","last_clean":"2022-08-10T17:55:23.671542+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:23.671542+0000","last_undegraded":"2022-08-10T17:55:23.671542+0000","last_fullsized":"2022-08-10T17:55:23.671542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.671406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:28:06.994122+0000","scrub_duration":0.037043489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.118511+0000","last_change":"2022-08-10T17:55:48.118489+0000","last_active":"2022-08-10T17:55:48.118511+0000","last_peered":"2022-08-10T17:55:48.118511+0000","last_clean":"2022-08-10T17:55:48.118511+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:48.118511+0000","last_undegraded":"2022-08-10T17:55:48.118511+0000","last_fullsized":"2022-08-10T17:55:48.118511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.118410+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:55:58.751362+0000","scrub_duration":0.003595076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.749547+0000","last_change":"2022-08-10T17:55:24.749527+0000","last_active":"2022-08-10T17:55:24.749547+0000","last_peered":"2022-08-10T17:55:24.749547+0000","last_clean":"2022-08-10T17:55:24.749547+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:24.749547+0000","last_undegraded":"2022-08-10T17:55:24.749547+0000","last_fullsized":"2022-08-10T17:55:24.749547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.749427+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:12.518032+0000","scrub_duration":0.0088304560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.879719+0000","last_change":"2022-08-10T17:55:34.879699+0000","last_active":"2022-08-10T17:55:34.879719+0000","last_peered":"2022-08-10T17:55:34.879719+0000","last_clean":"2022-08-10T17:55:34.879719+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:34.879719+0000","last_undegraded":"2022-08-10T17:55:34.879719+0000","last_fullsized":"2022-08-10T17:55:34.879719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.879618+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:21.211782+0000","scrub_duration":0.003479551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.970758+0000","last_change":"2022-08-10T17:55:54.970725+0000","last_active":"2022-08-10T17:55:54.970758+0000","last_peered":"2022-08-10T17:55:54.970758+0000","last_clean":"2022-08-10T17:55:54.970758+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:54.970758+0000","last_undegraded":"2022-08-10T17:55:54.970758+0000","last_fullsized":"2022-08-10T17:55:54.970758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.970624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:58.527187+0000","scrub_duration":0.018586465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:33.136621+0000","last_change":"2022-08-10T17:56:33.136589+0000","last_active":"2022-08-10T17:56:33.136621+0000","last_peered":"2022-08-10T17:56:33.136621+0000","last_clean":"2022-08-10T17:56:33.136621+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:56:33.136621+0000","last_undegraded":"2022-08-10T17:56:33.136621+0000","last_fullsized":"2022-08-10T17:56:33.136621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:33.136465+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:33.136465+0000","last_clean_scrub_stamp":"2022-08-10T17:56:33.136465+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:06:11.530878+0000","scrub_duration":0.003567686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.331223+0000","last_change":"2022-08-10T17:56:13.331186+0000","last_active":"2022-08-10T17:56:13.331223+0000","last_peered":"2022-08-10T17:56:13.331223+0000","last_clean":"2022-08-10T17:56:13.331223+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:56:13.331223+0000","last_undegraded":"2022-08-10T17:56:13.331223+0000","last_fullsized":"2022-08-10T17:56:13.331223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.331081+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:01:12.389751+0000","scrub_duration":0.039103919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.038721+0000","last_change":"2022-08-10T17:55:50.038689+0000","last_active":"2022-08-10T17:55:50.038721+0000","last_peered":"2022-08-10T17:55:50.038721+0000","last_clean":"2022-08-10T17:55:50.038721+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:50.038721+0000","last_undegraded":"2022-08-10T17:55:50.038721+0000","last_fullsized":"2022-08-10T17:55:50.038721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.038567+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:25:22.148321+0000","scrub_duration":0.0034662680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.017798+0000","last_change":"2022-08-10T17:55:56.017766+0000","last_active":"2022-08-10T17:55:56.017798+0000","last_peered":"2022-08-10T17:55:56.017798+0000","last_clean":"2022-08-10T17:55:56.017798+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:56.017798+0000","last_undegraded":"2022-08-10T17:55:56.017798+0000","last_fullsized":"2022-08-10T17:55:56.017798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.017619+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:34.560662+0000","scrub_duration":0.0309912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.092605+0000","last_change":"2022-08-10T17:55:24.092585+0000","last_active":"2022-08-10T17:55:24.092605+0000","last_peered":"2022-08-10T17:55:24.092605+0000","last_clean":"2022-08-10T17:55:24.092605+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:24.092605+0000","last_undegraded":"2022-08-10T17:55:24.092605+0000","last_fullsized":"2022-08-10T17:55:24.092605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.092509+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:43:12.935816+0000","scrub_duration":0.0044268040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.848285+0000","last_change":"2022-08-10T17:55:50.848264+0000","last_active":"2022-08-10T17:55:50.848285+0000","last_peered":"2022-08-10T17:55:50.848285+0000","last_clean":"2022-08-10T17:55:50.848285+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:50.848285+0000","last_undegraded":"2022-08-10T17:55:50.848285+0000","last_fullsized":"2022-08-10T17:55:50.848285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.848186+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:27:36.860710+0000","scrub_duration":0.0034554989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.587361+0000","last_change":"2022-08-10T17:55:27.587324+0000","last_active":"2022-08-10T17:55:27.587361+0000","last_peered":"2022-08-10T17:55:27.587361+0000","last_clean":"2022-08-10T17:55:27.587361+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:27.587361+0000","last_undegraded":"2022-08-10T17:55:27.587361+0000","last_fullsized":"2022-08-10T17:55:27.587361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.587177+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:18:28.369001+0000","scrub_duration":0.003490515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.597924+0000","last_change":"2022-08-10T17:55:28.597885+0000","last_active":"2022-08-10T17:55:28.597924+0000","last_peered":"2022-08-10T17:55:28.597924+0000","last_clean":"2022-08-10T17:55:28.597924+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:28.597924+0000","last_undegraded":"2022-08-10T17:55:28.597924+0000","last_fullsized":"2022-08-10T17:55:28.597924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.597685+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:50:51.165553+0000","scrub_duration":0.016393403000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.084201+0000","last_change":"2022-08-10T17:55:25.084163+0000","last_active":"2022-08-10T17:55:25.084201+0000","last_peered":"2022-08-10T17:55:25.084201+0000","last_clean":"2022-08-10T17:55:25.084201+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:25.084201+0000","last_undegraded":"2022-08-10T17:55:25.084201+0000","last_fullsized":"2022-08-10T17:55:25.084201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.084023+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:58:36.715764+0000","scrub_duration":0.0035396899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.289003+0000","last_change":"2022-08-10T17:56:09.288973+0000","last_active":"2022-08-10T17:56:09.289003+0000","last_peered":"2022-08-10T17:56:09.289003+0000","last_clean":"2022-08-10T17:56:09.289003+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:56:09.289003+0000","last_undegraded":"2022-08-10T17:56:09.289003+0000","last_fullsized":"2022-08-10T17:56:09.289003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.288839+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:42.321172+0000","scrub_duration":0.0035582019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.746364+0000","last_change":"2022-08-10T17:55:32.746346+0000","last_active":"2022-08-10T17:55:32.746364+0000","last_peered":"2022-08-10T17:55:32.746364+0000","last_clean":"2022-08-10T17:55:32.746364+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:32.746364+0000","last_undegraded":"2022-08-10T17:55:32.746364+0000","last_fullsized":"2022-08-10T17:55:32.746364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.746268+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:15.017040+0000","scrub_duration":0.0035363500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.956491+0000","last_change":"2022-08-10T17:55:53.956469+0000","last_active":"2022-08-10T17:55:53.956491+0000","last_peered":"2022-08-10T17:55:53.956491+0000","last_clean":"2022-08-10T17:55:53.956491+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:53.956491+0000","last_undegraded":"2022-08-10T17:55:53.956491+0000","last_fullsized":"2022-08-10T17:55:53.956491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.956366+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:02:03.066925+0000","scrub_duration":0.034545389000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.834163+0000","last_change":"2022-08-10T17:55:44.834143+0000","last_active":"2022-08-10T17:55:44.834163+0000","last_peered":"2022-08-10T17:55:44.834163+0000","last_clean":"2022-08-10T17:55:44.834163+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:44.834163+0000","last_undegraded":"2022-08-10T17:55:44.834163+0000","last_fullsized":"2022-08-10T17:55:44.834163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.834059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:17.359055+0000","scrub_duration":0.0034759230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.602705+0000","last_change":"2022-08-10T17:55:25.602683+0000","last_active":"2022-08-10T17:55:25.602705+0000","last_peered":"2022-08-10T17:55:25.602705+0000","last_clean":"2022-08-10T17:55:25.602705+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:25.602705+0000","last_undegraded":"2022-08-10T17:55:25.602705+0000","last_fullsized":"2022-08-10T17:55:25.602705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.602593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:49:36.908209+0000","scrub_duration":0.015965635999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:24.117641+0000","last_change":"2022-08-10T17:56:24.117608+0000","last_active":"2022-08-10T17:56:24.117641+0000","last_peered":"2022-08-10T17:56:24.117641+0000","last_clean":"2022-08-10T17:56:24.117641+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:56:24.117641+0000","last_undegraded":"2022-08-10T17:56:24.117641+0000","last_fullsized":"2022-08-10T17:56:24.117641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:56:24.117480+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:56:24.117480+0000","last_clean_scrub_stamp":"2022-08-10T17:56:24.117480+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:16:59.497528+0000","scrub_duration":0.003592703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:05.358959+0000","last_change":"2022-08-10T17:56:05.358912+0000","last_active":"2022-08-10T17:56:05.358959+0000","last_peered":"2022-08-10T17:56:05.358959+0000","last_clean":"2022-08-10T17:56:05.358959+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:56:05.358959+0000","last_undegraded":"2022-08-10T17:56:05.358959+0000","last_fullsized":"2022-08-10T17:56:05.358959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_clean_scrub_stamp":"2022-08-10T17:56:05.358729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:00:22.195910+0000","scrub_duration":0.051750043000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.964336+0000","last_change":"2022-08-10T17:55:49.964314+0000","last_active":"2022-08-10T17:55:49.964336+0000","last_peered":"2022-08-10T17:55:49.964336+0000","last_clean":"2022-08-10T17:55:49.964336+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:49.964336+0000","last_undegraded":"2022-08-10T17:55:49.964336+0000","last_fullsized":"2022-08-10T17:55:49.964336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.964237+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:13:15.202875+0000","scrub_duration":0.0034506480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.369947+0000","last_change":"2022-08-10T17:55:57.369922+0000","last_active":"2022-08-10T17:55:57.369947+0000","last_peered":"2022-08-10T17:55:57.369947+0000","last_clean":"2022-08-10T17:55:57.369947+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:57.369947+0000","last_undegraded":"2022-08-10T17:55:57.369947+0000","last_fullsized":"2022-08-10T17:55:57.369947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.369823+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:11:25.548675+0000","scrub_duration":0.023686576000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:07.270250+0000","last_change":"2022-08-10T17:56:07.270217+0000","last_active":"2022-08-10T17:56:07.270250+0000","last_peered":"2022-08-10T17:56:07.270250+0000","last_clean":"2022-08-10T17:56:07.270250+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:56:07.270250+0000","last_undegraded":"2022-08-10T17:56:07.270250+0000","last_fullsized":"2022-08-10T17:56:07.270250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_clean_scrub_stamp":"2022-08-10T17:56:07.270085+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:03:30.303765+0000","scrub_duration":0.003542674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:45.411773+0000","last_change":"2022-08-10T17:55:45.411749+0000","last_active":"2022-08-10T17:55:45.411773+0000","last_peered":"2022-08-10T17:55:45.411773+0000","last_clean":"2022-08-10T17:55:45.411773+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:45.411773+0000","last_undegraded":"2022-08-10T17:55:45.411773+0000","last_fullsized":"2022-08-10T17:55:45.411773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_clean_scrub_stamp":"2022-08-10T17:55:45.411650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:19:32.370100+0000","scrub_duration":0.046072038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.335430+0000","last_change":"2022-08-10T17:55:36.335408+0000","last_active":"2022-08-10T17:55:36.335430+0000","last_peered":"2022-08-10T17:55:36.335430+0000","last_clean":"2022-08-10T17:55:36.335430+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:36.335430+0000","last_undegraded":"2022-08-10T17:55:36.335430+0000","last_fullsized":"2022-08-10T17:55:36.335430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.335326+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:02:07.956826+0000","scrub_duration":0.0034800230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.147493+0000","last_change":"2022-08-10T17:55:38.147458+0000","last_active":"2022-08-10T17:55:38.147493+0000","last_peered":"2022-08-10T17:55:38.147493+0000","last_clean":"2022-08-10T17:55:38.147493+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:38.147493+0000","last_undegraded":"2022-08-10T17:55:38.147493+0000","last_fullsized":"2022-08-10T17:55:38.147493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.147290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:17:04.733650+0000","scrub_duration":0.021995639000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4472,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:36.184755+0000","last_change":"2022-08-10T17:56:36.184712+0000","last_active":"2022-08-10T17:56:36.184755+0000","last_peered":"2022-08-10T17:56:36.184755+0000","last_clean":"2022-08-10T17:56:36.184755+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:56:36.184755+0000","last_undegraded":"2022-08-10T17:56:36.184755+0000","last_fullsized":"2022-08-10T17:56:36.184755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4444","last_scrub_stamp":"2022-08-10T17:56:36.184607+0000","last_deep_scrub":"29'4444","last_deep_scrub_stamp":"2022-08-10T17:56:36.184607+0000","last_clean_scrub_stamp":"2022-08-10T17:56:36.184607+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:43.624823+0000","scrub_duration":0.080496158999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'12","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.916968+0000","last_change":"2022-08-10T17:56:04.916940+0000","last_active":"2022-08-10T17:56:04.916968+0000","last_peered":"2022-08-10T17:56:04.916968+0000","last_clean":"2022-08-10T17:56:04.916968+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:56:04.916968+0000","last_undegraded":"2022-08-10T17:56:04.916968+0000","last_fullsized":"2022-08-10T17:56:04.916968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.916856+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:31:33.074691+0000","scrub_duration":0.028362951000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.330599+0000","last_change":"2022-08-10T17:55:23.330567+0000","last_active":"2022-08-10T17:55:23.330599+0000","last_peered":"2022-08-10T17:55:23.330599+0000","last_clean":"2022-08-10T17:55:23.330599+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:23.330599+0000","last_undegraded":"2022-08-10T17:55:23.330599+0000","last_fullsized":"2022-08-10T17:55:23.330599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.330462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:10:32.984049+0000","scrub_duration":0.024365404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4722,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.922506+0000","last_change":"2022-08-10T17:55:50.922445+0000","last_active":"2022-08-10T17:55:50.922506+0000","last_peered":"2022-08-10T17:55:50.922506+0000","last_clean":"2022-08-10T17:55:50.922506+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:55:50.922506+0000","last_undegraded":"2022-08-10T17:55:50.922506+0000","last_fullsized":"2022-08-10T17:55:50.922506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4694","last_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_deep_scrub":"29'4694","last_deep_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.922264+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:24:16.270656+0000","scrub_duration":0.059697769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'14","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.422498+0000","last_change":"2022-08-10T17:55:33.422452+0000","last_active":"2022-08-10T17:55:33.422498+0000","last_peered":"2022-08-10T17:55:33.422498+0000","last_clean":"2022-08-10T17:55:33.422498+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:55:33.422498+0000","last_undegraded":"2022-08-10T17:55:33.422498+0000","last_fullsized":"2022-08-10T17:55:33.422498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.422315+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:27.773536+0000","scrub_duration":0.019140213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.009599+0000","last_change":"2022-08-10T17:55:27.009577+0000","last_active":"2022-08-10T17:55:27.009599+0000","last_peered":"2022-08-10T17:55:27.009599+0000","last_clean":"2022-08-10T17:55:27.009599+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:27.009599+0000","last_undegraded":"2022-08-10T17:55:27.009599+0000","last_fullsized":"2022-08-10T17:55:27.009599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.009500+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:15:21.317429+0000","scrub_duration":0.0035028260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4382,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.018283+0000","last_change":"2022-08-10T17:56:04.018232+0000","last_active":"2022-08-10T17:56:04.018283+0000","last_peered":"2022-08-10T17:56:04.018283+0000","last_clean":"2022-08-10T17:56:04.018283+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:56:04.018283+0000","last_undegraded":"2022-08-10T17:56:04.018283+0000","last_fullsized":"2022-08-10T17:56:04.018283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4354","last_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_deep_scrub":"29'4354","last_deep_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.018007+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:33:06.740237+0000","scrub_duration":0.053114884000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.272824+0000","last_change":"2022-08-10T17:55:34.272805+0000","last_active":"2022-08-10T17:55:34.272824+0000","last_peered":"2022-08-10T17:55:34.272824+0000","last_clean":"2022-08-10T17:55:34.272824+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:55:34.272824+0000","last_undegraded":"2022-08-10T17:55:34.272824+0000","last_fullsized":"2022-08-10T17:55:34.272824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.272714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:36.483574+0000","scrub_duration":0.0034525319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.957655+0000","last_change":"2022-08-10T17:55:29.957632+0000","last_active":"2022-08-10T17:55:29.957655+0000","last_peered":"2022-08-10T17:55:29.957655+0000","last_clean":"2022-08-10T17:55:29.957655+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:29.957655+0000","last_undegraded":"2022-08-10T17:55:29.957655+0000","last_fullsized":"2022-08-10T17:55:29.957655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.957536+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:43:07.254608+0000","scrub_duration":0.062576358999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3617,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.969865+0000","last_change":"2022-08-10T17:55:48.969826+0000","last_active":"2022-08-10T17:55:48.969865+0000","last_peered":"2022-08-10T17:55:48.969865+0000","last_clean":"2022-08-10T17:55:48.969865+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:55:48.969865+0000","last_undegraded":"2022-08-10T17:55:48.969865+0000","last_fullsized":"2022-08-10T17:55:48.969865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3589","last_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_deep_scrub":"29'3589","last_deep_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.969722+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:16.418208+0000","scrub_duration":0.065700320000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'64","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.093868+0000","last_change":"2022-08-10T17:55:35.093847+0000","last_active":"2022-08-10T17:55:35.093868+0000","last_peered":"2022-08-10T17:55:35.093868+0000","last_clean":"2022-08-10T17:55:35.093868+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:55:35.093868+0000","last_undegraded":"2022-08-10T17:55:35.093868+0000","last_fullsized":"2022-08-10T17:55:35.093868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.093760+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:13:33.865196+0000","scrub_duration":0.016913436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.402892+0000","last_change":"2022-08-10T17:56:14.402871+0000","last_active":"2022-08-10T17:56:14.402892+0000","last_peered":"2022-08-10T17:56:14.402892+0000","last_clean":"2022-08-10T17:56:14.402892+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:56:14.402892+0000","last_undegraded":"2022-08-10T17:56:14.402892+0000","last_fullsized":"2022-08-10T17:56:14.402892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.402390+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:25.065766+0000","scrub_duration":0.0035523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4186,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.393911+0000","last_change":"2022-08-10T17:56:14.393872+0000","last_active":"2022-08-10T17:56:14.393911+0000","last_peered":"2022-08-10T17:56:14.393911+0000","last_clean":"2022-08-10T17:56:14.393911+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:56:14.393911+0000","last_undegraded":"2022-08-10T17:56:14.393911+0000","last_fullsized":"2022-08-10T17:56:14.393911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4158","last_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_deep_scrub":"29'4158","last_deep_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.393769+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:25:17.353898+0000","scrub_duration":0.067364295000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.119148+0000","last_change":"2022-08-10T17:55:32.119128+0000","last_active":"2022-08-10T17:55:32.119148+0000","last_peered":"2022-08-10T17:55:32.119148+0000","last_clean":"2022-08-10T17:55:32.119148+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:55:32.119148+0000","last_undegraded":"2022-08-10T17:55:32.119148+0000","last_fullsized":"2022-08-10T17:55:32.119148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.119046+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:52:27.377502+0000","scrub_duration":0.015219678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.405585+0000","last_change":"2022-08-10T17:55:30.405562+0000","last_active":"2022-08-10T17:55:30.405585+0000","last_peered":"2022-08-10T17:55:30.405585+0000","last_clean":"2022-08-10T17:55:30.405585+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:30.405585+0000","last_undegraded":"2022-08-10T17:55:30.405585+0000","last_fullsized":"2022-08-10T17:55:30.405585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.405460+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:57:23.895561+0000","scrub_duration":0.024012329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5953,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.454025+0000","last_change":"2022-08-10T17:56:06.453970+0000","last_active":"2022-08-10T17:56:06.454025+0000","last_peered":"2022-08-10T17:56:06.454025+0000","last_clean":"2022-08-10T17:56:06.454025+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:56:06.454025+0000","last_undegraded":"2022-08-10T17:56:06.454025+0000","last_fullsized":"2022-08-10T17:56:06.454025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5925","last_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_deep_scrub":"29'5925","last_deep_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.453813+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:04:53.609822+0000","scrub_duration":0.069290974000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'24","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.079797+0000","last_change":"2022-08-10T17:55:27.079775+0000","last_active":"2022-08-10T17:55:27.079797+0000","last_peered":"2022-08-10T17:55:27.079797+0000","last_clean":"2022-08-10T17:55:27.079797+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:55:27.079797+0000","last_undegraded":"2022-08-10T17:55:27.079797+0000","last_fullsized":"2022-08-10T17:55:27.079797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.079689+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:16:30.544031+0000","scrub_duration":0.026671822000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.370196+0000","last_change":"2022-08-10T17:55:42.370175+0000","last_active":"2022-08-10T17:55:42.370196+0000","last_peered":"2022-08-10T17:55:42.370196+0000","last_clean":"2022-08-10T17:55:42.370196+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:42.370196+0000","last_undegraded":"2022-08-10T17:55:42.370196+0000","last_fullsized":"2022-08-10T17:55:42.370196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.370067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:10.161792+0000","scrub_duration":0.020699707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4213,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:51.434262+0000","last_change":"2022-08-10T17:55:51.434220+0000","last_active":"2022-08-10T17:55:51.434262+0000","last_peered":"2022-08-10T17:55:51.434262+0000","last_clean":"2022-08-10T17:55:51.434262+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:55:51.434262+0000","last_undegraded":"2022-08-10T17:55:51.434262+0000","last_fullsized":"2022-08-10T17:55:51.434262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4185","last_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_deep_scrub":"29'4185","last_deep_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:51.434118+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:56:18.697580+0000","scrub_duration":0.064411632999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'311","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.991208+0000","last_change":"2022-08-10T17:56:09.991174+0000","last_active":"2022-08-10T17:56:09.991208+0000","last_peered":"2022-08-10T17:56:09.991208+0000","last_clean":"2022-08-10T17:56:09.991208+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:56:09.991208+0000","last_undegraded":"2022-08-10T17:56:09.991208+0000","last_fullsized":"2022-08-10T17:56:09.991208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'311","last_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_deep_scrub":"29'311","last_deep_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.991082+0000","objects_scrubbed":5,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:28:46.755600+0000","scrub_duration":0.032474404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.015442+0000","last_change":"2022-08-10T17:56:14.015416+0000","last_active":"2022-08-10T17:56:14.015442+0000","last_peered":"2022-08-10T17:56:14.015442+0000","last_clean":"2022-08-10T17:56:14.015442+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:56:14.015442+0000","last_undegraded":"2022-08-10T17:56:14.015442+0000","last_fullsized":"2022-08-10T17:56:14.015442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.015311+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:03:48.477000+0000","scrub_duration":0.027149287000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5832,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.170504+0000","last_change":"2022-08-10T17:56:06.170447+0000","last_active":"2022-08-10T17:56:06.170504+0000","last_peered":"2022-08-10T17:56:06.170504+0000","last_clean":"2022-08-10T17:56:06.170504+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:56:06.170504+0000","last_undegraded":"2022-08-10T17:56:06.170504+0000","last_fullsized":"2022-08-10T17:56:06.170504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5804","last_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_deep_scrub":"29'5804","last_deep_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.170268+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:02:33.838572+0000","scrub_duration":0.064557167999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:52.153823+0000","last_change":"2022-08-10T17:55:52.153800+0000","last_active":"2022-08-10T17:55:52.153823+0000","last_peered":"2022-08-10T17:55:52.153823+0000","last_clean":"2022-08-10T17:55:52.153823+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:55:52.153823+0000","last_undegraded":"2022-08-10T17:55:52.153823+0000","last_fullsized":"2022-08-10T17:55:52.153823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_clean_scrub_stamp":"2022-08-10T17:55:52.153704+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:54:56.375867+0000","scrub_duration":0.019208741000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.358355+0000","last_change":"2022-08-10T17:55:25.358323+0000","last_active":"2022-08-10T17:55:25.358355+0000","last_peered":"2022-08-10T17:55:25.358355+0000","last_clean":"2022-08-10T17:55:25.358355+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:25.358355+0000","last_undegraded":"2022-08-10T17:55:25.358355+0000","last_fullsized":"2022-08-10T17:55:25.358355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.358222+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:32:47.761238+0000","scrub_duration":0.024137542000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4286,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:00.464274+0000","last_change":"2022-08-10T17:56:00.464222+0000","last_active":"2022-08-10T17:56:00.464274+0000","last_peered":"2022-08-10T17:56:00.464274+0000","last_clean":"2022-08-10T17:56:00.464274+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:56:00.464274+0000","last_undegraded":"2022-08-10T17:56:00.464274+0000","last_fullsized":"2022-08-10T17:56:00.464274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4258","last_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_deep_scrub":"29'4258","last_deep_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_clean_scrub_stamp":"2022-08-10T17:56:00.464107+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:55:24.422676+0000","scrub_duration":0.051924405999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.061351+0000","last_change":"2022-08-10T17:55:38.061316+0000","last_active":"2022-08-10T17:55:38.061351+0000","last_peered":"2022-08-10T17:55:38.061351+0000","last_clean":"2022-08-10T17:55:38.061351+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:55:38.061351+0000","last_undegraded":"2022-08-10T17:55:38.061351+0000","last_fullsized":"2022-08-10T17:55:38.061351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.061144+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:50.451261+0000","scrub_duration":0.016751453999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.108842+0000","last_change":"2022-08-10T17:55:26.108788+0000","last_active":"2022-08-10T17:55:26.108842+0000","last_peered":"2022-08-10T17:55:26.108842+0000","last_clean":"2022-08-10T17:55:26.108842+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:26.108842+0000","last_undegraded":"2022-08-10T17:55:26.108842+0000","last_fullsized":"2022-08-10T17:55:26.108842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.108605+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:10:35.922613+0000","scrub_duration":0.021195411000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4395,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:58.442683+0000","last_change":"2022-08-10T17:55:58.442647+0000","last_active":"2022-08-10T17:55:58.442683+0000","last_peered":"2022-08-10T17:55:58.442683+0000","last_clean":"2022-08-10T17:55:58.442683+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:55:58.442683+0000","last_undegraded":"2022-08-10T17:55:58.442683+0000","last_fullsized":"2022-08-10T17:55:58.442683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4367","last_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_deep_scrub":"29'4367","last_deep_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_clean_scrub_stamp":"2022-08-10T17:55:58.442543+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:41:05.524327+0000","scrub_duration":0.060906218999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'304","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.097085+0000","last_change":"2022-08-10T17:55:49.097051+0000","last_active":"2022-08-10T17:55:49.097085+0000","last_peered":"2022-08-10T17:55:49.097085+0000","last_clean":"2022-08-10T17:55:49.097085+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:55:49.097085+0000","last_undegraded":"2022-08-10T17:55:49.097085+0000","last_fullsized":"2022-08-10T17:55:49.097085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'304","last_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_deep_scrub":"29'304","last_deep_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.096942+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:12:27.209788+0000","scrub_duration":0.031557822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.045594+0000","last_change":"2022-08-10T17:56:13.045573+0000","last_active":"2022-08-10T17:56:13.045594+0000","last_peered":"2022-08-10T17:56:13.045594+0000","last_clean":"2022-08-10T17:56:13.045594+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:56:13.045594+0000","last_undegraded":"2022-08-10T17:56:13.045594+0000","last_fullsized":"2022-08-10T17:56:13.045594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.045497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:43:07.934183+0000","scrub_duration":0.0034909870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4934,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.103904+0000","last_change":"2022-08-10T17:55:57.103864+0000","last_active":"2022-08-10T17:55:57.103904+0000","last_peered":"2022-08-10T17:55:57.103904+0000","last_clean":"2022-08-10T17:55:57.103904+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:55:57.103904+0000","last_undegraded":"2022-08-10T17:55:57.103904+0000","last_fullsized":"2022-08-10T17:55:57.103904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4906","last_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_deep_scrub":"29'4906","last_deep_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.103765+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:30:44.540506+0000","scrub_duration":0.064568445000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.924288+0000","last_change":"2022-08-10T17:55:24.924251+0000","last_active":"2022-08-10T17:55:24.924288+0000","last_peered":"2022-08-10T17:55:24.924288+0000","last_clean":"2022-08-10T17:55:24.924288+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:55:24.924288+0000","last_undegraded":"2022-08-10T17:55:24.924288+0000","last_fullsized":"2022-08-10T17:55:24.924288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.924118+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:55:21.923386+0000","scrub_duration":0.021377028999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.408869+0000","last_change":"2022-08-10T17:55:27.408845+0000","last_active":"2022-08-10T17:55:27.408869+0000","last_peered":"2022-08-10T17:55:27.408869+0000","last_clean":"2022-08-10T17:55:27.408869+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:27.408869+0000","last_undegraded":"2022-08-10T17:55:27.408869+0000","last_fullsized":"2022-08-10T17:55:27.408869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.408747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:14:38.533949+0000","scrub_duration":0.040517141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:21.401868+0000","last_change":"2022-08-10T17:56:21.401826+0000","last_active":"2022-08-10T17:56:21.401868+0000","last_peered":"2022-08-10T17:56:21.401868+0000","last_clean":"2022-08-10T17:56:21.401868+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:56:21.401868+0000","last_undegraded":"2022-08-10T17:56:21.401868+0000","last_fullsized":"2022-08-10T17:56:21.401868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5293","last_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_deep_scrub":"29'5293","last_deep_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_clean_scrub_stamp":"2022-08-10T17:56:21.401724+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:57:42.790520+0000","scrub_duration":0.061559711000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.225847+0000","last_change":"2022-08-10T17:55:56.225825+0000","last_active":"2022-08-10T17:55:56.225847+0000","last_peered":"2022-08-10T17:55:56.225847+0000","last_clean":"2022-08-10T17:55:56.225847+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:55:56.225847+0000","last_undegraded":"2022-08-10T17:55:56.225847+0000","last_fullsized":"2022-08-10T17:55:56.225847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.225734+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:48.013865+0000","scrub_duration":0.032000617000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.160168+0000","last_change":"2022-08-10T17:55:37.160149+0000","last_active":"2022-08-10T17:55:37.160168+0000","last_peered":"2022-08-10T17:55:37.160168+0000","last_clean":"2022-08-10T17:55:37.160168+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:37.160168+0000","last_undegraded":"2022-08-10T17:55:37.160168+0000","last_fullsized":"2022-08-10T17:55:37.160168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.160075+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:27:20.436089+0000","scrub_duration":0.0034772340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.648371+0000","last_change":"2022-08-10T17:55:30.648315+0000","last_active":"2022-08-10T17:55:30.648371+0000","last_peered":"2022-08-10T17:55:30.648371+0000","last_clean":"2022-08-10T17:55:30.648371+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:55:30.648371+0000","last_undegraded":"2022-08-10T17:55:30.648371+0000","last_fullsized":"2022-08-10T17:55:30.648371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4353","last_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_deep_scrub":"29'4353","last_deep_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.648133+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:10.184933+0000","scrub_duration":0.067302737000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.138559+0000","last_change":"2022-08-10T17:55:43.138538+0000","last_active":"2022-08-10T17:55:43.138559+0000","last_peered":"2022-08-10T17:55:43.138559+0000","last_clean":"2022-08-10T17:55:43.138559+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:55:43.138559+0000","last_undegraded":"2022-08-10T17:55:43.138559+0000","last_fullsized":"2022-08-10T17:55:43.138559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.138462+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:40.531685+0000","scrub_duration":0.013263829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:20.069863+0000","last_change":"2022-08-10T17:56:20.069841+0000","last_active":"2022-08-10T17:56:20.069863+0000","last_peered":"2022-08-10T17:56:20.069863+0000","last_clean":"2022-08-10T17:56:20.069863+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:56:20.069863+0000","last_undegraded":"2022-08-10T17:56:20.069863+0000","last_fullsized":"2022-08-10T17:56:20.069863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:56:20.069759+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:56:20.069759+0000","last_clean_scrub_stamp":"2022-08-10T17:56:20.069759+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:15:39.795192+0000","scrub_duration":0.003559544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4709,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.577615+0000","last_change":"2022-08-10T17:55:33.577580+0000","last_active":"2022-08-10T17:55:33.577615+0000","last_peered":"2022-08-10T17:55:33.577615+0000","last_clean":"2022-08-10T17:55:33.577615+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:55:33.577615+0000","last_undegraded":"2022-08-10T17:55:33.577615+0000","last_fullsized":"2022-08-10T17:55:33.577615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4681","last_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_deep_scrub":"29'4681","last_deep_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.577468+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:50:41.930237+0000","scrub_duration":0.053293471000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:40.114580+0000","last_change":"2022-08-10T17:55:40.114552+0000","last_active":"2022-08-10T17:55:40.114580+0000","last_peered":"2022-08-10T17:55:40.114580+0000","last_clean":"2022-08-10T17:55:40.114580+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:55:40.114580+0000","last_undegraded":"2022-08-10T17:55:40.114580+0000","last_fullsized":"2022-08-10T17:55:40.114580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:40.114468+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:53:37.748882+0000","scrub_duration":0.013616628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.818264+0000","last_change":"2022-08-10T17:55:39.818234+0000","last_active":"2022-08-10T17:55:39.818264+0000","last_peered":"2022-08-10T17:55:39.818264+0000","last_clean":"2022-08-10T17:55:39.818264+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:39.818264+0000","last_undegraded":"2022-08-10T17:55:39.818264+0000","last_fullsized":"2022-08-10T17:55:39.818264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.818135+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:31:58.229281+0000","scrub_duration":0.027795573000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3833,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.499543+0000","last_change":"2022-08-10T17:55:38.499484+0000","last_active":"2022-08-10T17:55:38.499543+0000","last_peered":"2022-08-10T17:55:38.499543+0000","last_clean":"2022-08-10T17:55:38.499543+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:55:38.499543+0000","last_undegraded":"2022-08-10T17:55:38.499543+0000","last_fullsized":"2022-08-10T17:55:38.499543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3805","last_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_deep_scrub":"29'3805","last_deep_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.499317+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:59:44.072729+0000","scrub_duration":0.056492191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.078050+0000","last_change":"2022-08-10T17:55:30.078020+0000","last_active":"2022-08-10T17:55:30.078050+0000","last_peered":"2022-08-10T17:55:30.078050+0000","last_clean":"2022-08-10T17:55:30.078050+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:55:30.078050+0000","last_undegraded":"2022-08-10T17:55:30.078050+0000","last_fullsized":"2022-08-10T17:55:30.078050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.077894+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:33.679903+0000","scrub_duration":0.022499880999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.975371+0000","last_change":"2022-08-10T17:56:02.975349+0000","last_active":"2022-08-10T17:56:02.975371+0000","last_peered":"2022-08-10T17:56:02.975371+0000","last_clean":"2022-08-10T17:56:02.975371+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:56:02.975371+0000","last_undegraded":"2022-08-10T17:56:02.975371+0000","last_fullsized":"2022-08-10T17:56:02.975371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.975245+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:34.658380+0000","scrub_duration":0.0086057479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.617813+0000","last_change":"2022-08-10T17:55:32.617770+0000","last_active":"2022-08-10T17:55:32.617813+0000","last_peered":"2022-08-10T17:55:32.617813+0000","last_clean":"2022-08-10T17:55:32.617813+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:55:32.617813+0000","last_undegraded":"2022-08-10T17:55:32.617813+0000","last_fullsized":"2022-08-10T17:55:32.617813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3279","last_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_deep_scrub":"29'3279","last_deep_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.617666+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:55:16.394063+0000","scrub_duration":0.060262404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'335","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.385035+0000","last_change":"2022-08-10T17:55:39.385014+0000","last_active":"2022-08-10T17:55:39.385035+0000","last_peered":"2022-08-10T17:55:39.385035+0000","last_clean":"2022-08-10T17:55:39.385035+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:39.385035+0000","last_undegraded":"2022-08-10T17:55:39.385035+0000","last_fullsized":"2022-08-10T17:55:39.385035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'335","last_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_deep_scrub":"29'335","last_deep_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.384919+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:34:51.492681+0000","scrub_duration":0.038040591999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.819713+0000","last_change":"2022-08-10T17:55:48.819683+0000","last_active":"2022-08-10T17:55:48.819713+0000","last_peered":"2022-08-10T17:55:48.819713+0000","last_clean":"2022-08-10T17:55:48.819713+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:48.819713+0000","last_undegraded":"2022-08-10T17:55:48.819713+0000","last_fullsized":"2022-08-10T17:55:48.819713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.819544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:07:54.609189+0000","scrub_duration":0.014561592999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5075,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.420110+0000","last_change":"2022-08-10T17:55:54.420077+0000","last_active":"2022-08-10T17:55:54.420110+0000","last_peered":"2022-08-10T17:55:54.420110+0000","last_clean":"2022-08-10T17:55:54.420110+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:55:54.420110+0000","last_undegraded":"2022-08-10T17:55:54.420110+0000","last_fullsized":"2022-08-10T17:55:54.420110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5047","last_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_deep_scrub":"29'5047","last_deep_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.419972+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:37:40.479531+0000","scrub_duration":0.067399972000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'56","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.906120+0000","last_change":"2022-08-10T17:55:26.906097+0000","last_active":"2022-08-10T17:55:26.906120+0000","last_peered":"2022-08-10T17:55:26.906120+0000","last_clean":"2022-08-10T17:55:26.906120+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:55:26.906120+0000","last_undegraded":"2022-08-10T17:55:26.906120+0000","last_fullsized":"2022-08-10T17:55:26.906120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.906012+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:01.182562+0000","scrub_duration":0.014215698000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.925293+0000","last_change":"2022-08-10T17:55:55.925273+0000","last_active":"2022-08-10T17:55:55.925293+0000","last_peered":"2022-08-10T17:55:55.925293+0000","last_clean":"2022-08-10T17:55:55.925293+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:55.925293+0000","last_undegraded":"2022-08-10T17:55:55.925293+0000","last_fullsized":"2022-08-10T17:55:55.925293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.925196+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:07.952289+0000","scrub_duration":0.0034809820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6368,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.166064+0000","last_change":"2022-08-10T17:56:02.166028+0000","last_active":"2022-08-10T17:56:02.166064+0000","last_peered":"2022-08-10T17:56:02.166064+0000","last_clean":"2022-08-10T17:56:02.166064+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:56:02.166064+0000","last_undegraded":"2022-08-10T17:56:02.166064+0000","last_fullsized":"2022-08-10T17:56:02.166064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6340","last_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_deep_scrub":"29'6340","last_deep_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.165927+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:20:27.862013+0000","scrub_duration":0.078968956000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:11.948296+0000","last_change":"2022-08-10T17:56:11.948274+0000","last_active":"2022-08-10T17:56:11.948296+0000","last_peered":"2022-08-10T17:56:11.948296+0000","last_clean":"2022-08-10T17:56:11.948296+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:56:11.948296+0000","last_undegraded":"2022-08-10T17:56:11.948296+0000","last_fullsized":"2022-08-10T17:56:11.948296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_clean_scrub_stamp":"2022-08-10T17:56:11.948176+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:26:18.020901+0000","scrub_duration":0.01701418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:03.912780+0000","last_change":"2022-08-10T17:56:03.912759+0000","last_active":"2022-08-10T17:56:03.912780+0000","last_peered":"2022-08-10T17:56:03.912780+0000","last_clean":"2022-08-10T17:56:03.912780+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:56:03.912780+0000","last_undegraded":"2022-08-10T17:56:03.912780+0000","last_fullsized":"2022-08-10T17:56:03.912780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_clean_scrub_stamp":"2022-08-10T17:56:03.912661+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:17.642586+0000","scrub_duration":0.015979535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6060,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:38.234643+0000","last_change":"2022-08-10T17:56:38.234598+0000","last_active":"2022-08-10T17:56:38.234643+0000","last_peered":"2022-08-10T17:56:38.234643+0000","last_clean":"2022-08-10T17:56:38.234643+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:56:38.234643+0000","last_undegraded":"2022-08-10T17:56:38.234643+0000","last_fullsized":"2022-08-10T17:56:38.234643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6029","last_scrub_stamp":"2022-08-10T17:56:38.234498+0000","last_deep_scrub":"29'6029","last_deep_scrub_stamp":"2022-08-10T17:56:38.234498+0000","last_clean_scrub_stamp":"2022-08-10T17:56:38.234498+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:41:31.403283+0000","scrub_duration":0.064381774000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.378188+0000","last_change":"2022-08-10T17:55:32.378165+0000","last_active":"2022-08-10T17:55:32.378188+0000","last_peered":"2022-08-10T17:55:32.378188+0000","last_clean":"2022-08-10T17:55:32.378188+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:55:32.378188+0000","last_undegraded":"2022-08-10T17:55:32.378188+0000","last_fullsized":"2022-08-10T17:55:32.378188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.378072+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:37:51.551862+0000","scrub_duration":0.025084980999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.387732+0000","last_change":"2022-08-10T17:55:44.387701+0000","last_active":"2022-08-10T17:55:44.387732+0000","last_peered":"2022-08-10T17:55:44.387732+0000","last_clean":"2022-08-10T17:55:44.387732+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:44.387732+0000","last_undegraded":"2022-08-10T17:55:44.387732+0000","last_fullsized":"2022-08-10T17:55:44.387732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.387600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:07:54.771605+0000","scrub_duration":0.016116917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4559,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.026441+0000","last_change":"2022-08-10T17:56:06.026377+0000","last_active":"2022-08-10T17:56:06.026441+0000","last_peered":"2022-08-10T17:56:06.026441+0000","last_clean":"2022-08-10T17:56:06.026441+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:56:06.026441+0000","last_undegraded":"2022-08-10T17:56:06.026441+0000","last_fullsized":"2022-08-10T17:56:06.026441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4531","last_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_deep_scrub":"29'4531","last_deep_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.026208+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:36.860795+0000","scrub_duration":0.086058169000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.144294+0000","last_change":"2022-08-10T17:55:36.144271+0000","last_active":"2022-08-10T17:55:36.144294+0000","last_peered":"2022-08-10T17:55:36.144294+0000","last_clean":"2022-08-10T17:55:36.144294+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:55:36.144294+0000","last_undegraded":"2022-08-10T17:55:36.144294+0000","last_fullsized":"2022-08-10T17:55:36.144294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.144187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:21:38.195327+0000","scrub_duration":0.028929255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.367621+0000","last_change":"2022-08-10T17:55:38.367599+0000","last_active":"2022-08-10T17:55:38.367621+0000","last_peered":"2022-08-10T17:55:38.367621+0000","last_clean":"2022-08-10T17:55:38.367621+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:38.367621+0000","last_undegraded":"2022-08-10T17:55:38.367621+0000","last_fullsized":"2022-08-10T17:55:38.367621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.367524+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:16:32.842509+0000","scrub_duration":0.0035067779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4374,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.053873+0000","last_change":"2022-08-10T17:56:09.053830+0000","last_active":"2022-08-10T17:56:09.053873+0000","last_peered":"2022-08-10T17:56:09.053873+0000","last_clean":"2022-08-10T17:56:09.053873+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:56:09.053873+0000","last_undegraded":"2022-08-10T17:56:09.053873+0000","last_fullsized":"2022-08-10T17:56:09.053873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4346","last_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_deep_scrub":"29'4346","last_deep_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.053722+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:03.775600+0000","scrub_duration":0.061434124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.070691+0000","last_change":"2022-08-10T17:55:29.070663+0000","last_active":"2022-08-10T17:55:29.070691+0000","last_peered":"2022-08-10T17:55:29.070691+0000","last_clean":"2022-08-10T17:55:29.070691+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:55:29.070691+0000","last_undegraded":"2022-08-10T17:55:29.070691+0000","last_fullsized":"2022-08-10T17:55:29.070691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.070546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:28:30.391516+0000","scrub_duration":0.0035289599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.986802+0000","last_change":"2022-08-10T17:56:10.986777+0000","last_active":"2022-08-10T17:56:10.986802+0000","last_peered":"2022-08-10T17:56:10.986802+0000","last_clean":"2022-08-10T17:56:10.986802+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:56:10.986802+0000","last_undegraded":"2022-08-10T17:56:10.986802+0000","last_fullsized":"2022-08-10T17:56:10.986802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.986680+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:28.661781+0000","scrub_duration":0.019300363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.348594+0000","last_change":"2022-08-10T17:55:37.348571+0000","last_active":"2022-08-10T17:55:37.348594+0000","last_peered":"2022-08-10T17:55:37.348594+0000","last_clean":"2022-08-10T17:55:37.348594+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:37.348594+0000","last_undegraded":"2022-08-10T17:55:37.348594+0000","last_fullsized":"2022-08-10T17:55:37.348594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.348475+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:32:44.196786+0000","scrub_duration":0.0035728499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.563629+0000","last_change":"2022-08-10T17:55:36.563579+0000","last_active":"2022-08-10T17:55:36.563629+0000","last_peered":"2022-08-10T17:55:36.563629+0000","last_clean":"2022-08-10T17:55:36.563629+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:55:36.563629+0000","last_undegraded":"2022-08-10T17:55:36.563629+0000","last_fullsized":"2022-08-10T17:55:36.563629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4646","last_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_deep_scrub":"29'4646","last_deep_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.563473+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:09:00.188963+0000","scrub_duration":0.061717941999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.626811+0000","last_change":"2022-08-10T17:55:22.626781+0000","last_active":"2022-08-10T17:55:22.626811+0000","last_peered":"2022-08-10T17:55:22.626811+0000","last_clean":"2022-08-10T17:55:22.626811+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:55:22.626811+0000","last_undegraded":"2022-08-10T17:55:22.626811+0000","last_fullsized":"2022-08-10T17:55:22.626811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.626653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:34.446413+0000","scrub_duration":0.0035853080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.396141+0000","last_change":"2022-08-10T17:55:26.396110+0000","last_active":"2022-08-10T17:55:26.396141+0000","last_peered":"2022-08-10T17:55:26.396141+0000","last_clean":"2022-08-10T17:55:26.396141+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:55:26.396141+0000","last_undegraded":"2022-08-10T17:55:26.396141+0000","last_fullsized":"2022-08-10T17:55:26.396141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.396028+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:22:41.188174+0000","scrub_duration":0.016673178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.382444+0000","last_change":"2022-08-10T17:55:43.382417+0000","last_active":"2022-08-10T17:55:43.382444+0000","last_peered":"2022-08-10T17:55:43.382444+0000","last_clean":"2022-08-10T17:55:43.382444+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:43.382444+0000","last_undegraded":"2022-08-10T17:55:43.382444+0000","last_fullsized":"2022-08-10T17:55:43.382444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.382310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:35:24.953748+0000","scrub_duration":0.042344012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4801,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:23.411315+0000","last_change":"2022-08-10T17:56:23.411283+0000","last_active":"2022-08-10T17:56:23.411315+0000","last_peered":"2022-08-10T17:56:23.411315+0000","last_clean":"2022-08-10T17:56:23.411315+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:56:23.411315+0000","last_undegraded":"2022-08-10T17:56:23.411315+0000","last_fullsized":"2022-08-10T17:56:23.411315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4773","last_scrub_stamp":"2022-08-10T17:56:23.411180+0000","last_deep_scrub":"29'4773","last_deep_scrub_stamp":"2022-08-10T17:56:23.411180+0000","last_clean_scrub_stamp":"2022-08-10T17:56:23.411180+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:14.631283+0000","scrub_duration":0.066595267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.086112+0000","last_change":"2022-08-10T17:55:27.086083+0000","last_active":"2022-08-10T17:55:27.086112+0000","last_peered":"2022-08-10T17:55:27.086112+0000","last_clean":"2022-08-10T17:55:27.086112+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:55:27.086112+0000","last_undegraded":"2022-08-10T17:55:27.086112+0000","last_fullsized":"2022-08-10T17:55:27.086112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.085971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:11:51.139836+0000","scrub_duration":0.003529314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.998931+0000","last_change":"2022-08-10T17:55:28.998908+0000","last_active":"2022-08-10T17:55:28.998931+0000","last_peered":"2022-08-10T17:55:28.998931+0000","last_clean":"2022-08-10T17:55:28.998931+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:55:28.998931+0000","last_undegraded":"2022-08-10T17:55:28.998931+0000","last_fullsized":"2022-08-10T17:55:28.998931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.998804+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:40:46.133786+0000","scrub_duration":0.020972382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.369120+0000","last_change":"2022-08-10T17:55:31.369098+0000","last_active":"2022-08-10T17:55:31.369120+0000","last_peered":"2022-08-10T17:55:31.369120+0000","last_clean":"2022-08-10T17:55:31.369120+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:55:31.369120+0000","last_undegraded":"2022-08-10T17:55:31.369120+0000","last_fullsized":"2022-08-10T17:55:31.369120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.369017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:19.456252+0000","scrub_duration":0.0034799219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.902416+0000","last_change":"2022-08-10T17:55:31.902390+0000","last_active":"2022-08-10T17:55:31.902416+0000","last_peered":"2022-08-10T17:55:31.902416+0000","last_clean":"2022-08-10T17:55:31.902416+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:31.902416+0000","last_undegraded":"2022-08-10T17:55:31.902416+0000","last_fullsized":"2022-08-10T17:55:31.902416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.902294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:04.476448+0000","scrub_duration":0.027996058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3434,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:08.203081+0000","last_change":"2022-08-10T17:56:08.203034+0000","last_active":"2022-08-10T17:56:08.203081+0000","last_peered":"2022-08-10T17:56:08.203081+0000","last_clean":"2022-08-10T17:56:08.203081+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:56:08.203081+0000","last_undegraded":"2022-08-10T17:56:08.203081+0000","last_fullsized":"2022-08-10T17:56:08.203081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3406","last_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_deep_scrub":"29'3406","last_deep_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_clean_scrub_stamp":"2022-08-10T17:56:08.202932+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:41:13.192438+0000","scrub_duration":0.091572171999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.966787+0000","last_change":"2022-08-10T17:55:29.966768+0000","last_active":"2022-08-10T17:55:29.966787+0000","last_peered":"2022-08-10T17:55:29.966787+0000","last_clean":"2022-08-10T17:55:29.966787+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:55:29.966787+0000","last_undegraded":"2022-08-10T17:55:29.966787+0000","last_fullsized":"2022-08-10T17:55:29.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.966669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:30:37.613565+0000","scrub_duration":0.0037818109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'84","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.063945+0000","last_change":"2022-08-10T17:55:34.063912+0000","last_active":"2022-08-10T17:55:34.063945+0000","last_peered":"2022-08-10T17:55:34.063945+0000","last_clean":"2022-08-10T17:55:34.063945+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:55:34.063945+0000","last_undegraded":"2022-08-10T17:55:34.063945+0000","last_fullsized":"2022-08-10T17:55:34.063945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'84","last_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_deep_scrub":"29'84","last_deep_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.063817+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:21:24.542508+0000","scrub_duration":0.019597560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.989697+0000","last_change":"2022-08-10T17:55:50.989676+0000","last_active":"2022-08-10T17:55:50.989697+0000","last_peered":"2022-08-10T17:55:50.989697+0000","last_clean":"2022-08-10T17:55:50.989697+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:50.989697+0000","last_undegraded":"2022-08-10T17:55:50.989697+0000","last_fullsized":"2022-08-10T17:55:50.989697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.989601+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:29:39.434990+0000","scrub_duration":0.0035003970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5890,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.906460+0000","last_change":"2022-08-10T17:55:43.906421+0000","last_active":"2022-08-10T17:55:43.906460+0000","last_peered":"2022-08-10T17:55:43.906460+0000","last_clean":"2022-08-10T17:55:43.906460+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:55:43.906460+0000","last_undegraded":"2022-08-10T17:55:43.906460+0000","last_fullsized":"2022-08-10T17:55:43.906460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5862","last_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_deep_scrub":"29'5862","last_deep_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.906317+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:26:06.441129+0000","scrub_duration":0.075268903999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.069569+0000","last_change":"2022-08-10T17:55:37.069551+0000","last_active":"2022-08-10T17:55:37.069569+0000","last_peered":"2022-08-10T17:55:37.069569+0000","last_clean":"2022-08-10T17:55:37.069569+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:55:37.069569+0000","last_undegraded":"2022-08-10T17:55:37.069569+0000","last_fullsized":"2022-08-10T17:55:37.069569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.069477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:41.886326+0000","scrub_duration":0.0035232359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.399676+0000","last_change":"2022-08-10T17:55:34.399655+0000","last_active":"2022-08-10T17:55:34.399676+0000","last_peered":"2022-08-10T17:55:34.399676+0000","last_clean":"2022-08-10T17:55:34.399676+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:55:34.399676+0000","last_undegraded":"2022-08-10T17:55:34.399676+0000","last_fullsized":"2022-08-10T17:55:34.399676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.399577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:44:22.781395+0000","scrub_duration":0.0034960490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.071382+0000","last_change":"2022-08-10T17:55:33.071345+0000","last_active":"2022-08-10T17:55:33.071382+0000","last_peered":"2022-08-10T17:55:33.071382+0000","last_clean":"2022-08-10T17:55:33.071382+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:33.071382+0000","last_undegraded":"2022-08-10T17:55:33.071382+0000","last_fullsized":"2022-08-10T17:55:33.071382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.071183+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:40:33.068733+0000","scrub_duration":0.0095831489999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2960,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:54:42.922891+0000","last_change":"2022-08-10T17:35:41.442370+0000","last_active":"2022-08-10T17:54:42.922891+0000","last_peered":"2022-08-10T17:54:42.922891+0000","last_clean":"2022-08-10T17:54:42.922891+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:54:42.922891+0000","last_undegraded":"2022-08-10T17:54:42.922891+0000","last_fullsized":"2022-08-10T17:54:42.922891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:35:40.401298+0000","last_clean_scrub_stamp":"2022-08-10T17:35:40.401298+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.316191+0000","last_change":"2022-08-10T17:55:37.316154+0000","last_active":"2022-08-10T17:55:37.316191+0000","last_peered":"2022-08-10T17:55:37.316191+0000","last_clean":"2022-08-10T17:55:37.316191+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:55:37.316191+0000","last_undegraded":"2022-08-10T17:55:37.316191+0000","last_fullsized":"2022-08-10T17:55:37.316191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.316067+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:40:23.614188+0000","scrub_duration":0.016809653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.301522+0000","last_change":"2022-08-10T17:55:24.301501+0000","last_active":"2022-08-10T17:55:24.301522+0000","last_peered":"2022-08-10T17:55:24.301522+0000","last_clean":"2022-08-10T17:55:24.301522+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:55:24.301522+0000","last_undegraded":"2022-08-10T17:55:24.301522+0000","last_fullsized":"2022-08-10T17:55:24.301522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.301417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:33:53.898237+0000","scrub_duration":0.0034981370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.337456+0000","last_change":"2022-08-10T17:55:41.337433+0000","last_active":"2022-08-10T17:55:41.337456+0000","last_peered":"2022-08-10T17:55:41.337456+0000","last_clean":"2022-08-10T17:55:41.337456+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:41.337456+0000","last_undegraded":"2022-08-10T17:55:41.337456+0000","last_fullsized":"2022-08-10T17:55:41.337456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.337357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:41:32.970167+0000","scrub_duration":0.0035830240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4344,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.513696+0000","last_change":"2022-08-10T17:56:10.513657+0000","last_active":"2022-08-10T17:56:10.513696+0000","last_peered":"2022-08-10T17:56:10.513696+0000","last_clean":"2022-08-10T17:56:10.513696+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:56:10.513696+0000","last_undegraded":"2022-08-10T17:56:10.513696+0000","last_fullsized":"2022-08-10T17:56:10.513696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4316","last_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_deep_scrub":"29'4316","last_deep_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.513552+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:09.761651+0000","scrub_duration":0.084202658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.899289+0000","last_change":"2022-08-10T17:55:23.899252+0000","last_active":"2022-08-10T17:55:23.899289+0000","last_peered":"2022-08-10T17:55:23.899289+0000","last_clean":"2022-08-10T17:55:23.899289+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:55:23.899289+0000","last_undegraded":"2022-08-10T17:55:23.899289+0000","last_fullsized":"2022-08-10T17:55:23.899289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.899118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:10:44.169251+0000","scrub_duration":0.0035038819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'73","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.041014+0000","last_change":"2022-08-10T17:55:41.040993+0000","last_active":"2022-08-10T17:55:41.041014+0000","last_peered":"2022-08-10T17:55:41.041014+0000","last_clean":"2022-08-10T17:55:41.041014+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:55:41.041014+0000","last_undegraded":"2022-08-10T17:55:41.041014+0000","last_fullsized":"2022-08-10T17:55:41.041014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.040907+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:49:13.722929+0000","scrub_duration":0.024350785999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:19.065493+0000","last_change":"2022-08-10T17:56:19.065474+0000","last_active":"2022-08-10T17:56:19.065493+0000","last_peered":"2022-08-10T17:56:19.065493+0000","last_clean":"2022-08-10T17:56:19.065493+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:56:19.065493+0000","last_undegraded":"2022-08-10T17:56:19.065493+0000","last_fullsized":"2022-08-10T17:56:19.065493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_clean_scrub_stamp":"2022-08-10T17:56:19.065397+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:48:02.437895+0000","scrub_duration":0.0035302699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4838,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.416166+0000","last_change":"2022-08-10T17:55:53.416111+0000","last_active":"2022-08-10T17:55:53.416166+0000","last_peered":"2022-08-10T17:55:53.416166+0000","last_clean":"2022-08-10T17:55:53.416166+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:55:53.416166+0000","last_undegraded":"2022-08-10T17:55:53.416166+0000","last_fullsized":"2022-08-10T17:55:53.416166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4810","last_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_deep_scrub":"29'4810","last_deep_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.416011+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:10.405949+0000","scrub_duration":0.05286983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1834","reported_seq":1864,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:47.965716+0000","last_change":"2022-08-10T17:55:47.965696+0000","last_active":"2022-08-10T17:55:47.965716+0000","last_peered":"2022-08-10T17:55:47.965716+0000","last_clean":"2022-08-10T17:55:47.965716+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:47.965716+0000","last_undegraded":"2022-08-10T17:55:47.965716+0000","last_fullsized":"2022-08-10T17:55:47.965716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1834","last_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_deep_scrub":"29'1834","last_deep_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_clean_scrub_stamp":"2022-08-10T17:55:47.965611+0000","objects_scrubbed":3,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:45.463809+0000","scrub_duration":0.038525047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.601728+0000","last_change":"2022-08-10T17:55:24.601691+0000","last_active":"2022-08-10T17:55:24.601728+0000","last_peered":"2022-08-10T17:55:24.601728+0000","last_clean":"2022-08-10T17:55:24.601728+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:24.601728+0000","last_undegraded":"2022-08-10T17:55:24.601728+0000","last_fullsized":"2022-08-10T17:55:24.601728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.601546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:48:03.331213+0000","scrub_duration":0.0034631699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4557,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:16.361916+0000","last_change":"2022-08-10T17:56:16.361878+0000","last_active":"2022-08-10T17:56:16.361916+0000","last_peered":"2022-08-10T17:56:16.361916+0000","last_clean":"2022-08-10T17:56:16.361916+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:56:16.361916+0000","last_undegraded":"2022-08-10T17:56:16.361916+0000","last_fullsized":"2022-08-10T17:56:16.361916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4529","last_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_deep_scrub":"29'4529","last_deep_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:16.361775+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:02:50.074670+0000","scrub_duration":0.063326929000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.131177+0000","last_change":"2022-08-10T17:55:35.131146+0000","last_active":"2022-08-10T17:55:35.131177+0000","last_peered":"2022-08-10T17:55:35.131177+0000","last_clean":"2022-08-10T17:55:35.131177+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:55:35.131177+0000","last_undegraded":"2022-08-10T17:55:35.131177+0000","last_fullsized":"2022-08-10T17:55:35.131177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.131014+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:12:57.212526+0000","scrub_duration":0.028963988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:01.984902+0000","last_change":"2022-08-10T17:56:01.984875+0000","last_active":"2022-08-10T17:56:01.984902+0000","last_peered":"2022-08-10T17:56:01.984902+0000","last_clean":"2022-08-10T17:56:01.984902+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:56:01.984902+0000","last_undegraded":"2022-08-10T17:56:01.984902+0000","last_fullsized":"2022-08-10T17:56:01.984902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:01.984775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:02:21.804010+0000","scrub_duration":0.032020725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3909,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.144536+0000","last_change":"2022-08-10T17:55:54.144477+0000","last_active":"2022-08-10T17:55:54.144536+0000","last_peered":"2022-08-10T17:55:54.144536+0000","last_clean":"2022-08-10T17:55:54.144536+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:55:54.144536+0000","last_undegraded":"2022-08-10T17:55:54.144536+0000","last_fullsized":"2022-08-10T17:55:54.144536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3881","last_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_deep_scrub":"29'3881","last_deep_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.144322+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:34.319790+0000","scrub_duration":0.066230998999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.117089+0000","last_change":"2022-08-10T17:55:34.117062+0000","last_active":"2022-08-10T17:55:34.117089+0000","last_peered":"2022-08-10T17:55:34.117089+0000","last_clean":"2022-08-10T17:55:34.117089+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:55:34.117089+0000","last_undegraded":"2022-08-10T17:55:34.117089+0000","last_fullsized":"2022-08-10T17:55:34.117089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.116969+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:43:17.054491+0000","scrub_duration":0.029066613000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:21.114733+0000","last_change":"2022-08-10T17:56:21.114711+0000","last_active":"2022-08-10T17:56:21.114733+0000","last_peered":"2022-08-10T17:56:21.114733+0000","last_clean":"2022-08-10T17:56:21.114733+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:56:21.114733+0000","last_undegraded":"2022-08-10T17:56:21.114733+0000","last_fullsized":"2022-08-10T17:56:21.114733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:56:21.114629+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:56:21.114629+0000","last_clean_scrub_stamp":"2022-08-10T17:56:21.114629+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:16:34.026582+0000","scrub_duration":0.0035589020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4438,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:37.215710+0000","last_change":"2022-08-10T17:56:37.215676+0000","last_active":"2022-08-10T17:56:37.215710+0000","last_peered":"2022-08-10T17:56:37.215710+0000","last_clean":"2022-08-10T17:56:37.215710+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:56:37.215710+0000","last_undegraded":"2022-08-10T17:56:37.215710+0000","last_fullsized":"2022-08-10T17:56:37.215710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4410","last_scrub_stamp":"2022-08-10T17:56:37.215575+0000","last_deep_scrub":"29'4410","last_deep_scrub_stamp":"2022-08-10T17:56:37.215575+0000","last_clean_scrub_stamp":"2022-08-10T17:56:37.215575+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:03:54.591292+0000","scrub_duration":0.069803685000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.320131+0000","last_change":"2022-08-10T17:55:33.320112+0000","last_active":"2022-08-10T17:55:33.320131+0000","last_peered":"2022-08-10T17:55:33.320131+0000","last_clean":"2022-08-10T17:55:33.320131+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:55:33.320131+0000","last_undegraded":"2022-08-10T17:55:33.320131+0000","last_fullsized":"2022-08-10T17:55:33.320131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.320028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:04.115098+0000","scrub_duration":0.0034705809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.392253+0000","last_change":"2022-08-10T17:55:50.392218+0000","last_active":"2022-08-10T17:55:50.392253+0000","last_peered":"2022-08-10T17:55:50.392253+0000","last_clean":"2022-08-10T17:55:50.392253+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:50.392253+0000","last_undegraded":"2022-08-10T17:55:50.392253+0000","last_fullsized":"2022-08-10T17:55:50.392253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.392108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:07.042516+0000","scrub_duration":0.026038200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5535,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.445165+0000","last_change":"2022-08-10T17:55:49.445116+0000","last_active":"2022-08-10T17:55:49.445165+0000","last_peered":"2022-08-10T17:55:49.445165+0000","last_clean":"2022-08-10T17:55:49.445165+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:55:49.445165+0000","last_undegraded":"2022-08-10T17:55:49.445165+0000","last_fullsized":"2022-08-10T17:55:49.445165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5507","last_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_deep_scrub":"29'5507","last_deep_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.445013+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:23:49.478670+0000","scrub_duration":0.071917088000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.971860+0000","last_change":"2022-08-10T17:55:42.971824+0000","last_active":"2022-08-10T17:55:42.971860+0000","last_peered":"2022-08-10T17:55:42.971860+0000","last_clean":"2022-08-10T17:55:42.971860+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:55:42.971860+0000","last_undegraded":"2022-08-10T17:55:42.971860+0000","last_fullsized":"2022-08-10T17:55:42.971860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.971742+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:21:05.087309+0000","scrub_duration":0.019130503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:12.965428+0000","last_change":"2022-08-10T17:56:12.965406+0000","last_active":"2022-08-10T17:56:12.965428+0000","last_peered":"2022-08-10T17:56:12.965428+0000","last_clean":"2022-08-10T17:56:12.965428+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:56:12.965428+0000","last_undegraded":"2022-08-10T17:56:12.965428+0000","last_fullsized":"2022-08-10T17:56:12.965428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_clean_scrub_stamp":"2022-08-10T17:56:12.965326+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:31:27.062017+0000","scrub_duration":0.0035956199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.797625+0000","last_change":"2022-08-10T17:55:42.797602+0000","last_active":"2022-08-10T17:55:42.797625+0000","last_peered":"2022-08-10T17:55:42.797625+0000","last_clean":"2022-08-10T17:55:42.797625+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:42.797625+0000","last_undegraded":"2022-08-10T17:55:42.797625+0000","last_fullsized":"2022-08-10T17:55:42.797625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.797520+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:36.624748+0000","scrub_duration":0.0035868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.426634+0000","last_change":"2022-08-10T17:55:55.426610+0000","last_active":"2022-08-10T17:55:55.426634+0000","last_peered":"2022-08-10T17:55:55.426634+0000","last_clean":"2022-08-10T17:55:55.426634+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:55.426634+0000","last_undegraded":"2022-08-10T17:55:55.426634+0000","last_fullsized":"2022-08-10T17:55:55.426634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.426506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:30:26.689886+0000","scrub_duration":0.023987992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:32.178041+0000","last_change":"2022-08-10T17:56:32.178020+0000","last_active":"2022-08-10T17:56:32.178041+0000","last_peered":"2022-08-10T17:56:32.178041+0000","last_clean":"2022-08-10T17:56:32.178041+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:56:32.178041+0000","last_undegraded":"2022-08-10T17:56:32.178041+0000","last_fullsized":"2022-08-10T17:56:32.178041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:56:32.177938+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:56:32.177938+0000","last_clean_scrub_stamp":"2022-08-10T17:56:32.177938+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:20:29.168942+0000","scrub_duration":0.0034775819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.495214+0000","last_change":"2022-08-10T17:55:53.495189+0000","last_active":"2022-08-10T17:55:53.495214+0000","last_peered":"2022-08-10T17:55:53.495214+0000","last_clean":"2022-08-10T17:55:53.495214+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:53.495214+0000","last_undegraded":"2022-08-10T17:55:53.495214+0000","last_fullsized":"2022-08-10T17:55:53.495214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.495082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:02.429575+0000","scrub_duration":0.031547311000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.336472+0000","last_change":"2022-08-10T17:55:39.336435+0000","last_active":"2022-08-10T17:55:39.336472+0000","last_peered":"2022-08-10T17:55:39.336472+0000","last_clean":"2022-08-10T17:55:39.336472+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:39.336472+0000","last_undegraded":"2022-08-10T17:55:39.336472+0000","last_fullsized":"2022-08-10T17:55:39.336472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.336296+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:42:50.195666+0000","scrub_duration":0.003602035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3306,"ondisk_log_size":3306,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575106,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478196,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475200,"kb_avail":93893644,"statfs":{"total":96636764160,"available":96147091456,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486604800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":12.699999999999999,"15min":12.686999999999999},"min":{"1min":0.255,"5min":0.222,"15min":0.193},"max":{"1min":0.52700000000000002,"5min":111.864,"15min":140.46000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":12.630000000000001,"15min":12.773},"min":{"1min":0.214,"5min":0.214,"15min":0.186},"max":{"1min":0.47899999999999998,"5min":112.184,"15min":140.48099999999999},"last":0.441}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":5.3380000000000001,"15min":9.6479999999999997},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":5.3499999999999996,"15min":9.5310000000000006},"min":{"1min":0.32900000000000001,"5min":0.253,"15min":0.215},"max":{"1min":0.59799999999999998,"5min":70.302999999999997,"15min":76.177999999999997},"last":0.504}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":1.9650000000000001,"15min":3.1949999999999998},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58599999999999997,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.439,"5min":2.0760000000000001,"15min":3.3199999999999998},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":0.60599999999999998,"5min":43.933,"15min":60.771999999999998},"last":0.46800000000000003}]},{"osd":3,"last update":"Wed Aug 10 17:56:07 2022","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.76000000000000001,"15min":3.7189999999999999},"min":{"1min":0.33100000000000002,"5min":0.28100000000000003,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.82599999999999996,"15min":3.8929999999999998},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.0920000000000001,"15min":5.1589999999999998},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.218},"max":{"1min":0.55000000000000004,"5min":16.939,"15min":81.718999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.78800000000000003,"15min":5.3019999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.621,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.38400000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":4.157,"15min":8.4019999999999992},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":0.52800000000000002,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":4.0529999999999999,"15min":8.4369999999999994},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.35899999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.64000000000000001,"15min":2.8140000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.53200000000000003,"5min":9.0060000000000002,"15min":72.474999999999994},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.84099999999999997,"15min":3.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":20.064,"15min":72.403999999999996},"last":0.33600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575106,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503808,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515899392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":9.3140000000000001,"15min":11.616},"min":{"1min":0.28499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.51500000000000001,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":9.3170000000000002,"15min":11.853},"min":{"1min":0.26200000000000001,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":129.767,"15min":129.767},"last":0.37}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":7.0030000000000001,"15min":11.9},"min":{"1min":0.29099999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":0.69999999999999996,"5min":114.83,"15min":120.13500000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":6.9550000000000001,"15min":11.571},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":0.56399999999999995,"5min":114.842,"15min":119.708},"last":0.308}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.343,"15min":4.3499999999999996},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":17.885999999999999,"15min":107.033},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":1.3240000000000001,"15min":4.6289999999999996},"min":{"1min":0.32800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45300000000000001,"5min":17.895,"15min":107.062},"last":0.41299999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":1,"15min":2.6560000000000001},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.44},{"interface":"front","average":{"1min":0.432,"5min":1.0469999999999999,"15min":2.887},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":0.54000000000000004,"5min":16.331,"15min":96.870000000000005},"last":0.39600000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":2.899,"15min":6.5469999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.183},"max":{"1min":0.48699999999999999,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44,"5min":2.8500000000000001,"15min":6.5510000000000002},"min":{"1min":0.32300000000000001,"5min":0.28899999999999998,"15min":0.26000000000000001},"max":{"1min":0.58099999999999996,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":4.6390000000000002,"15min":7.9610000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":0.65300000000000002,"5min":79.944999999999993,"15min":100.741},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":5.1269999999999998,"15min":8.0600000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":80.159000000000006,"15min":100.715},"last":0.432}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":1.212,"15min":3.7719999999999998},"min":{"1min":0.34399999999999997,"5min":0.27100000000000002,"15min":0.23400000000000001},"max":{"1min":0.50700000000000001,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.83599999999999997,"15min":3.3679999999999999},"min":{"1min":0.36899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":10.551,"15min":59.384},"last":0.46100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575104,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621772,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621440,"kb_avail":93750068,"statfs":{"total":96636764160,"available":96000069632,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636354560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":9.8260000000000005,"15min":11.797000000000001},"min":{"1min":0.21199999999999999,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":0.36899999999999999,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.28399999999999997,"5min":9.5380000000000003,"15min":11.470000000000001},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":0.38200000000000001,"5min":116.699,"15min":116.699},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.661,"15min":4.8799999999999999},"min":{"1min":0.25,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.41599999999999998,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.374,"5min":1.5169999999999999,"15min":4.7030000000000003},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":0.52100000000000002,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":1.319,"15min":3.2320000000000002},"min":{"1min":0.30099999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":0.60499999999999998,"5min":25.152000000000001,"15min":87.884},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":2.387,"15min":3.3530000000000002},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.16600000000000001},"max":{"1min":0.51600000000000001,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":2.6949999999999998,"15min":8.0050000000000008},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":2.919,"15min":8.157},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.28000000000000003},"max":{"1min":0.64500000000000002,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.41299999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":3.5659999999999998,"15min":8.9169999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":3.3999999999999999,"15min":8.8940000000000001},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.65300000000000002,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.39300000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":1.5800000000000001,"15min":4.2859999999999996},"min":{"1min":0.373,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":30.183,"15min":115.45999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.496,"5min":1.631,"15min":3.9089999999999998},"min":{"1min":0.40999999999999998,"5min":0.34499999999999997,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":30.236000000000001,"15min":115.346},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.4139999999999999,"15min":2.7429999999999999},"min":{"1min":0.38200000000000001,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":1.141,"15min":2.8740000000000001},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.29499999999999998},"max":{"1min":0.68200000000000005,"5min":11.885,"15min":58.526000000000003},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575103,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604048,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596352,"kb_avail":93767792,"statfs":{"total":96636764160,"available":96018219008,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610664448},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":8.8580000000000005,"15min":11.233000000000001},"min":{"1min":0.21199999999999999,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":0.45000000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.377},{"interface":"front","average":{"1min":0.35399999999999998,"5min":9.6319999999999997,"15min":11.512},"min":{"1min":0.26800000000000002,"5min":0.21299999999999999,"15min":0.17799999999999999},"max":{"1min":0.51100000000000001,"5min":93.111999999999995,"15min":111.506},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.323,"15min":5.5839999999999996},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":0.52700000000000002,"5min":21.789000000000001,"15min":130.566},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.881,"15min":5.798},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.222},"max":{"1min":2.5910000000000002,"5min":50.625,"15min":130.63300000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":1.385,"15min":3.5369999999999999},"min":{"1min":0.22700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.39600000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.9810000000000001,"15min":3.6880000000000002},"min":{"1min":0.30399999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":50.686999999999998,"15min":111.377},"last":0.251}]},{"osd":4,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":1.804,"15min":6.6820000000000004},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.57699999999999996,"5min":39.814999999999998,"15min":127.629},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":2.6480000000000001,"15min":7.0259999999999998},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":2.5209999999999999,"5min":50.734000000000002,"15min":127.497},"last":0.495}]},{"osd":5,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":3.7650000000000001,"15min":7.7489999999999997},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":88.512,"15min":127.77500000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":3.9710000000000001,"15min":8.3360000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.41999999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":1.903,"15min":4.4100000000000001},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":50.664000000000001,"15min":114.8},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":2.1269999999999998,"15min":4.5149999999999997},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":2.5590000000000002,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.44}]},{"osd":7,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8049999999999999,"15min":3.0699999999999998},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":2.2690000000000001,"15min":3.298},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.39000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575105,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:08 2022","interfaces":[{"interface":"back","average":{"1min":0.27200000000000002,"5min":15.108000000000001,"15min":15.090999999999999},"min":{"1min":0.19900000000000001,"5min":0.18099999999999999,"15min":0.14899999999999999},"max":{"1min":0.40699999999999997,"5min":117.869,"15min":117.869},"last":0.37},{"interface":"front","average":{"1min":0.309,"5min":15.01,"15min":15.234},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41899999999999998,"5min":117.889,"15min":117.889},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":8.7029999999999994,"15min":12.433999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.185},"max":{"1min":0.38100000000000001,"5min":150.911,"15min":150.911},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":8.8629999999999995,"15min":12.443},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":0.53000000000000003,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:56:19 2022","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":1.1319999999999999,"15min":2.593},"min":{"1min":0.28399999999999997,"5min":0.22700000000000001,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":21.376000000000001,"15min":95.066999999999993},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.103,"15min":2.4609999999999999},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.48799999999999999,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":2.851,"15min":7.4329999999999998},"min":{"1min":0.373,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":0.71699999999999997,"5min":47.207999999999998,"15min":114.259},"last":0.499},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.7519999999999998,"15min":7.6630000000000003},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71099999999999997,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":2.887,"15min":7.3529999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":0.72999999999999998,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.433,"5min":3.0209999999999999,"15min":7.3540000000000001},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":63.508000000000003,"15min":100.22},"last":0.39600000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.1200000000000001,"15min":2.7989999999999999},"min":{"1min":0.378,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":19.789999999999999,"15min":60.429000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3029999999999999,"15min":2.9609999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":0.58699999999999997,"5min":28.131,"15min":60.445},"last":0.35499999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":1.355,"15min":3.5139999999999998},"min":{"1min":0.34899999999999998,"5min":0.33000000000000002,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":34.904000000000003,"15min":94.753},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":1.2889999999999999,"15min":3.7010000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":0.60499999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834575105,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473944,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":472000,"kb_avail":93897896,"statfs":{"total":96636764160,"available":96151445504,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483328000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":10.327,"15min":12.210000000000001},"min":{"1min":0.19400000000000001,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":0.434,"5min":117.169,"15min":117.169},"last":0.221},{"interface":"front","average":{"1min":0.34799999999999998,"5min":10.387,"15min":12.581},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":117.199,"15min":117.199},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":4.3049999999999997,"15min":10.551},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.19400000000000001},"max":{"1min":0.45000000000000001,"5min":56.604999999999997,"15min":135.714},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":4.0940000000000003,"15min":10.529},"min":{"1min":0.23300000000000001,"5min":0.23200000000000001,"15min":0.183},"max":{"1min":0.46600000000000003,"5min":57.014000000000003,"15min":135.65700000000001},"last":0.247}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":2.1440000000000001,"15min":3.5649999999999999},"min":{"1min":0.26700000000000002,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":87.492000000000004,"15min":87.492000000000004},"last":0.313},{"interface":"front","average":{"1min":0.35199999999999998,"5min":2.169,"15min":3.3100000000000001},"min":{"1min":0.29899999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.23899999999999999}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":2.7570000000000001,"15min":5.2770000000000001},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.433,"5min":2.2599999999999998,"15min":5.2560000000000002},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.66900000000000004,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.29499999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":2.7040000000000002,"15min":5.6210000000000004},"min":{"1min":0.378,"5min":0.30399999999999999,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":45.448,"15min":70.989000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.948,"15min":5.5910000000000002},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":45.462000000000003,"15min":71.114000000000004},"last":0.39100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":1.0369999999999999,"15min":3.4300000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":9.9450000000000003,"15min":51.773000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.675,"15min":3.3530000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":34.656999999999996,"15min":51.738},"last":0.34000000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.5609999999999999,"15min":3.3999999999999999},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.64000000000000001,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3140000000000001,"15min":3.2690000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.41899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575106,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559988,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551360,"kb_avail":93811852,"statfs":{"total":96636764160,"available":96063336448,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564592640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":8.7799999999999994,"15min":11.246},"min":{"1min":0.28599999999999998,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":0.47299999999999998,"5min":101.88,"15min":136.29300000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":9.1229999999999993,"15min":11.416},"min":{"1min":0.28199999999999997,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":101.867,"15min":136.142},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":7.3230000000000004,"15min":11.394},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.47799999999999998,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.378},{"interface":"front","average":{"1min":0.40400000000000003,"5min":7.1520000000000001,"15min":10.872999999999999},"min":{"1min":0.32100000000000001,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":0.54500000000000004,"5min":146.45699999999999,"15min":146.45699999999999},"last":0.31}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.7390000000000001,"15min":4.4000000000000004},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.792,"15min":3.9990000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":0.66200000000000003,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":1.587,"15min":3.8140000000000001},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.24099999999999999},"max":{"1min":0.48599999999999999,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":1.6299999999999999,"15min":3.5350000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.25800000000000001},"max":{"1min":0.52000000000000002,"5min":29.956,"15min":63.167999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":2.2989999999999999,"15min":8.6020000000000003},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.219},"max":{"1min":0.502,"5min":49.238999999999997,"15min":84.778999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.434,"5min":2.2389999999999999,"15min":8.8559999999999999},"min":{"1min":0.32100000000000001,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":0.61599999999999999,"5min":49.283999999999999,"15min":84.762},"last":0.34999999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":1.1970000000000001,"15min":4.5780000000000003},"min":{"1min":0.30499999999999999,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.54800000000000004,"5min":30.805,"15min":83.144000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.755,"15min":4.976},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":0.63700000000000001,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.438}]},{"osd":7,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.1379999999999999,"15min":2.5950000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.443},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.83299999999999996,"15min":3.1030000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55700000000000005,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575104,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546944,"kb_avail":93824560,"statfs":{"total":96636764160,"available":96076349440,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560070656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":8.298,"15min":11.548999999999999},"min":{"1min":0.28199999999999997,"5min":0.22900000000000001,"15min":0.192},"max":{"1min":0.51500000000000001,"5min":94.200000000000003,"15min":112.441},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":9.9450000000000003,"15min":12.314},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":6.5839999999999996,"15min":10.292},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":0.46700000000000003,"5min":106.054,"15min":111.13800000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":6.9550000000000001,"15min":10.839},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":0.54800000000000004,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":1.4370000000000001,"15min":4.0359999999999996},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":52.337000000000003,"15min":112.09099999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.436,"5min":1.736,"15min":4.3150000000000004},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.51500000000000001,"5min":52.393999999999998,"15min":112.91200000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":1.3100000000000001,"15min":3.9049999999999998},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":41.634999999999998,"15min":139.75299999999999},"last":0.435},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.3109999999999999,"15min":3.8130000000000002},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.50700000000000001,"5min":46.216999999999999,"15min":110.21599999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":1.083,"15min":7.2679999999999998},"min":{"1min":0.248,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.55000000000000004,"5min":25.922999999999998,"15min":88.391000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.234,"15min":7.3840000000000003},"min":{"1min":0.316,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":0.56499999999999995,"5min":26.094000000000001,"15min":88.344999999999999},"last":0.38600000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.81599999999999995,"15min":3.052},"min":{"1min":0.248,"5min":0.248,"15min":0.222},"max":{"1min":0.48599999999999999,"5min":15.548,"15min":68.132999999999996},"last":0.498},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.94899999999999995,"15min":3.1429999999999998},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":0.5,"5min":15.49,"15min":67.926000000000002},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.82199999999999995,"15min":3.7989999999999999},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":25.954999999999998,"15min":65.207999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.64600000000000002,"15min":3.8039999999999998},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":0.58199999999999996,"5min":7.2000000000000002,"15min":65.260999999999996},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:56:45.853 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2022-08-10T17:35:40.401298+0000 time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=8, tm_mday=10, tm_hour=17, tm_min=55, tm_sec=18, tm_wday=2, tm_yday=222, tm_isdst=0) 2022-08-10T17:56:45.854 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-08-10T17:57:05.855 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-08-10T17:57:05.979 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 Processor -- start 2022-08-10T17:57:05.980 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 -- start start 2022-08-10T17:57:05.987 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f484006d480 0x7f48400c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d850 0x7f48400b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48400b0e20 0x7f48400c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400c39a0 con 0x7f48400b0e20 2022-08-10T17:57:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484006e120 con 0x7f484006d480 2022-08-10T17:57:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.976+0000 7f4846a2f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400c5620 con 0x7f484006d850 2022-08-10T17:57:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48400b0e20 0x7f48400c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48400b0e20 0x7f48400c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45834/0 (socket says 172.21.15.150:45834) 2022-08-10T17:57:05.989 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 -- 172.21.15.150:0/2777721335 learned_addr learned my addr 172.21.15.150:0/2777721335 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f483f7fe700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d850 0x7f48400b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f483ffff700 1 --2- 172.21.15.150:0/2777721335 >> v2:172.21.15.197:3300/0 conn(0x7f484006d480 0x7f48400c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 -- 172.21.15.150:0/2777721335 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d850 msgr2=0x7f48400b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:05.990 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d850 0x7f48400b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 -- 172.21.15.150:0/2777721335 >> v2:172.21.15.197:3300/0 conn(0x7f484006d480 msgr2=0x7f48400c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:05.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 --2- 172.21.15.150:0/2777721335 >> v2:172.21.15.197:3300/0 conn(0x7f484006d480 0x7f48400c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 -- 172.21.15.150:0/2777721335 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400c5900 con 0x7f48400b0e20 2022-08-10T17:57:05.991 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f4844fcc700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f48400c4410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48400702c0 tx=0x7f483800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72a0fc4183d3770 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:05.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f483effd700 1 -- 172.21.15.150:0/2777721335 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800e070 con 0x7f48400b0e20 2022-08-10T17:57:05.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f483effd700 1 -- 172.21.15.150:0/2777721335 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800b910 con 0x7f48400b0e20 2022-08-10T17:57:05.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.977+0000 7f483effd700 1 -- 172.21.15.150:0/2777721335 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800bcc0 con 0x7f48400b0e20 2022-08-10T17:57:05.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 -- 172.21.15.150:0/2777721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 msgr2=0x7f48400c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:05.992 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f48400c4410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48400702c0 tx=0x7f483800b330 comp rx=0 tx=0).stop 2022-08-10T17:57:05.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 -- 172.21.15.150:0/2777721335 shutdown_connections 2022-08-10T17:57:05.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f48400c4410 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2777721335 >> v2:172.21.15.197:3300/0 conn(0x7f484006d480 0x7f48400c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.993 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2777721335 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d850 0x7f48400b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 -- 172.21.15.150:0/2777721335 >> 172.21.15.150:0/2777721335 conn(0x7f484006b3b0 msgr2=0x7f484006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:05.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 -- 172.21.15.150:0/2777721335 shutdown_connections 2022-08-10T17:57:05.994 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.978+0000 7f4846a2f700 1 -- 172.21.15.150:0/2777721335 wait complete. 2022-08-10T17:57:05.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.979+0000 7f4846a2f700 1 Processor -- start 2022-08-10T17:57:05.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.979+0000 7f4846a2f700 1 -- start start 2022-08-10T17:57:05.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f484006d850 0x7f4840155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.995 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:05.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400698b0 con 0x7f48400b0e20 2022-08-10T17:57:05.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484014fd70 con 0x7f484006d850 2022-08-10T17:57:05.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4846a2f700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4840158a90 con 0x7f484006d480 2022-08-10T17:57:05.996 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4844fcc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483f7fe700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f484006d850 0x7f4840155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:05.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:60058/0 (socket says 172.21.15.150:60058) 2022-08-10T17:57:05.997 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4844fcc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45840/0 (socket says 172.21.15.150:45840) 2022-08-10T17:57:05.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 -- 172.21.15.150:0/2648768536 learned_addr learned my addr 172.21.15.150:0/2648768536 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:05.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 -- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f484006d850 msgr2=0x7f4840155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:05.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f484006d850 0x7f4840155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.998 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 -- 172.21.15.150:0/2648768536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 msgr2=0x7f4840156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:05.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:05.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 -- 172.21.15.150:0/2648768536 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009b30 con 0x7f484006d480 2022-08-10T17:57:05.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f4844fcc700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:05.999 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.980+0000 7f483ffff700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f483000e620 tx=0x7f483000e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.981+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830013680 con 0x7f484006d480 2022-08-10T17:57:06.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.981+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300137e0 con 0x7f484006d480 2022-08-10T17:57:06.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.981+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4840068180 con 0x7f484006d480 2022-08-10T17:57:06.000 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.981+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830013b70 con 0x7f484006d480 2022-08-10T17:57:06.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.981+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48401587b0 con 0x7f484006d480 2022-08-10T17:57:06.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.982+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840150050 con 0x7f484006d480 2022-08-10T17:57:06.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.982+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f4830019030 con 0x7f484006d480 2022-08-10T17:57:06.001 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.982+0000 7f483cff9700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 0x7f4820067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.982+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f4830081df0 con 0x7f484006d480 2022-08-10T17:57:06.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.982+0000 7f483f7fe700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 0x7f4820067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.002 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.983+0000 7f483f7fe700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 0x7f4820067560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f48400ca1a0 tx=0x7f48340090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.003 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:05.987+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f483004fdd0 con 0x7f484006d480 2022-08-10T17:57:06.170 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.166+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 --> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f484014feb0 con 0x7f48200650b0 2022-08-10T17:57:06.180 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.177+0000 7f483cff9700 1 -- 172.21.15.150:0/2648768536 <== mgr.4102 v2:172.21.15.197:6832/97455 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+395084 (secure 0 0 0) 0x7f4834011780 con 0x7f48200650b0 2022-08-10T17:57:06.186 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:57:06.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 msgr2=0x7f4820067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 0x7f4820067560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f48400ca1a0 tx=0x7f48340090e0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.190 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 msgr2=0x7f48401def30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f483000e620 tx=0x7f483000e930 comp rx=0 tx=0).stop 2022-08-10T17:57:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 shutdown_connections 2022-08-10T17:57:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400b0e20 0x7f4840156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.191 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f48200650b0 0x7f4820067560 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f484006d480 0x7f48401def30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 --2- 172.21.15.150:0/2648768536 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f484006d850 0x7f4840155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 >> 172.21.15.150:0/2648768536 conn(0x7f484006b3b0 msgr2=0x7f4840071930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:06.192 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 shutdown_connections 2022-08-10T17:57:06.193 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.181+0000 7f4846a2f700 1 -- 172.21.15.150:0/2648768536 wait complete. 2022-08-10T17:57:06.193 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2022-08-10T17:57:06.199 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":672,"stamp":"2022-08-10T17:57:05.826871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16862299,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":146,"num_read_kb":372,"num_write":1250705,"num_write_kb":19248762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152613,"ondisk_log_size":152613,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4261808,"kb_used_data":22512,"kb_used_omap":0,"kb_used_meta":4239232,"kb_avail":750712912,"statfs":{"total":773094113280,"available":768730021888,"internally_reserved":0,"allocated":23052288,"data_stored":34794118,"data_compressed":2839216,"data_compressed_allocated":4071424,"data_compressed_original":17440768,"omap_allocated":0,"internal_metadata":4340973568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002859"},"pg_stats":[{"pgid":"4.3f","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.671542+0000","last_change":"2022-08-10T17:55:23.671511+0000","last_active":"2022-08-10T17:55:23.671542+0000","last_peered":"2022-08-10T17:55:23.671542+0000","last_clean":"2022-08-10T17:55:23.671542+0000","last_became_active":"2022-08-10T17:35:37.407910+0000","last_became_peered":"2022-08-10T17:35:37.407910+0000","last_unstale":"2022-08-10T17:55:23.671542+0000","last_undegraded":"2022-08-10T17:55:23.671542+0000","last_fullsized":"2022-08-10T17:55:23.671542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:23.671406+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.671406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:28:06.994122+0000","scrub_duration":0.037043489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.118511+0000","last_change":"2022-08-10T17:55:48.118489+0000","last_active":"2022-08-10T17:55:48.118511+0000","last_peered":"2022-08-10T17:55:48.118511+0000","last_clean":"2022-08-10T17:55:48.118511+0000","last_became_active":"2022-08-10T17:35:37.411957+0000","last_became_peered":"2022-08-10T17:35:37.411957+0000","last_unstale":"2022-08-10T17:55:48.118511+0000","last_undegraded":"2022-08-10T17:55:48.118511+0000","last_fullsized":"2022-08-10T17:55:48.118511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:48.118410+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.118410+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:55:58.751362+0000","scrub_duration":0.003595076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.749547+0000","last_change":"2022-08-10T17:55:24.749527+0000","last_active":"2022-08-10T17:55:24.749547+0000","last_peered":"2022-08-10T17:55:24.749547+0000","last_clean":"2022-08-10T17:55:24.749547+0000","last_became_active":"2022-08-10T17:35:37.409024+0000","last_became_peered":"2022-08-10T17:35:37.409024+0000","last_unstale":"2022-08-10T17:55:24.749547+0000","last_undegraded":"2022-08-10T17:55:24.749547+0000","last_fullsized":"2022-08-10T17:55:24.749547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:24.749427+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.749427+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:12.518032+0000","scrub_duration":0.0088304560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.879719+0000","last_change":"2022-08-10T17:55:34.879699+0000","last_active":"2022-08-10T17:55:34.879719+0000","last_peered":"2022-08-10T17:55:34.879719+0000","last_clean":"2022-08-10T17:55:34.879719+0000","last_became_active":"2022-08-10T17:35:37.413928+0000","last_became_peered":"2022-08-10T17:35:37.413928+0000","last_unstale":"2022-08-10T17:55:34.879719+0000","last_undegraded":"2022-08-10T17:55:34.879719+0000","last_fullsized":"2022-08-10T17:55:34.879719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:34.879618+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.879618+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:16:21.211782+0000","scrub_duration":0.003479551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.970758+0000","last_change":"2022-08-10T17:55:54.970725+0000","last_active":"2022-08-10T17:55:54.970758+0000","last_peered":"2022-08-10T17:55:54.970758+0000","last_clean":"2022-08-10T17:55:54.970758+0000","last_became_active":"2022-08-10T17:35:37.419008+0000","last_became_peered":"2022-08-10T17:35:37.419008+0000","last_unstale":"2022-08-10T17:55:54.970758+0000","last_undegraded":"2022-08-10T17:55:54.970758+0000","last_fullsized":"2022-08-10T17:55:54.970758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:54.970624+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.970624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:08:58.527187+0000","scrub_duration":0.018586465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:33.136621+0000","last_change":"2022-08-10T17:56:33.136589+0000","last_active":"2022-08-10T17:56:33.136621+0000","last_peered":"2022-08-10T17:56:33.136621+0000","last_clean":"2022-08-10T17:56:33.136621+0000","last_became_active":"2022-08-10T17:35:37.409830+0000","last_became_peered":"2022-08-10T17:35:37.409830+0000","last_unstale":"2022-08-10T17:56:33.136621+0000","last_undegraded":"2022-08-10T17:56:33.136621+0000","last_fullsized":"2022-08-10T17:56:33.136621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:33.136465+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:33.136465+0000","last_clean_scrub_stamp":"2022-08-10T17:56:33.136465+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:06:11.530878+0000","scrub_duration":0.003567686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.331223+0000","last_change":"2022-08-10T17:56:13.331186+0000","last_active":"2022-08-10T17:56:13.331223+0000","last_peered":"2022-08-10T17:56:13.331223+0000","last_clean":"2022-08-10T17:56:13.331223+0000","last_became_active":"2022-08-10T17:35:37.414088+0000","last_became_peered":"2022-08-10T17:35:37.414088+0000","last_unstale":"2022-08-10T17:56:13.331223+0000","last_undegraded":"2022-08-10T17:56:13.331223+0000","last_fullsized":"2022-08-10T17:56:13.331223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:13.331081+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.331081+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:01:12.389751+0000","scrub_duration":0.039103919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.038721+0000","last_change":"2022-08-10T17:55:50.038689+0000","last_active":"2022-08-10T17:55:50.038721+0000","last_peered":"2022-08-10T17:55:50.038721+0000","last_clean":"2022-08-10T17:55:50.038721+0000","last_became_active":"2022-08-10T17:35:37.411892+0000","last_became_peered":"2022-08-10T17:35:37.411892+0000","last_unstale":"2022-08-10T17:55:50.038721+0000","last_undegraded":"2022-08-10T17:55:50.038721+0000","last_fullsized":"2022-08-10T17:55:50.038721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:50.038567+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.038567+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:25:22.148321+0000","scrub_duration":0.0034662680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.017798+0000","last_change":"2022-08-10T17:55:56.017766+0000","last_active":"2022-08-10T17:55:56.017798+0000","last_peered":"2022-08-10T17:55:56.017798+0000","last_clean":"2022-08-10T17:55:56.017798+0000","last_became_active":"2022-08-10T17:35:37.415925+0000","last_became_peered":"2022-08-10T17:35:37.415925+0000","last_unstale":"2022-08-10T17:55:56.017798+0000","last_undegraded":"2022-08-10T17:55:56.017798+0000","last_fullsized":"2022-08-10T17:55:56.017798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:56.017619+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.017619+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:34.560662+0000","scrub_duration":0.0309912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.092605+0000","last_change":"2022-08-10T17:55:24.092585+0000","last_active":"2022-08-10T17:55:24.092605+0000","last_peered":"2022-08-10T17:55:24.092605+0000","last_clean":"2022-08-10T17:55:24.092605+0000","last_became_active":"2022-08-10T17:35:37.411308+0000","last_became_peered":"2022-08-10T17:35:37.411308+0000","last_unstale":"2022-08-10T17:55:24.092605+0000","last_undegraded":"2022-08-10T17:55:24.092605+0000","last_fullsized":"2022-08-10T17:55:24.092605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2022-08-10T17:55:24.092509+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.092509+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:43:12.935816+0000","scrub_duration":0.0044268040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.848285+0000","last_change":"2022-08-10T17:55:50.848264+0000","last_active":"2022-08-10T17:55:50.848285+0000","last_peered":"2022-08-10T17:55:50.848285+0000","last_clean":"2022-08-10T17:55:50.848285+0000","last_became_active":"2022-08-10T17:35:37.410819+0000","last_became_peered":"2022-08-10T17:35:37.410819+0000","last_unstale":"2022-08-10T17:55:50.848285+0000","last_undegraded":"2022-08-10T17:55:50.848285+0000","last_fullsized":"2022-08-10T17:55:50.848285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:50.848186+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.848186+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:27:36.860710+0000","scrub_duration":0.0034554989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'27","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.587361+0000","last_change":"2022-08-10T17:55:27.587324+0000","last_active":"2022-08-10T17:55:27.587361+0000","last_peered":"2022-08-10T17:55:27.587361+0000","last_clean":"2022-08-10T17:55:27.587361+0000","last_became_active":"2022-08-10T17:35:37.410409+0000","last_became_peered":"2022-08-10T17:35:37.410409+0000","last_unstale":"2022-08-10T17:55:27.587361+0000","last_undegraded":"2022-08-10T17:55:27.587361+0000","last_fullsized":"2022-08-10T17:55:27.587361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:27.587177+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.587177+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:18:28.369001+0000","scrub_duration":0.003490515,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.597924+0000","last_change":"2022-08-10T17:55:28.597885+0000","last_active":"2022-08-10T17:55:28.597924+0000","last_peered":"2022-08-10T17:55:28.597924+0000","last_clean":"2022-08-10T17:55:28.597924+0000","last_became_active":"2022-08-10T17:35:37.405956+0000","last_became_peered":"2022-08-10T17:35:37.405956+0000","last_unstale":"2022-08-10T17:55:28.597924+0000","last_undegraded":"2022-08-10T17:55:28.597924+0000","last_fullsized":"2022-08-10T17:55:28.597924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:55:28.597685+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.597685+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:50:51.165553+0000","scrub_duration":0.016393403000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.084201+0000","last_change":"2022-08-10T17:55:25.084163+0000","last_active":"2022-08-10T17:55:25.084201+0000","last_peered":"2022-08-10T17:55:25.084201+0000","last_clean":"2022-08-10T17:55:25.084201+0000","last_became_active":"2022-08-10T17:35:37.409457+0000","last_became_peered":"2022-08-10T17:35:37.409457+0000","last_unstale":"2022-08-10T17:55:25.084201+0000","last_undegraded":"2022-08-10T17:55:25.084201+0000","last_fullsized":"2022-08-10T17:55:25.084201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2022-08-10T17:55:25.084023+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.084023+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:58:36.715764+0000","scrub_duration":0.0035396899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.289003+0000","last_change":"2022-08-10T17:56:09.288973+0000","last_active":"2022-08-10T17:56:09.289003+0000","last_peered":"2022-08-10T17:56:09.289003+0000","last_clean":"2022-08-10T17:56:09.289003+0000","last_became_active":"2022-08-10T17:35:37.421362+0000","last_became_peered":"2022-08-10T17:35:37.421362+0000","last_unstale":"2022-08-10T17:56:09.289003+0000","last_undegraded":"2022-08-10T17:56:09.289003+0000","last_fullsized":"2022-08-10T17:56:09.289003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:09.288839+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.288839+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:35:42.321172+0000","scrub_duration":0.0035582019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.746364+0000","last_change":"2022-08-10T17:55:32.746346+0000","last_active":"2022-08-10T17:55:32.746364+0000","last_peered":"2022-08-10T17:55:32.746364+0000","last_clean":"2022-08-10T17:55:32.746364+0000","last_became_active":"2022-08-10T17:35:37.410861+0000","last_became_peered":"2022-08-10T17:35:37.410861+0000","last_unstale":"2022-08-10T17:55:32.746364+0000","last_undegraded":"2022-08-10T17:55:32.746364+0000","last_fullsized":"2022-08-10T17:55:32.746364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:55:32.746268+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.746268+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:58:15.017040+0000","scrub_duration":0.0035363500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'22","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.956491+0000","last_change":"2022-08-10T17:55:53.956469+0000","last_active":"2022-08-10T17:55:53.956491+0000","last_peered":"2022-08-10T17:55:53.956491+0000","last_clean":"2022-08-10T17:55:53.956491+0000","last_became_active":"2022-08-10T17:35:37.414793+0000","last_became_peered":"2022-08-10T17:35:37.414793+0000","last_unstale":"2022-08-10T17:55:53.956491+0000","last_undegraded":"2022-08-10T17:55:53.956491+0000","last_fullsized":"2022-08-10T17:55:53.956491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:55:53.956366+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.956366+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:02:03.066925+0000","scrub_duration":0.034545389000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.834163+0000","last_change":"2022-08-10T17:55:44.834143+0000","last_active":"2022-08-10T17:55:44.834163+0000","last_peered":"2022-08-10T17:55:44.834163+0000","last_clean":"2022-08-10T17:55:44.834163+0000","last_became_active":"2022-08-10T17:35:37.407919+0000","last_became_peered":"2022-08-10T17:35:37.407919+0000","last_unstale":"2022-08-10T17:55:44.834163+0000","last_undegraded":"2022-08-10T17:55:44.834163+0000","last_fullsized":"2022-08-10T17:55:44.834163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:44.834059+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.834059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:14:17.359055+0000","scrub_duration":0.0034759230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'33","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.602705+0000","last_change":"2022-08-10T17:55:25.602683+0000","last_active":"2022-08-10T17:55:25.602705+0000","last_peered":"2022-08-10T17:55:25.602705+0000","last_clean":"2022-08-10T17:55:25.602705+0000","last_became_active":"2022-08-10T17:35:37.417426+0000","last_became_peered":"2022-08-10T17:35:37.417426+0000","last_unstale":"2022-08-10T17:55:25.602705+0000","last_undegraded":"2022-08-10T17:55:25.602705+0000","last_fullsized":"2022-08-10T17:55:25.602705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:25.602593+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.602593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:49:36.908209+0000","scrub_duration":0.015965635999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:24.117641+0000","last_change":"2022-08-10T17:56:24.117608+0000","last_active":"2022-08-10T17:56:24.117641+0000","last_peered":"2022-08-10T17:56:24.117641+0000","last_clean":"2022-08-10T17:56:24.117641+0000","last_became_active":"2022-08-10T17:35:37.416423+0000","last_became_peered":"2022-08-10T17:35:37.416423+0000","last_unstale":"2022-08-10T17:56:24.117641+0000","last_undegraded":"2022-08-10T17:56:24.117641+0000","last_fullsized":"2022-08-10T17:56:24.117641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:56:24.117480+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:56:24.117480+0000","last_clean_scrub_stamp":"2022-08-10T17:56:24.117480+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:16:59.497528+0000","scrub_duration":0.003592703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'32","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:05.358959+0000","last_change":"2022-08-10T17:56:05.358912+0000","last_active":"2022-08-10T17:56:05.358959+0000","last_peered":"2022-08-10T17:56:05.358959+0000","last_clean":"2022-08-10T17:56:05.358959+0000","last_became_active":"2022-08-10T17:35:37.418592+0000","last_became_peered":"2022-08-10T17:35:37.418592+0000","last_unstale":"2022-08-10T17:56:05.358959+0000","last_undegraded":"2022-08-10T17:56:05.358959+0000","last_fullsized":"2022-08-10T17:56:05.358959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2022-08-10T17:56:05.358729+0000","last_clean_scrub_stamp":"2022-08-10T17:56:05.358729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:00:22.195910+0000","scrub_duration":0.051750043000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.964336+0000","last_change":"2022-08-10T17:55:49.964314+0000","last_active":"2022-08-10T17:55:49.964336+0000","last_peered":"2022-08-10T17:55:49.964336+0000","last_clean":"2022-08-10T17:55:49.964336+0000","last_became_active":"2022-08-10T17:35:37.411552+0000","last_became_peered":"2022-08-10T17:35:37.411552+0000","last_unstale":"2022-08-10T17:55:49.964336+0000","last_undegraded":"2022-08-10T17:55:49.964336+0000","last_fullsized":"2022-08-10T17:55:49.964336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:49.964237+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.964237+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:13:15.202875+0000","scrub_duration":0.0034506480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.369947+0000","last_change":"2022-08-10T17:55:57.369922+0000","last_active":"2022-08-10T17:55:57.369947+0000","last_peered":"2022-08-10T17:55:57.369947+0000","last_clean":"2022-08-10T17:55:57.369947+0000","last_became_active":"2022-08-10T17:35:37.408055+0000","last_became_peered":"2022-08-10T17:35:37.408055+0000","last_unstale":"2022-08-10T17:55:57.369947+0000","last_undegraded":"2022-08-10T17:55:57.369947+0000","last_fullsized":"2022-08-10T17:55:57.369947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:57.369823+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.369823+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:11:25.548675+0000","scrub_duration":0.023686576000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:07.270250+0000","last_change":"2022-08-10T17:56:07.270217+0000","last_active":"2022-08-10T17:56:07.270250+0000","last_peered":"2022-08-10T17:56:07.270250+0000","last_clean":"2022-08-10T17:56:07.270250+0000","last_became_active":"2022-08-10T17:35:37.414115+0000","last_became_peered":"2022-08-10T17:35:37.414115+0000","last_unstale":"2022-08-10T17:56:07.270250+0000","last_undegraded":"2022-08-10T17:56:07.270250+0000","last_fullsized":"2022-08-10T17:56:07.270250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2022-08-10T17:56:07.270085+0000","last_clean_scrub_stamp":"2022-08-10T17:56:07.270085+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:03:30.303765+0000","scrub_duration":0.003542674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:45.411773+0000","last_change":"2022-08-10T17:55:45.411749+0000","last_active":"2022-08-10T17:55:45.411773+0000","last_peered":"2022-08-10T17:55:45.411773+0000","last_clean":"2022-08-10T17:55:45.411773+0000","last_became_active":"2022-08-10T17:35:37.416630+0000","last_became_peered":"2022-08-10T17:35:37.416630+0000","last_unstale":"2022-08-10T17:55:45.411773+0000","last_undegraded":"2022-08-10T17:55:45.411773+0000","last_fullsized":"2022-08-10T17:55:45.411773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:45.411650+0000","last_clean_scrub_stamp":"2022-08-10T17:55:45.411650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:19:32.370100+0000","scrub_duration":0.046072038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.335430+0000","last_change":"2022-08-10T17:55:36.335408+0000","last_active":"2022-08-10T17:55:36.335430+0000","last_peered":"2022-08-10T17:55:36.335430+0000","last_clean":"2022-08-10T17:55:36.335430+0000","last_became_active":"2022-08-10T17:35:37.409823+0000","last_became_peered":"2022-08-10T17:35:37.409823+0000","last_unstale":"2022-08-10T17:55:36.335430+0000","last_undegraded":"2022-08-10T17:55:36.335430+0000","last_fullsized":"2022-08-10T17:55:36.335430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:36.335326+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.335326+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:02:07.956826+0000","scrub_duration":0.0034800230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.147493+0000","last_change":"2022-08-10T17:55:38.147458+0000","last_active":"2022-08-10T17:55:38.147493+0000","last_peered":"2022-08-10T17:55:38.147493+0000","last_clean":"2022-08-10T17:55:38.147493+0000","last_became_active":"2022-08-10T17:35:37.409705+0000","last_became_peered":"2022-08-10T17:35:37.409705+0000","last_unstale":"2022-08-10T17:55:38.147493+0000","last_undegraded":"2022-08-10T17:55:38.147493+0000","last_fullsized":"2022-08-10T17:55:38.147493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:38.147290+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.147290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:17:04.733650+0000","scrub_duration":0.021995639000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'4444","reported_seq":4472,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:36.184755+0000","last_change":"2022-08-10T17:56:36.184712+0000","last_active":"2022-08-10T17:56:36.184755+0000","last_peered":"2022-08-10T17:56:36.184755+0000","last_clean":"2022-08-10T17:56:36.184755+0000","last_became_active":"2022-08-10T17:35:41.442052+0000","last_became_peered":"2022-08-10T17:35:41.442052+0000","last_unstale":"2022-08-10T17:56:36.184755+0000","last_undegraded":"2022-08-10T17:56:36.184755+0000","last_fullsized":"2022-08-10T17:56:36.184755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4444","last_scrub_stamp":"2022-08-10T17:56:36.184607+0000","last_deep_scrub":"29'4444","last_deep_scrub_stamp":"2022-08-10T17:56:36.184607+0000","last_clean_scrub_stamp":"2022-08-10T17:56:36.184607+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:07:43.624823+0000","scrub_duration":0.080496158999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39692,"num_write_kb":608525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"29'12","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.916968+0000","last_change":"2022-08-10T17:56:04.916940+0000","last_active":"2022-08-10T17:56:04.916968+0000","last_peered":"2022-08-10T17:56:04.916968+0000","last_clean":"2022-08-10T17:56:04.916968+0000","last_became_active":"2022-08-10T17:35:37.029864+0000","last_became_peered":"2022-08-10T17:35:37.029864+0000","last_unstale":"2022-08-10T17:56:04.916968+0000","last_undegraded":"2022-08-10T17:56:04.916968+0000","last_fullsized":"2022-08-10T17:56:04.916968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2022-08-10T17:56:04.916856+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.916856+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:31:33.074691+0000","scrub_duration":0.028362951000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5559,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":6,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'34","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.330599+0000","last_change":"2022-08-10T17:55:23.330567+0000","last_active":"2022-08-10T17:55:23.330599+0000","last_peered":"2022-08-10T17:55:23.330599+0000","last_clean":"2022-08-10T17:55:23.330599+0000","last_became_active":"2022-08-10T17:35:37.417612+0000","last_became_peered":"2022-08-10T17:35:37.417612+0000","last_unstale":"2022-08-10T17:55:23.330599+0000","last_undegraded":"2022-08-10T17:55:23.330599+0000","last_fullsized":"2022-08-10T17:55:23.330599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2022-08-10T17:55:23.330462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.330462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:10:32.984049+0000","scrub_duration":0.024365404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'4694","reported_seq":4722,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.922506+0000","last_change":"2022-08-10T17:55:50.922445+0000","last_active":"2022-08-10T17:55:50.922506+0000","last_peered":"2022-08-10T17:55:50.922506+0000","last_clean":"2022-08-10T17:55:50.922506+0000","last_became_active":"2022-08-10T17:35:41.436531+0000","last_became_peered":"2022-08-10T17:35:41.436531+0000","last_unstale":"2022-08-10T17:55:50.922506+0000","last_undegraded":"2022-08-10T17:55:50.922506+0000","last_fullsized":"2022-08-10T17:55:50.922506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4694","last_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_deep_scrub":"29'4694","last_deep_scrub_stamp":"2022-08-10T17:55:50.922264+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.922264+0000","objects_scrubbed":0,"log_size":4694,"log_dups_size":0,"ondisk_log_size":4694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:24:16.270656+0000","scrub_duration":0.059697769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39058,"num_write_kb":606873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"29'14","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.422498+0000","last_change":"2022-08-10T17:55:33.422452+0000","last_active":"2022-08-10T17:55:33.422498+0000","last_peered":"2022-08-10T17:55:33.422498+0000","last_clean":"2022-08-10T17:55:33.422498+0000","last_became_active":"2022-08-10T17:35:37.025970+0000","last_became_peered":"2022-08-10T17:35:37.025970+0000","last_unstale":"2022-08-10T17:55:33.422498+0000","last_undegraded":"2022-08-10T17:55:33.422498+0000","last_fullsized":"2022-08-10T17:55:33.422498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2022-08-10T17:55:33.422315+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.422315+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:46:27.773536+0000","scrub_duration":0.019140213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5014,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":12,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.009599+0000","last_change":"2022-08-10T17:55:27.009577+0000","last_active":"2022-08-10T17:55:27.009599+0000","last_peered":"2022-08-10T17:55:27.009599+0000","last_clean":"2022-08-10T17:55:27.009599+0000","last_became_active":"2022-08-10T17:35:37.413203+0000","last_became_peered":"2022-08-10T17:35:37.413203+0000","last_unstale":"2022-08-10T17:55:27.009599+0000","last_undegraded":"2022-08-10T17:55:27.009599+0000","last_fullsized":"2022-08-10T17:55:27.009599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2022-08-10T17:55:27.009500+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.009500+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:15:21.317429+0000","scrub_duration":0.0035028260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'4354","reported_seq":4382,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:04.018283+0000","last_change":"2022-08-10T17:56:04.018232+0000","last_active":"2022-08-10T17:56:04.018283+0000","last_peered":"2022-08-10T17:56:04.018283+0000","last_clean":"2022-08-10T17:56:04.018283+0000","last_became_active":"2022-08-10T17:35:41.436230+0000","last_became_peered":"2022-08-10T17:35:41.436230+0000","last_unstale":"2022-08-10T17:56:04.018283+0000","last_undegraded":"2022-08-10T17:56:04.018283+0000","last_fullsized":"2022-08-10T17:56:04.018283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4354","last_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_deep_scrub":"29'4354","last_deep_scrub_stamp":"2022-08-10T17:56:04.018007+0000","last_clean_scrub_stamp":"2022-08-10T17:56:04.018007+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:33:06.740237+0000","scrub_duration":0.053114884000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35760,"num_write_kb":552507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.272824+0000","last_change":"2022-08-10T17:55:34.272805+0000","last_active":"2022-08-10T17:55:34.272824+0000","last_peered":"2022-08-10T17:55:34.272824+0000","last_clean":"2022-08-10T17:55:34.272824+0000","last_became_active":"2022-08-10T17:35:37.024568+0000","last_became_peered":"2022-08-10T17:35:37.024568+0000","last_unstale":"2022-08-10T17:55:34.272824+0000","last_undegraded":"2022-08-10T17:55:34.272824+0000","last_fullsized":"2022-08-10T17:55:34.272824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2022-08-10T17:55:34.272714+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.272714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:36.483574+0000","scrub_duration":0.0034525319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.957655+0000","last_change":"2022-08-10T17:55:29.957632+0000","last_active":"2022-08-10T17:55:29.957655+0000","last_peered":"2022-08-10T17:55:29.957655+0000","last_clean":"2022-08-10T17:55:29.957655+0000","last_became_active":"2022-08-10T17:35:37.412491+0000","last_became_peered":"2022-08-10T17:35:37.412491+0000","last_unstale":"2022-08-10T17:55:29.957655+0000","last_undegraded":"2022-08-10T17:55:29.957655+0000","last_fullsized":"2022-08-10T17:55:29.957655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:29.957536+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.957536+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:43:07.254608+0000","scrub_duration":0.062576358999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'3589","reported_seq":3617,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.969865+0000","last_change":"2022-08-10T17:55:48.969826+0000","last_active":"2022-08-10T17:55:48.969865+0000","last_peered":"2022-08-10T17:55:48.969865+0000","last_clean":"2022-08-10T17:55:48.969865+0000","last_became_active":"2022-08-10T17:35:41.435789+0000","last_became_peered":"2022-08-10T17:35:41.435789+0000","last_unstale":"2022-08-10T17:55:48.969865+0000","last_undegraded":"2022-08-10T17:55:48.969865+0000","last_fullsized":"2022-08-10T17:55:48.969865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3589","last_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_deep_scrub":"29'3589","last_deep_scrub_stamp":"2022-08-10T17:55:48.969722+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.969722+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:32:16.418208+0000","scrub_duration":0.065700320000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36251,"num_write_kb":558074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'64","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.093868+0000","last_change":"2022-08-10T17:55:35.093847+0000","last_active":"2022-08-10T17:55:35.093868+0000","last_peered":"2022-08-10T17:55:35.093868+0000","last_clean":"2022-08-10T17:55:35.093868+0000","last_became_active":"2022-08-10T17:35:37.025647+0000","last_became_peered":"2022-08-10T17:35:37.025647+0000","last_unstale":"2022-08-10T17:55:35.093868+0000","last_undegraded":"2022-08-10T17:55:35.093868+0000","last_fullsized":"2022-08-10T17:55:35.093868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2022-08-10T17:55:35.093760+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.093760+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:13:33.865196+0000","scrub_duration":0.016913436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'20","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.402892+0000","last_change":"2022-08-10T17:56:14.402871+0000","last_active":"2022-08-10T17:56:14.402892+0000","last_peered":"2022-08-10T17:56:14.402892+0000","last_clean":"2022-08-10T17:56:14.402892+0000","last_became_active":"2022-08-10T17:35:37.414931+0000","last_became_peered":"2022-08-10T17:35:37.414931+0000","last_unstale":"2022-08-10T17:56:14.402892+0000","last_undegraded":"2022-08-10T17:56:14.402892+0000","last_fullsized":"2022-08-10T17:56:14.402892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2022-08-10T17:56:14.402390+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.402390+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:09:25.065766+0000","scrub_duration":0.0035523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'4158","reported_seq":4186,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.393911+0000","last_change":"2022-08-10T17:56:14.393872+0000","last_active":"2022-08-10T17:56:14.393911+0000","last_peered":"2022-08-10T17:56:14.393911+0000","last_clean":"2022-08-10T17:56:14.393911+0000","last_became_active":"2022-08-10T17:35:41.443075+0000","last_became_peered":"2022-08-10T17:35:41.443075+0000","last_unstale":"2022-08-10T17:56:14.393911+0000","last_undegraded":"2022-08-10T17:56:14.393911+0000","last_fullsized":"2022-08-10T17:56:14.393911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4158","last_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_deep_scrub":"29'4158","last_deep_scrub_stamp":"2022-08-10T17:56:14.393769+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.393769+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:25:17.353898+0000","scrub_duration":0.067364295000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39451,"num_write_kb":602688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.119148+0000","last_change":"2022-08-10T17:55:32.119128+0000","last_active":"2022-08-10T17:55:32.119148+0000","last_peered":"2022-08-10T17:55:32.119148+0000","last_clean":"2022-08-10T17:55:32.119148+0000","last_became_active":"2022-08-10T17:35:37.022639+0000","last_became_peered":"2022-08-10T17:35:37.022639+0000","last_unstale":"2022-08-10T17:55:32.119148+0000","last_undegraded":"2022-08-10T17:55:32.119148+0000","last_fullsized":"2022-08-10T17:55:32.119148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:32.119046+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.119046+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:52:27.377502+0000","scrub_duration":0.015219678,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.405585+0000","last_change":"2022-08-10T17:55:30.405562+0000","last_active":"2022-08-10T17:55:30.405585+0000","last_peered":"2022-08-10T17:55:30.405585+0000","last_clean":"2022-08-10T17:55:30.405585+0000","last_became_active":"2022-08-10T17:35:37.413914+0000","last_became_peered":"2022-08-10T17:35:37.413914+0000","last_unstale":"2022-08-10T17:55:30.405585+0000","last_undegraded":"2022-08-10T17:55:30.405585+0000","last_fullsized":"2022-08-10T17:55:30.405585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:30.405460+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.405460+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:57:23.895561+0000","scrub_duration":0.024012329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'5925","reported_seq":5953,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.454025+0000","last_change":"2022-08-10T17:56:06.453970+0000","last_active":"2022-08-10T17:56:06.454025+0000","last_peered":"2022-08-10T17:56:06.454025+0000","last_clean":"2022-08-10T17:56:06.454025+0000","last_became_active":"2022-08-10T17:35:41.438285+0000","last_became_peered":"2022-08-10T17:35:41.438285+0000","last_unstale":"2022-08-10T17:56:06.454025+0000","last_undegraded":"2022-08-10T17:56:06.454025+0000","last_fullsized":"2022-08-10T17:56:06.454025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5925","last_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_deep_scrub":"29'5925","last_deep_scrub_stamp":"2022-08-10T17:56:06.453813+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.453813+0000","objects_scrubbed":0,"log_size":5925,"log_dups_size":0,"ondisk_log_size":5925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:04:53.609822+0000","scrub_duration":0.069290974000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45103,"num_write_kb":683771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'24","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.079797+0000","last_change":"2022-08-10T17:55:27.079775+0000","last_active":"2022-08-10T17:55:27.079797+0000","last_peered":"2022-08-10T17:55:27.079797+0000","last_clean":"2022-08-10T17:55:27.079797+0000","last_became_active":"2022-08-10T17:35:37.025189+0000","last_became_peered":"2022-08-10T17:35:37.025189+0000","last_unstale":"2022-08-10T17:55:27.079797+0000","last_undegraded":"2022-08-10T17:55:27.079797+0000","last_fullsized":"2022-08-10T17:55:27.079797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:27.079689+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.079689+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:16:30.544031+0000","scrub_duration":0.026671822000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.370196+0000","last_change":"2022-08-10T17:55:42.370175+0000","last_active":"2022-08-10T17:55:42.370196+0000","last_peered":"2022-08-10T17:55:42.370196+0000","last_clean":"2022-08-10T17:55:42.370196+0000","last_became_active":"2022-08-10T17:35:37.417535+0000","last_became_peered":"2022-08-10T17:35:37.417535+0000","last_unstale":"2022-08-10T17:55:42.370196+0000","last_undegraded":"2022-08-10T17:55:42.370196+0000","last_fullsized":"2022-08-10T17:55:42.370196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:42.370067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.370067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:10.161792+0000","scrub_duration":0.020699707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'4185","reported_seq":4213,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:51.434262+0000","last_change":"2022-08-10T17:55:51.434220+0000","last_active":"2022-08-10T17:55:51.434262+0000","last_peered":"2022-08-10T17:55:51.434262+0000","last_clean":"2022-08-10T17:55:51.434262+0000","last_became_active":"2022-08-10T17:35:41.437777+0000","last_became_peered":"2022-08-10T17:35:41.437777+0000","last_unstale":"2022-08-10T17:55:51.434262+0000","last_undegraded":"2022-08-10T17:55:51.434262+0000","last_fullsized":"2022-08-10T17:55:51.434262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4185","last_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_deep_scrub":"29'4185","last_deep_scrub_stamp":"2022-08-10T17:55:51.434118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:51.434118+0000","objects_scrubbed":0,"log_size":4185,"log_dups_size":0,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:56:18.697580+0000","scrub_duration":0.064411632999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39868,"num_write_kb":620958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'311","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.991208+0000","last_change":"2022-08-10T17:56:09.991174+0000","last_active":"2022-08-10T17:56:09.991208+0000","last_peered":"2022-08-10T17:56:09.991208+0000","last_clean":"2022-08-10T17:56:09.991208+0000","last_became_active":"2022-08-10T17:35:37.028150+0000","last_became_peered":"2022-08-10T17:35:37.028150+0000","last_unstale":"2022-08-10T17:56:09.991208+0000","last_undegraded":"2022-08-10T17:56:09.991208+0000","last_fullsized":"2022-08-10T17:56:09.991208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'311","last_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_deep_scrub":"29'311","last_deep_scrub_stamp":"2022-08-10T17:56:09.991082+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.991082+0000","objects_scrubbed":5,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:28:46.755600+0000","scrub_duration":0.032474404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194960,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:14.015442+0000","last_change":"2022-08-10T17:56:14.015416+0000","last_active":"2022-08-10T17:56:14.015442+0000","last_peered":"2022-08-10T17:56:14.015442+0000","last_clean":"2022-08-10T17:56:14.015442+0000","last_became_active":"2022-08-10T17:35:37.416387+0000","last_became_peered":"2022-08-10T17:35:37.416387+0000","last_unstale":"2022-08-10T17:56:14.015442+0000","last_undegraded":"2022-08-10T17:56:14.015442+0000","last_fullsized":"2022-08-10T17:56:14.015442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2022-08-10T17:56:14.015311+0000","last_clean_scrub_stamp":"2022-08-10T17:56:14.015311+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:03:48.477000+0000","scrub_duration":0.027149287000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'5804","reported_seq":5832,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.170504+0000","last_change":"2022-08-10T17:56:06.170447+0000","last_active":"2022-08-10T17:56:06.170504+0000","last_peered":"2022-08-10T17:56:06.170504+0000","last_clean":"2022-08-10T17:56:06.170504+0000","last_became_active":"2022-08-10T17:35:41.439125+0000","last_became_peered":"2022-08-10T17:35:41.439125+0000","last_unstale":"2022-08-10T17:56:06.170504+0000","last_undegraded":"2022-08-10T17:56:06.170504+0000","last_fullsized":"2022-08-10T17:56:06.170504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5804","last_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_deep_scrub":"29'5804","last_deep_scrub_stamp":"2022-08-10T17:56:06.170268+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.170268+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:02:33.838572+0000","scrub_duration":0.064557167999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42464,"num_write_kb":643713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:52.153823+0000","last_change":"2022-08-10T17:55:52.153800+0000","last_active":"2022-08-10T17:55:52.153823+0000","last_peered":"2022-08-10T17:55:52.153823+0000","last_clean":"2022-08-10T17:55:52.153823+0000","last_became_active":"2022-08-10T17:35:37.030341+0000","last_became_peered":"2022-08-10T17:35:37.030341+0000","last_unstale":"2022-08-10T17:55:52.153823+0000","last_undegraded":"2022-08-10T17:55:52.153823+0000","last_fullsized":"2022-08-10T17:55:52.153823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:52.153704+0000","last_clean_scrub_stamp":"2022-08-10T17:55:52.153704+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:54:56.375867+0000","scrub_duration":0.019208741000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:25.358355+0000","last_change":"2022-08-10T17:55:25.358323+0000","last_active":"2022-08-10T17:55:25.358355+0000","last_peered":"2022-08-10T17:55:25.358355+0000","last_clean":"2022-08-10T17:55:25.358355+0000","last_became_active":"2022-08-10T17:35:37.415663+0000","last_became_peered":"2022-08-10T17:35:37.415663+0000","last_unstale":"2022-08-10T17:55:25.358355+0000","last_undegraded":"2022-08-10T17:55:25.358355+0000","last_fullsized":"2022-08-10T17:55:25.358355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:25.358222+0000","last_clean_scrub_stamp":"2022-08-10T17:55:25.358222+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:32:47.761238+0000","scrub_duration":0.024137542000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'4258","reported_seq":4286,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:00.464274+0000","last_change":"2022-08-10T17:56:00.464222+0000","last_active":"2022-08-10T17:56:00.464274+0000","last_peered":"2022-08-10T17:56:00.464274+0000","last_clean":"2022-08-10T17:56:00.464274+0000","last_became_active":"2022-08-10T17:35:41.438035+0000","last_became_peered":"2022-08-10T17:35:41.438035+0000","last_unstale":"2022-08-10T17:56:00.464274+0000","last_undegraded":"2022-08-10T17:56:00.464274+0000","last_fullsized":"2022-08-10T17:56:00.464274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4258","last_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_deep_scrub":"29'4258","last_deep_scrub_stamp":"2022-08-10T17:56:00.464107+0000","last_clean_scrub_stamp":"2022-08-10T17:56:00.464107+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:55:24.422676+0000","scrub_duration":0.051924405999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38468,"num_write_kb":594325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.061351+0000","last_change":"2022-08-10T17:55:38.061316+0000","last_active":"2022-08-10T17:55:38.061351+0000","last_peered":"2022-08-10T17:55:38.061351+0000","last_clean":"2022-08-10T17:55:38.061351+0000","last_became_active":"2022-08-10T17:35:37.025400+0000","last_became_peered":"2022-08-10T17:35:37.025400+0000","last_unstale":"2022-08-10T17:55:38.061351+0000","last_undegraded":"2022-08-10T17:55:38.061351+0000","last_fullsized":"2022-08-10T17:55:38.061351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:38.061144+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.061144+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:50.451261+0000","scrub_duration":0.016751453999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'26","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.108842+0000","last_change":"2022-08-10T17:55:26.108788+0000","last_active":"2022-08-10T17:55:26.108842+0000","last_peered":"2022-08-10T17:55:26.108842+0000","last_clean":"2022-08-10T17:55:26.108842+0000","last_became_active":"2022-08-10T17:35:37.413082+0000","last_became_peered":"2022-08-10T17:35:37.413082+0000","last_unstale":"2022-08-10T17:55:26.108842+0000","last_undegraded":"2022-08-10T17:55:26.108842+0000","last_fullsized":"2022-08-10T17:55:26.108842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:26.108605+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.108605+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:10:35.922613+0000","scrub_duration":0.021195411000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'4367","reported_seq":4395,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:58.442683+0000","last_change":"2022-08-10T17:55:58.442647+0000","last_active":"2022-08-10T17:55:58.442683+0000","last_peered":"2022-08-10T17:55:58.442683+0000","last_clean":"2022-08-10T17:55:58.442683+0000","last_became_active":"2022-08-10T17:35:41.442053+0000","last_became_peered":"2022-08-10T17:35:41.442053+0000","last_unstale":"2022-08-10T17:55:58.442683+0000","last_undegraded":"2022-08-10T17:55:58.442683+0000","last_fullsized":"2022-08-10T17:55:58.442683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4367","last_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_deep_scrub":"29'4367","last_deep_scrub_stamp":"2022-08-10T17:55:58.442543+0000","last_clean_scrub_stamp":"2022-08-10T17:55:58.442543+0000","objects_scrubbed":0,"log_size":4367,"log_dups_size":0,"ondisk_log_size":4367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:41:05.524327+0000","scrub_duration":0.060906218999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39742,"num_write_kb":615080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'304","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.097085+0000","last_change":"2022-08-10T17:55:49.097051+0000","last_active":"2022-08-10T17:55:49.097085+0000","last_peered":"2022-08-10T17:55:49.097085+0000","last_clean":"2022-08-10T17:55:49.097085+0000","last_became_active":"2022-08-10T17:35:37.030239+0000","last_became_peered":"2022-08-10T17:35:37.030239+0000","last_unstale":"2022-08-10T17:55:49.097085+0000","last_undegraded":"2022-08-10T17:55:49.097085+0000","last_fullsized":"2022-08-10T17:55:49.097085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'304","last_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_deep_scrub":"29'304","last_deep_scrub_stamp":"2022-08-10T17:55:49.096942+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.096942+0000","objects_scrubbed":2,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:12:27.209788+0000","scrub_duration":0.031557822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1741878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'30","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:13.045594+0000","last_change":"2022-08-10T17:56:13.045573+0000","last_active":"2022-08-10T17:56:13.045594+0000","last_peered":"2022-08-10T17:56:13.045594+0000","last_clean":"2022-08-10T17:56:13.045594+0000","last_became_active":"2022-08-10T17:35:37.415076+0000","last_became_peered":"2022-08-10T17:35:37.415076+0000","last_unstale":"2022-08-10T17:56:13.045594+0000","last_undegraded":"2022-08-10T17:56:13.045594+0000","last_fullsized":"2022-08-10T17:56:13.045594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:56:13.045497+0000","last_clean_scrub_stamp":"2022-08-10T17:56:13.045497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:43:07.934183+0000","scrub_duration":0.0034909870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'4906","reported_seq":4934,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:57.103904+0000","last_change":"2022-08-10T17:55:57.103864+0000","last_active":"2022-08-10T17:55:57.103904+0000","last_peered":"2022-08-10T17:55:57.103904+0000","last_clean":"2022-08-10T17:55:57.103904+0000","last_became_active":"2022-08-10T17:35:41.433110+0000","last_became_peered":"2022-08-10T17:35:41.433110+0000","last_unstale":"2022-08-10T17:55:57.103904+0000","last_undegraded":"2022-08-10T17:55:57.103904+0000","last_fullsized":"2022-08-10T17:55:57.103904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4906","last_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_deep_scrub":"29'4906","last_deep_scrub_stamp":"2022-08-10T17:55:57.103765+0000","last_clean_scrub_stamp":"2022-08-10T17:55:57.103765+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:30:44.540506+0000","scrub_duration":0.064568445000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43663,"num_write_kb":653672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.924288+0000","last_change":"2022-08-10T17:55:24.924251+0000","last_active":"2022-08-10T17:55:24.924288+0000","last_peered":"2022-08-10T17:55:24.924288+0000","last_clean":"2022-08-10T17:55:24.924288+0000","last_became_active":"2022-08-10T17:35:37.028955+0000","last_became_peered":"2022-08-10T17:35:37.028955+0000","last_unstale":"2022-08-10T17:55:24.924288+0000","last_undegraded":"2022-08-10T17:55:24.924288+0000","last_fullsized":"2022-08-10T17:55:24.924288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:24.924118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.924118+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:55:21.923386+0000","scrub_duration":0.021377028999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.408869+0000","last_change":"2022-08-10T17:55:27.408845+0000","last_active":"2022-08-10T17:55:27.408869+0000","last_peered":"2022-08-10T17:55:27.408869+0000","last_clean":"2022-08-10T17:55:27.408869+0000","last_became_active":"2022-08-10T17:35:37.409615+0000","last_became_peered":"2022-08-10T17:35:37.409615+0000","last_unstale":"2022-08-10T17:55:27.408869+0000","last_undegraded":"2022-08-10T17:55:27.408869+0000","last_fullsized":"2022-08-10T17:55:27.408869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:55:27.408747+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.408747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:14:38.533949+0000","scrub_duration":0.040517141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'5293","reported_seq":5321,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:21.401868+0000","last_change":"2022-08-10T17:56:21.401826+0000","last_active":"2022-08-10T17:56:21.401868+0000","last_peered":"2022-08-10T17:56:21.401868+0000","last_clean":"2022-08-10T17:56:21.401868+0000","last_became_active":"2022-08-10T17:35:41.436413+0000","last_became_peered":"2022-08-10T17:35:41.436413+0000","last_unstale":"2022-08-10T17:56:21.401868+0000","last_undegraded":"2022-08-10T17:56:21.401868+0000","last_fullsized":"2022-08-10T17:56:21.401868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5293","last_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_deep_scrub":"29'5293","last_deep_scrub_stamp":"2022-08-10T17:56:21.401724+0000","last_clean_scrub_stamp":"2022-08-10T17:56:21.401724+0000","objects_scrubbed":0,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T17:57:42.790520+0000","scrub_duration":0.061559711000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38506,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:56.225847+0000","last_change":"2022-08-10T17:55:56.225825+0000","last_active":"2022-08-10T17:55:56.225847+0000","last_peered":"2022-08-10T17:55:56.225847+0000","last_clean":"2022-08-10T17:55:56.225847+0000","last_became_active":"2022-08-10T17:35:37.030627+0000","last_became_peered":"2022-08-10T17:35:37.030627+0000","last_unstale":"2022-08-10T17:55:56.225847+0000","last_undegraded":"2022-08-10T17:55:56.225847+0000","last_fullsized":"2022-08-10T17:55:56.225847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2022-08-10T17:55:56.225734+0000","last_clean_scrub_stamp":"2022-08-10T17:55:56.225734+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:51:48.013865+0000","scrub_duration":0.032000617000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.160168+0000","last_change":"2022-08-10T17:55:37.160149+0000","last_active":"2022-08-10T17:55:37.160168+0000","last_peered":"2022-08-10T17:55:37.160168+0000","last_clean":"2022-08-10T17:55:37.160168+0000","last_became_active":"2022-08-10T17:35:37.409655+0000","last_became_peered":"2022-08-10T17:35:37.409655+0000","last_unstale":"2022-08-10T17:55:37.160168+0000","last_undegraded":"2022-08-10T17:55:37.160168+0000","last_fullsized":"2022-08-10T17:55:37.160168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:37.160075+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.160075+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:27:20.436089+0000","scrub_duration":0.0034772340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'4353","reported_seq":4381,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.648371+0000","last_change":"2022-08-10T17:55:30.648315+0000","last_active":"2022-08-10T17:55:30.648371+0000","last_peered":"2022-08-10T17:55:30.648371+0000","last_clean":"2022-08-10T17:55:30.648371+0000","last_became_active":"2022-08-10T17:35:41.443725+0000","last_became_peered":"2022-08-10T17:35:41.443725+0000","last_unstale":"2022-08-10T17:55:30.648371+0000","last_undegraded":"2022-08-10T17:55:30.648371+0000","last_fullsized":"2022-08-10T17:55:30.648371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4353","last_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_deep_scrub":"29'4353","last_deep_scrub_stamp":"2022-08-10T17:55:30.648133+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.648133+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:10.184933+0000","scrub_duration":0.067302737000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34185,"num_write_kb":537386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.138559+0000","last_change":"2022-08-10T17:55:43.138538+0000","last_active":"2022-08-10T17:55:43.138559+0000","last_peered":"2022-08-10T17:55:43.138559+0000","last_clean":"2022-08-10T17:55:43.138559+0000","last_became_active":"2022-08-10T17:35:37.030522+0000","last_became_peered":"2022-08-10T17:35:37.030522+0000","last_unstale":"2022-08-10T17:55:43.138559+0000","last_undegraded":"2022-08-10T17:55:43.138559+0000","last_fullsized":"2022-08-10T17:55:43.138559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:43.138462+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.138462+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:09:40.531685+0000","scrub_duration":0.013263829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:20.069863+0000","last_change":"2022-08-10T17:56:20.069841+0000","last_active":"2022-08-10T17:56:20.069863+0000","last_peered":"2022-08-10T17:56:20.069863+0000","last_clean":"2022-08-10T17:56:20.069863+0000","last_became_active":"2022-08-10T17:35:37.410847+0000","last_became_peered":"2022-08-10T17:35:37.410847+0000","last_unstale":"2022-08-10T17:56:20.069863+0000","last_undegraded":"2022-08-10T17:56:20.069863+0000","last_fullsized":"2022-08-10T17:56:20.069863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:56:20.069759+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:56:20.069759+0000","last_clean_scrub_stamp":"2022-08-10T17:56:20.069759+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:15:39.795192+0000","scrub_duration":0.003559544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'4681","reported_seq":4709,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.577615+0000","last_change":"2022-08-10T17:55:33.577580+0000","last_active":"2022-08-10T17:55:33.577615+0000","last_peered":"2022-08-10T17:55:33.577615+0000","last_clean":"2022-08-10T17:55:33.577615+0000","last_became_active":"2022-08-10T17:35:41.444898+0000","last_became_peered":"2022-08-10T17:35:41.444898+0000","last_unstale":"2022-08-10T17:55:33.577615+0000","last_undegraded":"2022-08-10T17:55:33.577615+0000","last_fullsized":"2022-08-10T17:55:33.577615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4681","last_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_deep_scrub":"29'4681","last_deep_scrub_stamp":"2022-08-10T17:55:33.577468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.577468+0000","objects_scrubbed":0,"log_size":4681,"log_dups_size":0,"ondisk_log_size":4681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:50:41.930237+0000","scrub_duration":0.053293471000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44983,"num_write_kb":702520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:40.114580+0000","last_change":"2022-08-10T17:55:40.114552+0000","last_active":"2022-08-10T17:55:40.114580+0000","last_peered":"2022-08-10T17:55:40.114580+0000","last_clean":"2022-08-10T17:55:40.114580+0000","last_became_active":"2022-08-10T17:35:37.022518+0000","last_became_peered":"2022-08-10T17:35:37.022518+0000","last_unstale":"2022-08-10T17:55:40.114580+0000","last_undegraded":"2022-08-10T17:55:40.114580+0000","last_fullsized":"2022-08-10T17:55:40.114580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:40.114468+0000","last_clean_scrub_stamp":"2022-08-10T17:55:40.114468+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:53:37.748882+0000","scrub_duration":0.013616628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'24","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.818264+0000","last_change":"2022-08-10T17:55:39.818234+0000","last_active":"2022-08-10T17:55:39.818264+0000","last_peered":"2022-08-10T17:55:39.818264+0000","last_clean":"2022-08-10T17:55:39.818264+0000","last_became_active":"2022-08-10T17:35:37.415835+0000","last_became_peered":"2022-08-10T17:35:37.415835+0000","last_unstale":"2022-08-10T17:55:39.818264+0000","last_undegraded":"2022-08-10T17:55:39.818264+0000","last_fullsized":"2022-08-10T17:55:39.818264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:39.818135+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.818135+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:31:58.229281+0000","scrub_duration":0.027795573000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'3805","reported_seq":3833,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.499543+0000","last_change":"2022-08-10T17:55:38.499484+0000","last_active":"2022-08-10T17:55:38.499543+0000","last_peered":"2022-08-10T17:55:38.499543+0000","last_clean":"2022-08-10T17:55:38.499543+0000","last_became_active":"2022-08-10T17:35:41.432925+0000","last_became_peered":"2022-08-10T17:35:41.432925+0000","last_unstale":"2022-08-10T17:55:38.499543+0000","last_undegraded":"2022-08-10T17:55:38.499543+0000","last_fullsized":"2022-08-10T17:55:38.499543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3805","last_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_deep_scrub":"29'3805","last_deep_scrub_stamp":"2022-08-10T17:55:38.499317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.499317+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:59:44.072729+0000","scrub_duration":0.056492191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":505638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:30.078050+0000","last_change":"2022-08-10T17:55:30.078020+0000","last_active":"2022-08-10T17:55:30.078050+0000","last_peered":"2022-08-10T17:55:30.078050+0000","last_clean":"2022-08-10T17:55:30.078050+0000","last_became_active":"2022-08-10T17:35:37.023241+0000","last_became_peered":"2022-08-10T17:35:37.023241+0000","last_unstale":"2022-08-10T17:55:30.078050+0000","last_undegraded":"2022-08-10T17:55:30.078050+0000","last_fullsized":"2022-08-10T17:55:30.078050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2022-08-10T17:55:30.077894+0000","last_clean_scrub_stamp":"2022-08-10T17:55:30.077894+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:28:33.679903+0000","scrub_duration":0.022499880999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.975371+0000","last_change":"2022-08-10T17:56:02.975349+0000","last_active":"2022-08-10T17:56:02.975371+0000","last_peered":"2022-08-10T17:56:02.975371+0000","last_clean":"2022-08-10T17:56:02.975371+0000","last_became_active":"2022-08-10T17:35:37.410056+0000","last_became_peered":"2022-08-10T17:35:37.410056+0000","last_unstale":"2022-08-10T17:56:02.975371+0000","last_undegraded":"2022-08-10T17:56:02.975371+0000","last_fullsized":"2022-08-10T17:56:02.975371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:56:02.975245+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.975245+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:29:34.658380+0000","scrub_duration":0.0086057479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'3279","reported_seq":3307,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.617813+0000","last_change":"2022-08-10T17:55:32.617770+0000","last_active":"2022-08-10T17:55:32.617813+0000","last_peered":"2022-08-10T17:55:32.617813+0000","last_clean":"2022-08-10T17:55:32.617813+0000","last_became_active":"2022-08-10T17:35:41.430231+0000","last_became_peered":"2022-08-10T17:35:41.430231+0000","last_unstale":"2022-08-10T17:55:32.617813+0000","last_undegraded":"2022-08-10T17:55:32.617813+0000","last_fullsized":"2022-08-10T17:55:32.617813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3279","last_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_deep_scrub":"29'3279","last_deep_scrub_stamp":"2022-08-10T17:55:32.617666+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.617666+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:55:16.394063+0000","scrub_duration":0.060262404999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33288,"num_write_kb":515901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'335","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.385035+0000","last_change":"2022-08-10T17:55:39.385014+0000","last_active":"2022-08-10T17:55:39.385035+0000","last_peered":"2022-08-10T17:55:39.385035+0000","last_clean":"2022-08-10T17:55:39.385035+0000","last_became_active":"2022-08-10T17:35:37.027144+0000","last_became_peered":"2022-08-10T17:35:37.027144+0000","last_unstale":"2022-08-10T17:55:39.385035+0000","last_undegraded":"2022-08-10T17:55:39.385035+0000","last_fullsized":"2022-08-10T17:55:39.385035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'335","last_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_deep_scrub":"29'335","last_deep_scrub_stamp":"2022-08-10T17:55:39.384919+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.384919+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:34:51.492681+0000","scrub_duration":0.038040591999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655817,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:48.819713+0000","last_change":"2022-08-10T17:55:48.819683+0000","last_active":"2022-08-10T17:55:48.819713+0000","last_peered":"2022-08-10T17:55:48.819713+0000","last_clean":"2022-08-10T17:55:48.819713+0000","last_became_active":"2022-08-10T17:35:37.408233+0000","last_became_peered":"2022-08-10T17:35:37.408233+0000","last_unstale":"2022-08-10T17:55:48.819713+0000","last_undegraded":"2022-08-10T17:55:48.819713+0000","last_fullsized":"2022-08-10T17:55:48.819713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:48.819544+0000","last_clean_scrub_stamp":"2022-08-10T17:55:48.819544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:07:54.609189+0000","scrub_duration":0.014561592999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'5047","reported_seq":5075,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.420110+0000","last_change":"2022-08-10T17:55:54.420077+0000","last_active":"2022-08-10T17:55:54.420110+0000","last_peered":"2022-08-10T17:55:54.420110+0000","last_clean":"2022-08-10T17:55:54.420110+0000","last_became_active":"2022-08-10T17:35:41.442606+0000","last_became_peered":"2022-08-10T17:35:41.442606+0000","last_unstale":"2022-08-10T17:55:54.420110+0000","last_undegraded":"2022-08-10T17:55:54.420110+0000","last_fullsized":"2022-08-10T17:55:54.420110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5047","last_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_deep_scrub":"29'5047","last_deep_scrub_stamp":"2022-08-10T17:55:54.419972+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.419972+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:37:40.479531+0000","scrub_duration":0.067399972000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37175,"num_write_kb":590549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'56","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.906120+0000","last_change":"2022-08-10T17:55:26.906097+0000","last_active":"2022-08-10T17:55:26.906120+0000","last_peered":"2022-08-10T17:55:26.906120+0000","last_clean":"2022-08-10T17:55:26.906120+0000","last_became_active":"2022-08-10T17:35:37.028120+0000","last_became_peered":"2022-08-10T17:35:37.028120+0000","last_unstale":"2022-08-10T17:55:26.906120+0000","last_undegraded":"2022-08-10T17:55:26.906120+0000","last_fullsized":"2022-08-10T17:55:26.906120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2022-08-10T17:55:26.906012+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.906012+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:10:01.182562+0000","scrub_duration":0.014215698000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.925293+0000","last_change":"2022-08-10T17:55:55.925273+0000","last_active":"2022-08-10T17:55:55.925293+0000","last_peered":"2022-08-10T17:55:55.925293+0000","last_clean":"2022-08-10T17:55:55.925293+0000","last_became_active":"2022-08-10T17:35:37.408461+0000","last_became_peered":"2022-08-10T17:35:37.408461+0000","last_unstale":"2022-08-10T17:55:55.925293+0000","last_undegraded":"2022-08-10T17:55:55.925293+0000","last_fullsized":"2022-08-10T17:55:55.925293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:55:55.925196+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.925196+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:09:07.952289+0000","scrub_duration":0.0034809820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'6340","reported_seq":6368,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:02.166064+0000","last_change":"2022-08-10T17:56:02.166028+0000","last_active":"2022-08-10T17:56:02.166064+0000","last_peered":"2022-08-10T17:56:02.166064+0000","last_clean":"2022-08-10T17:56:02.166064+0000","last_became_active":"2022-08-10T17:35:41.433433+0000","last_became_peered":"2022-08-10T17:35:41.433433+0000","last_unstale":"2022-08-10T17:56:02.166064+0000","last_undegraded":"2022-08-10T17:56:02.166064+0000","last_fullsized":"2022-08-10T17:56:02.166064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6340","last_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_deep_scrub":"29'6340","last_deep_scrub_stamp":"2022-08-10T17:56:02.165927+0000","last_clean_scrub_stamp":"2022-08-10T17:56:02.165927+0000","objects_scrubbed":0,"log_size":6340,"log_dups_size":0,"ondisk_log_size":6340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:20:27.862013+0000","scrub_duration":0.078968956000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45553,"num_write_kb":689438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:11.948296+0000","last_change":"2022-08-10T17:56:11.948274+0000","last_active":"2022-08-10T17:56:11.948296+0000","last_peered":"2022-08-10T17:56:11.948296+0000","last_clean":"2022-08-10T17:56:11.948296+0000","last_became_active":"2022-08-10T17:35:37.024053+0000","last_became_peered":"2022-08-10T17:35:37.024053+0000","last_unstale":"2022-08-10T17:56:11.948296+0000","last_undegraded":"2022-08-10T17:56:11.948296+0000","last_fullsized":"2022-08-10T17:56:11.948296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:11.948176+0000","last_clean_scrub_stamp":"2022-08-10T17:56:11.948176+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:26:18.020901+0000","scrub_duration":0.01701418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:03.912780+0000","last_change":"2022-08-10T17:56:03.912759+0000","last_active":"2022-08-10T17:56:03.912780+0000","last_peered":"2022-08-10T17:56:03.912780+0000","last_clean":"2022-08-10T17:56:03.912780+0000","last_became_active":"2022-08-10T17:35:37.416385+0000","last_became_peered":"2022-08-10T17:35:37.416385+0000","last_unstale":"2022-08-10T17:56:03.912780+0000","last_undegraded":"2022-08-10T17:56:03.912780+0000","last_fullsized":"2022-08-10T17:56:03.912780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:56:03.912661+0000","last_clean_scrub_stamp":"2022-08-10T17:56:03.912661+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:56:17.642586+0000","scrub_duration":0.015979535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'6029","reported_seq":6060,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:38.234643+0000","last_change":"2022-08-10T17:56:38.234598+0000","last_active":"2022-08-10T17:56:38.234643+0000","last_peered":"2022-08-10T17:56:38.234643+0000","last_clean":"2022-08-10T17:56:38.234643+0000","last_became_active":"2022-08-10T17:35:41.443087+0000","last_became_peered":"2022-08-10T17:35:41.443087+0000","last_unstale":"2022-08-10T17:56:38.234643+0000","last_undegraded":"2022-08-10T17:56:38.234643+0000","last_fullsized":"2022-08-10T17:56:38.234643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6029","last_scrub_stamp":"2022-08-10T17:56:38.234498+0000","last_deep_scrub":"29'6029","last_deep_scrub_stamp":"2022-08-10T17:56:38.234498+0000","last_clean_scrub_stamp":"2022-08-10T17:56:38.234498+0000","objects_scrubbed":0,"log_size":6029,"log_dups_size":0,"ondisk_log_size":6029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:41:31.403283+0000","scrub_duration":0.064381774000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":42827,"num_write_kb":649236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:32.378188+0000","last_change":"2022-08-10T17:55:32.378165+0000","last_active":"2022-08-10T17:55:32.378188+0000","last_peered":"2022-08-10T17:55:32.378188+0000","last_clean":"2022-08-10T17:55:32.378188+0000","last_became_active":"2022-08-10T17:35:37.019369+0000","last_became_peered":"2022-08-10T17:35:37.019369+0000","last_unstale":"2022-08-10T17:55:32.378188+0000","last_undegraded":"2022-08-10T17:55:32.378188+0000","last_fullsized":"2022-08-10T17:55:32.378188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:32.378072+0000","last_clean_scrub_stamp":"2022-08-10T17:55:32.378072+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:37:51.551862+0000","scrub_duration":0.025084980999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:44.387732+0000","last_change":"2022-08-10T17:55:44.387701+0000","last_active":"2022-08-10T17:55:44.387732+0000","last_peered":"2022-08-10T17:55:44.387732+0000","last_clean":"2022-08-10T17:55:44.387732+0000","last_became_active":"2022-08-10T17:36:19.058602+0000","last_became_peered":"2022-08-10T17:36:19.058602+0000","last_unstale":"2022-08-10T17:55:44.387732+0000","last_undegraded":"2022-08-10T17:55:44.387732+0000","last_fullsized":"2022-08-10T17:55:44.387732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:55:44.387600+0000","last_clean_scrub_stamp":"2022-08-10T17:55:44.387600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:07:54.771605+0000","scrub_duration":0.016116917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"29'4531","reported_seq":4559,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:06.026441+0000","last_change":"2022-08-10T17:56:06.026377+0000","last_active":"2022-08-10T17:56:06.026441+0000","last_peered":"2022-08-10T17:56:06.026441+0000","last_clean":"2022-08-10T17:56:06.026441+0000","last_became_active":"2022-08-10T17:35:41.436740+0000","last_became_peered":"2022-08-10T17:35:41.436740+0000","last_unstale":"2022-08-10T17:56:06.026441+0000","last_undegraded":"2022-08-10T17:56:06.026441+0000","last_fullsized":"2022-08-10T17:56:06.026441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4531","last_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_deep_scrub":"29'4531","last_deep_scrub_stamp":"2022-08-10T17:56:06.026208+0000","last_clean_scrub_stamp":"2022-08-10T17:56:06.026208+0000","objects_scrubbed":0,"log_size":4531,"log_dups_size":0,"ondisk_log_size":4531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:36.860795+0000","scrub_duration":0.086058169000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43050,"num_write_kb":660759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.362391+0000","last_change":"2022-08-10T17:55:22.362372+0000","last_active":"2022-08-10T17:55:22.362391+0000","last_peered":"2022-08-10T17:55:22.362391+0000","last_clean":"2022-08-10T17:55:22.362391+0000","last_became_active":"2022-08-10T17:35:32.321690+0000","last_became_peered":"2022-08-10T17:35:32.321690+0000","last_unstale":"2022-08-10T17:55:22.362391+0000","last_undegraded":"2022-08-10T17:55:22.362391+0000","last_fullsized":"2022-08-10T17:55:22.362391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.362296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.362296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:05:15.511687+0000","scrub_duration":0.0034545679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.144294+0000","last_change":"2022-08-10T17:55:36.144271+0000","last_active":"2022-08-10T17:55:36.144294+0000","last_peered":"2022-08-10T17:55:36.144294+0000","last_clean":"2022-08-10T17:55:36.144294+0000","last_became_active":"2022-08-10T17:35:37.023340+0000","last_became_peered":"2022-08-10T17:35:37.023340+0000","last_unstale":"2022-08-10T17:55:36.144294+0000","last_undegraded":"2022-08-10T17:55:36.144294+0000","last_fullsized":"2022-08-10T17:55:36.144294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:36.144187+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.144187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:21:38.195327+0000","scrub_duration":0.028929255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'17","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:38.367621+0000","last_change":"2022-08-10T17:55:38.367599+0000","last_active":"2022-08-10T17:55:38.367621+0000","last_peered":"2022-08-10T17:55:38.367621+0000","last_clean":"2022-08-10T17:55:38.367621+0000","last_became_active":"2022-08-10T17:35:37.413980+0000","last_became_peered":"2022-08-10T17:35:37.413980+0000","last_unstale":"2022-08-10T17:55:38.367621+0000","last_undegraded":"2022-08-10T17:55:38.367621+0000","last_fullsized":"2022-08-10T17:55:38.367621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2022-08-10T17:55:38.367524+0000","last_clean_scrub_stamp":"2022-08-10T17:55:38.367524+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:16:32.842509+0000","scrub_duration":0.0035067779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'4346","reported_seq":4374,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:09.053873+0000","last_change":"2022-08-10T17:56:09.053830+0000","last_active":"2022-08-10T17:56:09.053873+0000","last_peered":"2022-08-10T17:56:09.053873+0000","last_clean":"2022-08-10T17:56:09.053873+0000","last_became_active":"2022-08-10T17:35:41.436359+0000","last_became_peered":"2022-08-10T17:35:41.436359+0000","last_unstale":"2022-08-10T17:56:09.053873+0000","last_undegraded":"2022-08-10T17:56:09.053873+0000","last_fullsized":"2022-08-10T17:56:09.053873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4346","last_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_deep_scrub":"29'4346","last_deep_scrub_stamp":"2022-08-10T17:56:09.053722+0000","last_clean_scrub_stamp":"2022-08-10T17:56:09.053722+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:40:03.775600+0000","scrub_duration":0.061434124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38019,"num_write_kb":588057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.070691+0000","last_change":"2022-08-10T17:55:29.070663+0000","last_active":"2022-08-10T17:55:29.070691+0000","last_peered":"2022-08-10T17:55:29.070691+0000","last_clean":"2022-08-10T17:55:29.070691+0000","last_became_active":"2022-08-10T17:35:31.994857+0000","last_became_peered":"2022-08-10T17:35:31.994857+0000","last_unstale":"2022-08-10T17:55:29.070691+0000","last_undegraded":"2022-08-10T17:55:29.070691+0000","last_fullsized":"2022-08-10T17:55:29.070691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.070546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.070546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:28:30.391516+0000","scrub_duration":0.0035289599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.986802+0000","last_change":"2022-08-10T17:56:10.986777+0000","last_active":"2022-08-10T17:56:10.986802+0000","last_peered":"2022-08-10T17:56:10.986802+0000","last_clean":"2022-08-10T17:56:10.986802+0000","last_became_active":"2022-08-10T17:35:37.027736+0000","last_became_peered":"2022-08-10T17:35:37.027736+0000","last_unstale":"2022-08-10T17:56:10.986802+0000","last_undegraded":"2022-08-10T17:56:10.986802+0000","last_fullsized":"2022-08-10T17:56:10.986802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2022-08-10T17:56:10.986680+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.986680+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:28.661781+0000","scrub_duration":0.019300363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.348594+0000","last_change":"2022-08-10T17:55:37.348571+0000","last_active":"2022-08-10T17:55:37.348594+0000","last_peered":"2022-08-10T17:55:37.348594+0000","last_clean":"2022-08-10T17:55:37.348594+0000","last_became_active":"2022-08-10T17:35:37.413827+0000","last_became_peered":"2022-08-10T17:35:37.413827+0000","last_unstale":"2022-08-10T17:55:37.348594+0000","last_undegraded":"2022-08-10T17:55:37.348594+0000","last_fullsized":"2022-08-10T17:55:37.348594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2022-08-10T17:55:37.348475+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.348475+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:32:44.196786+0000","scrub_duration":0.0035728499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'4646","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:36.563629+0000","last_change":"2022-08-10T17:55:36.563579+0000","last_active":"2022-08-10T17:55:36.563629+0000","last_peered":"2022-08-10T17:55:36.563629+0000","last_clean":"2022-08-10T17:55:36.563629+0000","last_became_active":"2022-08-10T17:35:41.436792+0000","last_became_peered":"2022-08-10T17:35:41.436792+0000","last_unstale":"2022-08-10T17:55:36.563629+0000","last_undegraded":"2022-08-10T17:55:36.563629+0000","last_fullsized":"2022-08-10T17:55:36.563629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4646","last_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_deep_scrub":"29'4646","last_deep_scrub_stamp":"2022-08-10T17:55:36.563473+0000","last_clean_scrub_stamp":"2022-08-10T17:55:36.563473+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:09:00.188963+0000","scrub_duration":0.061717941999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38548,"num_write_kb":592651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:22.626811+0000","last_change":"2022-08-10T17:55:22.626781+0000","last_active":"2022-08-10T17:55:22.626811+0000","last_peered":"2022-08-10T17:55:22.626811+0000","last_clean":"2022-08-10T17:55:22.626811+0000","last_became_active":"2022-08-10T17:35:31.986759+0000","last_became_peered":"2022-08-10T17:35:31.986759+0000","last_unstale":"2022-08-10T17:55:22.626811+0000","last_undegraded":"2022-08-10T17:55:22.626811+0000","last_fullsized":"2022-08-10T17:55:22.626811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:22.626653+0000","last_clean_scrub_stamp":"2022-08-10T17:55:22.626653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:27:34.446413+0000","scrub_duration":0.0035853080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:26.396141+0000","last_change":"2022-08-10T17:55:26.396110+0000","last_active":"2022-08-10T17:55:26.396141+0000","last_peered":"2022-08-10T17:55:26.396141+0000","last_clean":"2022-08-10T17:55:26.396141+0000","last_became_active":"2022-08-10T17:35:37.020631+0000","last_became_peered":"2022-08-10T17:35:37.020631+0000","last_unstale":"2022-08-10T17:55:26.396141+0000","last_undegraded":"2022-08-10T17:55:26.396141+0000","last_fullsized":"2022-08-10T17:55:26.396141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:26.396028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:26.396028+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:22:41.188174+0000","scrub_duration":0.016673178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'25","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.382444+0000","last_change":"2022-08-10T17:55:43.382417+0000","last_active":"2022-08-10T17:55:43.382444+0000","last_peered":"2022-08-10T17:55:43.382444+0000","last_clean":"2022-08-10T17:55:43.382444+0000","last_became_active":"2022-08-10T17:35:37.413833+0000","last_became_peered":"2022-08-10T17:35:37.413833+0000","last_unstale":"2022-08-10T17:55:43.382444+0000","last_undegraded":"2022-08-10T17:55:43.382444+0000","last_fullsized":"2022-08-10T17:55:43.382444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:43.382310+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.382310+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:35:24.953748+0000","scrub_duration":0.042344012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'4773","reported_seq":4801,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:23.411315+0000","last_change":"2022-08-10T17:56:23.411283+0000","last_active":"2022-08-10T17:56:23.411315+0000","last_peered":"2022-08-10T17:56:23.411315+0000","last_clean":"2022-08-10T17:56:23.411315+0000","last_became_active":"2022-08-10T17:35:41.435958+0000","last_became_peered":"2022-08-10T17:35:41.435958+0000","last_unstale":"2022-08-10T17:56:23.411315+0000","last_undegraded":"2022-08-10T17:56:23.411315+0000","last_fullsized":"2022-08-10T17:56:23.411315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4773","last_scrub_stamp":"2022-08-10T17:56:23.411180+0000","last_deep_scrub":"29'4773","last_deep_scrub_stamp":"2022-08-10T17:56:23.411180+0000","last_clean_scrub_stamp":"2022-08-10T17:56:23.411180+0000","objects_scrubbed":0,"log_size":4773,"log_dups_size":0,"ondisk_log_size":4773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:36:14.631283+0000","scrub_duration":0.066595267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43326,"num_write_kb":654000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:27.086112+0000","last_change":"2022-08-10T17:55:27.086083+0000","last_active":"2022-08-10T17:55:27.086112+0000","last_peered":"2022-08-10T17:55:27.086112+0000","last_clean":"2022-08-10T17:55:27.086112+0000","last_became_active":"2022-08-10T17:35:31.995385+0000","last_became_peered":"2022-08-10T17:35:31.995385+0000","last_unstale":"2022-08-10T17:55:27.086112+0000","last_undegraded":"2022-08-10T17:55:27.086112+0000","last_fullsized":"2022-08-10T17:55:27.086112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:27.085971+0000","last_clean_scrub_stamp":"2022-08-10T17:55:27.085971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:11:51.139836+0000","scrub_duration":0.003529314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:28.998931+0000","last_change":"2022-08-10T17:55:28.998908+0000","last_active":"2022-08-10T17:55:28.998931+0000","last_peered":"2022-08-10T17:55:28.998931+0000","last_clean":"2022-08-10T17:55:28.998931+0000","last_became_active":"2022-08-10T17:35:29.538053+0000","last_became_peered":"2022-08-10T17:35:29.538053+0000","last_unstale":"2022-08-10T17:55:28.998931+0000","last_undegraded":"2022-08-10T17:55:28.998931+0000","last_fullsized":"2022-08-10T17:55:28.998931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2022-08-10T17:55:28.998804+0000","last_clean_scrub_stamp":"2022-08-10T17:55:28.998804+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:40:46.133786+0000","scrub_duration":0.020972382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.369120+0000","last_change":"2022-08-10T17:55:31.369098+0000","last_active":"2022-08-10T17:55:31.369120+0000","last_peered":"2022-08-10T17:55:31.369120+0000","last_clean":"2022-08-10T17:55:31.369120+0000","last_became_active":"2022-08-10T17:35:37.023085+0000","last_became_peered":"2022-08-10T17:35:37.023085+0000","last_unstale":"2022-08-10T17:55:31.369120+0000","last_undegraded":"2022-08-10T17:55:31.369120+0000","last_fullsized":"2022-08-10T17:55:31.369120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2022-08-10T17:55:31.369017+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.369017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:38:19.456252+0000","scrub_duration":0.0034799219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'21","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:31.902416+0000","last_change":"2022-08-10T17:55:31.902390+0000","last_active":"2022-08-10T17:55:31.902416+0000","last_peered":"2022-08-10T17:55:31.902416+0000","last_clean":"2022-08-10T17:55:31.902416+0000","last_became_active":"2022-08-10T17:35:37.417179+0000","last_became_peered":"2022-08-10T17:35:37.417179+0000","last_unstale":"2022-08-10T17:55:31.902416+0000","last_undegraded":"2022-08-10T17:55:31.902416+0000","last_fullsized":"2022-08-10T17:55:31.902416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2022-08-10T17:55:31.902294+0000","last_clean_scrub_stamp":"2022-08-10T17:55:31.902294+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:06:04.476448+0000","scrub_duration":0.027996058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'3406","reported_seq":3434,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:08.203081+0000","last_change":"2022-08-10T17:56:08.203034+0000","last_active":"2022-08-10T17:56:08.203081+0000","last_peered":"2022-08-10T17:56:08.203081+0000","last_clean":"2022-08-10T17:56:08.203081+0000","last_became_active":"2022-08-10T17:35:41.441978+0000","last_became_peered":"2022-08-10T17:35:41.441978+0000","last_unstale":"2022-08-10T17:56:08.203081+0000","last_undegraded":"2022-08-10T17:56:08.203081+0000","last_fullsized":"2022-08-10T17:56:08.203081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3406","last_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_deep_scrub":"29'3406","last_deep_scrub_stamp":"2022-08-10T17:56:08.202932+0000","last_clean_scrub_stamp":"2022-08-10T17:56:08.202932+0000","objects_scrubbed":0,"log_size":3406,"log_dups_size":0,"ondisk_log_size":3406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:41:13.192438+0000","scrub_duration":0.091572171999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33224,"num_write_kb":502428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:29.966787+0000","last_change":"2022-08-10T17:55:29.966768+0000","last_active":"2022-08-10T17:55:29.966787+0000","last_peered":"2022-08-10T17:55:29.966787+0000","last_clean":"2022-08-10T17:55:29.966787+0000","last_became_active":"2022-08-10T17:35:31.994894+0000","last_became_peered":"2022-08-10T17:35:31.994894+0000","last_unstale":"2022-08-10T17:55:29.966787+0000","last_undegraded":"2022-08-10T17:55:29.966787+0000","last_fullsized":"2022-08-10T17:55:29.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:29.966669+0000","last_clean_scrub_stamp":"2022-08-10T17:55:29.966669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:30:37.613565+0000","scrub_duration":0.0037818109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'84","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.063945+0000","last_change":"2022-08-10T17:55:34.063912+0000","last_active":"2022-08-10T17:55:34.063945+0000","last_peered":"2022-08-10T17:55:34.063945+0000","last_clean":"2022-08-10T17:55:34.063945+0000","last_became_active":"2022-08-10T17:35:37.032493+0000","last_became_peered":"2022-08-10T17:35:37.032493+0000","last_unstale":"2022-08-10T17:55:34.063945+0000","last_undegraded":"2022-08-10T17:55:34.063945+0000","last_fullsized":"2022-08-10T17:55:34.063945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'84","last_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_deep_scrub":"29'84","last_deep_scrub_stamp":"2022-08-10T17:55:34.063817+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.063817+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T03:21:24.542508+0000","scrub_duration":0.019597560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71489,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":86,"num_write":80,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.989697+0000","last_change":"2022-08-10T17:55:50.989676+0000","last_active":"2022-08-10T17:55:50.989697+0000","last_peered":"2022-08-10T17:55:50.989697+0000","last_clean":"2022-08-10T17:55:50.989697+0000","last_became_active":"2022-08-10T17:35:37.410911+0000","last_became_peered":"2022-08-10T17:35:37.410911+0000","last_unstale":"2022-08-10T17:55:50.989697+0000","last_undegraded":"2022-08-10T17:55:50.989697+0000","last_fullsized":"2022-08-10T17:55:50.989697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.989601+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.989601+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:29:39.434990+0000","scrub_duration":0.0035003970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'5862","reported_seq":5890,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:43.906460+0000","last_change":"2022-08-10T17:55:43.906421+0000","last_active":"2022-08-10T17:55:43.906460+0000","last_peered":"2022-08-10T17:55:43.906460+0000","last_clean":"2022-08-10T17:55:43.906460+0000","last_became_active":"2022-08-10T17:35:41.441760+0000","last_became_peered":"2022-08-10T17:35:41.441760+0000","last_unstale":"2022-08-10T17:55:43.906460+0000","last_undegraded":"2022-08-10T17:55:43.906460+0000","last_fullsized":"2022-08-10T17:55:43.906460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5862","last_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_deep_scrub":"29'5862","last_deep_scrub_stamp":"2022-08-10T17:55:43.906317+0000","last_clean_scrub_stamp":"2022-08-10T17:55:43.906317+0000","objects_scrubbed":0,"log_size":5862,"log_dups_size":0,"ondisk_log_size":5862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:26:06.441129+0000","scrub_duration":0.075268903999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":593905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.069569+0000","last_change":"2022-08-10T17:55:37.069551+0000","last_active":"2022-08-10T17:55:37.069569+0000","last_peered":"2022-08-10T17:55:37.069569+0000","last_clean":"2022-08-10T17:55:37.069569+0000","last_became_active":"2022-08-10T17:35:32.321752+0000","last_became_peered":"2022-08-10T17:35:32.321752+0000","last_unstale":"2022-08-10T17:55:37.069569+0000","last_undegraded":"2022-08-10T17:55:37.069569+0000","last_fullsized":"2022-08-10T17:55:37.069569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:37.069477+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.069477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:44:41.886326+0000","scrub_duration":0.0035232359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.399676+0000","last_change":"2022-08-10T17:55:34.399655+0000","last_active":"2022-08-10T17:55:34.399676+0000","last_peered":"2022-08-10T17:55:34.399676+0000","last_clean":"2022-08-10T17:55:34.399676+0000","last_became_active":"2022-08-10T17:35:37.021995+0000","last_became_peered":"2022-08-10T17:35:37.021995+0000","last_unstale":"2022-08-10T17:55:34.399676+0000","last_undegraded":"2022-08-10T17:55:34.399676+0000","last_fullsized":"2022-08-10T17:55:34.399676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:34.399577+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.399577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T22:44:22.781395+0000","scrub_duration":0.0034960490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.071382+0000","last_change":"2022-08-10T17:55:33.071345+0000","last_active":"2022-08-10T17:55:33.071382+0000","last_peered":"2022-08-10T17:55:33.071382+0000","last_clean":"2022-08-10T17:55:33.071382+0000","last_became_active":"2022-08-10T17:35:37.415126+0000","last_became_peered":"2022-08-10T17:35:37.415126+0000","last_unstale":"2022-08-10T17:55:33.071382+0000","last_undegraded":"2022-08-10T17:55:33.071382+0000","last_fullsized":"2022-08-10T17:55:33.071382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2022-08-10T17:55:33.071183+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.071183+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:40:33.068733+0000","scrub_duration":0.0095831489999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'2946","reported_seq":2974,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:40.283998+0000","last_change":"2022-08-10T17:56:40.283960+0000","last_active":"2022-08-10T17:56:40.283998+0000","last_peered":"2022-08-10T17:56:40.283998+0000","last_clean":"2022-08-10T17:56:40.283998+0000","last_became_active":"2022-08-10T17:35:41.441990+0000","last_became_peered":"2022-08-10T17:35:41.441990+0000","last_unstale":"2022-08-10T17:56:40.283998+0000","last_undegraded":"2022-08-10T17:56:40.283998+0000","last_fullsized":"2022-08-10T17:56:40.283998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2946","last_scrub_stamp":"2022-08-10T17:56:40.283838+0000","last_deep_scrub":"29'2946","last_deep_scrub_stamp":"2022-08-10T17:56:40.283838+0000","last_clean_scrub_stamp":"2022-08-10T17:56:40.283838+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:05:07.204698+0000","scrub_duration":0.064756291999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29520,"num_write_kb":473829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:37.316191+0000","last_change":"2022-08-10T17:55:37.316154+0000","last_active":"2022-08-10T17:55:37.316191+0000","last_peered":"2022-08-10T17:55:37.316191+0000","last_clean":"2022-08-10T17:55:37.316191+0000","last_became_active":"2022-08-10T17:35:37.022891+0000","last_became_peered":"2022-08-10T17:35:37.022891+0000","last_unstale":"2022-08-10T17:55:37.316191+0000","last_undegraded":"2022-08-10T17:55:37.316191+0000","last_fullsized":"2022-08-10T17:55:37.316191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2022-08-10T17:55:37.316067+0000","last_clean_scrub_stamp":"2022-08-10T17:55:37.316067+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:40:23.614188+0000","scrub_duration":0.016809653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.301522+0000","last_change":"2022-08-10T17:55:24.301501+0000","last_active":"2022-08-10T17:55:24.301522+0000","last_peered":"2022-08-10T17:55:24.301522+0000","last_clean":"2022-08-10T17:55:24.301522+0000","last_became_active":"2022-08-10T17:35:31.994605+0000","last_became_peered":"2022-08-10T17:35:31.994605+0000","last_unstale":"2022-08-10T17:55:24.301522+0000","last_undegraded":"2022-08-10T17:55:24.301522+0000","last_fullsized":"2022-08-10T17:55:24.301522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:24.301417+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.301417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:33:53.898237+0000","scrub_duration":0.0034981370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.337456+0000","last_change":"2022-08-10T17:55:41.337433+0000","last_active":"2022-08-10T17:55:41.337456+0000","last_peered":"2022-08-10T17:55:41.337456+0000","last_clean":"2022-08-10T17:55:41.337456+0000","last_became_active":"2022-08-10T17:35:37.413398+0000","last_became_peered":"2022-08-10T17:35:37.413398+0000","last_unstale":"2022-08-10T17:55:41.337456+0000","last_undegraded":"2022-08-10T17:55:41.337456+0000","last_fullsized":"2022-08-10T17:55:41.337456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:41.337357+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.337357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:41:32.970167+0000","scrub_duration":0.0035830240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'4316","reported_seq":4344,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:10.513696+0000","last_change":"2022-08-10T17:56:10.513657+0000","last_active":"2022-08-10T17:56:10.513696+0000","last_peered":"2022-08-10T17:56:10.513696+0000","last_clean":"2022-08-10T17:56:10.513696+0000","last_became_active":"2022-08-10T17:35:41.443651+0000","last_became_peered":"2022-08-10T17:35:41.443651+0000","last_unstale":"2022-08-10T17:56:10.513696+0000","last_undegraded":"2022-08-10T17:56:10.513696+0000","last_fullsized":"2022-08-10T17:56:10.513696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4316","last_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_deep_scrub":"29'4316","last_deep_scrub_stamp":"2022-08-10T17:56:10.513552+0000","last_clean_scrub_stamp":"2022-08-10T17:56:10.513552+0000","objects_scrubbed":0,"log_size":4316,"log_dups_size":0,"ondisk_log_size":4316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:20:09.761651+0000","scrub_duration":0.084202658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38087,"num_write_kb":592534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:23.899289+0000","last_change":"2022-08-10T17:55:23.899252+0000","last_active":"2022-08-10T17:55:23.899289+0000","last_peered":"2022-08-10T17:55:23.899289+0000","last_clean":"2022-08-10T17:55:23.899289+0000","last_became_active":"2022-08-10T17:35:31.994279+0000","last_became_peered":"2022-08-10T17:35:31.994279+0000","last_unstale":"2022-08-10T17:55:23.899289+0000","last_undegraded":"2022-08-10T17:55:23.899289+0000","last_fullsized":"2022-08-10T17:55:23.899289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-08-10T17:55:23.899118+0000","last_clean_scrub_stamp":"2022-08-10T17:55:23.899118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:10:44.169251+0000","scrub_duration":0.0035038819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'73","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:41.041014+0000","last_change":"2022-08-10T17:55:41.040993+0000","last_active":"2022-08-10T17:55:41.041014+0000","last_peered":"2022-08-10T17:55:41.041014+0000","last_clean":"2022-08-10T17:55:41.041014+0000","last_became_active":"2022-08-10T17:35:37.028013+0000","last_became_peered":"2022-08-10T17:35:37.028013+0000","last_unstale":"2022-08-10T17:55:41.041014+0000","last_undegraded":"2022-08-10T17:55:41.041014+0000","last_fullsized":"2022-08-10T17:55:41.041014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2022-08-10T17:55:41.040907+0000","last_clean_scrub_stamp":"2022-08-10T17:55:41.040907+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:49:13.722929+0000","scrub_duration":0.024350785999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:19.065493+0000","last_change":"2022-08-10T17:56:19.065474+0000","last_active":"2022-08-10T17:56:19.065493+0000","last_peered":"2022-08-10T17:56:19.065493+0000","last_clean":"2022-08-10T17:56:19.065493+0000","last_became_active":"2022-08-10T17:35:37.405425+0000","last_became_peered":"2022-08-10T17:35:37.405425+0000","last_unstale":"2022-08-10T17:56:19.065493+0000","last_undegraded":"2022-08-10T17:56:19.065493+0000","last_fullsized":"2022-08-10T17:56:19.065493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:56:19.065397+0000","last_clean_scrub_stamp":"2022-08-10T17:56:19.065397+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:48:02.437895+0000","scrub_duration":0.0035302699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'4810","reported_seq":4838,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.416166+0000","last_change":"2022-08-10T17:55:53.416111+0000","last_active":"2022-08-10T17:55:53.416166+0000","last_peered":"2022-08-10T17:55:53.416166+0000","last_clean":"2022-08-10T17:55:53.416166+0000","last_became_active":"2022-08-10T17:35:41.439357+0000","last_became_peered":"2022-08-10T17:35:41.439357+0000","last_unstale":"2022-08-10T17:55:53.416166+0000","last_undegraded":"2022-08-10T17:55:53.416166+0000","last_fullsized":"2022-08-10T17:55:53.416166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4810","last_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_deep_scrub":"29'4810","last_deep_scrub_stamp":"2022-08-10T17:55:53.416011+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.416011+0000","objects_scrubbed":0,"log_size":4810,"log_dups_size":0,"ondisk_log_size":4810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:55:10.405949+0000","scrub_duration":0.05286983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39191,"num_write_kb":604879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1834","reported_seq":1864,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:47.965716+0000","last_change":"2022-08-10T17:55:47.965696+0000","last_active":"2022-08-10T17:55:47.965716+0000","last_peered":"2022-08-10T17:55:47.965716+0000","last_clean":"2022-08-10T17:55:47.965716+0000","last_became_active":"2022-08-10T17:35:37.032485+0000","last_became_peered":"2022-08-10T17:35:37.032485+0000","last_unstale":"2022-08-10T17:55:47.965716+0000","last_undegraded":"2022-08-10T17:55:47.965716+0000","last_fullsized":"2022-08-10T17:55:47.965716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1834","last_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_deep_scrub":"29'1834","last_deep_scrub_stamp":"2022-08-10T17:55:47.965611+0000","last_clean_scrub_stamp":"2022-08-10T17:55:47.965611+0000","objects_scrubbed":3,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:54:45.463809+0000","scrub_duration":0.038525047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'25","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:24.601728+0000","last_change":"2022-08-10T17:55:24.601691+0000","last_active":"2022-08-10T17:55:24.601728+0000","last_peered":"2022-08-10T17:55:24.601728+0000","last_clean":"2022-08-10T17:55:24.601728+0000","last_became_active":"2022-08-10T17:35:37.417490+0000","last_became_peered":"2022-08-10T17:35:37.417490+0000","last_unstale":"2022-08-10T17:55:24.601728+0000","last_undegraded":"2022-08-10T17:55:24.601728+0000","last_fullsized":"2022-08-10T17:55:24.601728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2022-08-10T17:55:24.601546+0000","last_clean_scrub_stamp":"2022-08-10T17:55:24.601546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T02:48:03.331213+0000","scrub_duration":0.0034631699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'4529","reported_seq":4557,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:16.361916+0000","last_change":"2022-08-10T17:56:16.361878+0000","last_active":"2022-08-10T17:56:16.361916+0000","last_peered":"2022-08-10T17:56:16.361916+0000","last_clean":"2022-08-10T17:56:16.361916+0000","last_became_active":"2022-08-10T17:35:41.437866+0000","last_became_peered":"2022-08-10T17:35:41.437866+0000","last_unstale":"2022-08-10T17:56:16.361916+0000","last_undegraded":"2022-08-10T17:56:16.361916+0000","last_fullsized":"2022-08-10T17:56:16.361916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4529","last_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_deep_scrub":"29'4529","last_deep_scrub_stamp":"2022-08-10T17:56:16.361775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:16.361775+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:02:50.074670+0000","scrub_duration":0.063326929000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39456,"num_write_kb":633875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:35.131177+0000","last_change":"2022-08-10T17:55:35.131146+0000","last_active":"2022-08-10T17:55:35.131177+0000","last_peered":"2022-08-10T17:55:35.131177+0000","last_clean":"2022-08-10T17:55:35.131177+0000","last_became_active":"2022-08-10T17:35:37.028675+0000","last_became_peered":"2022-08-10T17:35:37.028675+0000","last_unstale":"2022-08-10T17:55:35.131177+0000","last_undegraded":"2022-08-10T17:55:35.131177+0000","last_fullsized":"2022-08-10T17:55:35.131177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2022-08-10T17:55:35.131014+0000","last_clean_scrub_stamp":"2022-08-10T17:55:35.131014+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:12:57.212526+0000","scrub_duration":0.028963988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'31","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:01.984902+0000","last_change":"2022-08-10T17:56:01.984875+0000","last_active":"2022-08-10T17:56:01.984902+0000","last_peered":"2022-08-10T17:56:01.984902+0000","last_clean":"2022-08-10T17:56:01.984902+0000","last_became_active":"2022-08-10T17:35:37.407648+0000","last_became_peered":"2022-08-10T17:35:37.407648+0000","last_unstale":"2022-08-10T17:56:01.984902+0000","last_undegraded":"2022-08-10T17:56:01.984902+0000","last_fullsized":"2022-08-10T17:56:01.984902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2022-08-10T17:56:01.984775+0000","last_clean_scrub_stamp":"2022-08-10T17:56:01.984775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T05:02:21.804010+0000","scrub_duration":0.032020725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'3881","reported_seq":3909,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:54.144536+0000","last_change":"2022-08-10T17:55:54.144477+0000","last_active":"2022-08-10T17:55:54.144536+0000","last_peered":"2022-08-10T17:55:54.144536+0000","last_clean":"2022-08-10T17:55:54.144536+0000","last_became_active":"2022-08-10T17:35:41.438139+0000","last_became_peered":"2022-08-10T17:35:41.438139+0000","last_unstale":"2022-08-10T17:55:54.144536+0000","last_undegraded":"2022-08-10T17:55:54.144536+0000","last_fullsized":"2022-08-10T17:55:54.144536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3881","last_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_deep_scrub":"29'3881","last_deep_scrub_stamp":"2022-08-10T17:55:54.144322+0000","last_clean_scrub_stamp":"2022-08-10T17:55:54.144322+0000","objects_scrubbed":0,"log_size":3881,"log_dups_size":0,"ondisk_log_size":3881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:56:34.319790+0000","scrub_duration":0.066230998999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33269,"num_write_kb":500890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:34.117089+0000","last_change":"2022-08-10T17:55:34.117062+0000","last_active":"2022-08-10T17:55:34.117089+0000","last_peered":"2022-08-10T17:55:34.117089+0000","last_clean":"2022-08-10T17:55:34.117089+0000","last_became_active":"2022-08-10T17:35:37.030086+0000","last_became_peered":"2022-08-10T17:35:37.030086+0000","last_unstale":"2022-08-10T17:55:34.117089+0000","last_undegraded":"2022-08-10T17:55:34.117089+0000","last_fullsized":"2022-08-10T17:55:34.117089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2022-08-10T17:55:34.116969+0000","last_clean_scrub_stamp":"2022-08-10T17:55:34.116969+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:43:17.054491+0000","scrub_duration":0.029066613000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'26","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:21.114733+0000","last_change":"2022-08-10T17:56:21.114711+0000","last_active":"2022-08-10T17:56:21.114733+0000","last_peered":"2022-08-10T17:56:21.114733+0000","last_clean":"2022-08-10T17:56:21.114733+0000","last_became_active":"2022-08-10T17:35:37.408122+0000","last_became_peered":"2022-08-10T17:35:37.408122+0000","last_unstale":"2022-08-10T17:56:21.114733+0000","last_undegraded":"2022-08-10T17:56:21.114733+0000","last_fullsized":"2022-08-10T17:56:21.114733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2022-08-10T17:56:21.114629+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2022-08-10T17:56:21.114629+0000","last_clean_scrub_stamp":"2022-08-10T17:56:21.114629+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:16:34.026582+0000","scrub_duration":0.0035589020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'4410","reported_seq":4438,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:37.215710+0000","last_change":"2022-08-10T17:56:37.215676+0000","last_active":"2022-08-10T17:56:37.215710+0000","last_peered":"2022-08-10T17:56:37.215710+0000","last_clean":"2022-08-10T17:56:37.215710+0000","last_became_active":"2022-08-10T17:35:41.435873+0000","last_became_peered":"2022-08-10T17:35:41.435873+0000","last_unstale":"2022-08-10T17:56:37.215710+0000","last_undegraded":"2022-08-10T17:56:37.215710+0000","last_fullsized":"2022-08-10T17:56:37.215710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4410","last_scrub_stamp":"2022-08-10T17:56:37.215575+0000","last_deep_scrub":"29'4410","last_deep_scrub_stamp":"2022-08-10T17:56:37.215575+0000","last_clean_scrub_stamp":"2022-08-10T17:56:37.215575+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T20:03:54.591292+0000","scrub_duration":0.069803685000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39319,"num_write_kb":612009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:33.320131+0000","last_change":"2022-08-10T17:55:33.320112+0000","last_active":"2022-08-10T17:55:33.320131+0000","last_peered":"2022-08-10T17:55:33.320131+0000","last_clean":"2022-08-10T17:55:33.320131+0000","last_became_active":"2022-08-10T17:35:37.016095+0000","last_became_peered":"2022-08-10T17:35:37.016095+0000","last_unstale":"2022-08-10T17:55:33.320131+0000","last_undegraded":"2022-08-10T17:55:33.320131+0000","last_fullsized":"2022-08-10T17:55:33.320131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2022-08-10T17:55:33.320028+0000","last_clean_scrub_stamp":"2022-08-10T17:55:33.320028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:24:04.115098+0000","scrub_duration":0.0034705809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'30","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:50.392253+0000","last_change":"2022-08-10T17:55:50.392218+0000","last_active":"2022-08-10T17:55:50.392253+0000","last_peered":"2022-08-10T17:55:50.392253+0000","last_clean":"2022-08-10T17:55:50.392253+0000","last_became_active":"2022-08-10T17:35:37.403469+0000","last_became_peered":"2022-08-10T17:35:37.403469+0000","last_unstale":"2022-08-10T17:55:50.392253+0000","last_undegraded":"2022-08-10T17:55:50.392253+0000","last_fullsized":"2022-08-10T17:55:50.392253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2022-08-10T17:55:50.392108+0000","last_clean_scrub_stamp":"2022-08-10T17:55:50.392108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T19:14:07.042516+0000","scrub_duration":0.026038200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'5507","reported_seq":5535,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:49.445165+0000","last_change":"2022-08-10T17:55:49.445116+0000","last_active":"2022-08-10T17:55:49.445165+0000","last_peered":"2022-08-10T17:55:49.445165+0000","last_clean":"2022-08-10T17:55:49.445165+0000","last_became_active":"2022-08-10T17:35:41.434222+0000","last_became_peered":"2022-08-10T17:35:41.434222+0000","last_unstale":"2022-08-10T17:55:49.445165+0000","last_undegraded":"2022-08-10T17:55:49.445165+0000","last_fullsized":"2022-08-10T17:55:49.445165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5507","last_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_deep_scrub":"29'5507","last_deep_scrub_stamp":"2022-08-10T17:55:49.445013+0000","last_clean_scrub_stamp":"2022-08-10T17:55:49.445013+0000","objects_scrubbed":0,"log_size":5507,"log_dups_size":0,"ondisk_log_size":5507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T18:23:49.478670+0000","scrub_duration":0.071917088000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44789,"num_write_kb":701117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.971860+0000","last_change":"2022-08-10T17:55:42.971824+0000","last_active":"2022-08-10T17:55:42.971860+0000","last_peered":"2022-08-10T17:55:42.971860+0000","last_clean":"2022-08-10T17:55:42.971860+0000","last_became_active":"2022-08-10T17:35:37.025338+0000","last_became_peered":"2022-08-10T17:35:37.025338+0000","last_unstale":"2022-08-10T17:55:42.971860+0000","last_undegraded":"2022-08-10T17:55:42.971860+0000","last_fullsized":"2022-08-10T17:55:42.971860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2022-08-10T17:55:42.971742+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.971742+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T04:21:05.087309+0000","scrub_duration":0.019130503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:12.965428+0000","last_change":"2022-08-10T17:56:12.965406+0000","last_active":"2022-08-10T17:56:12.965428+0000","last_peered":"2022-08-10T17:56:12.965428+0000","last_clean":"2022-08-10T17:56:12.965428+0000","last_became_active":"2022-08-10T17:35:37.413358+0000","last_became_peered":"2022-08-10T17:35:37.413358+0000","last_unstale":"2022-08-10T17:56:12.965428+0000","last_undegraded":"2022-08-10T17:56:12.965428+0000","last_fullsized":"2022-08-10T17:56:12.965428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2022-08-10T17:56:12.965326+0000","last_clean_scrub_stamp":"2022-08-10T17:56:12.965326+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:31:27.062017+0000","scrub_duration":0.0035956199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:42.797625+0000","last_change":"2022-08-10T17:55:42.797602+0000","last_active":"2022-08-10T17:55:42.797625+0000","last_peered":"2022-08-10T17:55:42.797625+0000","last_clean":"2022-08-10T17:55:42.797625+0000","last_became_active":"2022-08-10T17:35:37.411723+0000","last_became_peered":"2022-08-10T17:35:37.411723+0000","last_unstale":"2022-08-10T17:55:42.797625+0000","last_undegraded":"2022-08-10T17:55:42.797625+0000","last_fullsized":"2022-08-10T17:55:42.797625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2022-08-10T17:55:42.797520+0000","last_clean_scrub_stamp":"2022-08-10T17:55:42.797520+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:02:36.624748+0000","scrub_duration":0.0035868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:55.426634+0000","last_change":"2022-08-10T17:55:55.426610+0000","last_active":"2022-08-10T17:55:55.426634+0000","last_peered":"2022-08-10T17:55:55.426634+0000","last_clean":"2022-08-10T17:55:55.426634+0000","last_became_active":"2022-08-10T17:35:37.415577+0000","last_became_peered":"2022-08-10T17:35:37.415577+0000","last_unstale":"2022-08-10T17:55:55.426634+0000","last_undegraded":"2022-08-10T17:55:55.426634+0000","last_fullsized":"2022-08-10T17:55:55.426634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2022-08-10T17:55:55.426506+0000","last_clean_scrub_stamp":"2022-08-10T17:55:55.426506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T23:30:26.689886+0000","scrub_duration":0.023987992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'27","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:56:32.178041+0000","last_change":"2022-08-10T17:56:32.178020+0000","last_active":"2022-08-10T17:56:32.178041+0000","last_peered":"2022-08-10T17:56:32.178041+0000","last_clean":"2022-08-10T17:56:32.178041+0000","last_became_active":"2022-08-10T17:35:37.416405+0000","last_became_peered":"2022-08-10T17:35:37.416405+0000","last_unstale":"2022-08-10T17:56:32.178041+0000","last_undegraded":"2022-08-10T17:56:32.178041+0000","last_fullsized":"2022-08-10T17:56:32.178041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2022-08-10T17:56:32.177938+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2022-08-10T17:56:32.177938+0000","last_clean_scrub_stamp":"2022-08-10T17:56:32.177938+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-11T21:20:29.168942+0000","scrub_duration":0.0034775819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:53.495214+0000","last_change":"2022-08-10T17:55:53.495189+0000","last_active":"2022-08-10T17:55:53.495214+0000","last_peered":"2022-08-10T17:55:53.495214+0000","last_clean":"2022-08-10T17:55:53.495214+0000","last_became_active":"2022-08-10T17:35:37.410472+0000","last_became_peered":"2022-08-10T17:35:37.410472+0000","last_unstale":"2022-08-10T17:55:53.495214+0000","last_undegraded":"2022-08-10T17:55:53.495214+0000","last_fullsized":"2022-08-10T17:55:53.495214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2022-08-10T17:55:53.495082+0000","last_clean_scrub_stamp":"2022-08-10T17:55:53.495082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T01:52:02.429575+0000","scrub_duration":0.031547311000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2022-08-10T17:55:39.336472+0000","last_change":"2022-08-10T17:55:39.336435+0000","last_active":"2022-08-10T17:55:39.336472+0000","last_peered":"2022-08-10T17:55:39.336472+0000","last_clean":"2022-08-10T17:55:39.336472+0000","last_became_active":"2022-08-10T17:35:37.414132+0000","last_became_peered":"2022-08-10T17:35:37.414132+0000","last_unstale":"2022-08-10T17:55:39.336472+0000","last_undegraded":"2022-08-10T17:55:39.336472+0000","last_fullsized":"2022-08-10T17:55:39.336472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2022-08-10T17:55:39.336296+0000","last_clean_scrub_stamp":"2022-08-10T17:55:39.336296+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-08-12T00:42:50.195666+0000","scrub_duration":0.003602035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":174,"num_write":1247085,"num_write_kb":19227899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147474,"ondisk_log_size":147474,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1714,"ondisk_log_size":1714,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16271931,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":27,"num_read_kb":98,"num_write":3461,"num_write_kb":18447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20398080,"data_stored":32543862,"data_compressed":2774610,"data_compressed_allocated":3981312,"data_compressed_original":16293888,"omap_allocated":0,"internal_metadata":0},"log_size":3306,"ondisk_log_size":3306,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64606,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575110,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":478196,"kb_used_data":2988,"kb_used_omap":0,"kb_used_meta":475200,"kb_avail":93893644,"statfs":{"total":96636764160,"available":96147091456,"internally_reserved":0,"allocated":3059712,"data_stored":6661678,"data_compressed":783572,"data_compressed_allocated":1073152,"data_compressed_original":4890624,"omap_allocated":0,"internal_metadata":486604800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":12.699999999999999,"15min":12.686999999999999},"min":{"1min":0.255,"5min":0.222,"15min":0.193},"max":{"1min":0.52700000000000002,"5min":111.864,"15min":140.46000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.371,"5min":12.630000000000001,"15min":12.773},"min":{"1min":0.214,"5min":0.214,"15min":0.186},"max":{"1min":0.47899999999999998,"5min":112.184,"15min":140.48099999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":5.3380000000000001,"15min":9.6479999999999997},"min":{"1min":0.29499999999999998,"5min":0.247,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":70.325999999999993,"15min":76.209000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":5.3499999999999996,"15min":9.5310000000000006},"min":{"1min":0.32900000000000001,"5min":0.253,"15min":0.215},"max":{"1min":0.59799999999999998,"5min":70.302999999999997,"15min":76.177999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":1.9650000000000001,"15min":3.1949999999999998},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58599999999999997,"5min":43.914000000000001,"15min":60.835000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.439,"5min":2.0760000000000001,"15min":3.3199999999999998},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.23200000000000001},"max":{"1min":0.60599999999999998,"5min":43.933,"15min":60.771999999999998},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:07 2022","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.76000000000000001,"15min":3.7189999999999999},"min":{"1min":0.33100000000000002,"5min":0.28100000000000003,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":13.641999999999999,"15min":90.873999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.82599999999999996,"15min":3.8929999999999998},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":14.845000000000001,"15min":90.911000000000001},"last":0.31}]},{"osd":4,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.0920000000000001,"15min":5.1589999999999998},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.218},"max":{"1min":0.55000000000000004,"5min":16.939,"15min":81.718999999999994},"last":0.25},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.78800000000000003,"15min":5.3019999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.621,"5min":16.827000000000002,"15min":81.775000000000006},"last":0.38400000000000001}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":4.157,"15min":8.4019999999999992},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":0.52800000000000002,"5min":77.674000000000007,"15min":135.32499999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":4.0529999999999999,"15min":8.4369999999999994},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":77.882000000000005,"15min":134.99299999999999},"last":0.30099999999999999}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.64000000000000001,"15min":2.8140000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.53200000000000003,"5min":9.0060000000000002,"15min":72.474999999999994},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.84099999999999997,"15min":3.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":20.064,"15min":72.403999999999996},"last":0.41799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575110,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":503808,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":323584,"data_stored":133802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":515899392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":9.3140000000000001,"15min":11.616},"min":{"1min":0.28499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.51500000000000001,"5min":129.80699999999999,"15min":129.80699999999999},"last":0.254},{"interface":"front","average":{"1min":0.36199999999999999,"5min":9.3170000000000002,"15min":11.853},"min":{"1min":0.26200000000000001,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":129.767,"15min":129.767},"last":0.317}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":7.0030000000000001,"15min":11.9},"min":{"1min":0.29099999999999998,"5min":0.24099999999999999,"15min":0.219},"max":{"1min":0.69999999999999996,"5min":114.83,"15min":120.13500000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":6.9550000000000001,"15min":11.571},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.23400000000000001},"max":{"1min":0.56399999999999995,"5min":114.842,"15min":119.708},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.343,"15min":4.3499999999999996},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.56000000000000005,"5min":17.885999999999999,"15min":107.033},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":1.3240000000000001,"15min":4.6289999999999996},"min":{"1min":0.32800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45300000000000001,"5min":17.895,"15min":107.062},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":1,"15min":2.6560000000000001},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.254},"max":{"1min":0.60399999999999998,"5min":16.376999999999999,"15min":96.834999999999994},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.432,"5min":1.0469999999999999,"15min":2.887},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.27800000000000002},"max":{"1min":0.54000000000000004,"5min":16.331,"15min":96.870000000000005},"last":0.432}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":2.899,"15min":6.5469999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.183},"max":{"1min":0.48699999999999999,"5min":73.783000000000001,"15min":96.807000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.44,"5min":2.8500000000000001,"15min":6.5510000000000002},"min":{"1min":0.32300000000000001,"5min":0.28899999999999998,"15min":0.26000000000000001},"max":{"1min":0.58099999999999996,"5min":73.852999999999994,"15min":96.768000000000001},"last":0.35799999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":4.6390000000000002,"15min":7.9610000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":0.65300000000000002,"5min":79.944999999999993,"15min":100.741},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":5.1269999999999998,"15min":8.0600000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":80.159000000000006,"15min":100.715},"last":0.375}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":1.212,"15min":3.7719999999999998},"min":{"1min":0.34399999999999997,"5min":0.27100000000000002,"15min":0.23400000000000001},"max":{"1min":0.50700000000000001,"5min":15.968999999999999,"15min":59.606999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.83599999999999997,"15min":3.3679999999999999},"min":{"1min":0.36899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":10.551,"15min":59.384},"last":0.41499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575108,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":621772,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":621440,"kb_avail":93750068,"statfs":{"total":96636764160,"available":96000069632,"internally_reserved":0,"allocated":331776,"data_stored":144263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":636354560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":9.8260000000000005,"15min":11.797000000000001},"min":{"1min":0.21199999999999999,"5min":0.19,"15min":0.16700000000000001},"max":{"1min":0.36899999999999999,"5min":117.01600000000001,"15min":117.01600000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.28399999999999997,"5min":9.5380000000000003,"15min":11.470000000000001},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":0.38200000000000001,"5min":116.699,"15min":116.699},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.661,"15min":4.8799999999999999},"min":{"1min":0.25,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.41599999999999998,"5min":28.670000000000002,"15min":115.44499999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":1.5169999999999999,"15min":4.7030000000000003},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.20899999999999999},"max":{"1min":0.52100000000000002,"5min":28.707000000000001,"15min":115.41500000000001},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":1.319,"15min":3.2320000000000002},"min":{"1min":0.30099999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":0.60499999999999998,"5min":25.152000000000001,"15min":87.884},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":2.387,"15min":3.3530000000000002},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.16600000000000001},"max":{"1min":0.51600000000000001,"5min":36.569000000000003,"15min":61.415999999999997},"last":0.318}]},{"osd":4,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":2.6949999999999998,"15min":8.0050000000000008},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":63.790999999999997,"15min":90.248999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":2.919,"15min":8.157},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.28000000000000003},"max":{"1min":0.64500000000000002,"5min":63.770000000000003,"15min":90.209999999999994},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":3.5659999999999998,"15min":8.9169999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":74.334999999999994,"15min":161.06899999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":3.3999999999999999,"15min":8.8940000000000001},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.65300000000000002,"5min":74.263000000000005,"15min":160.91499999999999},"last":0.5}]},{"osd":6,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":1.5800000000000001,"15min":4.2859999999999996},"min":{"1min":0.373,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":30.183,"15min":115.45999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.496,"5min":1.631,"15min":3.9089999999999998},"min":{"1min":0.40999999999999998,"5min":0.34499999999999997,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":30.236000000000001,"15min":115.346},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:56:09 2022","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.4139999999999999,"15min":2.7429999999999999},"min":{"1min":0.38200000000000001,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":0.67100000000000004,"5min":31.812999999999999,"15min":58.457000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":1.141,"15min":2.8740000000000001},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.29499999999999998},"max":{"1min":0.68200000000000005,"5min":11.885,"15min":58.526000000000003},"last":0.41599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575108,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604048,"kb_used_data":7688,"kb_used_omap":0,"kb_used_meta":596352,"kb_avail":93767792,"statfs":{"total":96636764160,"available":96018219008,"internally_reserved":0,"allocated":7872512,"data_stored":11047118,"data_compressed":668339,"data_compressed_allocated":1007616,"data_compressed_original":4403200,"omap_allocated":0,"internal_metadata":610664448},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":8.8580000000000005,"15min":11.233000000000001},"min":{"1min":0.21199999999999999,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":0.45000000000000001,"5min":90.528999999999996,"15min":111.419},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":9.6319999999999997,"15min":11.512},"min":{"1min":0.26800000000000002,"5min":0.21299999999999999,"15min":0.17799999999999999},"max":{"1min":0.51100000000000001,"5min":93.111999999999995,"15min":111.506},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.323,"15min":5.5839999999999996},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":0.52700000000000002,"5min":21.789000000000001,"15min":130.566},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.881,"15min":5.798},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.222},"max":{"1min":2.5910000000000002,"5min":50.625,"15min":130.63300000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":1.385,"15min":3.5369999999999999},"min":{"1min":0.22700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.39600000000000002,"5min":22.013000000000002,"15min":111.333},"last":0.314},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.9810000000000001,"15min":3.6880000000000002},"min":{"1min":0.30399999999999999,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":50.686999999999998,"15min":111.377},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":1.804,"15min":6.6820000000000004},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.24099999999999999},"max":{"1min":0.57699999999999996,"5min":39.814999999999998,"15min":127.629},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":2.6480000000000001,"15min":7.0259999999999998},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":2.5209999999999999,"5min":50.734000000000002,"15min":127.497},"last":0.379}]},{"osd":5,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":3.7650000000000001,"15min":7.7489999999999997},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":88.512,"15min":127.77500000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":3.9710000000000001,"15min":8.3360000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":88.429000000000002,"15min":127.798},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":1.903,"15min":4.4100000000000001},"min":{"1min":0.32500000000000001,"5min":0.27900000000000003,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":50.664000000000001,"15min":114.8},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":2.1269999999999998,"15min":4.5149999999999997},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":2.5590000000000002,"5min":50.767000000000003,"15min":114.77800000000001},"last":0.35099999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:56:17 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8049999999999999,"15min":3.0699999999999998},"min":{"1min":0.35199999999999998,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":50.707999999999998,"15min":58.447000000000003},"last":0.373},{"interface":"front","average":{"1min":0.48099999999999998,"5min":2.2690000000000001,"15min":3.298},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":50.914000000000001,"15min":58.558999999999997},"last":0.42899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575109,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472448,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":472128,"kb_avail":93899392,"statfs":{"total":96636764160,"available":96152977408,"internally_reserved":0,"allocated":319488,"data_stored":133780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":483459072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:08 2022","interfaces":[{"interface":"back","average":{"1min":0.27200000000000002,"5min":15.108000000000001,"15min":15.090999999999999},"min":{"1min":0.19900000000000001,"5min":0.18099999999999999,"15min":0.14899999999999999},"max":{"1min":0.40699999999999997,"5min":117.869,"15min":117.869},"last":0.245},{"interface":"front","average":{"1min":0.309,"5min":15.01,"15min":15.234},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41899999999999998,"5min":117.889,"15min":117.889},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":8.7029999999999994,"15min":12.433999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.185},"max":{"1min":0.38100000000000001,"5min":150.911,"15min":150.911},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":8.8629999999999995,"15min":12.443},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.185},"max":{"1min":0.53000000000000003,"5min":150.88300000000001,"15min":150.88300000000001},"last":0.307}]},{"osd":3,"last update":"Wed Aug 10 17:56:19 2022","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":1.1319999999999999,"15min":2.593},"min":{"1min":0.28399999999999997,"5min":0.22700000000000001,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":21.376000000000001,"15min":95.066999999999993},"last":0.37},{"interface":"front","average":{"1min":0.38500000000000001,"5min":1.103,"15min":2.4609999999999999},"min":{"1min":0.29799999999999999,"5min":0.23699999999999999,"15min":0.219},"max":{"1min":0.48799999999999999,"5min":19.399000000000001,"15min":95.117000000000004},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":2.851,"15min":7.4329999999999998},"min":{"1min":0.373,"5min":0.307,"15min":0.25900000000000001},"max":{"1min":0.71699999999999997,"5min":47.207999999999998,"15min":114.259},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.7519999999999998,"15min":7.6630000000000003},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71099999999999997,"5min":47.179000000000002,"15min":114.39700000000001},"last":0.502}]},{"osd":5,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":2.887,"15min":7.3529999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":0.72999999999999998,"5min":59.984999999999999,"15min":94.867000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.433,"5min":3.0209999999999999,"15min":7.3540000000000001},"min":{"1min":0.35399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":63.508000000000003,"15min":100.22},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.1200000000000001,"15min":2.7989999999999999},"min":{"1min":0.378,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":19.789999999999999,"15min":60.429000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3029999999999999,"15min":2.9609999999999999},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.28499999999999998},"max":{"1min":0.58699999999999997,"5min":28.131,"15min":60.445},"last":0.41199999999999998}]},{"osd":7,"last update":"Wed Aug 10 17:56:01 2022","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":1.355,"15min":3.5139999999999998},"min":{"1min":0.34899999999999998,"5min":0.33000000000000002,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":34.904000000000003,"15min":94.753},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":1.2889999999999999,"15min":3.7010000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":0.60499999999999998,"5min":19.922999999999998,"15min":94.894000000000005},"last":0.379}]}]},{"osd":3,"up_from":13,"seq":55834575109,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473944,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":472000,"kb_avail":93897896,"statfs":{"total":96636764160,"available":96151445504,"internally_reserved":0,"allocated":1982464,"data_stored":2795765,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":483328000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":10.327,"15min":12.210000000000001},"min":{"1min":0.19400000000000001,"5min":0.187,"15min":0.16300000000000001},"max":{"1min":0.434,"5min":117.169,"15min":117.169},"last":0.192},{"interface":"front","average":{"1min":0.34799999999999998,"5min":10.387,"15min":12.581},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50800000000000001,"5min":117.199,"15min":117.199},"last":0.25700000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":4.3049999999999997,"15min":10.551},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.19400000000000001},"max":{"1min":0.45000000000000001,"5min":56.604999999999997,"15min":135.714},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":4.0940000000000003,"15min":10.529},"min":{"1min":0.23300000000000001,"5min":0.23200000000000001,"15min":0.183},"max":{"1min":0.46600000000000003,"5min":57.014000000000003,"15min":135.65700000000001},"last":0.27100000000000002}]},{"osd":2,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":2.1440000000000001,"15min":3.5649999999999999},"min":{"1min":0.26700000000000002,"5min":0.19900000000000001,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":87.492000000000004,"15min":87.492000000000004},"last":0.309},{"interface":"front","average":{"1min":0.35199999999999998,"5min":2.169,"15min":3.3100000000000001},"min":{"1min":0.29899999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":87.260000000000005,"15min":87.260000000000005},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":2.7570000000000001,"15min":5.2770000000000001},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":63.719000000000001,"15min":70.677000000000007},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.433,"5min":2.2599999999999998,"15min":5.2560000000000002},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.66900000000000004,"5min":63.731999999999999,"15min":70.665999999999997},"last":0.35499999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":2.7040000000000002,"15min":5.6210000000000004},"min":{"1min":0.378,"5min":0.30399999999999999,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":45.448,"15min":70.989000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":2.948,"15min":5.5910000000000002},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":45.462000000000003,"15min":71.114000000000004},"last":0.437}]},{"osd":6,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":1.0369999999999999,"15min":3.4300000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":9.9450000000000003,"15min":51.773000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.675,"15min":3.3530000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":34.656999999999996,"15min":51.738},"last":0.45700000000000002}]},{"osd":7,"last update":"Wed Aug 10 17:56:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.5609999999999999,"15min":3.3999999999999999},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.64000000000000001,"5min":34.624000000000002,"15min":59.198999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3140000000000001,"15min":3.2690000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":21.422000000000001,"15min":59.026000000000003},"last":0.38500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575111,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":559988,"kb_used_data":8620,"kb_used_omap":0,"kb_used_meta":551360,"kb_avail":93811852,"statfs":{"total":96636764160,"available":96063336448,"internally_reserved":0,"allocated":8826880,"data_stored":13742708,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":564592640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":8.7799999999999994,"15min":11.246},"min":{"1min":0.28599999999999998,"5min":0.20000000000000001,"15min":0.19700000000000001},"max":{"1min":0.47299999999999998,"5min":101.88,"15min":136.29300000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":9.1229999999999993,"15min":11.416},"min":{"1min":0.28199999999999997,"5min":0.255,"15min":0.23300000000000001},"max":{"1min":0.55900000000000005,"5min":101.867,"15min":136.142},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":7.3230000000000004,"15min":11.394},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.47799999999999998,"5min":146.44200000000001,"15min":146.44200000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":7.1520000000000001,"15min":10.872999999999999},"min":{"1min":0.32100000000000001,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":0.54500000000000004,"5min":146.45699999999999,"15min":146.45699999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":1.7390000000000001,"15min":4.4000000000000004},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":33.960999999999999,"15min":83.099999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.792,"15min":3.9990000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.22800000000000001},"max":{"1min":0.66200000000000003,"5min":33.981999999999999,"15min":83.212999999999994},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":1.587,"15min":3.8140000000000001},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.24099999999999999},"max":{"1min":0.48599999999999999,"5min":30.765000000000001,"15min":63.142000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":1.6299999999999999,"15min":3.5350000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.25800000000000001},"max":{"1min":0.52000000000000002,"5min":29.956,"15min":63.167999999999999},"last":0.40999999999999998}]},{"osd":5,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":2.2989999999999999,"15min":8.6020000000000003},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.219},"max":{"1min":0.502,"5min":49.238999999999997,"15min":84.778999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.434,"5min":2.2389999999999999,"15min":8.8559999999999999},"min":{"1min":0.32100000000000001,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":0.61599999999999999,"5min":49.283999999999999,"15min":84.762},"last":0.35399999999999998}]},{"osd":6,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":1.1970000000000001,"15min":4.5780000000000003},"min":{"1min":0.30499999999999999,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.54800000000000004,"5min":30.805,"15min":83.144000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.755,"15min":4.976},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.23899999999999999},"max":{"1min":0.63700000000000001,"5min":21.940999999999999,"15min":83.070999999999998},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Aug 10 17:56:03 2022","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.1379999999999999,"15min":2.5950000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":23.818000000000001,"15min":60.109000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.83299999999999996,"15min":3.1030000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55700000000000005,"5min":10.853999999999999,"15min":60.124000000000002},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575109,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":546944,"kb_avail":93824560,"statfs":{"total":96636764160,"available":96076349440,"internally_reserved":0,"allocated":335872,"data_stored":135004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":560070656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":8.298,"15min":11.548999999999999},"min":{"1min":0.28199999999999997,"5min":0.22900000000000001,"15min":0.192},"max":{"1min":0.51500000000000001,"5min":94.200000000000003,"15min":112.441},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":9.9450000000000003,"15min":12.314},"min":{"1min":0.27700000000000002,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":159.19999999999999,"15min":159.19999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":6.5839999999999996,"15min":10.292},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":0.46700000000000003,"5min":106.054,"15min":111.13800000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":6.9550000000000001,"15min":10.839},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.20799999999999999},"max":{"1min":0.54800000000000004,"5min":106.26900000000001,"15min":140.95099999999999},"last":0.441}]},{"osd":2,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":1.4370000000000001,"15min":4.0359999999999996},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":52.337000000000003,"15min":112.09099999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.436,"5min":1.736,"15min":4.3150000000000004},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.51500000000000001,"5min":52.393999999999998,"15min":112.91200000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":1.3100000000000001,"15min":3.9049999999999998},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":41.634999999999998,"15min":139.75299999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.3109999999999999,"15min":3.8130000000000002},"min":{"1min":0.33500000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.50700000000000001,"5min":46.216999999999999,"15min":110.21599999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":1.083,"15min":7.2679999999999998},"min":{"1min":0.248,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.55000000000000004,"5min":25.922999999999998,"15min":88.391000000000005},"last":0.312},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.234,"15min":7.3840000000000003},"min":{"1min":0.316,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":0.56499999999999995,"5min":26.094000000000001,"15min":88.344999999999999},"last":0.434}]},{"osd":6,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.81599999999999995,"15min":3.052},"min":{"1min":0.248,"5min":0.248,"15min":0.222},"max":{"1min":0.48599999999999999,"5min":15.548,"15min":68.132999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.94899999999999995,"15min":3.1429999999999998},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":0.5,"5min":15.49,"15min":67.926000000000002},"last":0.36599999999999999}]},{"osd":7,"last update":"Wed Aug 10 17:56:11 2022","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.82199999999999995,"15min":3.7989999999999999},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":25.954999999999998,"15min":65.207999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.64600000000000002,"15min":3.8039999999999998},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.254},"max":{"1min":0.58199999999999996,"5min":7.2000000000000002,"15min":65.260999999999996},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32303,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":10323060,"data_compressed":636036,"data_compressed_allocated":962560,"data_compressed_original":3829760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":10573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":2662075,"data_compressed":247346,"data_compressed_allocated":352256,"data_compressed_original":1368064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8511488,"data_stored":13609018,"data_compressed":1139959,"data_compressed_allocated":1638400,"data_compressed_original":6778880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":5937620,"data_compressed":751269,"data_compressed_allocated":1028096,"data_compressed_original":4317184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-08-10T17:57:06.211 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2022-08-10T17:57:06.361 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.358+0000 7f8a0b655700 1 Processor -- start 2022-08-10T17:57:06.362 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.358+0000 7f8a0b655700 1 -- start start 2022-08-10T17:57:06.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a0b655700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 0x7f8a04069620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a0b655700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a040c3020 con 0x7f8a040c1730 2022-08-10T17:57:06.367 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a0b655700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a04156bd0 con 0x7f8a04070240 2022-08-10T17:57:06.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a0b655700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040c1b60 con 0x7f8a040691a0 2022-08-10T17:57:06.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a08bf0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a040c1730 0x7f8a040cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58526/0 (socket says 172.21.15.150:58526) 2022-08-10T17:57:06.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a08bf0700 1 -- 172.21.15.150:0/1916634533 learned_addr learned my addr 172.21.15.150:0/1916634533 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:06.368 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a09bf2700 1 --2- 172.21.15.150:0/1916634533 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 0x7f8a04069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742853196 0 0) 0x7f8a040c3020 con 0x7f8a040c1730 2022-08-10T17:57:06.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ec003430 con 0x7f8a040c1730 2022-08-10T17:57:06.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362443179 0 0) 0x7f8a04156bd0 con 0x7f8a04070240 2022-08-10T17:57:06.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a040c3020 con 0x7f8a04070240 2022-08-10T17:57:06.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a09bf2700 1 -- 172.21.15.150:0/1916634533 >> v1:172.21.15.197:6789/0 conn(0x7f8a04070240 legacy=0x7f8a04157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a09bf2700 1 -- 172.21.15.150:0/1916634533 >> v1:172.21.15.150:6789/0 conn(0x7f8a040c1730 legacy=0x7f8a040cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a09bf2700 1 -- 172.21.15.150:0/1916634533 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0406f770 con 0x7f8a040691a0 2022-08-10T17:57:06.370 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.359+0000 7f8a09bf2700 1 --2- 172.21.15.150:0/1916634533 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 0x7f8a04069620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009dc0 tx=0x7f89fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f60b3d70dfba4a2 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00e070 con 0x7f8a040691a0 2022-08-10T17:57:06.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00bb20 con 0x7f8a040691a0 2022-08-10T17:57:06.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f89f3fff700 1 -- 172.21.15.150:0/1916634533 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc012430 con 0x7f8a040691a0 2022-08-10T17:57:06.371 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 -- 172.21.15.150:0/1916634533 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 msgr2=0x7f8a04069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 --2- 172.21.15.150:0/1916634533 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 0x7f8a04069620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009dc0 tx=0x7f89fc00b330 comp rx=0 tx=0).stop 2022-08-10T17:57:06.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 -- 172.21.15.150:0/1916634533 shutdown_connections 2022-08-10T17:57:06.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 --2- 172.21.15.150:0/1916634533 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a040691a0 0x7f8a04069620 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.372 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 -- 172.21.15.150:0/1916634533 >> 172.21.15.150:0/1916634533 conn(0x7f8a04071e40 msgr2=0x7f8a040cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:06.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 -- 172.21.15.150:0/1916634533 shutdown_connections 2022-08-10T17:57:06.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.360+0000 7f8a0b655700 1 -- 172.21.15.150:0/1916634533 wait complete. 2022-08-10T17:57:06.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.361+0000 7f8a0b655700 1 Processor -- start 2022-08-10T17:57:06.373 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.361+0000 7f8a0b655700 1 -- start start 2022-08-10T17:57:06.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a040691a0 0x7f8a04149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 0x7f8a040c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.374 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0414a530 con 0x7f8a040c1730 2022-08-10T17:57:06.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04159260 con 0x7f8a040691a0 2022-08-10T17:57:06.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a0b655700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04159820 con 0x7f8a04070240 2022-08-10T17:57:06.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a09bf2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.375 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a08bf0700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 0x7f8a040c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a09bf2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45854/0 (socket says 172.21.15.150:45854) 2022-08-10T17:57:06.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a09bf2700 1 -- 172.21.15.150:0/890633362 learned_addr learned my addr 172.21.15.150:0/890633362 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:06.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.362+0000 7f8a093f1700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a040691a0 0x7f8a04149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.376 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 -- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 msgr2=0x7f8a040c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 0x7f8a040c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 -- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a040691a0 msgr2=0x7f8a04149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a040691a0 0x7f8a04149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.377 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 -- 172.21.15.150:0/890633362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc009a70 con 0x7f8a040c1730 2022-08-10T17:57:06.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a08bf0700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 0x7f8a040c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:06.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a09bf2700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00b370 tx=0x7f89fc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc01b810 con 0x7f8a040c1730 2022-08-10T17:57:06.378 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a04154ff0 con 0x7f8a040c1730 2022-08-10T17:57:06.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc020070 con 0x7f8a040c1730 2022-08-10T17:57:06.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc01bbb0 con 0x7f8a040c1730 2022-08-10T17:57:06.379 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.363+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a041594b0 con 0x7f8a040c1730 2022-08-10T17:57:06.380 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.364+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a04159640 con 0x7f8a040c1730 2022-08-10T17:57:06.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.365+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f89fc01bd10 con 0x7f8a040c1730 2022-08-10T17:57:06.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.365+0000 7f89f1ffb700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 0x7f89e4067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.365+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f89fc022070 con 0x7f8a040c1730 2022-08-10T17:57:06.381 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.365+0000 7f8a093f1700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 0x7f89e4067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.365+0000 7f8a093f1700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 0x7f89e4067590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a00001220 tx=0x7f8a00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.382 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.369+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f89fc0522f0 con 0x7f8a040c1730 2022-08-10T17:57:06.554 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.550+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8a04072890 con 0x7f8a040c1730 2022-08-10T17:57:06.557 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.554+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f89fc0098f0 con 0x7f8a040c1730 2022-08-10T17:57:06.558 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.554+0000 7f89f1ffb700 1 -- 172.21.15.150:0/890633362 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f89fc055910 con 0x7f8a040c1730 2022-08-10T17:57:06.561 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 msgr2=0x7f89e4067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 0x7f89e4067590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a00001220 tx=0x7f8a00009040 comp rx=0 tx=0).stop 2022-08-10T17:57:06.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 msgr2=0x7f8a040c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00b370 tx=0x7f89fc004950 comp rx=0 tx=0).stop 2022-08-10T17:57:06.562 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 shutdown_connections 2022-08-10T17:57:06.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a040c1730 0x7f8a040c4700 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8a040691a0 0x7f8a04149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f89e40650e0 0x7f89e4067590 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.563 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 --2- 172.21.15.150:0/890633362 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8a04070240 0x7f8a040c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 >> 172.21.15.150:0/890633362 conn(0x7f8a04071e40 msgr2=0x7f8a041547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 shutdown_connections 2022-08-10T17:57:06.564 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.557+0000 7f8a0b655700 1 -- 172.21.15.150:0/890633362 wait complete. 2022-08-10T17:57:06.573 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2022-08-10T17:57:06.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:57:06.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.692+0000 7ff33213d700 1 Processor -- start 2022-08-10T17:57:06.696 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.692+0000 7ff33213d700 1 -- start start 2022-08-10T17:57:06.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff33213d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 0x7ff32c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff33213d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 0x7ff32c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.702 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff33213d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0c4dc0 con 0x7ff32c0647d0 2022-08-10T17:57:06.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff33213d700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c0c5940 con 0x7ff32c150af0 2022-08-10T17:57:06.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff33213d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0c9fc0 con 0x7ff32c06c860 2022-08-10T17:57:06.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff32c0647d0 0x7ff32c0c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58542/0 (socket says 172.21.15.150:58542) 2022-08-10T17:57:06.703 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32bfff700 1 -- 172.21.15.150:0/2424705890 learned_addr learned my addr 172.21.15.150:0/2424705890 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32affd700 1 --2- 172.21.15.150:0/2424705890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 0x7ff32c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32b7fe700 1 --2- 172.21.15.150:0/2424705890 >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 0x7ff32c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32a7fc700 1 -- 172.21.15.150:0/2424705890 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746961809 0 0) 0x7ff32c0c4dc0 con 0x7ff32c0647d0 2022-08-10T17:57:06.704 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32a7fc700 1 -- 172.21.15.150:0/2424705890 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff318003430 con 0x7ff32c0647d0 2022-08-10T17:57:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32affd700 1 -- 172.21.15.150:0/2424705890 >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 msgr2=0x7ff32c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32affd700 1 --2- 172.21.15.150:0/2424705890 >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 0x7ff32c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32affd700 1 -- 172.21.15.150:0/2424705890 >> v1:172.21.15.150:6789/0 conn(0x7ff32c0647d0 legacy=0x7ff32c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.705 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32affd700 1 -- 172.21.15.150:0/2424705890 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c06f9a0 con 0x7ff32c06c860 2022-08-10T17:57:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.693+0000 7ff32b7fe700 1 --2- 172.21.15.150:0/2424705890 >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 0x7ff32c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff32affd700 1 --2- 172.21.15.150:0/2424705890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 0x7ff32c15a3a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3200096b0 tx=0x7ff3200099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993790b939212ad4 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.706 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff32a7fc700 1 -- 172.21.15.150:0/2424705890 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200107b0 con 0x7ff32c06c860 2022-08-10T17:57:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff32a7fc700 1 -- 172.21.15.150:0/2424705890 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff320010910 con 0x7ff32c06c860 2022-08-10T17:57:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff32a7fc700 1 -- 172.21.15.150:0/2424705890 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320010ca0 con 0x7ff32c06c860 2022-08-10T17:57:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 -- 172.21.15.150:0/2424705890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 msgr2=0x7ff32c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.707 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 --2- 172.21.15.150:0/2424705890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 0x7ff32c15a3a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3200096b0 tx=0x7ff3200099c0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 -- 172.21.15.150:0/2424705890 shutdown_connections 2022-08-10T17:57:06.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 --2- 172.21.15.150:0/2424705890 >> v2:172.21.15.197:3300/0 conn(0x7ff32c150af0 0x7ff32c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 --2- 172.21.15.150:0/2424705890 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c06c860 0x7ff32c15a3a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.708 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 -- 172.21.15.150:0/2424705890 >> 172.21.15.150:0/2424705890 conn(0x7ff32c0c92f0 msgr2=0x7ff32c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:06.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 -- 172.21.15.150:0/2424705890 shutdown_connections 2022-08-10T17:57:06.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.694+0000 7ff33213d700 1 -- 172.21.15.150:0/2424705890 wait complete. 2022-08-10T17:57:06.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.695+0000 7ff33213d700 1 Processor -- start 2022-08-10T17:57:06.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 -- start start 2022-08-10T17:57:06.709 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff32c06c860 0x7ff32c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 0x7ff32c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c156bb0 con 0x7ff32c0647d0 2022-08-10T17:57:06.710 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0bd660 con 0x7ff32c06c860 2022-08-10T17:57:06.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff33213d700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c1efa00 con 0x7ff32c150af0 2022-08-10T17:57:06.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff32b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff32bfff700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 0x7ff32c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.711 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff32affd700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff32c06c860 0x7ff32c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff32b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45864/0 (socket says 172.21.15.150:45864) 2022-08-10T17:57:06.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.696+0000 7ff32b7fe700 1 -- 172.21.15.150:0/1997130268 learned_addr learned my addr 172.21.15.150:0/1997130268 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:06.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 -- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 msgr2=0x7ff32c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.712 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 0x7ff32c0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 -- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff32c06c860 msgr2=0x7ff32c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff32c06c860 0x7ff32c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 -- 172.21.15.150:0/1997130268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c009310 con 0x7ff32c0647d0 2022-08-10T17:57:06.713 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32bfff700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 0x7ff32c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:06.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff32b7fe700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e870 tx=0x7ff31c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c013680 con 0x7ff32c0647d0 2022-08-10T17:57:06.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff31c0137e0 con 0x7ff32c0647d0 2022-08-10T17:57:06.714 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff320009310 con 0x7ff32c0647d0 2022-08-10T17:57:06.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c013b90 con 0x7ff32c0647d0 2022-08-10T17:57:06.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.697+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c1efca0 con 0x7ff32c0647d0 2022-08-10T17:57:06.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.698+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c1ef860 con 0x7ff32c0647d0 2022-08-10T17:57:06.715 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.699+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff31c019030 con 0x7ff32c0647d0 2022-08-10T17:57:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.699+0000 7ff313fff700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 0x7ff30c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.699+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff31c081f00 con 0x7ff32c0647d0 2022-08-10T17:57:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.699+0000 7ff32affd700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 0x7ff30c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:06.717 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.700+0000 7ff32affd700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 0x7ff30c067560 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06ccb0 tx=0x7ff320008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:06.718 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.703+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff32c1ef860 con 0x7ff32c0647d0 2022-08-10T17:57:06.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.930+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff32c1ef860 con 0x7ff32c0647d0 2022-08-10T17:57:06.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.931+0000 7ff313fff700 1 -- 172.21.15.150:0/1997130268 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+6152 (secure 0 0 0) 0x7ff32c1ef860 con 0x7ff32c0647d0 2022-08-10T17:57:06.935 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:57:06.935 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:56:50.874807+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":40,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:57:06.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 msgr2=0x7ff30c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 0x7ff30c067560 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06ccb0 tx=0x7ff320008030 comp rx=0 tx=0).stop 2022-08-10T17:57:06.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 msgr2=0x7ff32c1f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:06.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e870 tx=0x7ff31c00eb80 comp rx=0 tx=0).stop 2022-08-10T17:57:06.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 shutdown_connections 2022-08-10T17:57:06.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff30c0650b0 0x7ff30c067560 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff32c150af0 0x7ff32c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff32c0647d0 0x7ff32c1f01c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 --2- 172.21.15.150:0/1997130268 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff32c06c860 0x7ff32c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:06.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 >> 172.21.15.150:0/1997130268 conn(0x7ff32c0c92f0 msgr2=0x7ff32c14d400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:06.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 shutdown_connections 2022-08-10T17:57:06.940 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:06.933+0000 7ff33213d700 1 -- 172.21.15.150:0/1997130268 wait complete. 2022-08-10T17:57:06.940 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2022-08-10T17:57:06.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-08-10T17:57:07.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.067+0000 7f6311125700 1 Processor -- start 2022-08-10T17:57:07.071 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.067+0000 7f6311125700 1 -- start start 2022-08-10T17:57:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 0x7f630c0c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.084 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f630c06d850 0x7f630c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f630c0b0e20 0x7f630c0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0c39a0 con 0x7f630c0b0e20 2022-08-10T17:57:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c06e120 con 0x7f630c06d850 2022-08-10T17:57:07.085 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f6311125700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0c5620 con 0x7f630c06d480 2022-08-10T17:57:07.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f630c0b0e20 0x7f630c0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 0x7f630c0c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630ad9d700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 0x7f630c0c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:60094/0 (socket says 172.21.15.150:60094) 2022-08-10T17:57:07.086 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f630c0b0e20 0x7f630c0c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45876/0 (socket says 172.21.15.150:45876) 2022-08-10T17:57:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630ad9d700 1 -- 172.21.15.150:0/720614049 learned_addr learned my addr 172.21.15.150:0/720614049 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630a59c700 1 --2- 172.21.15.150:0/720614049 >> v2:172.21.15.197:3300/0 conn(0x7f630c06d850 0x7f630c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 -- 172.21.15.150:0/720614049 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 msgr2=0x7f630c0c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:07.087 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 --2- 172.21.15.150:0/720614049 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 0x7f630c0c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 -- 172.21.15.150:0/720614049 >> v2:172.21.15.197:3300/0 conn(0x7f630c06d850 msgr2=0x7f630c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:07.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 --2- 172.21.15.150:0/720614049 >> v2:172.21.15.197:3300/0 conn(0x7f630c06d850 0x7f630c0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.068+0000 7f630b59e700 1 -- 172.21.15.150:0/720614049 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0c5900 con 0x7f630c0b0e20 2022-08-10T17:57:07.088 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f630b59e700 1 --2- 172.21.15.150:0/720614049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c0b0e20 0x7f630c0c4410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f630c06f5f0 tx=0x7f630400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b14fa88d0464d19 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6309d9b700 1 -- 172.21.15.150:0/720614049 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400e070 con 0x7f630c0b0e20 2022-08-10T17:57:07.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6309d9b700 1 -- 172.21.15.150:0/720614049 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f630400bb20 con 0x7f630c0b0e20 2022-08-10T17:57:07.089 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6309d9b700 1 -- 172.21.15.150:0/720614049 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304012430 con 0x7f630c0b0e20 2022-08-10T17:57:07.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 -- 172.21.15.150:0/720614049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c0b0e20 msgr2=0x7f630c0c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 --2- 172.21.15.150:0/720614049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c0b0e20 0x7f630c0c4410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f630c06f5f0 tx=0x7f630400b330 comp rx=0 tx=0).stop 2022-08-10T17:57:07.090 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 -- 172.21.15.150:0/720614049 shutdown_connections 2022-08-10T17:57:07.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 --2- 172.21.15.150:0/720614049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c0b0e20 0x7f630c0c4410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 --2- 172.21.15.150:0/720614049 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d480 0x7f630c0c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 --2- 172.21.15.150:0/720614049 >> v2:172.21.15.197:3300/0 conn(0x7f630c06d850 0x7f630c0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.091 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 -- 172.21.15.150:0/720614049 >> 172.21.15.150:0/720614049 conn(0x7f630c06b3b0 msgr2=0x7f630c06fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:07.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 -- 172.21.15.150:0/720614049 shutdown_connections 2022-08-10T17:57:07.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.069+0000 7f6311125700 1 -- 172.21.15.150:0/720614049 wait complete. 2022-08-10T17:57:07.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 Processor -- start 2022-08-10T17:57:07.092 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 -- start start 2022-08-10T17:57:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d850 0x7f630c1ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f630c0b0e20 0x7f630c1ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.093 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0ac110 con 0x7f630c06d480 2022-08-10T17:57:07.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c068ad0 con 0x7f630c0b0e20 2022-08-10T17:57:07.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.071+0000 7f6311125700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c068d70 con 0x7f630c06d850 2022-08-10T17:57:07.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.094 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45878/0 (socket says 172.21.15.150:45878) 2022-08-10T17:57:07.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 -- 172.21.15.150:0/3972937682 learned_addr learned my addr 172.21.15.150:0/3972937682 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:07.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630a59c700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d850 0x7f630c1ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630b59e700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f630c0b0e20 0x7f630c1ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.095 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 -- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d850 msgr2=0x7f630c1ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d850 0x7f630c1ed2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 -- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f630c0b0e20 msgr2=0x7f630c1ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.096 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f630c0b0e20 0x7f630c1ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 -- 172.21.15.150:0/3972937682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009a70 con 0x7f630c06d480 2022-08-10T17:57:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f630ad9d700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00e840 tx=0x7f62fc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc013680 con 0x7f630c06d480 2022-08-10T17:57:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f62fc0137e0 con 0x7f630c06d480 2022-08-10T17:57:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c069050 con 0x7f630c06d480 2022-08-10T17:57:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc013b70 con 0x7f630c06d480 2022-08-10T17:57:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.072+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c069610 con 0x7f630c06d480 2022-08-10T17:57:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.073+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c069f40 con 0x7f630c06d480 2022-08-10T17:57:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.074+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f62fc019030 con 0x7f630c06d480 2022-08-10T17:57:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.074+0000 7f62f37fe700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 0x7f62ec067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.074+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f62fc081ed0 con 0x7f630c06d480 2022-08-10T17:57:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.074+0000 7f630a59c700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 0x7f62ec067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.100 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.074+0000 7f630a59c700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 0x7f62ec067590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cb580 tx=0x7f63000090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.101 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.082+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f62fc04fe30 con 0x7f630c06d480 2022-08-10T17:57:07.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.305+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f630c072890 con 0x7f630c06d480 2022-08-10T17:57:07.309 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.305+0000 7f62f37fe700 1 -- 172.21.15.150:0/3972937682 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+6152 (secure 0 0 0) 0x7f62fc021090 con 0x7f630c06d480 2022-08-10T17:57:07.309 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:57:07.310 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4219640178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4219640178},{"type":"v1","addr":"172.21.15.150:6837","nonce":4219640178}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/744243651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":744243651},{"type":"v1","addr":"172.21.15.150:6836","nonce":744243651}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.197:6838/1780584048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6836","nonce":1780584048},{"type":"v1","addr":"172.21.15.197:6838","nonce":1780584048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-08-10T17:35:37.393269+0000","modified":"2022-08-10T17:56:50.874807+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4317,"mds_1":4297,"mds_2":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":40,"addr":"172.21.15.150:6833/903670715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":903670715},{"type":"v1","addr":"172.21.15.150:6833","nonce":903670715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4297":{"gid":4297,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":38,"addr":"172.21.15.197:6839/4060491020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6837","nonce":4060491020},{"type":"v1","addr":"172.21.15.197:6839","nonce":4060491020}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4317":{"gid":4317,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.197:6835/1505577177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6834","nonce":1505577177},{"type":"v1","addr":"172.21.15.197:6835","nonce":1505577177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-08-10T17:57:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 msgr2=0x7f62ec067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 0x7f62ec067590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cb580 tx=0x7f63000090e0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 msgr2=0x7f630c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00e840 tx=0x7f62fc00eb50 comp rx=0 tx=0).stop 2022-08-10T17:57:07.312 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 shutdown_connections 2022-08-10T17:57:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f630c0b0e20 0x7f630c1ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f630c06d480 0x7f630c155b10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.313 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f62ec0650e0 0x7f62ec067590 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 --2- 172.21.15.150:0/3972937682 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f630c06d850 0x7f630c1ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 >> 172.21.15.150:0/3972937682 conn(0x7f630c06b3b0 msgr2=0x7f630c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 shutdown_connections 2022-08-10T17:57:07.314 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.307+0000 7f6311125700 1 -- 172.21.15.150:0/3972937682 wait complete. 2022-08-10T17:57:07.315 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 26 2022-08-10T17:57:07.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-10T17:57:07.445 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.441+0000 7ff34433a700 1 Processor -- start 2022-08-10T17:57:07.446 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.441+0000 7ff34433a700 1 -- start start 2022-08-10T17:57:07.452 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff33c1540f0 0x7ff33c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7ff33c1544c0 0x7ff33c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0c5270 con 0x7ff33c1540f0 2022-08-10T17:57:07.453 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0c6100 con 0x7ff33c1544c0 2022-08-10T17:57:07.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff34433a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c5e00 con 0x7ff33c0bd4b0 2022-08-10T17:57:07.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff33c1540f0 0x7ff33c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff33c1540f0 0x7ff33c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45886/0 (socket says 172.21.15.150:45886) 2022-08-10T17:57:07.454 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 -- 172.21.15.150:0/771808906 learned_addr learned my addr 172.21.15.150:0/771808906 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:07.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3418d5700 1 --2- 172.21.15.150:0/771808906 >> v2:172.21.15.197:3300/0 conn(0x7ff33c1544c0 0x7ff33c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3428d7700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 -- 172.21.15.150:0/771808906 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 msgr2=0x7ff33c068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:07.455 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 -- 172.21.15.150:0/771808906 >> v2:172.21.15.197:3300/0 conn(0x7ff33c1544c0 msgr2=0x7ff33c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:07.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 --2- 172.21.15.150:0/771808906 >> v2:172.21.15.197:3300/0 conn(0x7ff33c1544c0 0x7ff33c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 -- 172.21.15.150:0/771808906 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c06eb00 con 0x7ff33c1540f0 2022-08-10T17:57:07.456 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.442+0000 7ff3420d6700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1540f0 0x7ff33c071370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06be40 tx=0x7ff338009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f1fb8a2dae2fb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff3410d4700 1 -- 172.21.15.150:0/771808906 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004230 con 0x7ff33c1540f0 2022-08-10T17:57:07.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff3410d4700 1 -- 172.21.15.150:0/771808906 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff338004390 con 0x7ff33c1540f0 2022-08-10T17:57:07.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff3410d4700 1 -- 172.21.15.150:0/771808906 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338011870 con 0x7ff33c1540f0 2022-08-10T17:57:07.457 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 -- 172.21.15.150:0/771808906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1540f0 msgr2=0x7ff33c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1540f0 0x7ff33c071370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06be40 tx=0x7ff338009a60 comp rx=0 tx=0).stop 2022-08-10T17:57:07.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 -- 172.21.15.150:0/771808906 shutdown_connections 2022-08-10T17:57:07.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.458 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 --2- 172.21.15.150:0/771808906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1540f0 0x7ff33c071370 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 --2- 172.21.15.150:0/771808906 >> v2:172.21.15.197:3300/0 conn(0x7ff33c1544c0 0x7ff33c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 -- 172.21.15.150:0/771808906 >> 172.21.15.150:0/771808906 conn(0x7ff33c06d0d0 msgr2=0x7ff33c0c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:07.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 -- 172.21.15.150:0/771808906 shutdown_connections 2022-08-10T17:57:07.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.443+0000 7ff34433a700 1 -- 172.21.15.150:0/771808906 wait complete. 2022-08-10T17:57:07.459 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.445+0000 7ff34433a700 1 Processor -- start 2022-08-10T17:57:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.445+0000 7ff34433a700 1 -- start start 2022-08-10T17:57:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff33c1540f0 0x7ff33c1efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1ec900 con 0x7ff33c1544c0 2022-08-10T17:57:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1effd0 con 0x7ff33c1540f0 2022-08-10T17:57:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.446+0000 7ff34433a700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c15ae30 con 0x7ff33c0bd4b0 2022-08-10T17:57:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.461 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45896/0 (socket says 172.21.15.150:45896) 2022-08-10T17:57:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 -- 172.21.15.150:0/1149060299 learned_addr learned my addr 172.21.15.150:0/1149060299 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3420d6700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3418d5700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff33c1540f0 0x7ff33c1efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 -- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 msgr2=0x7ff33c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 -- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff33c1540f0 msgr2=0x7ff33c1efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff33c1540f0 0x7ff33c1efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 -- 172.21.15.150:0/1149060299 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380093e0 con 0x7ff33c1544c0 2022-08-10T17:57:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff3428d7700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff33400eed0 tx=0x7ff33400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334010040 con 0x7ff33c1544c0 2022-08-10T17:57:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff33400bc80 con 0x7ff33c1544c0 2022-08-10T17:57:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c1ebc80 con 0x7ff33c1544c0 2022-08-10T17:57:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334009e40 con 0x7ff33c1544c0 2022-08-10T17:57:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.447+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c1ec240 con 0x7ff33c1544c0 2022-08-10T17:57:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.448+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c1eca40 con 0x7ff33c1544c0 2022-08-10T17:57:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.449+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7ff334014400 con 0x7ff33c1544c0 2022-08-10T17:57:07.465 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.449+0000 7ff32affd700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 0x7ff31c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.449+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7ff334082960 con 0x7ff33c1544c0 2022-08-10T17:57:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.449+0000 7ff3420d6700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 0x7ff31c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.450+0000 7ff3420d6700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 0x7ff31c067560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3380096d0 tx=0x7ff338008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.457+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7ff33c1eca40 con 0x7ff33c1544c0 2022-08-10T17:57:07.644 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.640+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff33c1eca40 con 0x7ff33c1544c0 2022-08-10T17:57:07.645 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.642+0000 7ff32affd700 1 -- 172.21.15.150:0/1149060299 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18821 (secure 0 0 0) 0x7ff33c1eca40 con 0x7ff33c1544c0 2022-08-10T17:57:07.646 INFO:teuthology.orchestra.run.smithi150.stdout: 2022-08-10T17:57:07.646 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":29,"fsid":"1038d638-5c3e-47f8-a696-c70f19144095","created":"2022-08-10T17:35:11.850862+0000","modified":"2022-08-10T17:36:18.670734+0000","last_up_change":"2022-08-10T17:35:26.849703+0000","last_in_change":"2022-08-10T17:35:14.377554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-08-10T17:35:27.251819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-08-10T17:35:30.366555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-08-10T17:35:35.008984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-08-10T17:35:36.359965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-08-10T17:35:39.420480+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"98ca98d1-92cc-45ea-a7f1-9f0869c7dfd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":97995},{"type":"v1","addr":"172.21.15.150:6801","nonce":97995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":97995},{"type":"v1","addr":"172.21.15.150:6803","nonce":97995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":97995},{"type":"v1","addr":"172.21.15.150:6807","nonce":97995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":97995},{"type":"v1","addr":"172.21.15.150:6805","nonce":97995}]},"public_addr":"172.21.15.150:6801/97995","cluster_addr":"172.21.15.150:6803/97995","heartbeat_back_addr":"172.21.15.150:6807/97995","heartbeat_front_addr":"172.21.15.150:6805/97995","state":["exists","up"]},{"osd":1,"uuid":"d2c1f294-f218-4559-b04e-a2a230c87196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":98006},{"type":"v1","addr":"172.21.15.150:6817","nonce":98006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":98006},{"type":"v1","addr":"172.21.15.150:6819","nonce":98006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":98006},{"type":"v1","addr":"172.21.15.150:6823","nonce":98006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":98006},{"type":"v1","addr":"172.21.15.150:6821","nonce":98006}]},"public_addr":"172.21.15.150:6817/98006","cluster_addr":"172.21.15.150:6819/98006","heartbeat_back_addr":"172.21.15.150:6823/98006","heartbeat_front_addr":"172.21.15.150:6821/98006","state":["exists","up"]},{"osd":2,"uuid":"5d2a3df3-41d0-4150-97fc-7fad2adc3812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":98004},{"type":"v1","addr":"172.21.15.150:6809","nonce":98004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":98004},{"type":"v1","addr":"172.21.15.150:6811","nonce":98004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":98004},{"type":"v1","addr":"172.21.15.150:6815","nonce":98004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":98004},{"type":"v1","addr":"172.21.15.150:6813","nonce":98004}]},"public_addr":"172.21.15.150:6809/98004","cluster_addr":"172.21.15.150:6811/98004","heartbeat_back_addr":"172.21.15.150:6815/98004","heartbeat_front_addr":"172.21.15.150:6813/98004","state":["exists","up"]},{"osd":3,"uuid":"26947788-cf56-4352-bd46-38000bf1d126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":98020},{"type":"v1","addr":"172.21.15.150:6825","nonce":98020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":98020},{"type":"v1","addr":"172.21.15.150:6827","nonce":98020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":98020},{"type":"v1","addr":"172.21.15.150:6831","nonce":98020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":98020},{"type":"v1","addr":"172.21.15.150:6829","nonce":98020}]},"public_addr":"172.21.15.150:6825/98020","cluster_addr":"172.21.15.150:6827/98020","heartbeat_back_addr":"172.21.15.150:6831/98020","heartbeat_front_addr":"172.21.15.150:6829/98020","state":["exists","up"]},{"osd":4,"uuid":"1a95c275-f6b5-48a8-bf9d-12912e5be6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":98109},{"type":"v1","addr":"172.21.15.197:6801","nonce":98109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":98109},{"type":"v1","addr":"172.21.15.197:6803","nonce":98109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":98109},{"type":"v1","addr":"172.21.15.197:6807","nonce":98109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":98109},{"type":"v1","addr":"172.21.15.197:6805","nonce":98109}]},"public_addr":"172.21.15.197:6801/98109","cluster_addr":"172.21.15.197:6803/98109","heartbeat_back_addr":"172.21.15.197:6807/98109","heartbeat_front_addr":"172.21.15.197:6805/98109","state":["exists","up"]},{"osd":5,"uuid":"cee7100d-1f0a-4ead-9832-217bbe1b483f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":98110},{"type":"v1","addr":"172.21.15.197:6809","nonce":98110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":98110},{"type":"v1","addr":"172.21.15.197:6811","nonce":98110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":98110},{"type":"v1","addr":"172.21.15.197:6815","nonce":98110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":98110},{"type":"v1","addr":"172.21.15.197:6813","nonce":98110}]},"public_addr":"172.21.15.197:6809/98110","cluster_addr":"172.21.15.197:6811/98110","heartbeat_back_addr":"172.21.15.197:6815/98110","heartbeat_front_addr":"172.21.15.197:6813/98110","state":["exists","up"]},{"osd":6,"uuid":"94b91e81-e45f-451c-b4a4-7a216eaba26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":98136},{"type":"v1","addr":"172.21.15.197:6825","nonce":98136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":98136},{"type":"v1","addr":"172.21.15.197:6827","nonce":98136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":98136},{"type":"v1","addr":"172.21.15.197:6831","nonce":98136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":98136},{"type":"v1","addr":"172.21.15.197:6829","nonce":98136}]},"public_addr":"172.21.15.197:6825/98136","cluster_addr":"172.21.15.197:6827/98136","heartbeat_back_addr":"172.21.15.197:6831/98136","heartbeat_front_addr":"172.21.15.197:6829/98136","state":["exists","up"]},{"osd":7,"uuid":"2d1cd19c-4765-472f-b541-01dece4d9ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":98111},{"type":"v1","addr":"172.21.15.197:6817","nonce":98111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":98111},{"type":"v1","addr":"172.21.15.197:6819","nonce":98111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":98111},{"type":"v1","addr":"172.21.15.197:6823","nonce":98111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":98111},{"type":"v1","addr":"172.21.15.197:6821","nonce":98111}]},"public_addr":"172.21.15.197:6817/98111","cluster_addr":"172.21.15.197:6819/98111","heartbeat_back_addr":"172.21.15.197:6823/98111","heartbeat_front_addr":"172.21.15.197:6821/98111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.497705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.578318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.577599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.536117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.648271+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.665368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-08-10T17:35:24.657214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-10T17:57:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 msgr2=0x7ff31c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.648 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 0x7ff31c067560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3380096d0 tx=0x7ff338008030 comp rx=0 tx=0).stop 2022-08-10T17:57:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 msgr2=0x7ff33c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff33400eed0 tx=0x7ff33400b390 comp rx=0 tx=0).stop 2022-08-10T17:57:07.649 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 shutdown_connections 2022-08-10T17:57:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff33c1544c0 0x7ff33c157480 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.650 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7ff31c0650b0 0x7ff31c067560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7ff33c0bd4b0 0x7ff33c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 --2- 172.21.15.150:0/1149060299 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7ff33c1540f0 0x7ff33c1efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.651 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 >> 172.21.15.150:0/1149060299 conn(0x7ff33c06d0d0 msgr2=0x7ff33c1dfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 shutdown_connections 2022-08-10T17:57:07.652 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.644+0000 7ff34433a700 1 -- 172.21.15.150:0/1149060299 wait complete. 2022-08-10T17:57:07.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-08-10T17:57:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.799+0000 7f8cdc280700 1 Processor -- start 2022-08-10T17:57:07.803 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.799+0000 7f8cdc280700 1 -- start start 2022-08-10T17:57:07.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cdc280700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cdc280700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 0x7f8cd415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.809 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cdc280700 1 -- --> v1:172.21.15.197:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd406a050 con 0x7f8cd41544d0 2022-08-10T17:57:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cdc280700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40c6220 con 0x7f8cd406eff0 2022-08-10T17:57:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cdc280700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40c4420 con 0x7f8cd406ea90 2022-08-10T17:57:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cda01c700 1 --1- >> v1:172.21.15.197:6789/0 conn(0x7f8cd41544d0 0x7f8cd4071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.197:6789/0 says I am v1:172.21.15.150:44932/0 (socket says 172.21.15.150:44932) 2022-08-10T17:57:07.810 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cd981b700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cda01c700 1 -- 172.21.15.150:0/3172285411 learned_addr learned my addr 172.21.15.150:0/3172285411 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:07.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.800+0000 7f8cda81d700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 0x7f8cd415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd901a700 1 -- 172.21.15.150:0/3172285411 <== mon.1 v1:172.21.15.197:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77722349 0 0) 0x7f8cd406a050 con 0x7f8cd41544d0 2022-08-10T17:57:07.811 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd901a700 1 -- 172.21.15.150:0/3172285411 --> v1:172.21.15.197:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003430 con 0x7f8cd41544d0 2022-08-10T17:57:07.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd981b700 1 -- 172.21.15.150:0/3172285411 >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 msgr2=0x7f8cd415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:07.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd981b700 1 --2- 172.21.15.150:0/3172285411 >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 0x7f8cd415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd981b700 1 -- 172.21.15.150:0/3172285411 >> v1:172.21.15.197:6789/0 conn(0x7f8cd41544d0 legacy=0x7f8cd4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.812 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd981b700 1 -- 172.21.15.150:0/3172285411 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40c4700 con 0x7f8cd406ea90 2022-08-10T17:57:07.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cda81d700 1 --2- 172.21.15.150:0/3172285411 >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 0x7f8cd415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:07.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd981b700 1 --2- 172.21.15.150:0/3172285411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd415a260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40096b0 tx=0x7f8cc40099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868897ad491bb48c server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd901a700 1 -- 172.21.15.150:0/3172285411 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40107b0 con 0x7f8cd406ea90 2022-08-10T17:57:07.813 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd901a700 1 -- 172.21.15.150:0/3172285411 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8cc4010910 con 0x7f8cd406ea90 2022-08-10T17:57:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.801+0000 7f8cd901a700 1 -- 172.21.15.150:0/3172285411 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4010ce0 con 0x7f8cd406ea90 2022-08-10T17:57:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 -- 172.21.15.150:0/3172285411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 msgr2=0x7f8cd415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 --2- 172.21.15.150:0/3172285411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd415a260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40096b0 tx=0x7f8cc40099c0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 -- 172.21.15.150:0/3172285411 shutdown_connections 2022-08-10T17:57:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 --2- 172.21.15.150:0/3172285411 >> v2:172.21.15.197:3300/0 conn(0x7f8cd406eff0 0x7f8cd415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 --2- 172.21.15.150:0/3172285411 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd415a260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 -- 172.21.15.150:0/3172285411 >> 172.21.15.150:0/3172285411 conn(0x7f8cd4068110 msgr2=0x7f8cd4068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 -- 172.21.15.150:0/3172285411 shutdown_connections 2022-08-10T17:57:07.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.802+0000 7f8cdc280700 1 -- 172.21.15.150:0/3172285411 wait complete. 2022-08-10T17:57:07.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 Processor -- start 2022-08-10T17:57:07.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 -- start start 2022-08-10T17:57:07.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.816 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8cd406eff0 0x7f8cd40c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cd41544d0 0x7f8cd40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4153780 con 0x7f8cd41544d0 2022-08-10T17:57:07.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40c27d0 con 0x7f8cd406eff0 2022-08-10T17:57:07.817 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.803+0000 7f8cdc280700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40c32e0 con 0x7f8cd406ea90 2022-08-10T17:57:07.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:60128/0 (socket says 172.21.15.150:60128) 2022-08-10T17:57:07.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda81d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cd41544d0 0x7f8cd40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.818 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 -- 172.21.15.150:0/2907684427 learned_addr learned my addr 172.21.15.150:0/2907684427 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:07.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cd981b700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8cd406eff0 0x7f8cd40c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 -- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8cd406eff0 msgr2=0x7f8cd40c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8cd406eff0 0x7f8cd40c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.819 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 -- 172.21.15.150:0/2907684427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cd41544d0 msgr2=0x7f8cd40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:07.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cd41544d0 0x7f8cd40c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:07.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 -- 172.21.15.150:0/2907684427 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc009a70 con 0x7f8cd406ea90 2022-08-10T17:57:07.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cda01c700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c3c0 tx=0x7f8cd0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.820 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00072d0 con 0x7f8cd406ea90 2022-08-10T17:57:07.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8cd0007450 con 0x7f8cd406ea90 2022-08-10T17:57:07.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4009310 con 0x7f8cd406ea90 2022-08-10T17:57:07.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00057c0 con 0x7f8cd406ea90 2022-08-10T17:57:07.821 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.804+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd40c2d20 con 0x7f8cd406ea90 2022-08-10T17:57:07.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.805+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4072890 con 0x7f8cd406ea90 2022-08-10T17:57:07.822 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.806+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8cd0019030 con 0x7f8cd406ea90 2022-08-10T17:57:07.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.806+0000 7f8cc2ffd700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 0x7f8cb4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:07.823 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.806+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6846+0+0 (secure 0 0 0) 0x7f8cd00813e0 con 0x7f8cd406ea90 2022-08-10T17:57:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.806+0000 7f8cd981b700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 0x7f8cb4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.807+0000 7f8cd981b700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 0x7f8cb4067560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4000c00 tx=0x7f8cc4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:07.824 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:07.810+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8cd004f3c0 con 0x7f8cd406ea90 2022-08-10T17:57:08.041 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.038+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8cd41e0f10 con 0x7f8cd406ea90 2022-08-10T17:57:08.928 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.925+0000 7f8cc2ffd700 1 -- 172.21.15.150:0/2907684427 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8cd0017020 con 0x7f8cd406ea90 2022-08-10T17:57:08.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 msgr2=0x7f8cb4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:08.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 0x7f8cb4067560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4000c00 tx=0x7f8cc4008030 comp rx=0 tx=0).stop 2022-08-10T17:57:08.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 msgr2=0x7f8cd41552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:08.932 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c3c0 tx=0x7f8cd0001e70 comp rx=0 tx=0).stop 2022-08-10T17:57:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 shutdown_connections 2022-08-10T17:57:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cd41544d0 0x7f8cd40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8cb40650b0 0x7f8cb4067560 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8cd406ea90 0x7f8cd41552e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:08.933 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 --2- 172.21.15.150:0/2907684427 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8cd406eff0 0x7f8cd40c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:08.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 >> 172.21.15.150:0/2907684427 conn(0x7f8cd4068110 msgr2=0x7f8cd41e1710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:08.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 shutdown_connections 2022-08-10T17:57:08.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:08.927+0000 7f8cdc280700 1 -- 172.21.15.150:0/2907684427 wait complete. 2022-08-10T17:57:08.935 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-08-10T17:57:09.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-08-10T17:57:09.041 INFO:tasks.ceph.mds.a.smithi150.stdout:starting mds.a at 2022-08-10T17:57:09.098 INFO:tasks.ceph.mds.d.smithi197.stdout:starting mds.d at 2022-08-10T17:57:09.099 INFO:tasks.ceph.mds.b.smithi197.stdout:starting mds.b at 2022-08-10T17:57:09.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.131+0000 7fcc4b6a4700 1 Processor -- start 2022-08-10T17:57:09.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.131+0000 7fcc4b6a4700 1 -- start start 2022-08-10T17:57:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 0x7fcc440686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 0x7fcc440c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.142 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc440c7200 con 0x7fcc44068c00 2022-08-10T17:57:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc440c6cb0 con 0x7fcc440c3700 2022-08-10T17:57:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc4b6a4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44157d60 con 0x7fcc440682f0 2022-08-10T17:57:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc48c3f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.143 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 0x7fcc440686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49c41700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 0x7fcc440c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc48c3f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45924/0 (socket says 172.21.15.150:45924) 2022-08-10T17:57:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc48c3f700 1 -- 172.21.15.150:0/2377634894 learned_addr learned my addr 172.21.15.150:0/2377634894 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:09.144 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 -- 172.21.15.150:0/2377634894 >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 msgr2=0x7fcc440c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 0x7fcc440c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 -- 172.21.15.150:0/2377634894 >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 msgr2=0x7fcc440c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.145 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 -- 172.21.15.150:0/2377634894 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440c6f20 con 0x7fcc440682f0 2022-08-10T17:57:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49c41700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 0x7fcc440c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc48c3f700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.132+0000 7fcc49440700 1 --2- 172.21.15.150:0/2377634894 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 0x7fcc440686c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc440c6660 tx=0x7fcc40009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3bb51594ee02a5 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:09.146 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc33fff700 1 -- 172.21.15.150:0/2377634894 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc400107b0 con 0x7fcc440682f0 2022-08-10T17:57:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc33fff700 1 -- 172.21.15.150:0/2377634894 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc40010910 con 0x7fcc440682f0 2022-08-10T17:57:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc33fff700 1 -- 172.21.15.150:0/2377634894 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40010ce0 con 0x7fcc440682f0 2022-08-10T17:57:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/2377634894 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 msgr2=0x7fcc440686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:09.147 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/2377634894 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 0x7fcc440686c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc440c6660 tx=0x7fcc40009990 comp rx=0 tx=0).stop 2022-08-10T17:57:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/2377634894 shutdown_connections 2022-08-10T17:57:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.197:3300/0 conn(0x7fcc440c3700 0x7fcc440c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/2377634894 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc440682f0 0x7fcc440686c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.148 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/2377634894 >> v2:172.21.15.150:3300/0 conn(0x7fcc44068c00 0x7fcc440c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/2377634894 >> 172.21.15.150:0/2377634894 conn(0x7fcc4406f840 msgr2=0x7fcc4406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/2377634894 shutdown_connections 2022-08-10T17:57:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.133+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/2377634894 wait complete. 2022-08-10T17:57:09.149 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.134+0000 7fcc4b6a4700 1 Processor -- start 2022-08-10T17:57:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.134+0000 7fcc4b6a4700 1 -- start start 2022-08-10T17:57:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 0x7fcc44149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.150 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44148630 con 0x7fcc440c3700 2022-08-10T17:57:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440c12a0 con 0x7fcc440682f0 2022-08-10T17:57:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc4b6a4700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc441e1040 con 0x7fcc44068c00 2022-08-10T17:57:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc49440700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.151 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc49c41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 0x7fcc44149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc49440700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:56522/0 (socket says 172.21.15.150:56522) 2022-08-10T17:57:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc49440700 1 -- 172.21.15.150:0/1260509458 learned_addr learned my addr 172.21.15.150:0/1260509458 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:09.152 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc49c41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 0x7fcc44149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45934/0 (socket says 172.21.15.150:45934) 2022-08-10T17:57:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3301/0 says I am v2:172.21.15.150:60154/0 (socket says 172.21.15.150:60154) 2022-08-10T17:57:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 -- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 msgr2=0x7fcc441ef550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:09.153 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 -- 172.21.15.150:0/1260509458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 msgr2=0x7fcc44149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:09.154 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.135+0000 7fcc48c3f700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 0x7fcc44149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc48c3f700 1 -- 172.21.15.150:0/1260509458 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340093e0 con 0x7fcc44068c00 2022-08-10T17:57:09.156 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc49440700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc48c3f700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400e8b0 tx=0x7fcc3400ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34013680 con 0x7fcc44068c00 2022-08-10T17:57:09.157 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc340137e0 con 0x7fcc44068c00 2022-08-10T17:57:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34013b90 con 0x7fcc44068c00 2022-08-10T17:57:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c009a70 con 0x7fcc44068c00 2022-08-10T17:57:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.136+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc40009310 con 0x7fcc44068c00 2022-08-10T17:57:09.158 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.137+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc44072890 con 0x7fcc44068c00 2022-08-10T17:57:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.137+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fcc34019030 con 0x7fcc44068c00 2022-08-10T17:57:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.138+0000 7fcc31ffb700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 0x7fcc24067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:09.159 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.138+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fcc340820c0 con 0x7fcc44068c00 2022-08-10T17:57:09.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.138+0000 7fcc49440700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 0x7fcc24067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:09.160 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.138+0000 7fcc49440700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 0x7fcc24067590 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcc400099d0 tx=0x7fcc40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:09.161 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.142+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fcc3404ff60 con 0x7fcc44068c00 2022-08-10T17:57:09.369 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.365+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc440c7f80 con 0x7fcc44068c00 2022-08-10T17:57:09.931 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.928+0000 7fcc31ffb700 1 -- 172.21.15.150:0/1260509458 <== mon.2 v2:172.21.15.197:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc340170a0 con 0x7fcc44068c00 2022-08-10T17:57:09.934 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 msgr2=0x7fcc24067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:09.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 0x7fcc24067590 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcc400099d0 tx=0x7fcc40008030 comp rx=0 tx=0).stop 2022-08-10T17:57:09.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 msgr2=0x7fcc440c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:09.935 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400e8b0 tx=0x7fcc3400ebc0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 shutdown_connections 2022-08-10T17:57:09.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440c3700 0x7fcc44149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fcc440682f0 0x7fcc441ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.936 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fcc240650e0 0x7fcc24067590 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 --2- 172.21.15.150:0/1260509458 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fcc44068c00 0x7fcc440c0c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:09.937 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 >> 172.21.15.150:0/1260509458 conn(0x7fcc4406f840 msgr2=0x7fcc44154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:09.938 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 shutdown_connections 2022-08-10T17:57:09.939 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:09.930+0000 7fcc4b6a4700 1 -- 172.21.15.150:0/1260509458 wait complete. 2022-08-10T17:57:09.948 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-08-10T17:57:10.112 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.108+0000 7fd8639af700 1 Processor -- start 2022-08-10T17:57:10.113 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 -- start start 2022-08-10T17:57:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fd85c150ab0 0x7fd85c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 0x7fd85c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.121 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c069640 con 0x7fd85c157400 2022-08-10T17:57:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c06a1c0 con 0x7fd85c150ab0 2022-08-10T17:57:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.109+0000 7fd8639af700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c156790 con 0x7fd85c06d1c0 2022-08-10T17:57:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd861f4c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd85c157400 0x7fd85c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58628/0 (socket says 172.21.15.150:58628) 2022-08-10T17:57:10.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd861f4c700 1 -- 172.21.15.150:0/828174919 learned_addr learned my addr 172.21.15.150:0/828174919 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd860f4a700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 0x7fd85c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 --2- 172.21.15.150:0/828174919 >> v2:172.21.15.197:3300/0 conn(0x7fd85c150ab0 0x7fd85c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd84bfff700 1 -- 172.21.15.150:0/828174919 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127771655 0 0) 0x7fd85c069640 con 0x7fd85c157400 2022-08-10T17:57:10.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd84bfff700 1 -- 172.21.15.150:0/828174919 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003430 con 0x7fd85c157400 2022-08-10T17:57:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 -- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 msgr2=0x7fd85c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 0x7fd85c156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 -- 172.21.15.150:0/828174919 >> v1:172.21.15.150:6789/0 conn(0x7fd85c157400 legacy=0x7fd85c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 -- 172.21.15.150:0/828174919 --> v2:172.21.15.197:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c069920 con 0x7fd85c150ab0 2022-08-10T17:57:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd860f4a700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 0x7fd85c156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd86174b700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c150ab0 0x7fd85c06df20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8580096b0 tx=0x7fd8580099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5bb5255834ae887 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:10.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd84bfff700 1 -- 172.21.15.150:0/828174919 <== mon.1 v2:172.21.15.197:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580107b0 con 0x7fd85c150ab0 2022-08-10T17:57:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd84bfff700 1 -- 172.21.15.150:0/828174919 <== mon.1 v2:172.21.15.197:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd858010910 con 0x7fd85c150ab0 2022-08-10T17:57:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.110+0000 7fd84bfff700 1 -- 172.21.15.150:0/828174919 <== mon.1 v2:172.21.15.197:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858010ce0 con 0x7fd85c150ab0 2022-08-10T17:57:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 -- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c150ab0 msgr2=0x7fd85c06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:10.126 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c150ab0 0x7fd85c06df20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8580096b0 tx=0x7fd8580099c0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 -- 172.21.15.150:0/828174919 shutdown_connections 2022-08-10T17:57:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c150ab0 0x7fd85c06df20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 --2- 172.21.15.150:0/828174919 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c06d1c0 0x7fd85c156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.127 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 -- 172.21.15.150:0/828174919 >> 172.21.15.150:0/828174919 conn(0x7fd85c06fab0 msgr2=0x7fd85c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 -- 172.21.15.150:0/828174919 shutdown_connections 2022-08-10T17:57:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.111+0000 7fd8639af700 1 -- 172.21.15.150:0/828174919 wait complete. 2022-08-10T17:57:10.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.112+0000 7fd8639af700 1 Processor -- start 2022-08-10T17:57:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.112+0000 7fd8639af700 1 -- start start 2022-08-10T17:57:10.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c150ab0 0x7fd85c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 0x7fd85c149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c3ad0 con 0x7fd85c157400 2022-08-10T17:57:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c8270 con 0x7fd85c06d1c0 2022-08-10T17:57:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd8639af700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c2f90 con 0x7fd85c150ab0 2022-08-10T17:57:10.131 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd86174b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 0x7fd85c149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd86174b700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.197:3300/0 says I am v2:172.21.15.150:56542/0 (socket says 172.21.15.150:56542) 2022-08-10T17:57:10.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd86174b700 1 -- 172.21.15.150:0/1989355912 learned_addr learned my addr 172.21.15.150:0/1989355912 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:10.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd860f4a700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c150ab0 0x7fd85c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 -- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c150ab0 msgr2=0x7fd85c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:10.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c150ab0 0x7fd85c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 -- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 msgr2=0x7fd85c1ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:10.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:10.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd861f4c700 1 -- 172.21.15.150:0/1989355912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c009310 con 0x7fd85c157400 2022-08-10T17:57:10.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.113+0000 7fd86174b700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-08-10T17:57:10.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd861f4c700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 0x7fd85c149f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c700 tx=0x7fd85400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:10.136 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540070d0 con 0x7fd85c157400 2022-08-10T17:57:10.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd854007230 con 0x7fd85c157400 2022-08-10T17:57:10.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540075c0 con 0x7fd85c157400 2022-08-10T17:57:10.137 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd858009310 con 0x7fd85c157400 2022-08-10T17:57:10.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.114+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c1ed1b0 con 0x7fd85c157400 2022-08-10T17:57:10.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.115+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c068c10 con 0x7fd85c157400 2022-08-10T17:57:10.138 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.115+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fd854019030 con 0x7fd85c157400 2022-08-10T17:57:10.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.116+0000 7fd849ffb700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 0x7fd83c067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:10.139 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.116+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fd854081750 con 0x7fd85c157400 2022-08-10T17:57:10.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.116+0000 7fd86174b700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 0x7fd83c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:10.140 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.116+0000 7fd86174b700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 0x7fd83c067590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd858013040 tx=0x7fd858008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:10.141 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.120+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fd85404f630 con 0x7fd85c157400 2022-08-10T17:57:10.308 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:10.304+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd85c072890 con 0x7fd85c157400 2022-08-10T17:57:11.119 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.115+0000 7fd849ffb700 1 -- 172.21.15.150:0/1989355912 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd854017070 con 0x7fd85c157400 2022-08-10T17:57:11.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 msgr2=0x7fd83c067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 0x7fd83c067590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd858013040 tx=0x7fd858008030 comp rx=0 tx=0).stop 2022-08-10T17:57:11.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 msgr2=0x7fd85c149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.122 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 0x7fd85c149f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c700 tx=0x7fd85400ca10 comp rx=0 tx=0).stop 2022-08-10T17:57:11.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 shutdown_connections 2022-08-10T17:57:11.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c157400 0x7fd85c149f90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fd85c06d1c0 0x7fd85c1ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.123 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fd83c0650e0 0x7fd83c067590 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 --2- 172.21.15.150:0/1989355912 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fd85c150ab0 0x7fd85c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.117+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 >> 172.21.15.150:0/1989355912 conn(0x7fd85c06fab0 msgr2=0x7fd85c06dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:11.124 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.118+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 shutdown_connections 2022-08-10T17:57:11.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.118+0000 7fd8639af700 1 -- 172.21.15.150:0/1989355912 wait complete. 2022-08-10T17:57:11.125 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2022-08-10T17:57:11.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-08-10T17:57:11.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.282+0000 7fea35fe9700 1 Processor -- start 2022-08-10T17:57:11.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.282+0000 7fea35fe9700 1 -- start start 2022-08-10T17:57:11.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea35fe9700 1 --2- >> v2:172.21.15.197:3300/0 conn(0x7fea300c3b70 0x7fea300c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea35fe9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea3014ebc0 0x7fea30157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.290 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea35fe9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300c0d50 con 0x7fea3014e7f0 2022-08-10T17:57:11.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea35fe9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300c3700 con 0x7fea3014ebc0 2022-08-10T17:57:11.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea35fe9700 1 -- --> v2:172.21.15.197:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300c0790 con 0x7fea300c3b70 2022-08-10T17:57:11.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea3014ebc0 0x7fea30157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.291 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fea3014e7f0 0x7fea300c2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58638/0 (socket says 172.21.15.150:58638) 2022-08-10T17:57:11.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2f7fe700 1 -- 172.21.15.150:0/2321608728 learned_addr learned my addr 172.21.15.150:0/2321608728 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:11.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea3014ebc0 0x7fea30157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45962/0 (socket says 172.21.15.150:45962) 2022-08-10T17:57:11.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea26ffd700 1 --2- 172.21.15.150:0/2321608728 >> v2:172.21.15.197:3300/0 conn(0x7fea300c3b70 0x7fea300c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.292 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 -- 172.21.15.150:0/2321608728 >> v2:172.21.15.197:3300/0 conn(0x7fea300c3b70 msgr2=0x7fea300c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:11.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 --2- 172.21.15.150:0/2321608728 >> v2:172.21.15.197:3300/0 conn(0x7fea300c3b70 0x7fea300c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 -- 172.21.15.150:0/2321608728 >> v1:172.21.15.150:6789/0 conn(0x7fea3014e7f0 legacy=0x7fea300c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2ffff700 1 -- 172.21.15.150:0/2321608728 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300c0a70 con 0x7fea3014ebc0 2022-08-10T17:57:11.293 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.283+0000 7fea2effd700 1 -- 172.21.15.150:0/2321608728 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037065265 0 0) 0x7fea300c0d50 con 0x7fea3014e7f0 2022-08-10T17:57:11.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea2ffff700 1 --2- 172.21.15.150:0/2321608728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3014ebc0 0x7fea30157ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea300bd0a0 tx=0x7fea2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b711dbeb3d9fb server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:11.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea2effd700 1 -- 172.21.15.150:0/2321608728 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800e070 con 0x7fea3014ebc0 2022-08-10T17:57:11.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea2effd700 1 -- 172.21.15.150:0/2321608728 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea2800bb20 con 0x7fea3014ebc0 2022-08-10T17:57:11.294 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea2effd700 1 -- 172.21.15.150:0/2321608728 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28012430 con 0x7fea3014ebc0 2022-08-10T17:57:11.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 -- 172.21.15.150:0/2321608728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3014ebc0 msgr2=0x7fea30157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 --2- 172.21.15.150:0/2321608728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3014ebc0 0x7fea30157ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea300bd0a0 tx=0x7fea2800b330 comp rx=0 tx=0).stop 2022-08-10T17:57:11.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 -- 172.21.15.150:0/2321608728 shutdown_connections 2022-08-10T17:57:11.295 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 --2- 172.21.15.150:0/2321608728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3014ebc0 0x7fea30157ea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 --2- 172.21.15.150:0/2321608728 >> v2:172.21.15.197:3300/0 conn(0x7fea300c3b70 0x7fea300c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 -- 172.21.15.150:0/2321608728 >> 172.21.15.150:0/2321608728 conn(0x7fea300c9290 msgr2=0x7fea300c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:11.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 -- 172.21.15.150:0/2321608728 shutdown_connections 2022-08-10T17:57:11.296 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.284+0000 7fea35fe9700 1 -- 172.21.15.150:0/2321608728 wait complete. 2022-08-10T17:57:11.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.286+0000 7fea35fe9700 1 Processor -- start 2022-08-10T17:57:11.297 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.286+0000 7fea35fe9700 1 -- start start 2022-08-10T17:57:11.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.300 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea3014e7f0 0x7fea30145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea3014ebc0 0x7fea30145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30151060 con 0x7fea300c3b70 2022-08-10T17:57:11.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30151dc0 con 0x7fea3014e7f0 2022-08-10T17:57:11.301 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea35fe9700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea30145180 con 0x7fea3014ebc0 2022-08-10T17:57:11.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45964/0 (socket says 172.21.15.150:45964) 2022-08-10T17:57:11.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 -- 172.21.15.150:0/853859529 learned_addr learned my addr 172.21.15.150:0/853859529 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:11.302 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea26ffd700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea3014e7f0 0x7fea30145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2ffff700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea3014ebc0 0x7fea30145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 -- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea3014ebc0 msgr2=0x7fea30145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea3014ebc0 0x7fea30145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.303 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 -- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea3014e7f0 msgr2=0x7fea30145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea3014e7f0 0x7fea30145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 -- 172.21.15.150:0/853859529 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28009a70 con 0x7fea300c3b70 2022-08-10T17:57:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.287+0000 7fea2f7fe700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea200011e0 tx=0x7fea2000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:11.304 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.288+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200072d0 con 0x7fea300c3b70 2022-08-10T17:57:11.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.288+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea20007430 con 0x7fea300c3b70 2022-08-10T17:57:11.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.288+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20004910 con 0x7fea300c3b70 2022-08-10T17:57:11.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.288+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea30068780 con 0x7fea300c3b70 2022-08-10T17:57:11.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.288+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30151520 con 0x7fea300c3b70 2022-08-10T17:57:11.305 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.289+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea30144f50 con 0x7fea300c3b70 2022-08-10T17:57:11.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.289+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7fea2001a020 con 0x7fea300c3b70 2022-08-10T17:57:11.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.290+0000 7fea2cff9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 0x7fea14067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:11.306 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.290+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fea20081b80 con 0x7fea300c3b70 2022-08-10T17:57:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.290+0000 7fea26ffd700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 0x7fea14067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.290+0000 7fea26ffd700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 0x7fea14067590 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fea30157ce0 tx=0x7fea180090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:11.307 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.294+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7fea30144f50 con 0x7fea300c3b70 2022-08-10T17:57:11.482 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:11.478+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea30072890 con 0x7fea300c3b70 2022-08-10T17:57:12.125 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.122+0000 7fea2cff9700 1 -- 172.21.15.150:0/853859529 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea2004fc10 con 0x7fea300c3b70 2022-08-10T17:57:12.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 msgr2=0x7fea14067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 0x7fea14067590 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fea30157ce0 tx=0x7fea180090e0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 msgr2=0x7fea301de720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.128 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea200011e0 tx=0x7fea2000c730 comp rx=0 tx=0).stop 2022-08-10T17:57:12.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 shutdown_connections 2022-08-10T17:57:12.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7fea140650e0 0x7fea14067590 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7fea3014ebc0 0x7fea30145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea300c3b70 0x7fea301de720 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 --2- 172.21.15.150:0/853859529 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7fea3014e7f0 0x7fea30145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 >> 172.21.15.150:0/853859529 conn(0x7fea300c9290 msgr2=0x7fea3014b650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 shutdown_connections 2022-08-10T17:57:12.130 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.124+0000 7fea35fe9700 1 -- 172.21.15.150:0/853859529 wait complete. 2022-08-10T17:57:12.131 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2022-08-10T17:57:12.142 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2022-08-10T17:57:12.271 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.264+0000 7f8ca5bcb700 1 Processor -- start 2022-08-10T17:57:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.264+0000 7f8ca5bcb700 1 -- start start 2022-08-10T17:57:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8ca5bcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca00bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.272 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8ca5bcb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ca006f380 0x7f8ca00c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8ca5bcb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca006f130 con 0x7f8ca00c9f10 2022-08-10T17:57:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8ca5bcb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00c4a80 con 0x7f8ca006f380 2022-08-10T17:57:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8ca5bcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca006ea00 con 0x7f8ca00c6760 2022-08-10T17:57:12.273 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ca006f380 0x7f8ca00c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8ca00c9f10 0x7f8ca0153e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:58654/0 (socket says 172.21.15.150:58654) 2022-08-10T17:57:12.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9ffff700 1 -- 172.21.15.150:0/753302781 learned_addr learned my addr 172.21.15.150:0/753302781 (peer_addr_for_me v1:172.21.15.150:0/0) 2022-08-10T17:57:12.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9f7fe700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca00bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.274 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9effd700 1 -- 172.21.15.150:0/753302781 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 msgr2=0x7f8ca00bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-08-10T17:57:12.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9effd700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca00bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9effd700 1 -- 172.21.15.150:0/753302781 >> v1:172.21.15.150:6789/0 conn(0x7f8ca00c9f10 legacy=0x7f8ca0153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9effd700 1 -- 172.21.15.150:0/753302781 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00ca6d0 con 0x7f8ca006f380 2022-08-10T17:57:12.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.265+0000 7f8c9e7fc700 1 -- 172.21.15.150:0/753302781 <== mon.0 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053759297 0 0) 0x7f8ca006f130 con 0x7f8ca00c9f10 2022-08-10T17:57:12.275 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8c9effd700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca006f380 0x7f8ca00c99d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c880096b0 tx=0x7f8c880099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda02e0da7e48ed server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8c9e7fc700 1 -- 172.21.15.150:0/753302781 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880107b0 con 0x7f8ca006f380 2022-08-10T17:57:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8c9e7fc700 1 -- 172.21.15.150:0/753302781 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c88010910 con 0x7f8ca006f380 2022-08-10T17:57:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8c9e7fc700 1 -- 172.21.15.150:0/753302781 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88010ce0 con 0x7f8ca006f380 2022-08-10T17:57:12.276 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/753302781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca006f380 msgr2=0x7f8ca00c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca006f380 0x7f8ca00c99d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c880096b0 tx=0x7f8c880099c0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/753302781 shutdown_connections 2022-08-10T17:57:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca00bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.277 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/753302781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca006f380 0x7f8ca00c99d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/753302781 >> 172.21.15.150:0/753302781 conn(0x7f8ca0068110 msgr2=0x7f8ca0068510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/753302781 shutdown_connections 2022-08-10T17:57:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.266+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/753302781 wait complete. 2022-08-10T17:57:12.278 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 Processor -- start 2022-08-10T17:57:12.279 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 -- start start 2022-08-10T17:57:12.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 --2- >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ca006f380 0x7f8ca014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.282 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 --2- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00ab950 con 0x7f8ca00c9f10 2022-08-10T17:57:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 -- --> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca014c380 con 0x7f8ca006f380 2022-08-10T17:57:12.283 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.268+0000 7f8ca5bcb700 1 -- --> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca014bd00 con 0x7f8ca00c6760 2022-08-10T17:57:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45982/0 (socket says 172.21.15.150:45982) 2022-08-10T17:57:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 -- 172.21.15.150:0/4229351032 learned_addr learned my addr 172.21.15.150:0/4229351032 (peer_addr_for_me v2:172.21.15.150:0/0) 2022-08-10T17:57:12.284 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9effd700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9f7fe700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ca006f380 0x7f8ca014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 -- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 msgr2=0x7f8ca014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.285 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 -- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ca006f380 msgr2=0x7f8ca014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ca006f380 0x7f8ca014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 -- 172.21.15.150:0/4229351032 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88009310 con 0x7f8ca00c9f10 2022-08-10T17:57:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c9ffff700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c750 tx=0x7f8c9000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:12.286 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90004e80 con 0x7f8ca00c9f10 2022-08-10T17:57:12.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c900070d0 con 0x7f8ca00c9f10 2022-08-10T17:57:12.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca00c9270 con 0x7f8ca00c9f10 2022-08-10T17:57:12.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90007440 con 0x7f8ca00c9f10 2022-08-10T17:57:12.287 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.269+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca014c010 con 0x7f8ca00c9f10 2022-08-10T17:57:12.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.270+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0070520 con 0x7f8ca00c9f10 2022-08-10T17:57:12.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.271+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83354+0+0 (secure 0 0 0) 0x7f8c9001a020 con 0x7f8ca00c9f10 2022-08-10T17:57:12.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.271+0000 7f8c97fff700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 0x7f8c84067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-08-10T17:57:12.288 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.271+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6215+0+0 (secure 0 0 0) 0x7f8c90081bc0 con 0x7f8ca00c9f10 2022-08-10T17:57:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.272+0000 7f8c9f7fe700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 0x7f8c84067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-08-10T17:57:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.272+0000 7f8c9f7fe700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 0x7f8c84067590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009a50 tx=0x7f8c980090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-08-10T17:57:12.289 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.276+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169621 (secure 0 0 0) 0x7f8c9004fe10 con 0x7f8ca00c9f10 2022-08-10T17:57:12.469 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:12.466+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ca00c57b0 con 0x7f8ca00c9f10 2022-08-10T17:57:13.129 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.126+0000 7f8c97fff700 1 -- 172.21.15.150:0/4229351032 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8c90053430 con 0x7f8ca00c9f10 2022-08-10T17:57:13.132 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 msgr2=0x7f8c84067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:13.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 0x7f8c84067590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009a50 tx=0x7f8c980090e0 comp rx=0 tx=0).stop 2022-08-10T17:57:13.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 msgr2=0x7f8ca014c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-08-10T17:57:13.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c750 tx=0x7f8c9000ca60 comp rx=0 tx=0).stop 2022-08-10T17:57:13.133 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 shutdown_connections 2022-08-10T17:57:13.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00c9f10 0x7f8ca014c810 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:13.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] conn(0x7f8ca006f380 0x7f8ca014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:13.134 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:6832/97455,v1:172.21.15.197:6833/97455] conn(0x7f8c840650e0 0x7f8c84067590 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:13.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 --2- 172.21.15.150:0/4229351032 >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x7f8ca00c6760 0x7f8ca014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-08-10T17:57:13.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 >> 172.21.15.150:0/4229351032 conn(0x7f8ca0068110 msgr2=0x7f8ca00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-08-10T17:57:13.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 shutdown_connections 2022-08-10T17:57:13.135 INFO:teuthology.orchestra.run.smithi150.stderr:2022-08-10T17:57:13.128+0000 7f8ca5bcb700 1 -- 172.21.15.150:0/4229351032 wait complete. 2022-08-10T17:57:13.136 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data_ec' removed 2022-08-10T17:57:13.144 INFO:teuthology.misc:Shutting down mds daemons... 2022-08-10T17:57:13.145 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-08-10T17:57:13.145 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.153 INFO:tasks.ceph.mds.a:Stopped 2022-08-10T17:57:13.154 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-08-10T17:57:13.154 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.203 INFO:tasks.ceph.mds.c:Stopped 2022-08-10T17:57:13.203 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2022-08-10T17:57:13.204 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.253 INFO:tasks.ceph.mds.e:Stopped 2022-08-10T17:57:13.253 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-08-10T17:57:13.254 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.281 INFO:tasks.ceph.mds.b:Stopped 2022-08-10T17:57:13.282 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2022-08-10T17:57:13.282 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.372 INFO:tasks.ceph.mds.d:Stopped 2022-08-10T17:57:13.373 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2022-08-10T17:57:13.373 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:13.402 INFO:tasks.ceph.mds.f:Stopped 2022-08-10T17:57:13.402 INFO:teuthology.misc:Shutting down osd daemons... 2022-08-10T17:57:13.403 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-08-10T17:57:13.403 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:19.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2022-08-10T17:57:19.506 INFO:tasks.ceph.osd.0:Stopped 2022-08-10T17:57:19.506 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-08-10T17:57:19.507 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:25.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2022-08-10T17:57:25.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2022-08-10T17:57:25.609 INFO:tasks.ceph.osd.1:Stopped 2022-08-10T17:57:25.610 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-08-10T17:57:25.610 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:31.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2022-08-10T17:57:31.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2022-08-10T17:57:31.712 INFO:tasks.ceph.osd.2:Stopped 2022-08-10T17:57:31.713 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2022-08-10T17:57:31.713 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:37.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2022-08-10T17:57:37.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2022-08-10T17:57:37.816 INFO:tasks.ceph.osd.3:Stopped 2022-08-10T17:57:37.817 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2022-08-10T17:57:37.817 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:42.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2022-08-10T17:57:42.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2022-08-10T17:57:43.919 INFO:tasks.ceph.osd.4:Stopped 2022-08-10T17:57:43.920 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2022-08-10T17:57:43.920 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:48.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2022-08-10T17:57:48.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2022-08-10T17:57:50.022 INFO:tasks.ceph.osd.5:Stopped 2022-08-10T17:57:50.023 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2022-08-10T17:57:50.023 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:54.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2022-08-10T17:57:54.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2022-08-10T17:57:56.125 INFO:tasks.ceph.osd.6:Stopped 2022-08-10T17:57:56.126 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2022-08-10T17:57:56.126 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:57:59.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2022-08-10T17:57:59.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2022-08-10T17:58:02.229 INFO:tasks.ceph.osd.7:Stopped 2022-08-10T17:58:02.230 INFO:teuthology.misc:Shutting down mgr daemons... 2022-08-10T17:58:02.230 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2022-08-10T17:58:02.231 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:58:02.253 INFO:tasks.ceph.mgr.y:Stopped 2022-08-10T17:58:02.254 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-08-10T17:58:02.254 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:58:02.277 INFO:tasks.ceph.mgr.x:Stopped 2022-08-10T17:58:02.278 INFO:teuthology.misc:Shutting down mon daemons... 2022-08-10T17:58:02.278 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-10T17:58:02.279 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:58:02.304 INFO:tasks.ceph.mon.a:Stopped 2022-08-10T17:58:02.305 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-10T17:58:02.305 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:58:02.327 INFO:tasks.ceph.mon.b:Stopped 2022-08-10T17:58:02.328 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-10T17:58:02.328 INFO:teuthology.orchestra.run:waiting for 300 2022-08-10T17:58:02.378 INFO:tasks.ceph.mon.c:Stopped 2022-08-10T17:58:02.378 INFO:tasks.ceph:Checking cluster log for badness... 2022-08-10T17:58:02.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2022-08-10T17:58:02.497 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:58:02.498 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2022-08-10T17:58:03.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:58:03.931 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2022-08-10T17:58:04.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:58:04.106 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2022-08-10T17:58:04.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi150.front.sepia.ceph.com 2022-08-10T17:58:04.337 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2022-08-10T17:58:04.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:58:04.565 DEBUG:teuthology.orchestra.run.smithi197:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2022-08-10T17:58:04.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2022-08-10T17:58:05.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:58:05.584 DEBUG:teuthology.orchestra.run.smithi197:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2022-08-10T17:58:05.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:58:05.809 DEBUG:teuthology.orchestra.run.smithi197:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2022-08-10T17:58:06.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi197.front.sepia.ceph.com 2022-08-10T17:58:06.028 DEBUG:teuthology.orchestra.run.smithi197:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2022-08-10T17:58:06.209 INFO:tasks.ceph:Archiving mon data... 2022-08-10T17:58:06.211 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/data/mon.a.tgz 2022-08-10T17:58:06.212 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2022-08-10T17:58:06.242 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.CvDy8nIvQK 2022-08-10T17:58:06.242 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CvDy8nIvQK 2022-08-10T17:58:06.404 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.CvDy8nIvQK 2022-08-10T17:58:06.490 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.CvDy8nIvQK is 409KB 2022-08-10T17:58:06.598 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.CvDy8nIvQK 2022-08-10T17:58:06.614 DEBUG:teuthology.misc:Transferring archived files from smithi197:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/data/mon.b.tgz 2022-08-10T17:58:06.615 DEBUG:teuthology.orchestra.run.smithi197:> mktemp 2022-08-10T17:58:06.648 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.mNdNU4UBRv 2022-08-10T17:58:06.648 DEBUG:teuthology.orchestra.run.smithi197:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mNdNU4UBRv 2022-08-10T17:58:06.856 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.mNdNU4UBRv 2022-08-10T17:58:07.027 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.mNdNU4UBRv is 411KB 2022-08-10T17:58:07.127 DEBUG:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.mNdNU4UBRv 2022-08-10T17:58:07.154 DEBUG:teuthology.misc:Transferring archived files from smithi197:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/data/mon.c.tgz 2022-08-10T17:58:07.154 DEBUG:teuthology.orchestra.run.smithi197:> mktemp 2022-08-10T17:58:07.209 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.GgFW0NPTig 2022-08-10T17:58:07.209 DEBUG:teuthology.orchestra.run.smithi197:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GgFW0NPTig 2022-08-10T17:58:07.346 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.GgFW0NPTig 2022-08-10T17:58:07.432 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.GgFW0NPTig is 411KB 2022-08-10T17:58:07.528 DEBUG:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.GgFW0NPTig 2022-08-10T17:58:07.544 INFO:tasks.ceph:Cleaning ceph cluster... 2022-08-10T17:58:07.545 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-08-10T17:58:07.548 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-08-10T17:58:07.610 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2022-08-10T17:58:07.611 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-08-10T17:58:07.615 DEBUG:teuthology.orchestra.run.smithi197:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-08-10T17:58:07.639 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-08-10T17:58:07.677 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-08-10T17:58:07.683 INFO:tasks.ceph:Archiving crash dumps... 2022-08-10T17:58:07.685 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/remote/smithi150/crash 2022-08-10T17:58:07.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-08-10T17:58:07.721 DEBUG:teuthology.misc:Transferring archived files from smithi197:/var/lib/ceph/crash to /home/teuthworker/archive/dgalloway-2022-08-10_16:43:02-fs-main-distro-default-smithi/6965900/remote/smithi197/crash 2022-08-10T17:58:07.723 DEBUG:teuthology.orchestra.run.smithi197:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-08-10T17:58:07.751 INFO:tasks.ceph:Shutting down logrotate 2022-08-10T18:11:21.483 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-08-10T18:11:21.519 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2022-08-10T18:11:21.521 DEBUG:teuthology.task.console_log:Killing console logger for smithi197 2022-08-10T18:11:21.522 DEBUG:teuthology.exit:Finished running handlers